"I'm not racist, I have black friends"

Humans do tend to sort of stick with a group of friends that closely reflects the friends they had in early adulthood.

It's not that there it's just that where I live there isn't really that many people around my age that are different colours to me

Yeah, locale can be a big factor.