Is my goldfish racist ?

I recently bought a goldfish and in his tank there are black and white pebbles but he seems to stay away from the black pebbles. I've thought of everything even that my goldfish has a attration to the white pebbles any ideas is my goldfish a racist