Actually, it's because black absorbs heat instead of reflecting it. The body emits heat. So when wearing white, which is a good reflector of heat, the heat is reflected back into the body. When wearing black, sure it absorbs heat from the sun. But it also absorbs heat from inside the body. Once it has absorbed heat, it has to have some way to radiate it away. So if there's even little wind, black clothing is the better choice for those who want to keep cool.

Dude, i'm thinking of a more Hannibal style

There must be no ice in hell huh