If you wouldn't use a woman's small chest as an insult, I don't think it is nice to use a man''s small penis. I know that isn't the point of this, but I always found that a little annoying. You should insult the choices people make or the things they can control.
I guess it depends on weather or not you "suffer" from that.