Do you mean the muscles that hold the hair up? In that case it depends if the mammal has hair which is yes because all mammals have hair I'm pretty sure, unless you discount polar bears because their hair is hollow but it's still considered hair. So I think the answer is yes

Even a platypus?

Well a platypus isn't a normal mammal it's a Monotreme but it does have fur so I presume so.