It could also mean that his past wife often put him in terrifying situations. So when he's in a scary situation, he could be having a flashback to when Pearl's mom was terrifying him. This could also explain his love for money; his love life never worked out so he resorted to cash.
Comments