While growing up, my dad never could say no, he still can't