I've just gotten in the habit of telling people I have plans. It's easier than telling them I'm not doing anything, and then having to explain to them why no, I don't want to hang out with you.
People underestimate how awesome doing nothing is. Speaking as a guy who had spent two plus years building a house and working a full time job, nothing is awesome.
"I'm meditating": oooohhhh!