He's being ridiculous. He can't guilt trip you into liking something just because he likes it. You aren't stopping him from doing anything, he's choosing not to (for whatever silly reason). It's not fair for people to make choices and then complain about them and hold you responsible.