It is an adverb, you’re right. But used as it is in this case, it would mean “I do a bad job of feeling” (hence my dumb joke). We don’t say “I feel sadly” or “I feel happily,” because we want to describe the quality of the feeling (sad/happy), not the way it is felt (feeling your emotions in a happy manner). “I feel…