That’s the mistake I made: refresh raises Affection, not happiness. Happiness is raised by masaladas, and having them as the first Pokémon in battle. Winning battles raises happiness, running decreases. Having them out first and immediately swapping them increases.