I just re-watched the Art scene to confirm it was as sad as I first thought. And it's as you said - Raylan coming back to Dad, hoping, almost expecting, to get a (male version of a ) hug; an Art version of "I'm proud of you." ; Raylan's relief he can come back to the "family"; and then his shock that he isn't wanted…