To be honest, 99% of the time you shouldn't feel pity for Frank when he "lost" something/somebody. It usually means that one of his scams stoped working. How should they know that Frank was actually emotionally invested this time? Did they even know that he had a sort-of-girlfriend?