I’ve financed through the dealer only to refi with credit union the very next month multiple times. Never been an issue- once the deal is done, the dealer could care less and on the other side, credit union is happy to do the deal and have your money.