The president can’t do that unilaterally. Generally, it’s a good thing that some positions aren’t subject to political changes immediately — though that does assume that the person in charge of the agency is qualified and not there as a bad-faith actor with the goal to destroy said agency.