I went into this late-game, when I was already over lvl 40 for sure. No power armor, no drugs - just the Blitz and other melee-focused perks. Practically VATS teleported straight to the guy and critical hit him with a bat into the forge itself. Didn’t get his loot, but it was worth it.