Ghouls can actually be tough adversaries, given their sponginess. Fallout 4 simply put that into the fore.
Also, @Navarro, I've always pictured the Enclave being effectively split between two factions: one consisting of the genocidal maniacs and one that consists of those genuinely wanting to...