I think this was somewhat intentional for two reasons. The first and most obvious being the constraints of the show and simply not having enough time for the many major character arcs and the little guys. They attempted (and failed) to redress this with the rebellion arc and specifically the Zarek character.