exactly if there is no population to fill it then there is no point of building it.

Sometimes is has to do with demand... if there no population to fill buildings that are tall and big then it won’t be constructed, or sometimes it is height restriction.