It's how it is for technical reasons currently- all Imperial factions work off of the same building set, which helps things stay organized. We hope to change how it functions in the future so we can set different things like specialized garrisons through LUA, but it also helps keep some consistent "Imperialness" between them all as well.