For example, “Washington” (US), “Brussels” (EU), “Moscow” (Russia).

I guess it’s a short hand for writing “US government”, “Russian government”, etc. but why? And what happens when you’re referring to a country with multiple capitals like South Africa?