This is what we had in Australia before federation. Each territory (a term I'm using very generally to mean anything from a nation to a local government area) has its own government, which does what it thinks is best for that region.