This depends on the nature of your business, the requirements on how to develop it and on the locations involved.

I'm not aware of your case, but I'd suggest that you are starting in a familiar environment (UK?) and then work remotely from anywhere in the world. This means lesser risks (language, regulatory framework, support...). Of course working remotely becomes rather challenging if you are running a "nuts & bolts" operations like a restaurant or a logistics company.

You can then establish a presence outside the UK in a 2nd step, to expand your network but also to show commitment to that new market. Furthermore: depending on where you go, having a "home base" in the UK can be leveraged as an advantage.