They spend too long bike-shedding, because in the beginning it does not matter. This is a trivial choice when you need to understand who your market is, what pain points you are fixing, and the means of marketing you will use to reach them.
In the beginning scale is most likely not your issue. You might consider regulatory ones like HIPAA / PCI, but otherwise it does not matter.
Azure, AWS, Digital Ocean... it hardly matters. The most important thing is to get started and get in front of customers with good questions.