The speakers decided to start a New York-style pizza restaurant in Victoria, Canada. While many people think running a restaurant would be an enjoyable experience, the speakers realize the challenges and hard work it requires.