The speaker suggests being conservative with hard-to-change trapdoor decisions like organizational structure. While it's important to understand the prevailing belief and have proprietary insight, the bias should be towards not making risky radical departures from the status quo.