The speaker considered investing tens of millions of dollars in ProsperCon, a company that had started to have issues with the SEC and was ahead of its time. However, due to concerns about the 2008 financial crisis, they ultimately decided against the investment.