The speaker suggests that a portfolio of at least 15-20 investments is necessary when investing in venture capital funds, assuming a minimum investment period of one year and a goal of achieving higher returns than the historical 7% average return of the stock market.