The speaker is hesitant about spending so much time on angel investing, as the returns could take up to eight years to appear. They would rather look into specific companies to invest in, rather than simply helping founders.