The speaker cautions against investing based on short time horizons and focusing on the company's popularity instead of its potential for long-term growth and profitability.