The speaker suggests knowing the league's tendencies and having an eight to 10-year plan when drafting quarterbacks, as there is a 50% hit rate in terms of fantasy performance, and it's important to identify which quarterbacks have the most potential to avoid flops.