The speaker discusses the possibility of achieving record-breaking accuracy using fewer examples by selecting decisions from a set of functions that match a given predicate, rather than relying on a wide set of functions. However, it is noted that this approach may not work for all applications, and is currently being applied to digit recognition.