The speaker discusses the use of Recurrent Neural Networks (RNNs) and Long Short-Term Memory Networks (LSTMs) in speech recognition, explaining that RNNs are expanded and old versions of a record network, while LSTMs are a type of RNN that allows for better memory retention.