The speaker suggests paying banks for specific services rather than allowing them to profit from the money deposited, recommending startups pay for white glove service or wires instead of banks using their money for loans. Instead, consumers and small businesses should review banks' financial statements when opening an account.