The podcast discusses Alan Turing's concept of computer and his aim to have a mechanical process that could calculate numbers, similar to how humans use to generate tables. He came up with a simple set of constraints where there was an infinite supply of paper, which is the tape of the Turing machine.