The speaker discusses the importance of constructing a graph or data structure for artificial intelligence by designing a pattern of connections between components to influence each other's inputs and outputs. However, he also notes that specifics are often communicated through natural language.