The process of creating effective neural networks involves various factors such as data organization, training, optimization, and architecture. The size of the network, such as GPT-4 with 100 trillion parameters, can also impact its performance.