The goal for PyTorch is to allow developers to compile and run their code seamlessly on hardware without needing to optimize it for performance. One example is turning big matrix multiplication into the right size chunks to use all processing elements without any extra tweaking.