The fusiform gyrus is the part of the brain responsible for face recognition and is thicker in congenital prosopagnosia patients. However, it becomes more efficient and thinner in individuals with normal face recognition abilities as they're exposed to more faces.