The trait that people struggle to most to change is emotional instability, also known as neuroticism. This is because lasting personality change goes beyond minor tweaks to habits, and requires significant effort and commitment.