The speaker finds boxing fascinating because it's a spectacle of man-on-man sport that is both technical and impossible to follow for many. It's about the best versus the best, and the speaker admits they don't know much about UFC.