The tension between efficiency and abstraction in C++ highlights the importance of using a variety of programming techniques and ideas, including object-oriented, data abstraction, and functional programming. The use of static type systems and higher levels of abstraction leads to better efficiency in programming solutions.