The challenge for social media companies is how to distill user behavior into a notion of what users want. It is essential to find mechanisms for importing complicated human desires and norms into the language of optimization.