Why Facebook’s Responsible A.I. Team Needs to Be Able to Lose Money in Order to Do Its Job
‘Oh, your algorithm update lowers revenue and decreases usage? Ship it!’
“Measure what matters and what you measure matters.” There are any number of similar quotations that talk about how the very act of tracking a KPI in an organization causes people to focus on it more, let alone if you’re linking an explicit incentive structure to goals. It’s why, for example, if boards care about ideals like diversity and culture, they should work with CEOs to make sure those stats are first-class citizens on the company dashboards alongside revenue and profit.
It’s even harder when you can’t agree what the right metric should be. As I’ve written before, one of the problems we face as an industry is largely trying to measure current day Web 3.0 with Web 2.0 dashboards. Misinformation, trolling, harassment, polarization, and the resulting negative implications — none of these are as simple to define as CTR or CPM. I myself fell victim to this during my time leading the consumer product team at YouTube. When Google leadership asked us to shift from focusing solely on user growth to also increasing monetization, the team we destaffed to fund the new effort had been working on the comments system. Yup, YouTube comments, which most…
