Source: Lewis C. Lin’s Newsletter
Netflix's algorithmic recommendations drive four-fifths of viewing behavior, making the choice of success metric existentially important—but the company struggles to distinguish between competing measurement approaches that perform almost identically. Which metric Netflix optimizes for determines whether it prioritizes engagement depth, retention, or discovery breadth, each with different implications for content strategy and subscriber lifetime value. The inability to decisively measure what's working reveals a deeper tension in recommendation systems: the metrics that are easiest to quantify (clicks, time spent) often conflict with the business outcomes that matter most (sustainable satisfaction, reduced churn).