Drawer 11 · 318 notes · 58 people · 2005–2026

Metrics, data & experimentation

North-star metrics, analytics, A/B tests, and data-informed decisions

Q:
Answers from Metrics, data & experimentation notes, cited
Product Talk · Teresa TorresAug 22, 2013

Turn Your Inside View Outward

Aug 22, 2013 · 3 min

“This post is part of a series about making better product decisions. One of the most common questions I get at my company, is why don't we have a mobile app. We are in the age of mobile, how can we possibly survive without a mobile app? There are”

Lenny’s Newsletter♥ 13

Prioritizing conversion opportunities

May 26, 2020 · 6 min
Subscriber post — summary only

Lenny answers a reader question on how to split effort across conversion levers (focus, motivation, friction) and which tends to pay off most. He shares rules of thumb such as starting wide, mining past wins, and mixing…

Lenny’s Newsletter♥ 229

What is good free-to-paid conversion

Aug 1, 2023 · 13 min
Subscriber post — summary only

Lenny Rachitsky, with OpenView and Pendo, benchmarks free-to-paid conversion from a survey of 1,000+ products, defining good and great rates for freemium, sales-assisted, and free-trial models. It argues conversion…

Product Talk · Teresa TorresJan 7, 2015

Run Experiments Before You Write Code

Jan 7, 2015 · 5 min

Teresa Torres argues that the Lean Startup loop of Build, Measure, Learn starts in the wrong place, and that teams should instead Learn, Build, Measure. Building first means writing code for features that often fail…

Product Talk · Teresa TorresNov 11, 2015

How to Choose Your Next Experiments

Nov 11, 2015

Teresa Torres argues that a common mistake among teams new to Lean Startup methods is substituting experimentation for judgment, testing options like folders versus tags without first reasoning about which is most…

Product Talk · Teresa TorresSep 23, 2015

The Path to Better Product Decisions

Sep 23, 2015 · 5 min

Teresa Torres argues that product managers often fall into a throughput mindset, filling backlogs and keeping engineers busy rather than driving outcomes. She identifies three recurring failures: not starting from a…

Lenny’s Newsletter♥ 89

Prioritizing

Jul 27, 2021 · 8 min
Subscriber post — summary only

Lenny argues that most teams should skip elaborate prioritization frameworks and use a simple impact-versus-cost sort of T-shirt-sized ideas, then refine it with team input. He stresses that the roadmap must follow a…

SVPG · Marty CaganOct 1, 2007

Prototype Testing

Oct 1, 2007 · 16 min

Marty Cagan argues that testing high-fidelity prototypes with real users is the most important activity a product manager performs, because it reveals whether people can use a product and whether they want it before…

Product Talk · Teresa TorresJan 30, 2014

Are You Getting Your Growth Goals Right?

Jan 30, 2014 · 4 min

Teresa Torres argues that once a product's success funnel converts well, the next step is growth, but only after that funnel is healthy; otherwise acquiring users just wastes time, energy and money. She introduces two…

Product Talk · Teresa TorresAug 8, 2013

How To Make Better Product Decisions

Aug 8, 2013 · 3 min

Teresa Torres argues that product managers make dozens of decisions daily and tend to feel confident about them, yet decision research shows people often make poor choices while believing they are sound. Our minds are…

Product Talk · Teresa TorresFeb 8, 2017

The Evolution of Modern Product Discovery

Feb 8, 2017 · 30 min

Teresa Torres traces how product discovery has evolved over roughly two decades, from long requirements documents and shipping flops like Windows ME toward experiment-driven, customer-centered practice. She argues that…

Product Talk · Teresa TorresMar 23, 2016

An Introduction to Product Discovery

Mar 23, 2016 · 3 min

Teresa Torres argues that many product managers remain unaware of a fundamental shift toward modern product discovery, despite the Lean Startup and design thinking having been around for years. She observes that many…