Skip to content

How To Better Understand Your Users

Y Combinator Podcast

13m
Transcript

Original podcast

Where to listen

Summary

Written by a model from the transcript; not yet reviewed.

This episode explores the limitations of aggregate metrics like daily and monthly active users, which often show upward trends even when users are not finding real value. To counter this, a speaker introduces the dot plot, a two-dimensional grid visualization where rows represent individual users and columns represent time periods. By mapping specific value-creating actions as dots across these grids, founders can uncover hidden behavioral patterns, spot onboarding drop-offs, and monitor customer health in both B2C and B2B contexts.

The host explains how to build and scale dot plots, demonstrating their use with examples from Spotify, Google Photos, and B2B SaaS companies. The discussion details how sorting rows by attributes like device type or geography reveals nuanced user segments, such as weekday workers versus weekend hobbyists. Furthermore, the episode warns against common pitfalls, such as tracking superficial events like app logins instead of genuine value metrics, and stresses combining dot plots with cohort retention curves for deep product understanding.

  • Build a two dimensional grid where each row is a user and each column is a day to spot behavioral patterns. 1:42
  • Choose a core event representing real value, such as listening to a song, rather than just tracking app opens. 12:07
  • Use daily columns rather than wide time windows to ensure you can actually see what is going on. 12:29
  • Pair dot plots with cohort retention curves as the two most important tools to understand product usage. 13:03

Chapters

  1. 0:09
    Mistakes in User Metrics

    Founders often rely on aggregate metrics and ignore individual user behavior.

  2. 1:23
    Introducing the Dot Plot Tool

    The speaker explains the concept and construction of a dot plot to visualize individual user activity.

  3. 4:09
    Analyzing Patterns and Retention

    Using dot plots to uncover weekday vs weekend usage, retention issues, and feature impact.

  4. 6:09
    Advanced Features and Sorting

    Adding symbols for actions, demographics, and sorting rows to isolate specific user segments.

  5. 9:58
    Dot Plots in Large‑Scale Products

    Illustrates how dot plots scale to billions of users by sampling and printing visualizations.

  6. 10:52
    Case Study: B2B Churn Prediction

    Shows how dot plots revealed low activation and churn risk in a high‑value enterprise contract.

  7. 11:57
    Common Pitfalls and Best Practices

    Warns against choosing the wrong event or time granularity and recommends daily logs for early stages.

  8. 13:03
    Dot Plots vs Cohort Retention Curves

    Explains how dot plots complement cohort curves, providing granular usage insights alongside aggregate trends.

Highlights

  • 0:59

    Deception of Aggregate Metricsinsight

    Aggregate graphs like DAUs and MAUs can look like they are going up and to the right even when users are not enjoying the product.

  • 1:35

    Introducing the Dot Plotstrategy

    A dot plot is a grid where every row is an individual user and every column represents a time period like a day.

  • 4:09

    Spotting Weekday Versus Weekend Usersinsight

    Visualizing individual data points reveals distinct user segments, such as people who use a product exclusively on weekdays versus weekends.

  • 6:40

    PayPal Fraud Detection Rootsstory

    PayPal founders once had humans stare at visual graphs of transactions to spot anomalies and identify fraud patterns.

  • 9:58

    Scaling to Billions of Usersstrategy

    At Google Photos, teams used printed dot plot samples for specific user segments, such as iOS users in France, to draw conclusions.

  • 10:50

    Diagnosing B2B Churn Risksstory

    A B2B company lost an eighty thousand dollar contract because only three seats activated and usage dropped after a champion left.

  • 11:57

    The Danger of Wrong Eventsinsight

    Tracking superficial actions like app opens makes founders feel good with dots, but fails to measure real user value.

Quotes

  • “One of the biggest mistakes I see founders make is relying on aggregate user metrics instead of understanding how any individual users use their product.”
    Unnamed speaker · 0:09
  • “The dot plot shows you how those users are actually using your product.”
    Unnamed speaker · 13:16
  • “You can look at these, these charts and figure out, huh, there's something going on with users.”
    Unnamed speaker · 7:19
  • “The other mistake you can make is picking a time period that's too wide.”
    Unnamed speaker · 12:25

About this episode

Most founders obsess over dashboards and aggregate metrics, but some of the best product insights come from understanding how individual users actually use their product. In this episode of Startup School, YC's David Lieb walks through one of his favorite tools for better understanding your users, the dot plot. It's a simple two-dimensional grid that reveals usage patterns no aggregate chart can show you. He’ll cover why it gives founders a better sense of product health, what patterns to look for, and real-world exam

Transcript

0:00
13:50

2,699 words · 1 speaker

Topics

  • Spotify
  • PayPal
  • GitHub
  • Bump
  • Google Photos
  • YC

Page updated · transcript and summary are machine-generated