Pod Insights Y Combinator Podcast #13 - Scaling Growth - Gustaf Alstromer, Ed Baker, and Josh Elman About this episode Gustaf Alstromer https://twitter.com/gustaf is a YC Partner and prior to YC he worked on growth at Airbnb.
Ed Baker https://twitter.com/esbaker worked on growth at Uber and Facebook.
Josh Elman https://twitter.com/joshelman is a partner at Greylock.
The conversation was recorded at The Scaleup Offsite, a private event hosted by Y Combinator Continuity and Greylock Partners in April 2017.
Transcript 0:00 Speaker 00 Hey, this is Craig Cannon and you're listening to Y Combinator's podcast. Today's episode is about scaling growth. It's a conversation between Gustaf Alstromer, Ed Baker, and Josh Elman. Gustav is a YC partner, and prior to that, he worked on growth at Airbnb. Ed worked on growth at Uber and Facebook, and Josh is a partner at Greylock. The conversation was recorded at the Scale Up Offsite, a private event hosted by Y Combinator Continuity and Greylock Partners in April 2017. Okay, here we go.
0:27 Speaker 01 What's pretty cool is we have two guys who've been living the center of building up these growth teams kind of for the past seven or eight years. Ed joined Uber to start the growth team when it was five people, and then over the three and a half years became kind of VP of both product and growth for kind of all of Uber. And Gustav joined in the Airbnb growth team was him and two other people when he got started a few years ago, and that has scaled to over 100. So it's fun to the Scale Up Offsite to talk about scaling. We've mostly been talking about scaling organizations. This is a chance to talk about how do you scale the organization that continues to scale your users? You know, what's fun for me is, you know, I've known Ed and Gustav now for most of a decade kind of in this growth world.
1:12 Speaker 01 And, you know, we were all started back when sort of this idea of a growth team, this idea of a team that's focused on this sort of intersection of product and marketing to build stuff was pretty novel and almost didn't even really exist. And we were all kind of doing it in the social world. And I remember Ed started a company in 2008 called Friendly, or it's D'Amico and then Friendly. You know, Gustav started a company in 2007 called Heysan and then went over to Voxer. And these were like, how do we get to like millions of users in the early days? So I'm curious if you could just kind of talk about this heyday of social viral growth explosion and sort of what are some of the key kind of crazy things you learned then that have really helped you as you think about growth today? You know, Ed, if you want to start?
1:51 Speaker 02 Sure. So yeah, I guess 2007, summer of 2007, when Facebook launched the platform was, I think, part of that explosion of just crazy viral growth, spammy apps on the Facebook platform. That was actually the first, those were the first apps I built that reached tens of millions of users, you know, within months' time. And I think it was a great Platform on which to just experiment with a lot of different ideas because it was so easy to build these simple Facebook apps and just run lots of A/B tests. And so much of, I think, figuring out how to grow something is, it's a combination of an art and a science. And by running lots of experiments, you start to build an intuition for the types of things
2:36 Speaker 02 that work and don't work.
2:37 Speaker 01 That's great. What were some of the early tricks you found that like made you go super viral? You were pretty famous back in those days.
2:44 Speaker 02 Yeah, I mean, you were at Facebook back then, right? So I think Facebook created new rules after I found some loopholes.
2:54 Speaker 01 Almost often, yes.
2:56 Speaker 02 There was one I remember, I think the most viral Facebook app, I'm hesitant to even admit this, but it was called Zodiac Photo Album. And the way it worked was, literally with one click, it would create a photo album with 12 photos in it, one for each Zodiac sign, and then show all of your friends who had that Zodiac sign in each of the 12 photos and tag all of them. And I think we were allowed to tag like 20 people per photo. So it would show up to 20 of your friends per Zodiac sign times 12. So with one click, you'd tag 240 friends. And all 240 people would get an email saying, Ed just tagged you in a photo.
3:39 Speaker 02 So that has a very high response rate. People kind of want to see you when they're tagged in a photo. They would go, they'd see, oh, it's a Zodiac photo album, create your own at, you know, with the Zodiac app. Within, I think within 24 hours, we had tagged tens of millions of people in photos.
3:56 Speaker 01 Incredible.
3:57 Speaker 02 I think, including Zuck. And then I heard the platform team shut it down shortly after that.
4:02 Speaker 01 Now, I wonder if those days are over of kind of those crazy viral pops. And then Gustav, you were really central to a lot of the early experimentation on mobile. I remember we first met when Voxer was blowing up. And you guys had figured out some really unique ways to blow up using notifications and inviting. Can you kind of remind us, like, how did you get to this world of growth? And how did you kind of figure out stuff in those early days, especially on mobile, which people think is a lot harder, even than social was?
4:29 Speaker 03 So before Voxer, I was at a company called Heysun, we co-founded, and it was a product, like a messaging product on mobile that we couldn't grow. So I spent a lot of time trying to learn how to grow. When I joined Voxer, a couple of years later, the first kind of approach or the first thing I kept in mind is like, we need to think about growth. And at the time, so back to the early question, I think there's a couple of like, growth becomes important in when they have new platforms. So you have Facebook platform, you have the mobile platform, you have Google SEO. There's a bunch of larger platforms that makes people actually care about investing in them. At Voxer, the iOS platform, which key to those things were the Addis Book and push notifications.
5:13 Speaker 03 Those are things that kind of like weren't there in the very beginning. Once they started happening, people started exploring what you can do with those things. With Voxer, when I joined, the most important thing, so Voxer was a walkie-talkie app on iOS and Android. You push a button, you start speaking in the other end. We found that the amount of friends that you have when you open the app that were the very first time on the app and how you display them was absolutely key to whether they were going to use the app or not. So we spent basically the first year optimizing those things. Like basically, how many people do you have when you open up the app for the first time? And how do you get to a list like that, right, when you open the app? Well, you match phone numbers with Addis Books. Spent a lot of time investing in matching phone numbers with Addis Books, not that different from Facebook platform.
5:57 Speaker 03 And we kind of tried to optimize how many Addis Books and how many phone numbers we got from people. And we're doing this in the best interest of the users. Like, you wouldn't end up using the app unless you actually saw friends on the app. So that was basically the goal. This was all in the best interest of the users. And sometimes you forget like why you do things.
6:17 Speaker 01 So Ed, I remember your company got acquired by Facebook and you kind of jumped into a little bit more mature growth team at Facebook. You'd been kind of virally hacking and building these things on the platform. What was sort of the adjustment to go from kind of being in this sort of? Experimentation mode to something that was a little bit more mature. But what did you see when you observed kind of that mature Facebook growth team?
6:36 Speaker 02 Yeah, so, well, one thing I saw was I was finally working at a company that had an amazing product that people loved, and I had just never actually built that myself before, so that was pretty cool. And with that came amazing retention, amazing engagement. And Facebook was already at a size where retention and engagement were bigger drivers of the North Star metric MAUs than new user acquisition. So kind of everything I had worked on in the past was all about how do you get those first million users. At Facebook, it was how do we keep the users we've already acquired, keep them engaged, minimize churn.
7:18 Speaker 02 And to me, that was one of the biggest differences. And most of the growth team at Facebook at the time was actually focused on friending, because we discovered at Facebook that friending was the number one driver of retention and engagement. So then there were teams on the Facebook growth team that were basically focused on things like PYMPK, people you may know, and other ways of causing people to form more connections. So I think that was one big takeaway. The other one, we can talk about it later, is just the way the team was structured. Anu got into that a little bit, like their different functions as the team grows.
8:02 Speaker 01 Actually, can you walk us through that? Now is actually a good time to kind of think about how was that structured? Because then I want to get into this transition to these sort of different real-world companies.
8:10 Speaker 02 Sure, sure, the real-world companies, yeah. Well, so, one thing I learned at Facebook was I really liked how the growth team there was structured with all functions. So product, engineering, analytics, design, and even marketing. So those five functions were all critical to work together, kind of all within that growth org. And when I was at Facebook, I think the growth team was about around 500 people or so.
8:45 Speaker 01 Oh, wow.
8:45 Speaker 02 And, but across all those different functions. In fact, all of analytics back then was part of the growth team. And I kind of took a lot of those learnings when I went over to Uber and started our growth team there with just initially a five-person team, kind of picked one person for each function.
9:07 Speaker 01 Right.
9:08 Speaker 02 But yeah, I think that was one of the big takeaways from Facebook.
9:12 Speaker 01 Well, and you know, that's a perfect transition because when I've been talking to a lot of people about sort of what the real success of Uber and Airbnb, I mean, Joe gave a great talk about sort of why Airbnb has become so important in the world, but a lot of people have said it's kind of, we took these hotels and transportation, which were sort of old world, real businesses, and applied a lot of these digital growth technology and learning to them. And so kind of talk a little bit about what it was like going into Airbnb and starting the growth team with two people, and Uber and starting the little growth team. Like, what did you see there and how did you kind of start that, this sort of practice from what you'd learned before?
9:49 Speaker 03 Sure. So I think the, I can't speak for Ed, but like, I think the initial idea of a growth team is that there is some function of the company that really cares about metrics, that really optimize for the goals. And some time ago, like, this was unusual in startups. Those, most people did not look at metrics when they made prior decisions, they did not experiment. So instead of making everybody responsible for that, you made one team responsible for that, and that ended up being the growth team. I think really great companies today, they have everyone kind of carry by metrics, using experimentation, and doing all those things that growth teams do to make decisions. So I think things have changed a little bit, and the role of the growth team as kind of the team that kind of evangelized those things have changed a little bit.
10:33 Speaker 03 When I joined Airbnb, a lot of people joined at the same time, that experience from, from, from all those things. So pretty quickly, I got a lot better set of tools than I had ever had a Voxer around experimentation, around support from data science, and that just...
10:54 Speaker 03 I would say in some sense made like all the infrastructure of doing a growth team at MB like really, really easy compared to my previous experience. And I learned a ton from all those people and it's been pretty incredible. But yeah, in the very beginning, we, like everyone else, had, MB had always been an incredible product. And as a company, we, along those years, have learned to kind of identify and optimize every single step of that experience. A lot of it is of course offline, but of the stuff that we do online, it's a lot of things that we can do to just like measure and, and make the user experience better. And that's what we've been doing. But I think, yeah, the role of the growth team have changed from being that evangelizing
11:35 Speaker 03 team that do all of it to kind of evangelizing to the rest of the company so that everyone do product in a very similar way.
11:42 Speaker 02 I'd say at Uber, there were kind of three big differences from Facebook when I went over there in terms of forming our initial growth team. So the first was it's a two-sided marketplace. And when we came up with our North Star metric, I remember having conversations with that small team of five, one of whom Mike Powell is sitting in the audience here.
12:04 Speaker 01 Can you define North Star metric? You've used that a couple of times.
12:06 Speaker 02 Sure.
12:06 Speaker 01 I think that's actually really important for sort of the growth discussion.
12:09 Speaker 02 Definitely. So at Facebook, it was monthly active users. It's basically the one metric that if you talk to, the way I like to think about it is if I talk to anyone on the growth team and ask them, what number are we trying to grow? They would be able to say it's that number. And if they're not working on something that ultimately is growing that number, they're probably working on the wrong thing. So that's kind of how I like to think about it. And it's helpful to, to set goals, you know? We'd set every, every half, we'd kind of have, this is our six-month goal, but then we'd track our progress every week and see, are we on track? And there's of course seasonality and stuff. It's not just a straight line, but you could kind of see like, how are we doing versus our goal?
12:53 Speaker 02 So at Uber, when we came up with our North Star metric, we had to consider there are two sides of the marketplace. So it's not just monthly active riders. Ultimately, we decided on trips, weekly trips, as the North Star metric. Because for every trip to take place, you need riders and you need drivers. And so by having trips as that North Star metric, you could then break that down into the supply side and the demand side. And you need more riders, more drivers, and you can do growth accounting on each side of the marketplace to say, well, to get more riders, you need more new riders, reengage churned riders, and minimize churn of your existing riders. And same thing on the driver's side.
13:37 Speaker 02 So that was one thing, was kind of agreeing on, this is our North Star metric in a two-sided marketplace. So that was a bit different from Facebook. I'd say a second thing was because it was, Uber is a real-world company, there were several parts of that funnel that you can't just measure online. Whereas on Facebook, you can track every click, every pixel, all of that stuff. With Uber, there are steps of that funnel where it involves, you know, a driver going in and getting their vehicle inspected, or uploading their documents, and ultimately downloading their iPhone app, going into their car, and doing that first trip.
14:20 Speaker 02 And, you know, for me, it was super eye-opening. When I did my first trip as a driver, I walked out to my car. I'd done everything, I was activated, I walked out to my car, I walked back to my house, because I got so nervous about doing that first trip. And that's when it suddenly hit me, this is why, you know, so many of our drivers who are activated never do that first trip. So that real-world component added kind of some extra challenges in terms of, one, how do you measure it? And two, what are some things you can do to influence the way people behave in the real world? And then, the, let's see, I said three things, and now I mention two.
15:02 Speaker 02 So, two-sided marketplace, the real-world component to it, and I'll come back to the third when I remember it.
15:09 Speaker 01 Your different North Star metric. Well, and so, as these teams have scaled now, you know, way up, you know, you said, talk about data analytics, design, product, sort of internet marketing.
15:21 Speaker 02 Oh, that was the third, by the way. Paid acquisition.
15:23 Speaker 01 That's what I was gonna actually ask.
15:25 Speaker 02 So, Facebook, we didn't really do very much paid acquisition. But at Uber, we had an entire performance marketing team. Well, initially, it was a one-person team, but ultimately became a team where we would actually spend money to acquire both riders and drivers.
15:41 Speaker 01 Well, actually, I was gonna... That's exactly right. In our social worlds, we were all about these organic... How many people can we organically get into our products? And if we spend a dollar on user acquisition, we always spend a dollar too much. And, you know, the boards were like, "How do you get more free virality?" But I think, you know, both Uber and Airbnb, because your business is people actually pay for, how do you think about paid acquisition differently than this sort of organic acquisition? How do you train a team to sort of understand that and think about that differently?
16:09 Speaker 02 Do you wanna start?
16:10 Speaker 03 Sure. So, let's see. I would say a lot of those platforms that you are doing growth on, Google, Facebook, they are turning... Kind of the opportunity of doing free growth there is getting smaller, and the opportunity of doing paid growth better is getting larger. So, most good growth teams should invest in paid marketing. I think that, and by experience, I've seen, looking at other companies, what they've been doing, large companies that do paid marketing, they tend to integrate that with the product team and the engineering team. So, there are engineers and product managers supporting those teams. They call it ad tech or something like that. And I'm sure both Uber and Airbnb is at that stage right now where, basically, most
16:55 Speaker 03 of the leverage you'll have at that scale is gonna be through engineering, data science, and product management. That's a different world than when you start off. When you start off, you have a smaller, smaller team.
17:07 Speaker 03 And...
17:10 Speaker 03 Yeah, it's probably...
17:11 Speaker 02 Yeah, I mean, I'd say the way I think about paid acquisition is it can just further accelerate growth. So, Uber would've kept growing even if we had never done any paid acquisition, but especially in a competitive market. It kind of makes sense to pay up to what that rider, that driver is ultimately going to be worth. When you're in a situation where the faster you grow, the better. Because as you get bigger and bigger, there are a lot of other efficiencies that kick in. So the whole network becomes more efficient once you have more liquidity. So there's value to getting there as quickly as possible.
17:53 Speaker 02 It's kind of tricky to know exactly how to calculate the LTV of a rider or a driver in a two-sided marketplace because, you know, the riders pay the drivers and some of that money goes to Uber. So how much is the rider worth versus a driver worth? And we had a team actually focused on that exact question, a team of data scientists. And it was more complicated than I understood, but basically there are certain markets that are more supply constrained where a driver, the incremental driver is worth a lot more. Other markets that at a certain time of year might be more demand constrained where you might be willing to pay more for the rider. And that varies over time and by geography.
18:30 Speaker 03 A quick comment on that. I would say most companies that go really, really large, they do it on figuring out one platform. So they are really good at online marketing, they're really good at SEO, they're really good at virality or the Facebook platform or something like that. It's rare that you have, like, I figured out all the platforms. So I would think about the product that someone have, the product that you have, and which of these platforms is it the most suited to? Is it the most suited to search? Is it the most suited to displays? Is it the most suited to virality? It really depends on the product, I would say.
19:01 Speaker 01 Interesting. And where do you guys see any upside right now in sort of the marketing or growth world? I mean, it seems like a lot of these channels have gotten pretty saturated. Facebook's gotten relatively expensive to be buying on. Google's various platforms and video, you know, I've heard a lot of people talking about video ads are sort of the new place. Even people are actually going and advertising on TV. You know, where do you guys just think about sort of where those growth opportunities sit out there now?
19:30 Speaker 02 I mean, I come back to build a great product. Because if you have that product-market fit and the people using your product love it, all of the channels are out there today that will allow people who love a product to share it with their friends. So, I think that's actually the most important thing. And then, everything else will follow.
19:50 Speaker 03 Yeah, I mean, I would, I don't think there's anything short-term that will remain, like, successful for a very long time. So, the best advice is invest for the long-term, whether it's SEO, whether it's paid marketing, whether it's virality. Take like, a couple of years to look out and see, kind of, where do we want to be? And aim for, like, look for channels that actually do have true scale. Like, channels that have like, hundreds of millions of people discovering products through those channels. And then, invest for the long-term. And engineering and data science is critical to be successful, in my opinion.
20:24 Speaker 01 I'm surprised neither of you mentioned Instagram. The tip I got yesterday at FA, talking to a bunch of Facebook folks, is they think Instagram app install ads are significantly underpriced relative to Facebook. So, if you guys go back and start buying on Instagram, you might be surprised at how it does. So, one of the unique things, again, in the social viral world, we kind of grew, scaled on the internet. You guys also have to grow city by city. What are some of the things that you did to kind of, set up teams for growth that could actually do growth in a city that sort of, that could sort of customize it for the city? Or how much did you try to make it sort of a centralized playbook that you'd control from the mothership?
20:59 Speaker 02 So, I mean, every city would have its own city team, beginning with a launcher. Again, I mentioned Mike in the audience. He was a launcher, then was our general manager in Boston, and then started, basically headed up product for the growth team. So, it was really valuable to have the person who was running product for growth be one of these ex-operation people. And working with all the city teams was really important, in terms of just making sure that product and operations were integrated. And Uber, we now have a team at Uber called Product Ops. And it's basically a team that kind of, is that bridge between the product team and And the operations team. But as much as possible, we tried to just have a playbook.
21:44 Speaker 02 And, you know, one thing that's helpful with Uber being a global business, and I'm sure you guys see this as much, if not more so, at Airbnb, is when we would launch in a new city, there would also be a lot of, there would already be a lot of pent-up demand. We'd see a lot of people trying to use Uber in a city before we'd launch in that city. So there were certain things we could do to kick off that flywheel. But I'll share one example of something where we actually did something very different to the product in another city, and this was back when we were in China. We found that it was hard for drivers to sign up to become Uber drivers in China.
22:25 Speaker 02 Because of the firewall, there were latency issues, and just like signing up online, and a lot of drivers had phones but didn't have computers, and like, it was just hard for them to sign up. So one of the engineers on our China growth team built a WeChat bot. WeChat's, you know, like a messaging app, or the Facebook of, sorry, the Facebook and also the internet of China, really. And so we built this WeChat bot, where as a driver, you could take a picture of a QR code, and then it would just start asking you questions. What's your name? What's your birth date? What's your driver's license number? And people would quickly be able to sign up to become a driver. And we'd have these onboarding sessions with hundreds of drivers, if not even more than
23:09 Speaker 02 that, showing up in one room, all on WeChat signing up, which was amazing until WeChat started blocking us. Because they were owned by Tencent, which had invested in our competitor. So that's one example of something we had to do very differently in a different market.
23:24 Speaker 03 I would say two things I would call out. One is translation, so absolutely key to
23:31 Speaker 03 Have a way that you can translate content across languages is often overlooked. And it's like a huge growth driver, like a lot of people don't speak English and the experience that you're offering in different language. The second thing is what we what I call product gaps. So if you look at your product globally, there are some parts of your product that won't work in some countries, whether it's authentication like Facebook Connect, whether it's payment mechanisms, search, SEO, and just like identify those gaps. There are not that many countries in my experience that are dramatically different. There are maybe five or 10 that are quite different than US, but most countries are not that different.
24:07 Speaker 01 Cool. And just last thing, because growth is all about experimentation and often experimentation against instincts. What is one great case where you and your growth team like really either believed something was going to make a huge impact and then were disappointed when it didn't? Or where someone just did an experiment and even you, you were like, oh, this is never going to work and then it like blew you away?
24:29 Speaker 03 So we have actually institutionalized this thing. We call it the experiment review. Every two weeks, the growth team gets into a room and we show experiments that we've shipped and gotten significant results on in the last last month, say. And the engineer will go on stage, show the experiments, show the control and the experiment. Before they show the answer, they'll ask the audience, what do you guys think? How many here think control? How many think experience? Experiment? And it turns out that we often disagree. Most of the times we disagree, which is exactly the point you're trying to make by doing experimentation, that predicting product decisions are really, it's really tricky. So I would say this happens all the time. And if it doesn't happen, then you're not taking big enough risks.
25:12 Speaker 03 You should be seeing there are things that are counterintuitive. Sometimes when they're very counterintuitive, having experience of seeing a lot of experimentations makes you ask the right questions. Oh, maybe the metrics is wrong this time. That happens as well. But yeah, things should be really counterintuitive. Give one tidbit and one advice. If you have a website and you have people come to your website and you have accounts, don't log them out. It's like keep people logging for as long as you can. There's really no benefit in automatically logging people out after after a couple of months, after a couple of days in terms of growth. So I would, I would look for Amazon for some advice and how they've done things.
25:49 Speaker 02 So, I mean, one thing I found interesting is often it's the smallest tweaks that can make the biggest impact. And there's not necessarily correlation between how much work you put in and how much of a step change it makes, or sometimes an inverse correlation. So, I'll share one interesting example from Facebook. We were looking at the signup, basically the funnel and the viral metrics by region, and we noticed that Japan was our least viral country. And when we dug in and tried to understand why, we saw that very few new users were actually sending invites to any of their friends.
26:32 Speaker 02 And we had like a small team in Japan. I spoke with the country manager there, and he said, "You know, people just think it's rude to send invites, so no one's going to, it's like a cultural thing, but people don't want to intrude on their friends and send invites." So, we brainstormed a bit, and we decided to literally make a copy tweak. And instead of calling them invites, we called them announcements. And we would say, as part of the signup flow, you'd import your address book to find your friends. And then instead of saying "invite all your friends," we said, "Let Facebook now announce to all of your friends that you're on Facebook, and this is where they can find you." And Japan went from like our least viral country to our most viral country.
27:13 Speaker 02 And when Zuck saw that, he was excited and thought, "Why don't we do this in some other places as well?" But it was literally just a copy tweak to make people more comfortable with sharing what the product they were using with their friends.
27:30 Speaker 01 That's great. I've been talking to some mobile developers that even the difference of invite versus add somebody, which is sort of vaguer. If you press, if you change your language from invite to add, people will send the SMSs out to their friends to invite them to a service at a much higher rate than the word invite. So, these really subtle things they don't expect. We have a time for like one or two questions from the audience? Anybody have any? There?
27:58 Speaker 04 Ed, you talked about the North Star and you said at Uber it was about the number of rides, but you could have easily been optimizing for crazy retention and zero growth, new user growth or new rider growth, or all new rider growth and to news last comment like horrible retention. So how did you balance out knowing what your almost sub North Stars were so that you could have the best North Star?
28:21 Speaker 02 Totally, yeah, that makes a lot of sense. And it actually changed over time. So, early on, we were kind of in land grab mode where it was all about new user acquisition, new riders, new drivers. But we would look at growth accounting. So you'd say, well, the total number of active riders or active drivers equals like last week's active number plus any new users you get, minus any users that churned, plus any users that re-engaged. And you can look at each of those three things, kind of the magnitude of each. And early on in the growth curve, when you're kind of at the bottom of that S curve, the
29:03 Speaker 02 new user acquisition number is probably going to be much larger than like the churn or the re-engagement. And so it makes sense to focus the most on growing that number. But as you get bigger and bigger, as your active user base gets larger, the churn as an absolute number goes up because it tends to remain like a, you know, constant percentage or roughly like constant percentage of the absolute number. And then at the same time, new user acquisition gets more difficult because you've already reached out to so many new people. So if you just monitor, look at the growth accounting and kind of see like those are the levers, which ones can have the biggest impact.
29:46 Speaker 02 Early on, it might be new user acquisition, but later on, it's probably going to be retention and re-engagement.
29:53 Speaker 02 But that said, you kind of need that retention from the beginning. Because if you're just like, I've thrown plenty of things in the past that haven't had retention and it's fun while it's going like this, but if that retention's not there, ultimately, it's not really going to help. Is that like Zodiac calendars? Exactly, that kind of stuff.
30:11 Speaker 05 So Ed, you, earlier you told a story of like the challenge of getting people to go from registering as a driver to actually like overcoming the nervousness to go out and do the first trip as a driver. Interested in what are some of the experiments you ran there and what you learned about how to actually get people to do that in the real world?
30:30 Speaker 02 Yeah, definitely, definitely. So, you know, I'll just mention one example is we saw that sometimes like a driver, a new driver would log in and might not get a trip request right away. And sometimes that driver might just be waiting for a really long time because they're a brand-new driver and maybe they're waiting somewhere, maybe they are waiting in front of their house and there just isn't a bunch of stuff happening right there. Or there's another driver who's more experienced and who knows if you wait a block away from here, they're more likely to get a request.
31:08 Speaker 02 So, like one of the experiments we ran was what if we make it like, make sure that that first experience is better? Are there things we can do to kind of get that, get that driver hooked? So that's one example. You know, we also experimented with, are there ways we can get potentially existing drivers or other people to like get on the phone with a driver and talk them through that first, that first trip? And so the team's experimented with a bunch of different things like that.
31:45 Speaker 06 Fritz. Just to kind of probe on something Gustav alluded to regarding growth and organizationally. Do you guys think that the right steady-state outcome is for all teams to become growth-oriented and have growth people inside of them, or to have a separate standalone team that's kind of fully vertically integrated? And if the latter, how, what conflicts have you seen between, say, marketing, you know, who's focused on owning the homepage and the language and the brand kind of goals, or lifecycle, who thinks that they own retention versus growth, and likewise with product groups that feel like they own a product and a customer experience that they're trying to get, with you guys kind of hacking away at that?
32:22 Speaker 03 So, I would say that the, ultimately, the company becomes a growth team in the sense that you use data to make your decisions. Like, you don't make, you basically look at the data because it gets so hard to predict what are the right practices to make, like, once you make optimizations. So, ultimately, at Airbnb, all the larger teams are using data to validate experiments. And that's kind of, the idea of a growth team for us means where you sit in the funnel, you're on the top of the funnel, you're finding users on the, they're not already using Airbnb. In other companies, growth teams is a smaller organization that kind of advantifies that to the rest of the product team, but Airbnb, really, the entire product team is now a growth team.
33:07 Speaker 03 And the goal of the data team that had the ability to use tools is to get everybody to use them. Like, they are literally measured by how many people are using experimentation frameworks.
33:15 Speaker 02 Yeah. We actually merged the product team and the growth team about a year ago at Uber for, largely for those reasons. Especially as we started focusing more on engagement and retention within the growth team, and that's kind of what the core product team was working on as well. It just made more sense to bring it all together.
33:35 Speaker 01 And I would just add, as you talk about your lifecycle and your homepage copy teams and everything, and brand, that, actually, when they kind of merge together and they sort of have the orientation where really growth and marketing are sort of one thing as opposed to, as opposed to two, you understand sort of, everything we do is in the spirit of growth, even if it is driving our brand or other stuff, you know, rather than trying to keep them separate and contentious as we're then merging. We've got time for one more question.
34:03 Speaker 07 Question for Ed. Uber was super aggressive in China and growing. Were there any really crazy things you guys discovered or hacks there that maybe people could use back here?
34:17 Speaker 02 I'm sure there were, but I probably can't talk about them. I mean, actually, I don't have any like super crazy ones that are coming to mind right now, but I probably shouldn't talk about any of the stuff that worked really well, just given that we're probably still doing it if it did. Sorry about that.
34:35 Speaker 01 Awesome. Well, thank you. Hopefully you'll be scaling your orgs and your user bases together. Thanks, Ed, and Gustav a lot for this.
34:46 Speaker 00 All right. Thanks for listening. So if you want to read the transcript or watch the video, you can check out blog.ycombinator.com. And as always, please remember to subscribe and rate the show. See you next time.
Previous #12 - How Should Business Schools Prepare Students for Startups? - Jeff Bussgang and Michael Seibel Next #14 - Ex Machina's Scientific Advisor - Murray Shanahan Page updated October 26, 2026 · transcript and summary are machine-generated