Pod Insights a16z Podcast a16z Podcast | Talking Humans and Machines with NYT’s John Markoff About this episode Longtime New York Times technology and science writer John Markoff joins the a16z Podcast to discuss our changing relationship with technology and machines ... as well as the changing nature of Silicon Valley itself (where Markoff grew up).
Jumping off from the themes of Markoff’s new book, Machines of Loving Grace: The Quest for Common Ground Between Humans and Robots, we explore the future of human and robot work; hear about chatbots that keep kids enthralled during "toilet time;" and the implications of “the wheels finally falling off of Moore’s Law” -- something people have long predicted but has never happened yet. And finally, why education is the raw material for a future where humans and intelligent machines work hand in (robotic) hand.
Transcript 0:00 Speaker 1 Hi everyone, welcome to the A6 and Z podcast. I'm Sonol, and today Michael and I are interviewing John Markoff, the longtime New York Times technology and science reporter who's been covering the evolution of technology, Silicon Valley, both inside and outside Silicon Valley for the over the past three decades. He wrote his first book in over a decade that just came out this past week Machines of Loving Grace, The Quest for Common Ground Between Humans and Robots. And that's what we're going to talk about today. John, welcome. Thanks for joining the A6 and Z podcast today. Trevor
0:30 Speaker 0 Burrus, Jr. It's really nice to be here. Trevor Burrus,
0:31 Speaker 1 So Michael and I um were excited to have you in the ACX and Z podcast today because you have been a longtime journalist and chronicler of technology and how it's evolved and also been have been observing Silicon Valley. And until now, those two things have been completely conflated. We're curious to hear your vantage point on what's changed so much for you. Like what surprised you the most in that time frame.
0:55 Speaker 0 Well, you know, I actually grew up in Silicon Valley. I mean, the the sort of the my street cred is I played in the Hewlett household when I was a kid in in kindergarten in first grade. And I was the paper boy at the houses where Steve Jobs and Larry Page lived. I like to say there goes the neighborhood. So I grew up with a very different Silicon Valley than the one we have right now. And actually, you know what surprises me, I guess if you it's it's actually the geographic shift. I mean, Richard Florida about a year ago did this wonderful bit of research where he basically found the center of Silicon Valley by geo-coordinating current investments. And you know, once upon a time, the Center of Silicon Valley was in Santa Clara, and now it's at the foot of Potero Hill in San Francisco.
1:39 Speaker 1 Right.
1:39 Speaker 0 And you know, it used to be a manufacturing center, and now it's a marketing and design center. And uh still a very unique place. Um, but I have to say, um, it's generational. And I grew up with a particular generation of Silicon Valley. I sort of call it the second generation personal computing. Um there was a valley, electronics valley before there was Silicon Valley, but the semiconductor guys were the first generation. And now it's something that I'm only barely in touch with, you know, personally. I mean, I'm in the science section of the New York Times, so I've kind of moved on in a number of ways. I walked away from the cyber beat in 2011 because I figured that if I had to write a story about one more testosterone poisoned teenager with an attitude, I was going to have an aneurysm. It was time to do something different. It turned out to be one of the best beats, and you know, it just gets worse, right?
2:25 Speaker 0 Right.
2:26 Speaker 1 I walked away from
2:26 Speaker 2 it, but I was just not having fun. Perfect timing.
2:29 Speaker 1 And the biggest events happen in that one, period. Yeah.
2:32 Speaker 0 But uh, you know, I do have I I do feel like I have a long view, and I feel like the valley is very generational, and I'm marginally in contact with what's going on now. It's remarkable. I mean it's it's still a a unique place, and I watch it from the outside, I feel a lot of time because you really have to be like a fish in the sea to appreciate what's going on. Aaron Powell
2:51 Speaker 2 You wrote a book um about the sort of the dawn of the PC era and kind of the culture that that um fomented that and and why that happened and how it happened. Robots, you know, we've been dreaming of robots um or fearing robots for for a long time in automation, but why this book now? What brought you to it? Aaron Ross Powell
3:09 Speaker 0 Yeah. So um I I can go in a couple different directions with that. And uh you know, why now? In some ways it was a sequel to my last book called What the Dormouse said, How the 60 counterculture shaped uh the personal computer industry. When I was writing that book, um, and I I I at that time I kind of it it was kind of an anti-autobiography. I was gone from Silicon Valley from 65 to 75, 77, and I wanted to see what happened while I was gone and this amazing world, you know, sort of bubbled up then. But the one thing I noticed and just mentioned in uh Dormouse was um at the very dawn of interactive computing, there were two laboratories on either side of the Stanford campus. One was John McCarthy's, the Stanford AI lab. At that point in 62, 63, McCarthy thought it would take him a decade to build a working AI. On the other side of campus uh was Doug Engelbart's uh laboratory, and he wanted to do something that was sort of philosophically opp opposite to what McCarthy wanted to do.
4:01 Speaker 0 McCarthy wanted to replace the human. Engelbart, who was the inventor of the mouse and invented hypertext and all the things that would become the modern personal computer world and and internet world, um, he wanted to extend the human. He wanted to give small groups of human beings intellectual tools to make them more powerful intellects. Trevor Burrus,
4:20 Speaker 1 Jr. In fact, I think he even called it augmented. He called it IA augmented cognition or I mean oh IA, okay.
4:25 Speaker 0 Intelligence augmentation. So it's AI versus IA, and I was fascinated by that. And then so dialed the clock forward to when did I start on this? Uh 2010, 2011, I began looking at this new wave of technology. Um AI as a field has failed many times.
4:41 Speaker 2 Yes, yes,
4:42 Speaker 0 really quite remarkable how it overpromises and underperforms over a long time. But something different was happening because of a set of technologies which were finally maturing, you know, you pull together big data, pull together the internet, all these things and the algorithms in terms of uh, you know, basically uh statistical algorithms ranging from neural nets to Bayesian statistics, they began to work. And it began to have an impact. And I began to report on that. And uh I really sort of set out to sort of try to square the circle between AI and IA because I mean I think this there is a solution. I mean, you know, it's it's both it's both a dichotomy and it's a paradox. Um it's a dichotomy in the sense that these two things either, you know, you either read the people out of the equation or you or you extend them. Um but even when you extend them, you need fewer people, right?
5:29 Speaker 0 So it's not uh it's not a neat dichotomy. And I've been struggling with that. And so that's I set out to explore that. And what I really and the the book is a set of linked narratives about people who crossed over, most from AI to IA, and you know, their stories. And I, you know, I am you know, I'm I'm a I'm a failed social scientist, and so there's this notion of social construction of technology. I'm a total believer in the Church Hill and McGlue and view of the world that we shape our tools and then they shape us, but we shape our tools. And I'm very interested in sort of describing that, and that's what I tried to do in this book. Aaron Powell The
6:04 Speaker 2 versus AI versus IA is still very much alive and still very much kind of this religious war, isn't it? Yeah,
6:11 Speaker 0 I w I uh I I wouldn't call it a war. What happened was these two communities emerged there and they both they both they went their own way and they largely don't talk to each other. And they, you know, uh Engelbard's work has been as a research community and as a part of the industry is now the uh human-computer interface world. Those people largely do design with the human in the center of the equation.
6:31 Speaker 1 The
6:32 Speaker 0 AI guys, not so much. You know, they're really fascinated. I mean, one of the cool things that I stumbled across is how influential science fiction has been on the careers of these people who make these machines. Uh you know, two examples. Both Jerry Kaplan and Rod Brooks, who are early AI guys, a roboticist, and Jerry was the co-founder of two companies. One was technology and the other was Symantec. No, most people don't know that it started as an AI company, but they both decided to go into AI because of um Space Odyssey 2001. They both saw HAL and said, I want to build that. Right. Uh which is not the reaction you might expect.
7:08 Speaker 2 Yeah, and I'm not surprised by that. And Ronnie Brooks is building, you know, robots that will help us in factories and help us do all sorts of things. He's
7:16 Speaker 0 crossed back over. I mean, he really now takes an IA point of view. I mean, he sort of positions the rethink Baxter as a machine that collaborates with humans, not replaces them. Aaron Ross Powell
7:26 Speaker 1 Is this versus really a thing though? Because you know, coming from the world of human-computer interaction, that it doesn't seem that people really view them as like computers versus humans. Like most people, whether if you're on the AI side, clearly your interface has to interact with your inner interface has to interact with people at some point. I mean, you have to design it to interact with people. There's just no way to not have a robot that doesn't operate independently. Similarly, in the and the on the IA side of things, you have to embody that humanity into the interface in some form so it can do things for people. So I that feels like this this dichotomy is almost false. Aaron Powell
8:00 Speaker 0 Well, I maybe. I I actually don't think so. I think that the AI community has a set of values that are about um building systems that uh basically um replicate human capabilities. That's their their value set. And um oftentimes, you know, in uh in an economic system where you can take labor out of the equation, that's the priority. I mean it's called capitalism. Right. And it's uh you know, there's a big debate. I mean, it's it's so murky what's going on in terms of jobs. I mean, it's a reporter's field day because you can you know, you can take the entire spectrum of p of of uh you know position on the question of do these things destroy jobs, all the way from the you know, the International Federation of Robotics, who argues that
8:43 Speaker 1 there's
8:43 Speaker 0 gonna be the biggest job renaissance in history, to a guy like Moshi Vardy, a computer scientist who argu uh argues, you know, machines will be able to do everything that humans do by 2045. And so look at that. Somebody's got to be right and somebody's gotta be wrong.
8:56 Speaker 2 Well, and what's the evidence thus far? I mean, the evidence is there's been more jobs created and more job creation in the last you know, 40 years than
9:04 Speaker 0 you know,
9:04 Speaker 2 ever,
9:04 Speaker 0 right? I'm with you. I have to admit, I started I mean, I'm one of the guys who started this new wave of debate. There was a piece I wrote in 2010, I think, about a new wave of AI that was basically capable of replacing $35 an hour um uh uh uh uh what are called le legal interns, what are they called? Um paralegals and $400 an hour attorneys uh and doing a demonstrably better job of reading documents. Right. Right. And that was for the first time that you know you began to see concretely that it you know, working its way into the uh upper uh reaches of the um of the workforce. Uh doctors, for example, are also uh radiologists are another classic example. So, you know, uh high value work for the first time. Something new was going on. Uh and I became very alarmed. I was an alarmist, and gradually over the last four or five years, I've come way over.
9:53 Speaker 0 Um A classic example. I was uh I I was you know my hair was on fire and I was trying to uh basically make the argument to Danny Kahneman, the economist that as robots were deployed in China, um it was gonna perhaps lead to social disruption. And Coneman uh said, you don't get it. In China, the robots are gonna come just in time. And I said, what? And he said, yeah. Um in China, the population is aging dramatically. Um the workforce is going to shrink. Uh you have to look at these things not as snapshots but as dynamic systems. And when you begin to consider what's going on in the world, the advanced world, look at Japan. Right. I mean, it's stunning how I mean we just did it in the Times, a piece about ghost houses because there's nobody living in them because the population is shrinking.
10:39 Speaker 0 Look at Korea, same thing. China. Um the U.S. is an exception because we have immigration. I mean, that's the really the rich irony. Europe, they're spending a billion dollars to try to develop elder robots. So you really need to frame these things dynamically rather than as a snapshot.
10:55 Speaker 1 Well, actually I heard you mention somewhere that's I don't know if this is the entire world or only in those regions that by in five years that more there'll be more people over the age of 65 alive than there are children under the age of five. Aaron Powell
11:08 Speaker 0 For the first time in history. Trevor Burrus, Jr.
11:09 Speaker 1 That's insane. Yeah. And so what does that mean in terms of it
11:12 Speaker 0 means we need robots for the
11:14 Speaker 1 to take care of? I mean, I so
11:17 Speaker 2 what I love about care or take out. That's the debate we're going to have.
11:20 Speaker 0 I spent I've spent three years trying to understand um the economics of the situation, and I've come away feeling I mean, take one of the best labor economists in the country, David Otter. I just read this wonderful piece he wrote in 2014. He's the guy who's basic basically been really closely identified with this notion of polarization that you know the middle drops out and the economy is growing at the top and the bottom. And it seems to be a lot of evidence that that's happening. And you can make that argument. I had made that argument in my mind that these the you know the arrival of the internet coupled with companies like SAP and PeopleSoft and Oracle and IBM who are re-engineering the white-collar clerk class inside uh corporations has caused this, you know, the evaporation of the hollowing out of modern corporation.
12:06 Speaker 0 I can see it happened in my own company. Right. There's a debate, even in the economics world. I mean, uh Otter acknowledges not all economists agree with the polarization idea. I mean, it's really is fascinating. The the economists don't quite know what's going on. Here's the thing that baffles me as much as anything. You know, in the late 1990s, um, there was an incredible productivity boom in the United States. You saw productivity growth up around 4%. Since 2008, you know, where the the modern theory is capital's replacing labor, you should see that kind of productivity growth. We've seen no productivity growth. Right. And there are all kinds of explanations. I think that's right, among
12:43 Speaker 1 among the popular ones. Halvarian. Right, exactly. That we're not measuring the right things at all, exactly.
12:48 Speaker 2 Or or there's the curmudgeon from uh Chicago. Oh, I love him, Gordon. Yes. Who was like, look, we're just there's we we failed. Yeah. Or we're failing. Trevor Burrus,
12:56 Speaker 0 Jr. But that brings us to Moore's Law. Because, you know, I come on, I grew up in Silicon Valley. I worshipped at the Church of Moore's Law forever. Um, you know, things get faster, faster, and things get cheaper faster. That that's gospel in Silicon Valley. Um, if that's true, you know, it's you get back to Robert Solo. Computers are everywhere except in the productivity statistics. And so it's a great puzzle to me. And in fact, I mean, there's so many nuances. I mean, one of my favorite stories, um, there are three of the books that are sort of wringing their hands without naming them about the labor situation, mention um the Instagram versus Kodak situation. Thirteen programmers at Instagram take out 140,000 workers at Kodak. You know, great story. Except it's not true. I mean, first, you know, the guys at Kodak made a series of strategic mistakes and they shot themselves in the head repeatedly until they were dead.
13:47 Speaker 0 The proof of that is Fuji, their chief competitor made it across the chasm. Okay. But it's even more interesting than that because Instagram as a company couldn't uh exist until there was a mature internet. How many jobs did the mature internet create? Probably two and a half million at least good jobs. Most of the things that are unbalanced people
14:06 Speaker 1 benefited from that. So in
14:08 Speaker 0 Vallis, it's not a simple equation. Right, exactly. There's disruption, but there's a lot of growth.
14:13 Speaker 2 And and just and it's hard to quantify this, but the the volume of just photos. If that's codec's business, I mean just exponentially gross, right? Because of things like Instagram and and the technology behind it. Trevor Burrus, Jr.
14:25 Speaker 0 Well, that's the that's mainstream economics is by and large, uh, you know, productivity growth is supposed to raise all boats. It it improves the quality of life. Now, the questi there is this question of distribution. And that's the fly in the oil. And I I would love to see good reporting on what the impact of new technologies has been on the on the distribution of income. And I just haven't seen a definitive study. Trevor Burrus, Jr.
14:49 Speaker 1 Right. I don't think there is one either. Trevor Burrus, Jr.: What do you think but then you know that's interesting? The title of your book is Machines of Loving Grace. You're not talking about machines being helpful and saving the world. You're talking there's those are very two very specific words. Um what do you tell people who are losing jobs to machines? Is that even happening directly?
15:08 Speaker 0 Well, yeah, sure. Um, you know, the there are people who are being displaced by new labor, new new types of labor. But I mean, what do I tell them? It it has been happening since the you know the industrial revolution. And so it will continue to happen. I actually don't think that there's evidence that it's happening at an accelerating rate. Right now in the United States, more people are working than ever before in history. There are 140 million people employed. Even if there's this polarization stuff, that's a lot of people working. Now, people come back and say to me, but you know, workforce participation is down. Okay, that's true. There are a lot of reasons of which technology is one of them. It's not the only
15:46 Speaker 1 one. Aging society is a reason.
15:48 Speaker 0 Uh and so you get into this stuff and you read the papers and you come out thinking, you know, I think that the big impact has the things that uh that are gonna really reshape society haven't happened yet. Trevor Burrus,
15:59 Speaker 1 Jr. Yeah. I want to actually come back to this theme that you've talked about a little bit about acceleration, both in terms of this notion of accelerating, you know, job growth, accelerating job loss, acceleration through Moore's law. Um of the mindsets in Silicon Valley that you've described is that put we just have this concept that things never plateau. Like that Moore's Law is gonna keep going, it's gonna keep going. And every time we think it's not gonna keep going, it just does. Something happens, some innovation comes across, some material science advance, whatever it is. What do you think is gonna happen next? Like, do you think that's gonna keep going in that direction? So
16:35 Speaker 0 I am absolutely obsessed now with the concept of scaling for a kind of an unusual reason, but I think you you'll be able to relate to this. Um I'm the one who stumbled across the paper in uh the Stanford archives that Doug Engelbart wrote in 1960, where he looked at uh this brand new technology of uh semiconductors, and he pointed out that it scales. And he made a very uh systematic argument about the way the relationship between the components change and the performance change. And so a lot of the stuff that was codified five years later in Moore's law in that electronics article, Doug got at. And he was looking, you know, the irony is he had come from the uh he was an electronics tech in the 1950s at NASA Ames in the wind tunnel, and that's where they had this the aeronautical engineers used this term similitude, which was sim similar to scale, it meant scaling.
17:27 Speaker 0 And they took a small model and they scaled it up. And he saw that when he looked at photolithographic technologies, he realized it scaled down. That was a profound uh insight. For him, it gave him the confidence to realize there was gonna be more computing power and he could go and do his thing and develop his augmentation tools more than codified it. But what I've realized is, you know, scaling works both ways. And you know, the valley used to scale down, be obsessed with scaling down. Now the valley is obsessed with scaling up. Right. I mean, everybody, everything that you fund here is about its ability to scale. Trevor Burrus, Jr.
18:05 Speaker 2 Is that is that the shift from hardware to software kind of
18:08 Speaker 0 manifesting itself or I think it crosses I think it's something broader than that. I um may maybe, maybe.
18:18 Speaker 0 I'm just starting to think about this. Right. But I have a coda that I want to uh add on because I've been, you know, I've I've made an entire career out of writing about Moore's law, you know, not dead yet, not dead yet, not dead yet.
18:29 Speaker 2 Except that maybe it's dead, but that was not dead.
18:32 Speaker 0 Okay, I'm finally gonna call it. Um the wheels are falling off. It is in fact not dead. But if you look carefully at what's going on right now, the wheels really are falling off. And let me just give you a couple of examples. Um Denard scaling, which was really the most important part of Silicon Valley stopped in 2006, just stopped dead. Clock speed stopped advancing, and so you went to parallelism and all these other kinds of technique. But more recently, the the interesting things that have happened uh are one, uh for most of the industry, uh the cost of transistors has stopped falling. And so as you scale, this is uh everybody but Intel in the industry says this. Um you if you talk to Broadcom, if you talk to Qualcomm, all of the customers of the foundries say, you know, going to the next generation, we're not getting that cost advantage. That's a big deal. Trevor Burrus, Jr.
19:17 Speaker 1 But you do get the performance advantage. People have argued that you get per uh better performance in another way. Trevor Burrus, Jr.
19:22 Speaker 0 It's it's true, but not in clock. I mean clocks flattened out. Um and and and then you get this this other thing sort of chimed in. There's this phenomenon called dark silicon. Um out of the clock problem, um, you know, the the they're they're so challenged by heat that they can't turn all the transistors on at the same time. Oh,
19:41 Speaker 1 interesting.
19:41 Speaker 0 They go through elaborate sort of uh algorithms to keep the chips cool. And you know, they do this in the mobile play uh devices particularly. You you lose the you know, you you you lose the value of all the transistors. Um okay, where we are. We're we're you know, Intel just said that they've uh delayed Going from 14 nanometers to 10 nanometers. It was TikTok TikTok forever, and now it's TikTok talk. And so when is the next talk going to be? Well, they say it's going to be 2017. We'll see. I believe, you know, based on talking to all the wise men I keep being able to talk to in Silicon Valley that there are three more turns of the crank. We go from 14 to 10 to 7 to 5. The industry can see its way to five. And there is one more build big deal. If you get to five, or if you get to seven, um it's a significant savings and power.
20:30 Speaker 0 And it's so it's not a performance and it's cost, but that turn of the crank on power, I think that could create new platforms that will create new industries and have all that goodness. So not dead yet, you're right, but a lot of the driving force has slowed down. Aaron Powell
20:47 Speaker 1 Well, the low power thing is actually really incredibly interesting because then you think of developing countries and the fact that you don't require that much power to power entirely amazingly huge large-scale platforms. Yes. Which that does beg the question that I've heard you ask as well, which is is it possible for the next great platform to come not from Silicon Valley?
21:07 Speaker 0 So I just a bit of history. Because I was spending a lot of time in Europe in sort of 2004 to 2006. And I was over there and it seemed like all the mobile innovation was happening in in uh in Europe and not in the U.S. And I thought, wow, we're behind. This could be a big deal because I was really bought into the fact that mobile was going to be next. And all of a sudden, here comes the iPhone and it resets and it comes and the next platform comes from Silicon Valley. But you know, it seemed to me that there was this moment where the new platform innovation might come from outside the valley. It's you know, if Tom Friedman is right and the world is flat, it has to happen at some point. We don't have a lock on good ideas, and I I'm amazed it's last as as long as it's like
21:50 Speaker 2 one thing, and for those of you who who don't design chips, um the the move from seven to five nanometers just means you can cram more transistors in any given space, correct? And use less power. Trevor Burrus, and use less power. And what that also means, though, the consequence as you were discussing about platforms is that the compute goes everywhere, right? These chips which are already pretty ubiquitous, all of a sudden they're in everything. And so what if if there's chips and everything, if there's intelligence in everything, do does the definition of a machine change and are we already seeing evidence of like robots actually don't have arms and say hello to you when you walk in the room, they're in your light switches, they're in your ceiling, they're in
22:27 Speaker 0 your car. Aaron Ross Powell, I so believe that. I mean we reach Mark Weiser's world then. You know, this was the second big idea from Xerox Park. Ubiquitous, you know, first you had a personal computer and you had one computer, and then computers basically disappeared into everyday objects and everyday objects became magic. And I I hate to say it, but Steve Jobs was the first guy to get that. I mean he's a good idea. You take a microprocessor and you combine it with a music player and you've got an iPod. You take a microprocessor, you combine it with a telephone, you got a smartphone. He was the first guy to really take advantage of that. But
23:00 Speaker 1 how many everyday objects are there?
23:02 Speaker 0 I mean, you know, and Tony Fidel went off and did it to the to the thermostat and to the smoke detector, and you know, that we'll work through these things. And I believe that um we increasingly will talk to them because that's the most obvious interface. And you know, right now people sort of uh they balk at talking to machines. Um but I see a lot of indication that as you know, they're connected to the cloud, the recognition accuracy reaches a human level, speech synthesis is going to improve very dramatically very quickly. Uh it just is gonna work. And it will be the more you know, y you won't be able to put uh interface on this device, but you'll be able to have a conversation with it. Right. Aaron Ross Powell
23:44 Speaker 1 I mean, one consequence of Weiser's vision though is interesting is his vision of ubiquitous computing was that the computing itself would disappear and it it clearly has because it's in the object. And I think I don't know who said this. Maybe Chris Anderson used to always say, like AI is gonna really be AI when we stop calling it AI, like a toaster is a toaster. That's right. You know, a curling
24:03 Speaker 2 iron. You're referring to the wired Chris Anderson, nothing. Right, right. Not the Ted Chris Anderson.
24:07 Speaker 1 So um so I think there's definitely something different going on right now, which is that you know, we are actually kind of glorifying those objects. Because Mark Weiser used to say like computing will be so ubiquitous and so cheap and so invisible that you could leave a conference room and leave your pencil behind and never think twice about leaving your pencil behind. But we don't do that with our iPhones and our objects. Like we're actually those devices are probably more valuable than our own children and family members at some points. I mean, you feel very brave without your phone.
24:35 Speaker 2 I just want to for the record, I'm glad I'm not related to you.
24:39 Speaker 1 Um I think um I it is interesting because as the computing itself disappears, our relationship with that entity changes.
24:47 Speaker 0 Yeah.
24:47 Speaker 1 And and how we fear it or don't fear it. Aaron Ross Powell
24:50 Speaker 0 Well, let me tell you a story. Um I I agree, and I spent a lot of time thinking about that, and I don't think I have it figured out, but I think it's an important point to look, and the the human computer interface designers are doing that point. I just wrote a story a couple of weeks ago about a Microsoft experiment in China called Zhao Ice. And Zhao Ice is a chat bot uh that is very different than uh Syrian Cortana. I mean, Syrian Cortana are productivity tools. You you ask it a question, it gives you an answer. Zhao ICE is a conversational companion. And the numbers are just stunning. Um they've gotten 20 million uh users, um, 10 million of them are intense users who have multiple conversations with it a day, and a conversation might be it could be consist of a wide range of interactions. They call it toilet time. The kids go into the bathroom, toilet time, go into the bathroom late at night when they're by themselves and they have conversations.
25:40 Speaker 0 Twenty-five percent of the Zhao Ice users have said I love you to the program.
25:44 Speaker 1 Really? Wow. So what does this
25:46 Speaker 0 mean or what does it foretell? So the Microsoft guys who designed this were creeped out by it. And I was kind of creeped out by it because you know, this is an this is Sherry Turkell territory. We're having deep relationships with inanimate objects. What could possibly be wrong with this picture? Okay. I I talked to um I think her name is Michelle Liu, uh who is an IBM researcher. She's just I got a startup now, and she's Chinese, and she said, you know, when we come to your country, we feel that it's quiet. She said that in China, there's so much more densely socially interwoven than we are, that something like Zhao ICE is actually a way to get private space. And it's not like it's not weird in our sense of the world. It's it's their their way of having time themselves. And I'm I'm willing to buy that as a hypothesis at least. Trevor Burrus, Jr.
26:31 Speaker 1 That's you know, I
26:32 Speaker 2 I I I wouldn't mind walking into a bathroom and having a conversation or somebody I don't know and somebody that's not there. Let's be clear.
26:39 Speaker 0 Um I uh
26:41 Speaker 2 I want you to put your hat on as a longtime sort of technology business um writer too. This this world that you describe, who wins and or who benefits most? Aaron Powell
26:52 Speaker 0 Well, uh one of the things I'm fascinated by is Google's foray into robotics and what it means. And I have lots of theories. I'm gonna have a little bit more insight than some people because of the reporting I've done and why they were trying to get in robotics. They haven't said yet, right? There's that you know, it's kind of they haven't said anything publicly about robotics. But when Andy Rubin was going around the valley and buying and around the world and buying up you know, the world's best roboticist, he was sketching out a vision, um, which I would describe as uh Google competing with Amazon. And uh, you know, and if you can kind of see the architecture of that competition, you know, what is it, the f the friend of my enemy is my friend.
27:28 Speaker 2 Yeah,
27:28 Speaker 0 they want to set up a distribution infrastructure which would allow them to compete without having to build the the large warehouse, although they have warehouses all over the valley already. So that's where the robot comes in. I mean, his vision was the Google car drives up to your house and the Google robot hops off the back bumper and runs the package up to your uh uh you know, up to your your door. And if you've seen the big dog uh videos, the little dog videos that Mark Grabert at Boston Dynamics, which is now a Google subsidiary going up the stairs, you might believe that that actually was on the agenda. So that's a fascinating competition to me. It although it's you know it's not really laid out, but um that's one of the places I'd watch. Um in terms of so you know one of the things that Ruben said to me in 2005 that got me going in this direction was that personal computers were starting to sprout legs and move around in the environment.
28:20 Speaker 0 And it took me a couple of years to figure out what he was talking about, and you really see it in the in the DARPA robotics challenge, which just finished. And I clearly see that that's true, but it's one of those areas where it's gonna take a lot longer than people think. I mean, you know, the the DARPA Robotics Challenge, which just was finished in Los Angeles was real ground truth of where we are in building autonomous machines. Let's forget cars for a second. Let's just talk about machines that can get out of their cages and walk around. And here we had 25 teams from all over the world that had millions of dollars of funding, the best roboticists around. And uh, you know, they had they had trouble opening doors. Um
29:01 Speaker 2 not too worried if I get taking over my job.
29:04 Speaker 0 His son, Joel Pratt said, you know, if you're worried about the terminator, just keep your door closed. Because
29:10 Speaker 2 you can't get the door open. Aaron Powell
29:12 Speaker 1 You know, I do think we're focused too much though in this discussion about robots that have form. I mean, I'm not just talking about humanoid robots that are human-like, but just any robot that has arms and legs, as you note, to me, the real threat or advantage of automation and especially AI is in that layer that's invisible to our eyes. You know, all the things that are powering what Brian Arthur calls a second economy. Like there's whole deep, rich, interconnected tree and ecosystem that's completely beneath the surface that's not being counted in productivity stats, but that is literally changing how we operate and how we work. What are your thoughts on that aspect of the debate? Because I think a lot of times when we embody it in human or non-human form or machine form, we kind of lose sight of what we're talking about.
29:54 Speaker 0 Trevor Burrus, Jr. Well, so one aspect of that where you can see it very clearly. I have a hypothesis that uh this sort of fits in a free economic. Way of the world. So, you know, if you look at uh where the American economy has grown since World War II, a lot of it is in people who transact business via the telephone. Tech support. Uh people who are salespeople, ticketing agents. Okay.
30:17 Speaker 1 Exactly.
30:17 Speaker 0 That because of falling cost of telecommunication, many of those jobs were outsourced to the Philippines in India. And now you have this free economics reverse thing happening where those jobs are coming back to run in U.S. data centers as software, not as U.S. workers. So that's at the heart of what you're talking about the scene economy. So how far does that go? I'm fascinated by that because I believe that that's one area where the technologies are moving quickly enough that they will have a job impact. And you know, first people will hate talking to machines, and then just like ATMs and bank tailors, they'll realize that it's a more efficient way to get the information you want, and we will spend much of our time talking to machines. Trevor Burrus, Jr.
30:55 Speaker 1 Exactly. And in fact, I think when we talk about talking to machines, it doesn't have to always be conversational UI. I mean, there are many ways to talk to machines, inputs, touch screens, multimodal, yep. There's exactly, you know, picking up on sensory cues that are embedded into environment. There's so many different things to think about there, definitely. Trevor Burrus,
31:12 Speaker 2 Jr.: Do do we as people then you you mentioned efficiency uh, you know, whether whether it's call centers or warehouses or whatever. Do we have to draw the line ever, like, okay, that's efficient enough, but we need to preserve this for humans, or like how does that debate. Well, so this is why I think it started it's already
31:29 Speaker 0 started back. I mean, the reality is I mean, I talked to someone like Terry Winningrad, an AI pioneer where I was talking about this AI versus IA thing, and he said, you know, we're in a capitalist economy and the the economic structure dictates these decisions. And you know, that was very disheartening to me because I believe, I mean, you know, I I grew up as a Marxist as a kid, and not all of that sort of filtered out of me. And I I believe
31:51 Speaker 1 that,
31:51 Speaker 0 you know, well, uh let's talk uh about a Stanford economist like Veblin, who who wrote this uh wonderful book called The Engineers in the Price System, where he basically argued that that sort of all the knowledge about the economy would accrete to the engineers and they would become the new power elite. Didn't this he wrote this in like 1913? But I see that potential again. I mean, so you know, the the designers of these systems have a great deal of power over what they look like. And that's my one hope. I mean, that's where I'm trying to be optimistic that it won't just be about cost, but there'll be human values that will be put into these systems.
32:24 Speaker 1 Exactly. And it's you know, a
32:25 Speaker 0 human responsibility. Um maybe I'm um maybe I'm being overly optimistic. I don't know.
32:33 Speaker 1 Well, you know, let's wrap up and talk about some implications of your book and and your findings over the years. Um let's talk about what happens to the research. So one of the things as we've seen the valve valley and technology evolve is that we've moved in in cycles from basic research to applied research back and forth. We see this in NIH funding, NSF funding. What are your views on where we are in that balance today, sort of the pastures quadrant of investing in the future? Aaron Ross Powell
32:58 Speaker 0 Well, look at the role that uh DARPA's played in sort of developing the seed corn for Silicon Valley. I mean, I you don't know how many people understand how much of the technologies that have been commercialized were originally pioneered by DARPA. And you'd think that looking at the history, you could just sort of dial it forward and say, well, that kind of spending probably would be good for us. Um but that's not the framing of the discussion right now. Um what what worries me when I look at a great institution like Stanford is that Stanford, you know, is become it's become an entrepreneurial hotbed on a scale that you can't imagine. You know, there used to be this notion of an ivory tower, and that's so gone. People pass through on their way to their startup and they'll, you know, maybe come back. I talked to Hannesy when he was Dean of Engineering about this was this 15 years ago, maybe 20 years ago.
33:46 Speaker 0 Before he became the president of the Special Speaker, before he was president of retirement. Um at that point, he had sort of worked out a model where he'd sort of get enough of his faculty to hang around that he had a core in coherent whole. And it's changed dramatically since then. Um I think there's and actually, you know, and I've spent time at Carnegie Mellon, and it's almost in an interesting way uh refreshing to go to Carnegie Mellon because not everybody is just getting ready to start their next company, which is the feeling you have at Stanford. I mean, there are people who are actually, you know, interested in computer science and they want to stay there. And that's that's true at Stanford. There are people who are, you know, computer scientists, and there are people who have gone out and started companies, and it it it really i it's a really viable system, but I think that there is a value to long-term research and that our society undervalues that.
34:37 Speaker 0 Uh and I don't know how to reset it. Um do we need another Sputnik? Probably. I mean, that's what got DARPA started. There was this event that was an existential threat to the country. And uh you know, the the the country responded and it had this incredible impact. And so, but you know, it's that's a kind of a grim scenario if it's going to take it's gonna take that. Um, I'm uh when I've been again thinking about some of these labor technology challenges, at the end of the day, I don't see any way out of this conundrum um but through education. Um if we're moving toward an econom an economic system where you can't expect to do what someone like I has done and but stay in a job for your career, but that you have to have a series of jobs. Then it doesn't seem like socialism to want to fund education as it's the raw material for the economy. And so maybe you need to I mean we've done it before as a society.
35:25 Speaker 0 Uh the GI Bill had this incredible impact in terms of making America a competitive nation in the wake of World War II. So let's take a look at that. And you know, maybe we need an educational version of Obamacare, where if someone loses a job to they can simply retrain themselves. And you know, just society will fund them to do that. I don't see what's so terrible about that. And I think that, you know, if you had that to fall back on, and you could, you know, you could go in a different direction, it really might change the nature of the game, and it would it would create this raw material for an economy that was changing and dynamic, and uh uh you know, all boats might rise. Aaron Powell
36:02 Speaker 1 What do you think about then like Peter Thiel's view on people drop kids dropping out of college to become entrepreneurs? Yeah.
36:08 Speaker 0 So uh you know um how to respond to that. Um at the Bits and Adams Center, um, there is a physicist whose name I'm blanking on right at the moment, uh, who basically styles himself as the anti-Peter Teal. I'll think of his name as soon as we get off the air. Um he has a series of students who've um studied sort of uh serious graduate level physics who were in incredibly important CTO-like roles all over the valley, probably 20 of them, some of the best and brightest in Silicon Valley. So you know you get back to my notion of wanting to be an entrepreneur before you have an idea. I think that's the cart before the horse. Oh,
36:49 Speaker 1 right. So about that notion. So this is a notion where you talk about how Steve Jobs and and and Gates dropped out of college in order to build these companies, but that's because they had the vision. They had a reality. They didn't decide they were going to be entrepreneurs and then adopt the vision. Trevor Burrus, Jr. And
37:03 Speaker 0 I also have this no slightly different notion of um many people about Silicon Valley, which is you know, not just entrepreneurial uh driven. I mean, two uh two things that I've noticed over the times. Look at um look at uh jobs in Wozniak. I mean, to me, that's the canonical example of a Silicon Valley company. One guy who just wanted to build a computer so he could share it with his friends at the Homebrew Computer Club, he was not thinking about markets, he wasn't thinking about anything but the fact that he was in love with the technology, and another guy who realized that there might be a market for there. I can't tell you how many times I saw that in Silicon Valley. And from for me, the the moment that I got you know, my generation of Silicon Valley was slightly after the introduction of the IBM PC, immediately after it was introduced, there was something called the big blue computer club that meant met a Dyson Auditorium in Sunnyvale.
37:51 Speaker 0 We're talking 1981 or 1982, and I went to one of these meetings, and at that point it was a room full of mostly um almost all men in wearing white shirts with pocket protectors who are working in their day jobs in the valley. And on Evelyn Richards, who's a reporter for the San Jose Mercury got up on stage and did a sir uh survey, Evelyn had an amazing amount of HUTSPA. And um she said, um, how many of you are planning on starting your own companies? And two-thirds of the hands went up. And I said, Oh, I get it. There was a culture who believed if you had a good idea, but if you had a good idea that you could be the next Steve Jobs. That was really already woven into the the, you know, the the drinking water in Silicon Valley. Trevor Burrus, Jr.
38:29 Speaker 1 Right. Well, it's kind of what's been around since day one, because this this dichotomy between academia, government, and entrepreneurialism like through startups, it's kind of false when it comes to Silicon Valley. I mean, it's bore boundaries have always been really permeable. Trevor Burrus, Jr. Yeah.
38:43 Speaker 2 Trevor Burrus, I I want to sort of come back to the beginning and and um well, almost the beginning where you were talking about scale. And I just wonder going forward and and for non-engineers, for people who are out there in the workplace, you know, as Silicon Valley scales across the world as these products go everywhere. And and again, as automation happens and robots come in more and more into our lives. What would you advise people to think about and how they move through the world when they adopt these machines, when they adopt, you know, or faced with automation? You know, you seem optimistic, but it also sounds to me that that people have a big role to play in, like you say, designing this future. Um but how do the people who aren't designing the the things themselves, what role do they play? Trevor Burrus,
39:25 Speaker 0 Jr. Yeah. So um you know, as a citizen, um, you know, I see uh I see I mean I'm I'm really torn because you see all kinds of things that worry you. Um you see I mean one of the things that I I worry about in the Internet of Things kinds of uh impact is there's a you know, the the Facebook and Google um explosion has been based on this kind of Faustian bargain where you know they give me these wonderful services, and what do I give them? Well, I give them behavioral information about my life. Right. And it's you know, it's troubling to me because It's not clearly demarcated. I think you know we there's been a lot of discussion about it, but no answer. And so I guess I would say to a citizen who's not a technologist in designing you know, I guess educate, educate, educate.
40:11 Speaker 0 You know, learn more about the technology, understand what it does. It's not magic. You know, you just get a little bit deeper and try to understand what's wrapping around you. Um you're gonna need to because it's gonna completely wrap around you very quickly.
40:27 Speaker 2 John Markov, if uh robot overlords let us talk to you again, uh we would look forward to it. So thanks so much for coming. Thanks for joining the ACC
40:34 Speaker 1 podcast.
40:35 Speaker 0 Thanks.
Previous Company Building in Crypto: A Conversation between Brian Armstrong and Chris Dixon Next What's Next for Education Startups Page updated August 25, 2026 · transcript and summary are machine-generated