Pod Insights a16z Podcast a16z Podcast | Mapping the Future of Virtual Reality About this episode Virtual reality is coming fast, and everyone seems to assume that it will be gamers who get to have all the fun first. But there are other applications for VR that could also bring it into the mainstream. “It could very well be business users,” says 16z’s Chris Dixon. “It’s anything where you would want time travel or teleportation.”
Dixon is joined on this segment of the podcast by Saku Panditharatne and Kyle Russell, both on the firm’s deal team, to offer their perspective on how virtual reality is likely to enter all of our lives. This year promises to be the moment when more than a very small number of people will get their first taste of VR. What that looks and feels like, and what that shared experience sets in motion on this segment of the a16z podcast. Chris Dixon starts the conversation.
Transcript 0:00 Speaker 3 Welcome to the A16Z Podcast. I'm Michael Copeland. Virtual reality is coming fast. And everyone seems to assume that it will be gamers who get to have all the fun first. But there are other applications for VR that could also bring it into the mainstream. It could very well be business users, says A16Z's Chris Dixon. It's anything where you would want time travel or teleportation, he says. Dixon is joined on this segment of the podcast by Saku Panditaratne and Kyle Russell, both on the firm's deal team, to offer their perspective on how virtual reality is likely to enter all of our lives. 2016 promises to be the year when more than a very small number of people will get their first taste of VR.
0:46 Speaker 3 What does VR look like and feel like? And what does that shared experience set in motion on this segment of the A16Z podcast? Chris Dixon starts the conversation. Aaron Powell
0:57 Speaker 1 The first question is kind of where are we in terms of VR?
1:08 Speaker 1 There's gear and cardboard. Maybe Kyle, you know, can you kind of talk about the current landscape?
1:14 Speaker 0 Yeah. So last fall we saw the launch of the Gear VR, which is compatible with Samsung phones, and it's kind of the prototypical mobile VR headset. You take your high-end smartphone, you slot it in, it provides optics that make the flat screen on your phone into an immersive uh screen that kind of you know fills your vision and also adds some motion sensors so that it's tracking of your head is more accurate. Uh and then you know uh last month and then this month, um the Oculus Rift and uh HTC Vive uh were both the pre-orders were announced respectively. Uh those are kind of the high-end approaches to VR. They hook up to a high-end gaming PC, they provide positional tracking, which means that it tracks not only how you turn your head, but how you move forward, backward to the side, which means you have kind of a more immersive experience.
2:06 Speaker 0 You can see things from different angles. Uh the it feels like you're in the world because you can move relative to it. Uh no. So both of those are having their initial launches this spring, uh, Oculus, the first units will ship in March, the Vive, the first units will ship in April. Um
2:24 Speaker 1 it's kind of slow, uh, I I think of it as low-end and high-end, and then the high end is Oculus, HTC Vive Valve Valve Vive and uh the rumored PlayStation, and the low end is gear and cardboard. And eventually obviously these will probably converge and they'll all have features like traditional tracking, but for this year, there's sort of a separation, right?
2:44 Speaker 0 Yeah, no, you you talk to anyone, and this is one of the things where uh leaks are kind of slowly but surely making their way out of Apple and Google. Um you'll see lots of great scoops coming from, for instance, the Financial Times has done one for Apple and Google recently, where uh it's clear that they have hundreds of people working on these. And uh when it comes to what kinds of hardware they're working on, they do want to bring the h parts of the high-end experience, the things that we consider like the differentiators that give immersion presence, however, you want to describe that, bring that down to mobile, because I think everyone understands that the mobile plat mobile as a platform is you know 10 times larger than desktop will ever be. And while the capabilities today of desktop VR are really impressive, if you want to become truly mainstream, you want to reach people who have smartphones.
3:30 Speaker 0 Aaron Powell
3:31 Speaker 2 I think the feeling is the next couple of years will be the years of VR for for gamers and for proceamers. So people who are really enthusiastic about VR are the ones who have the high-end version. And um like the mobile is just gonna like a teaser for the general popular.
3:44 Speaker 1 So what like let's just go into some detail. So for example, um the we we've tried all these demos. The um the Oculus, sort of the consumer toy box um is an incredible demo. A lot of the valve demos are really good where you have room scale. Um, one thing I'm excited about is this is this is these demos have been available, you know, for kind of non-public trials, um, they'll finally be public. And even if you know, only I don't know, a million people get these devices this year, um, maybe 10 million will get to try it, and you know, some s significant subset of those micro start companies. Um and so you sort of have this really interesting period happening. Um but um but maybe yeah, maybe we can give a sort of a flavor for what um these the the demos feel like in the high end and low end.
4:34 Speaker 2 I think the really critical difference between low and high-end is that the high-end VR actually achieves presence. So you feel like you're you know, it tricks your lesser brain to think you're actually there. I think with mobile are not quite there yet, so it's it's a little it's sometimes Yeah,
4:46 Speaker 1 it's kind of so when you say presence, that's a that's a term of art and VR, which refers to just kind of what people have found through empirical testing, is just that once you get sort of there's a threshold, a minimum threshold of kind of enough of your senses are tricked that you just you sort of use a bit flips and your brain says I'm now in this virtual world
5:08 Speaker 2 as
5:09 Speaker 1 opposed to I'm standing here looking at a uh screen. Right. So mobile VR, it's it's the spixelated video, it's um
5:17 Speaker 3 interactive
5:18 Speaker 0 experience that's kind of game-like and has graphics from the late 1990s video games or maybe you know PlayStation 2 uh right when it first came out. Um and then you work your way up the spectrum and you have these higher-end uh headsets that do give presence. And now kind of the discussion is around uh okay, so positional tracking, you're seated, but it's you can move your head around and you feel like you're there. Okay, that's great. Now let's start talking about standing up experiences and room scale. And when we talk about room scale, we're talking about Oculus Rift with several cameras and it can track you as you move around in a let's say three by three or five foot uh by five foot space, and you it's almost like having like you can interact with parts of the room around you. And then you graduate up to you know what we would call, I guess true room scale, which is what you have from day one on the HDC Vive, which is it has sensors that you place in the corners of the room, and you can have up to 15 by 15 feet space, and you can actually walk.
6:14 Speaker 0 Oh, I'm gonna go look at that thing over there and actually physically walk over instead of using a controller to move your avatar.
6:21 Speaker 1 I mean, this is one of the important things I think when you've tried these things, like some of the critics, most of whom I think haven't tried the high-end VR, compare VR to 3D TV. Um there's you know, with the low-end devices, it is a little bit like 3D TV, and that you have just a sort of, you know, you have this parallax effect, but it's only for far away, it's for far field objects, right? With the with the high-end, you actually are able to like literally walk around like this, you know, you're sculpting something like in the medium demo or in one of these. Um you're sculpting an object that you're actually able to walk around completely, and it just feels like that object is there. And the and it feels like that in a very um intense and um uh you know, kind of um Yeah, I think
7:02 Speaker 0 about
7:03 Speaker 1 it in terms of
7:03 Speaker 0 like marginal change in experience, where if you're looking at mobile VR, it's a step up from the kind of video where you move your phone around you. Um but it's still at times can feel gimmicky. It really depends on implementation, but it's not that revolutionary of an experience. It's a teaser. But then when you move up to okay, software as this world I'm stepping into, and you know, you one of the kind of frequent things you'll see that you know where people who were skeptics came out and pressed was they thought to lean against a virtual table to you know look at something even higher, or they thought to put uh their controller down on a uh you know a uh virtual couch, and they forgot that it wasn't real. Um that's kind of where you start to hear just like the hints of oh, this is why it's so powerful.
7:48 Speaker 2 I think one thing that's interesting is that in VR, because of this threshold is so binary, uh, all of the technical problems are about getting over the threshold. So whether that's in capture or rendering or any of the even the headset technology, um it's really key to have like be over that threshold to get presents. Aaron Powell
8:05 Speaker 1 So let's talk about the the unsolved problems in VR, because the so the big companies are working um primarily it seems on headsets um but there's a whole kind of chain of of things that need to be built out, including content creation. Um you know what's going on there?
8:22 Speaker 2 Yeah, so with um so with tools, it's like as a debate whether VR content is either going to be captured from a camera or whether it's going to be rendered like a video game, or whether it's like like films are today, it's gonna be a mix of both. But um despite whichever one is ultimately becomes the winner, like still the tools need to be built out. So right now it seems like most of the people doing VR content are using game engines like Unity and Unreal, or they're gravitating towards 360 or light field video, and so those seem to be like the main categories for creating.
8:54 Speaker 1 But there's all sorts of uns I mean, there's companies working on it, but there's a lot of work to be done, right? Like there's a lot of opportunity for new things, like for example. Um like, you know, it's a difficult compression problem, for example, but there's a ton more data than you normally have.
9:07 Speaker 2 Right. Like you like light field technology is is like an emerging field. Can you can you
9:10 Speaker 1 explain what that is?
9:11 Speaker 2 So light field is um it's a way of capturing video, which also takes into account the angle at which you look at an object. So it's more similar to a hologram than the three than uh than the video. So um but you know, as you can imagine, if you capture more than just um, you know, your view, you have to capture an object from all different views. That's a lot of data. And so that's really overwhelming for the current video streaming infrastructure that we have. So it's gonna be a way to make that smaller, um, easier to capture. Also edit, because it's you know, it's very different from what we have. And then
9:42 Speaker 1 there's like, so for example, like you mentioned how movies today are a combination of filmed and rendered content. Like one of the demos I saw was you're at a basketball game and they're real basketball players and it's filmed, and it's filmed in ideally in Lightfield, so you have a full 3D and you can move around and it feels like you're there, but then you're sitting next to your virtual friends. Right, instead of sitting next to strangers, you're sitting next to your friend who actually is in you know, my friends actually in Moscow and Chicago and whatever. And but we're all sitting there, and so there's part of it is sort of this real thing, and part of it is virtual.
10:13 Speaker 2 Right. It's like the like the space jam type mixture of
10:16 Speaker 1 the R. How do you do all of that? It's a very hard problem to mix all of that and lots of different tools.
10:21 Speaker 2 There aren't tools yet. I mean, even the other thing with you know creating VR um movies and films and games is that performance is so important because we have to be above this presence threshold. So you need a really, really high-end game engine to be. Which
10:35 Speaker 1 is basically 90 frames per second, like is what Oculus is running, right? Which is higher than than most game consoles, for example. And movies. Aaron Powell
10:41 Speaker 2 So it's it's just a higher threshold. So if you're doing a film, you you know, you can take as long as you want to render it. So it's like a different type of tool chain, which will probably be needed there. Aaron Powell
10:49 Speaker 0 And even if you're not talking about light fields, if you're just talking about traditional video, but you're stitching together 360 degrees worth of footage captured on what are essentially you know like the old fashioned Google Jammas. Like the
11:01 Speaker 1 Trevor Burrus, Jesus.
11:01 Speaker 0 So Google Jump was a collaboration with GoPro where you're taking a set of, you know, let's say 15 GoPros and then stuff sticking them into a rig and then stitching the video from all of them together. Um, 15 cameras worth of 4K footage is a ton of data. Uh the tools for stitching them together in a way that doesn't have really stark lines between the different cameras they capture, uh that is actually a pretty tricky problem solve. And then when it comes to as Saku mentioned, streaming, um even streaming one 4K video is really intensive for most people's uh data connections. So you're starting to see really clever solutions where you know you look at how people transcode video today, uh they'll have let's say uh high and low-end versions of views, like say you have uh 360 degree video, they'll break it up into 30 different views, and as you look to different places, it'll switch to the high resolution stream for that specific way you're looking.
11:55 Speaker 0 And so you have to have on the back end stored all 30 of those different views and then have uh a system that can switch between them quick enough that your connection can keep up. And that's you know, Facebook has recently open sourced their efforts on it. Uh Next VR has done some really interesting stuff for their live streaming of sporting events, but there's still a lot more work to be done in terms of uh tools to do that for live events and also just to continue to improve the quality and make it so that you know you don't actually have to be connected to your home Wi-Fi on a gigabit connection uh to have like a perfect experience. Aaron Powell I
12:32 Speaker 1 thought one of the coolest things I saw lately was at Unreal video, um which was uh a demonstration of using VR to actually create 3D content, right? Because I think the the metaphor people are the assumption people had made kind of before was you would use uh 2D screen with Unity or Unreal Um create 3D content the way we have always have and then export it to VR, right? And this idea actually inverts that, right? And you're creating in 3D, maybe even for a 2D um uh maybe even for content that's ultimately consumed on a screen, or maybe something in the real world, maybe you're making an airplane wing, right? And if you think about using AutoCAD today, like it's a very it's a very difficult thing for people to learn who aren't experts in 3D modeling because you're having to work on a 2D screen. And so the idea kind of Ironman style that you can work in a 3D environment, I thought was very, very exciting possibility.
13:23 Speaker 0 Like that's what's interesting, in terms of talking about input, you know, uh it's a new paradigm and it's tricky to develop for, but you look at a mouse and it's uh it's a motion tracking like hand controller that only works on a plane. Yeah and so you're like if you put it in those sense, it's like, well, actually, that's kind of a really awkward way to interact with lots of things. Well, and you've got and
13:40 Speaker 1 the thing is you've got millions of people who use AutoCAD using this this 2D hand controller, the mouse, this just primitive 2D hand controller, right? And they've learned over years going to school and everything else how to do it. And those people, by the way, would be happy to pay, they pay thousands of dollars per you know for their rigs, tens of thousands of dollars for their machines and their software and everything. Like they'd be very happy for a high-end cat. I think CAD, for example, just no-brainer is going to move to uh VR in the next couple of years.
14:06 Speaker 0 So to help visualize what this looks like for people who again who haven't seen these videos or tried these experiences. Um imagine you know you're building a replica of your living room and you have a selection of couches and sofas and TVs and fireplaces that you could drop into the uh room to build it up to look like your room, and you want it maybe the scale isn't quite right. You could you know pick up your couch with these motion tracking controllers and then use essentially 3D pinched to zoom to rescale. And it feels much more naturalistic than messing with parameters or you using a mouse wheel to adjust how big something is, pressing command plus plus plus until it looks kind of right. Aaron Powell
14:43 Speaker 2 Yeah. And I think it it might be the right time now for these kind of prosumer tools because you know, real VR isn't going to reach most people for a couple of years. And so it's not going to be a mass market thing until then. So it might be the specialists who have a real need for these tools who might want to use it in the next coming years.
14:58 Speaker 1 Yep. People people just this assumption that it's all going to be gamers, I think is just is highly to me is highly questionable. I mean we could very well be business users like this at first. Aaron Powell So one question is are the problems that need to be solved? Are they are we on a clear trajectory to solving them, or are they like is there fundamental science to be done? Uh or is it just kind of like Moore's Law and bandwidth will get better and devices will get better. Are we on a clear path
15:21 Speaker 0 to um these things getting much better? Aaron Powell I'd say there's two sets of problems. There's the ones that we've been talking about, which I would say are very much so just engineering the snot out of them until you have this an interface that actually is preferable to what we're all used to. There is
15:35 Speaker 1 And that's gonna happen. I mean, it's a lot of work involved, not gonna not to disminu diminish that, but there but it's it's a it's a standard hard engineering problem that we've that the community has solved before.
15:45 Speaker 0 Right. I mean you know, we are constantly looking at the space and no matter what category of problem you're looking at on that side of things, it feels like we're seeing regular improvements. Aaron Powell
15:54 Speaker 2 Yeah. I would say like a lot of the problems in VR are tied to the performance of GPUs, and those are on a Moore's Law style exponential curve. So that's everything from processing light field video, which is a big problem, to just the performance of games and just you know rendered experience in VR. And like that kind of speed is also part of it. Aaron Powell
16:12 Speaker 0 If you want to talk about problems where uh it is actual hard science, that's kind of where you're talking about the treating virtual reality in terms of actually a reality where it's tricking your brain and making you think it's a real one even though it's fake. So that's things like having a field of view that fills your entire vision and doesn't just you know look like kind of a box that or you know, looking through a pair of swimming goggles uh and seeing this virtual world, but making it look like it's an entirety of your world. Or things like how to what extent do we need uh to trick the brain to have interesting haptic feedback to make it feel like when you touch something in the virtual world, you know, you yourself can feel it, whether it's gloves or a body suit, or if it's a clever trick, you know, we've seen some things where it's uh you wear kind of like a bracer on your arm and it taps you in different places and because of the other sensory input of sound coming in, things that you're seeing, having that extra tap, your your brain kind of fills in the rest of what that sensation was and uh you know makes you think that you interacted with something it brushed against you.
17:10 Speaker 0 Um that really is a hard science problem. And that's where you see like Michael Abrach come on stage and talk about uh you know illusions and how we trick the brain. Those are things where you know over the next 10 years, it's kind of hard to predict where we'll go, but it's probably gonna be really transformative and go way beyond really what we're expecting today. Aaron Powell
17:29 Speaker 2 That's true, but I think those things are kind of outside the really important problems that need to be solved. I think you know, if you just had VR uh you know, very high quality headset with vi good visuals and a good controller. I think people would with you know like I think they could live with that without having the haptic feedback, but that that's just my
17:47 Speaker 0 I think that's very true for especially for these early use cases. I think that the hard science things are coin are going to be what lead to the totally unexpected use cases that we're all going to be used to ten years from now. Aaron Powell
17:59 Speaker 1 One obvious use case for VR is games, and we've seen a lot of companies that are making games and there will be a lot of great games on VR. Um and that might propel some of the early adoption. Um what are some of the other you know potentially interesting apps? Aaron Powell
18:12 Speaker 2 Yeah, I think um live streaming of events is gonna be like a really popular use of the same thing. So sports and music. Sports music. It might even be that you know, after this becomes popular, you have events which are thrown for a mass audience at once. Um participation on the Trevor Burrus
18:29 Speaker 1 We saw a demo which is like um uh point cloud capture of mixed martial arts. So you have like you can basically re-watch the mixed martial arts fight and um walk around in the arena like you're the ref and like rewind it and see the whole thing. And
18:44 Speaker 2 same thing in extreme sports, like you know, you ski down the mountain or
18:48 Speaker 1 I'm not uh personally into sports, but I could imagine people that are, it's pretty awesome. I mean, you see like the you watch like the Super Bowl and just like the new camera angles they have and things, it's just like that times 10x. Aaron Powell
18:58 Speaker 0 Yeah, no, and this is something where you'll talk to people in the NBA or NFL and you see on TV when you watch broadcasts, they'll do every hour or two, you'll see uh they'll take a really impressive play that happened and zoom in really close and turn around with like a matrix when you know dodges the bullet that scene where you go around and you zoom in and see like the interesting angle and how intense the face was on the guy who did it. Um right now they can that takes like an hour of processing to get one second worth of footage. And you know, over the next couple of years, as volumetric capture kind of you know, it's invested in more. Um, you know, new breakthroughs happen because people are really paying attention to it because of VR arising. Um you'll start to see just events entirely recorded that way.
19:44 Speaker 0 Um other interesting things in terms of content. Uh and this is where again the blending of real world via light fields and rendered content and something that lives in a video game but looks real. Um the idea of and this is something that's also talked about with augmented reality, though, is like recording. Recording someone doing a task and you get to observe them doing it in also in a virtual space. And you could have that for repairing a car, let's say, where people uh today will record you know set up their iPhone and record them changing the oil on a car and then put it on YouTube. Now you could set up a VR camera right under the hood and say, here is exactly what you need to be doing, and here's the perspective that you'll have as you're doing the task. Um I think that that kind of thing, again, like maybe in terms of user-generated content, we're a couple of years away just because there's not quite really great, you know, uh pro sumer tier couple hundred dollars or a few thousand dollar cameras that make that easy.
20:41 Speaker 0 But I think that that's gonna be a big use case is um not so much like, hey, here's you know, uh video of me out at the park with my dog, you know, as random things that people put on YouTube. Um but things where you know you want to share an experience, whether it's something cool you did or you know, a skill you have that you think is worth sharing with the world. That seems like something for VR where it'll make a lot of sense as that capture becomes more available.
21:08 Speaker 1 It's funny, you know, if you go back and you read about like when early PCs, everyone was trying to figure out what would you do with them. And they always talked about um recipes for some reason. That was always the thing, which turned out to be kind of useful on the web, but you know, not like the ki the only use case for computers for sure. And then with mobile, it was always these things where you could check uh the stock market and the weather. That was what people thought would be the use case. And like and so I think games are sort of that version of VR where everyone thinks is games and will kind of look back and laugh. I mean, I think it's basically my view, I mean, this is the obviously optimistic view is that it's basically anything where you'd want time travel or teleportation, um, you can now do in VR, right? So for example, I think like Ocean Rift is a really cool app in you know, you can use on Oculus, um, which as a in the old paradigm of of staring at a rectangle across the room would have been really boring.
21:59 Speaker 1 You're just swimming around the ocean, right? But in VR, it's like I'm under the water, I'm in the ocean. There's a shark. And like it's when they show you a shark, for example, they they you can only see the shark when you're in a cage because it's like super intense and scary if you weren't in cage. And so um it's an example of just like the kind of thing which, you know, I think for example instead of kids reading a really boring textbook about ancient Rome, like, hey, let's go watch them build an aqueduct or something, and like it's just so much more interesting if you could go visit it, right? Like school education will be just vastly more interesting. Um hey, instead of talking on the phone or whatever, you know, texting each of your friend, like let's go virtually sit together and watch um I mean that's actually one of the problems of VR, right? Is that like from the outside it looks so antisocial, yet from the in it's one of the technologies that the that the the contrast between what you're experiencing and how you look from the outside is is is more heightened than anything else because it looks like you're you know the zombie sitting in a um you know in it in like a in a chamber or something, but in fact inside of it, you're like it's the opposite.
23:02 Speaker 2 Yeah, I think one thing's really exciting is like what the descendant of like MMO games will be in VR. So it's like you know, in World of Warcraft, like how the attraction for a lot of people is like going around with that guild and like being a team.
23:14 Speaker 1 Yeah. And
23:14 Speaker 2 you know, in VR, you take that to the next level. You can go have like a whole village and you can all live in this in the game and just have like it's for people to dream up what's gonna be in that game. Aaron Powell
23:25 Speaker 0 And people, you know, you look back uh a decade and a half ago when like Second Life first came out, and people were on really bad broadband connections or dial up and they had really basic looking avatars and still hundreds of thousands of people you know were living virtual lives. They had virtual currencies, they were making different virtual objects that they would share with each other and pay m real money for. Um it's just not even a step change, it's a huge exponential change compared in terms of experience with what you could get uh even with today's VR hardware if you you know really had the back end infrastructure to support it and came up with let's you know a couple of use cases where you know that would bring you back every day. Um it's also interesting to think of even business use cases where I think we've all had difficulties with Skype or Google Hangouts or any telepresence uh experience where um you know either the connection was bad or uh you know you could see the other person like checking their Gmail window while they were talking to you.
24:26 Speaker 0 Um I think we're only a couple years out from having things where it's tracking the muscles on your face, tracking the movement of your eyes, where your avatars could really reflect what you look like at that time. And you could do things like have an entire meeting where eight different people are in you know different locations, but they all feel like they're in the same conference room and they're looking across the table and meet m matching each other's eye contact, and you can just have meetings that are much more effective than you would have over the phone or over you know uh video over IP. Aaron
25:01 Speaker 1 Ross Powell It's interesting because you know the internet supposedly was going to make distributed teams work so well, yet you know, still so many teams are not distributed and find that doesn't work. And one hypothesis is that it's just because you've we've we we haven't been able to sufficiently recreate all the important things of of kind of interpersonal communication that happen um in real life, but might might be on the threshold of being able to do that. Sort of the intimacy is you made like the making eye contact and you know, you think about why do salespeople fly across the country to close a multimillion dollar deal because people don't write multimillion dollar checks until you make eye contact and have this dinner and there's sort of this emotional component to a lot of um a lot of uh work um uh activities that just can't be captured on the with current communication technologies.
25:49 Speaker 1 Aaron Powell
25:50 Speaker 0 Yeah. And you know, I think you know you mentioned Toy Box earlier, which is an Oculus Rift demo where uh it's you with the Oculus Rift and the two touch controllers which track your hand movement, and another person in another room, maybe you know, down the hall or in a different building or wherever. And just with today's tracking plus the microphones built into the headset and the fact that they're headphones um built into the headset that are pretty high quality. Um even without an avatar that looks like you, it's just like a translucent head and you know the hands that pretty much approximate how you gesticulate while you talk, it feels like you're there with the specific person you're talking to. That was one of the most
26:30 Speaker 1 surprising things to me about
26:30 Speaker 0 the
26:31 Speaker 1 demo was how how it really felt like the person was there. Um you just can't unfortunately you just have to try to feel that. Right. It's just you can't convince skeptics without trying it. But
26:40 Speaker 2 it's actually quite amazing how this all you need to convince someone's that that so like um I remember saying one Oculus Tem it was cool, like nightclub or something. It was really just your cube and your friend was a cube, and like you could just move your head and then that cue would rotate. But it even then
26:56 Speaker 1 because the motion was so accurate. Right, because the motion was so accurate. And the sound matters a lot. You know, that's one thing we can replicate perfectly is three-dimensional sound, right? The technology is there for that. And so those things matter so much. Aaron Powell
27:07 Speaker 2 Right. And then the big technical problem for social VR is this kind of back-end infrastructure, the same technology they'd use in multiplayer games, which has become really important now.
27:16 Speaker 0 Right. If if you're going to have this metaver metaverse from science fiction, how do you have tens, hundreds, thousands, maybe millions of people simultaneously in a world, do you have instances in like in World of Warcraft where people are you know could reach each other, but for the most part you're in like an area that only has a hundred people total. And you know, if you go to this other area, then you know you load onto a different like part of the server and you know, or do you have you know something where it's simulating all of it and there's you know different shards where you're breaking it down into smaller bits. Aaron Powell
27:48 Speaker 1 We have yeah, we have an investment here in probable, um, which is I think of as um you know, if you read Ready Player One, which hopefully the listeners have read, is uh canonical VR book. Um the uh there's a section where they describe the system called Oasis that's in that's featured in the book, um, and there's two parts of the system. There's the headset and then there's the back end infrastructure, which lets you create these kind of unlimited um virtual spaces, and that's something which needs to be created. Aaron Powell
28:15 Speaker 0 There are other facets that are maybe less pressing, um, but will also lead to really interesting possibilities. For instance, IBM just announced that they're going to try to use Watson to provide uh basically an AI interaction system for a game based on an anime about a VR MMO. Uh so the idea there is um you'd be able to interact with characters in the game, kind of like how in games, let's say from Bioware, where you can ha choose different dialogue options and get different reactions based on how your response was, you know, was it aggressive or were you trying to be conciliatory? Um you could have things where you actually talk to that character and it tries to read what you're saying. Aaron Powell
28:55 Speaker 2 Yeah. This is probably why Amazon actually just released a game engine, because which has connections to AWS. So they I guess they want to they the plan is to have that as the back end or at least be part of it. Aaron Powell
29:07 Speaker 1 So let's talk a little bit about augmented reality. Um you know, which which um uh there's things like Microsoft has the HoloLens, and then there's companies like Magic Leap. Um, you know, and and that's some people are more excited about AR than VR. Um I think you could argue that there's a spectrum, right? That they're not as sharply distinguished as people say in the sense that you can you know, VR will very soon sort of scan the room around you and put you back in the room and add things onto the room, and um and so really it comes down to sort of there's a mixture in what you're viewing between what's real and what's virtual and the one extreme is it's all virtual, the other extreme is nothing and it's all real, and then there's stuff in between. And so what do you guys think about um about what's gonna happen in AR in the near future?
29:56 Speaker 0 Well, uh Microsoft actually uh at TED just announced that they're Delaying the consumer release of HoloLens. So they I think realized the date
30:04 Speaker 1 is to
30:05 Speaker 0 win. No. So they're going to continue with their basically like for enterprise slash people who want to develop early augmented reality applications. They're going to sell a $3,000, you know, the equivalent of the Google Glass and uh Explorer Edition one to just experiment with. And then I think they realized that they needed to have kind of uh kill uh at least one killer app for consumers. You know, a use case where you buy this thing, whether it's a thousand dollars as a consumer product or actually goes all the way up to three thousand, who knows. But something where you'd actually want to use it as a consumer. Um I think that that's kind of reflective of the rest of the space, and that it doesn't quite feel like there's any applications today for regular people where it makes sense. There are some things that feel compelling.
30:52 Speaker 0 Well,
30:52 Speaker 1 it's a harder technical problem too, though, because you have to to be able to put a virtual object in the real world, you have to interpret and understand the real world, right? Which is a hard machine vision problem. Trevor Burrus, Jr. Right.
31:02 Speaker 0 This is falls into uh kind of the class of technology is slam, simultaneous localization and mapping where you have to be aware of exactly what the room looks like around you and then constantly be uh checking where is the headset and therefore the viewer in relation to that room.
31:16 Speaker 1 Well, and where is the ver and if I have this virtual soda can I have to know it's a real table and the table can support it and the physics are right, and there's a whole set of problems that are that are uh in addition to what you need to do for for regular VR.
31:28 Speaker 0 Right. So you're doing the compute of rendering what that virtual object looks like, and then you're also doing that slam work of figuring out where it should all be. Um those are both really hard. Um that said, it's it feels like there are some you know potential enterprise use cases. Again, going back to the training example, um while training in VR is compelling, the idea of uh being able to have something overlaid on top of the task you're trying to do, pointing out how to do it. So you're fixing an
31:53 Speaker 1 airplane engine and overlay it on the engine is is like the instructions for how to do it or whatever the right. Or maybe
31:59 Speaker 0 it has uh, for instance, with the whole Internet of Things trend, there's sensors on everything. Maybe it's constantly giving you a readout of different sensors, so you know, oh, I just turned this uh crank and it actually you know raise the pressure too much on that dial. Um I should actually probably bring that back. And you can not know all of that in real time. Aaron Powell
32:15 Speaker 2 I think one interesting thing about AR versus VR is if you know VR is you can only spend like a a small fraction of your day in VR, um perhaps. So but I guess with AR, the potential is you can have it on all the time. And perhaps that's what gets people more excited about AR and VR. But whether that's actually gonna happen, that's actually how it's gonna play out is really debatable. Aaron Powell
32:35 Speaker 0 And then there's certain things where at first glance it seems like something is a use case, like the idea of 3D modeling, but having it short the model sh flows next to you in the real world and you can look at it from different angles. That is kind of compelling, except for the way, you know, what's nice about editing that all in VR is you get to see the final context of what you'd have that model in. So if you're building a game world, for instance, you could see how that model fits in with lighting and you know the particular shaders that you're using. Does it match the rest of the environment? Whereas just having an arbitrary 3D model floating around may not actually be that useful. Aaron Powell
33:08 Speaker 2 Right. And the other thing is like the upper bound for how much time you can spend in VR is how much time you spend looking at screens anyway. And that's I would say like maybe 20% of your working out waking hours is not unreasonable. Aaron Ross Powell
33:20 Speaker 0 And you could say that you know what what makes mobile devices like smartphones so powerful is it can fill kind of the empty times throughout your day. It's you know, you're not sitting down for uh you know, okay, now it's Facebook time. I've got an hour free, I'm gonna go on Facebook. It's no, okay, I'm between tasks. I was walking to the bank, but it turns out there was 20 people in line, so I'm gonna go check my updates and maybe send a snap. Um whereas you know, with VR, you're not gonna fill empty time. AR, you know, the case could be made that you could use in that way.
33:49 Speaker 1 Aaron
33:49 Speaker 0 Powell
33:49 Speaker 1 As fans of VR, what do we hope um happens in 2016?
33:55 Speaker 0 Uh well a recent
33:56 Speaker 1 announcement that got
33:57 Speaker 0 me really excited for uh what's gonna happen in VR in 2016 is the idea or uh that Samsung is going to be providing uh gear VRs to the first 300,000 people who um order a Samsung Galaxy S7 uh through their site. They're gonna be uh doing a similar offer for people who buy through other channels. So we're gonna see potentially millions of people get uh VR headset for free in the next couple of months. Um and again, while that's not kind of the ideal of what we consider you know, VR what VR experiences should be. Uh your VR is enough of a taste of what VR can be like at the n you know at the high end when you have a comfortable headset that you're not holding up that you know sits on your head and you can play some games, you can watch some videos and be pretty comfortable. That's exciting just because people will understand, oh, this is possible.
34:46 Speaker 0 Um I would say at the higher end, what I'm really excited for is to see both how Oculus Rift and Vive do. They're launching at a fairly high price, you know, $600 for the Rift, $800 for the Vive. Um but they're coming as if you've already tasted VR, it's a pretty compelling bundle. Rift coming with you know a game that satisfies some hardcore people with evalky, but also you'll be able to show it to your kids with uh Lucky's Tale, which is like a Mario style platformer. But then on the Vive, they're gonna have these experiences that really take advantage of room scale. So things like job simulator, where uh the idea is you're in an office and you can do a bunch of like silly behaviors. Uh but the it's basically, you know, you if you went into an office and could do anything and there were no repercussions, you know.
35:33 Speaker 0 It's like
35:33 Speaker 2 Grand Theft Auto for offices, right? Yeah, it's
35:36 Speaker 0 it's mundane Grand Theft Auto. Um just looking at the different, you know, the doors that will open up in people's minds and understanding what's possible. I don't think that either of them has to do particularly well. You know, we don't we won't have to see a connect style 10 million units in 60 days. I I don't think that's gonna be the case, but it's going to make a lot more people understand where it could go. Aaron Powell
36:00 Speaker 2 I guess the main thing is um the I was like what kind of games are gonna be on VR because that is the initial market, right? And so this year it's gonna be all about gamers. And I mean I'm just curious to see what the VR content will be like and um whether you know people are gonna get really excited about games, and I think that would be really good for VR if if uh people really want to play these.
36:22 Speaker 1 I think the key for me the key metric is not number of units sold um on the high end, it's the number of demos given kind of like it's how many people get to try high-end VR, which I just think will create a whole new wave of um excitement and and new companies and new content. And so, you know, this is the year people finally get to try what we're talking about. Um I've I have yet to see anyone I I've seen a number I love this the ones that just went in Gizmodo last week, and there was one time before of like the most skeptical people on earth who finally try the high-end stuff and they and universally get converted. And so
36:59 Speaker 0 the third paragraph is generally an apology for all the things they've said. Aaron Powell I made
37:03 Speaker 1 fun of everybody, I thought it was so dumb, it was 3D TV, and I just tried it and oh my god. I think I hope 10 million people will be saying that this year. That's my hopeful.
37:12 Speaker 0 So this is where the fact that it'll be in you know, the Oculus Rect will be in Best Buys starting in April. That's really exciting. The challenge there is having a quality demo in terms of you know, these are brand new experiences and people generally need a little bit of guidance when they're gonna be able to do that. You need to train the sales
37:28 Speaker 1 people and everything else.
37:29 Speaker 0 Yeah, and that's where will you get salespeople that truly understand like here are the pros, you know, here are the best kinds of experiences you're gonna have, not overselling it and you know, convincing people they're buying a matrix rig, but saying, you know, you're gonna it's gonna be like a gaming-ish experience, but you know, more immersive than anything you've ever tried before. You know, having this uh practical, kind of balanced approach to selling it. Um that's kind of a big unknown about how well that'll be executed on. But even the fact that it'll be available, you know, there's going to be a whole new class of early adopters who just haven't been able to go to E3 or the game developers conference or Oculus Connect, who are finally like they will go out there and they will find an Oculus Rift and they will try it on and they will be sold. Aaron Powell
38:14 Speaker 2 The other thing is um this the year that Creates is going to figure out what exactly to do with VR. Like we've already seen like a lot of progress um in the film, film and gaming community of like how to tell stories, um, you know, how to edit um like good music videos or games or like short film. And I I think we're just gonna see more of that. And that's just another thing which is gonna convince people of the potential of VR and um figure out the medium. Aaron Powell
38:38 Speaker 1 All right, Sakun Kyle, thanks a lot. Thanks. Thanks.
Previous Company Building in Crypto: A Conversation between Brian Armstrong and Chris Dixon Next What's Next for Education Startups Page updated August 25, 2026 · transcript and summary are machine-generated