HoloLens 2 AR Headset: On Stage Live Demonstration

today I can show you something very special, it's something we've been waiting for for many years when we set out to build Holland's: we wanted to create some things that you didn't need to learn how to use, you should just know and we call this instinctive interaction, let me show you now, Alex mentioned the Holland's - it's very comfortable, it fits like a hat and the only thing that's even easier is the automatic login time with Windows Hello and RS syndication, the

hololens

- it's In fact, when I log in when I place my device, the holographic lens not only recognizes me, but also recognizes my hands.

Look at this fully articulated hand tracking and as I move my hands around Holland, it's actually calibrating itself to the unique size of my hand. Of course, Holland not only recognizes me and my hands, but also recognizes the world. Welcome to my mixed reality home. This is where I have all the apps and content I use every day. Let's look at some of them now. I've seen a lot of people put on Holland for the first time and the first thing they do when they put on the device is put their hands out and try to touch the holograms and now you can see the way the hologram responds to my hand. almost inviting me to touch it and I can actually grab this corner to resize it or I can rotate it or move it, that's right, we're touching Holograms, this is enough.

I called it spatial, let me put it right there. I have another app here called view for some of you. Now it's a little big, so let me use two hands here to make it smaller and then rotate it so you can see where we're going and then let me put it here in its space. maybe make it a little smaller yeah, that's fine, now let's switch gears and talk about a different type of application. I have a navigator there, but it's a little far and I don't really want to walk there, so let me. call it with my voice follow me this is a browser that runs microsoft teams which is a tool we use at home to collaborate let me see what the team has been working on ok it looks like they have a surprise for me in the gaming app i just have I have to say that the words show surprise so let me open the Start menu here and then put the application and then launch it, so now we will leave my mixed reality house and enter an immersive experience, but Please note that that browser in the one I really followed now, this guide should be really helpful and has things like emails or PDFs that you need to refer to while you do your work.

I really don't want him to follow me around all the time. I'm showing you all this cool stuff, so let me put it here and then we'll get back to it. Welcome to the playground where we spent years exploring and refining interactions for Hollande, and the playground is just a small sample of the Many of the prototypes we build, test and learn from our approach is to basically try as many things as We were able to and search for the ones that stood out, so for example, here I have three sliders, each one of them controls this wind farm simulation, but each one in a different way using a different interaction technique one of the things we tried it's this touch slider here, so here I could just stick my finger on the slider and so go to a particular value to control the wind speed, it felt good there.

We also tried this push slider, so this guy was pushing from side to side like he was an abacus, which was interesting now, the interaction that really took the cake was this pinch slider. The way it works is you just pinch it and move it. wherever and what we found was that people really like that tactile sensation of their fingers touching as they grab and then release and across the board for all interactions keep the auditory and visual feedback like a grab and then release motion, We're all really critical for this experience to stay connected oh, this is so satisfying.

I can't wait for you all to try this right now, let's move on to a different type of control buttons, how do you press the buttons on Hollins? Well, it's just enough. One interesting thing we discovered about buttons was that the size of the buttons actually impacted how people interacted with them, so for example, for the smallest one most people would use one. or maybe two fingers, but for the bigger ones. Almost everyone uses their entire hand and this is interesting if you think about it because these objects don't actually weigh anything, they are just digital things, but despite that, people treat them like real things, almost as if the biggest one had more weight, I just love the way they move and the sounds they make when I press them, it's great, how about something that uses all ten fingers well to try it out?

We built the piano, so here I can play a chord or I can. Play the keys one at a time, where's that surprise the team had for me? Oh, that's right, I had to say those words show surprise mmm, look at that bird clapping there, it's beautiful, I wonder if it will fly to my hand, yeah. Oh wow, this is beautiful. I love the way it follows my hand. I have to tell the team that they have done a great job and in fact, I don't even need to use my hands to do this because I can.

I use my eyes and my voice, that's right, Holland's two has eye tracking, so I could just look at this browser here and look at the bottom of the screen to scroll and then send my message. Start dictation. The hummingbird looks great. Exclamation mark. So this is it. what we understand by instinctive interaction combining our hands, our eyes and our voice, the two from Holland work in a more human way today, the companies that address the world's biggest problems are increasingly spread around the world and the holographic lenses allow us to work together as if we were next to each other face to face to show you how that works, let me do a special move here with my Hollens to materialize the hygena room i Anand Hello everyone, it's great to be here on

stage

holographically.

It's great to have you here, Jenna, can you tell everyone? a little bit about what you're seeing, sure I can see your realistic avatar that we generated in seconds from a 2D photo and we can walk around the

stage

with spatial audio and use all this space around us to collaborate as if we were all here . together in the same room, great now to show you how companies are using space to transform the way they work, let's invite Gurjit CTO of the iconic toy brand Mattel to the stage. Hey guys, how amazing is this, so at Mattel we are going through a huge digital transformation is impacting every aspect of our business, this includes the way we use technology to design and develop our products, our classic brands like Barbie and Hot Wheels and Fisher-price.

They have diverse teams of designers, engineers, marketers and manufacturers that are spread all over the world, they can now meet in one space project room, minimizing the need for travel so that everyone is on the same page when we develop toys like this. Rescue here. A fire truck. Here we can set. creating dynamic content on virtual walls like this power point for example or videos or even concept art teams can now quickly exchange ideas and create a shared understanding to find potential problems much earlier in the cycle for example guys check this out wheel clearance here. oh yeah, I can see that's going to be a problem, so I can pull out my space phone app and write a quick note and then just hit send and it turns into a digital sticky note that I can take and stick right on the truck of firemen, so we can have engineering check us out later, we can also use a space mentor earlier in our design process for id8 and generate inspiration, okay guys, let's think of some ideas for a line of water toys, yeah, shall we?

How about sea turtles? Oh, that's really cool, let's try sharks. That's great, how about jellyfish? All we have to do is say the words and they are instantly displayed before our eyes. You can even click on one of these packages and they expand it to a full internet search with images of 3D models. and web pages, but you know why we don't click adjust the images here so we can get some good inspiration for this new aquatic line mm-hmm, make sure that every object you see in the space is physical and tactile so you can move around or pick it up. images that you like and throw them on the wall with physics and we don't have to stay only with digital content.

I can actually pull up these sketches I made on my phone last night using that same space app. I just take those photos and Press Send and they will instantly transform into this digital environment. Nice drawing, it's very easy to complete your roommate idea, so we created a tool to help you quickly organize all these ideas, so let me select them all and let them read if it works. stuck to the wall, now this entire room that we have created is a persistent digital object that anyone can access or contribute to at any time, whether they are using an AR or VR

headset

or even a PC or a mobile phone, so right now we can have virtually rich visual rooms that we can maintain for the life of the product, which means we won't have to tear down war rooms all the time, so spatial and

hololens

es help us drive improvements in our process of digital design and development, changing the way we create new toys by bringing people from all over the world together to collaborate in the same virtual room.

We are overcoming a natural barrier to our collective success: people's desire to interact directly face-to-face to build engagement and trust. We are very excited to see faster times. -reach the market and reduce the need to travel, as well as many other benefits that we will generate at Mattel as we collaborate on mixed reality.