YTread Logo
YTread Logo

Hololens 2 - TWiT Specials 337

Jun 01, 2021
gasps you love from people you trust this is true this is

twit

live special number 337 recorded on Sunday February 24, 2019

hololens

- hello everyone welcome to our studios early in the morning for us here it's almost 9:00 am. Midday Pacific East Mary Jo Foley joins us from New York from all things Microsoft Fame and Windows Weekly Fame hi Mary Jo hi leo and we're going to go to Barcelona where it's six past seven in the afternoon, yes, six in the afternoon late and the Mobile World Congress that Microsoft expected. his brother is a keynote they are going to release something expected shout announced a new

hololens

Paul Surratt is also from my Windows weekly you said you stayed home I made it easier to do this from home you know I love Barcelona but I'm like, ah, I have to go there for an hour-long press conference.
hololens 2   twit specials 337
Well, actually, there are other things we've seen now besides the Galaxy Fold you saw on Wednesday. Huawei now has a foldable phone for almost three grand. dollars, let's say we show Microsoft as theater because it seems like we want to look for Paul. We thought he would be in the front row. That's up front. I just saw a photo of him. He looks great up front with a short haircut. Oh, I'm probably a little drunk right now from too much, yes, Iberian ham. It would definitely be the Hammond that Barcelona is amazing, all the food is hmm.
hololens 2   twit specials 337

More Interesting Facts About,

hololens 2 twit specials 337...

Does Microsoft usually attend Mobile World Congress? You know what they say sometimes at 10:00, but they usually don't do a press conference or announcement there, it's been a long time since they did that, so this is unusual, yeah, yeah, and what? Why do we think it is the next generation of Holland? We haven't seen a Holland update in how many years. Oh man well the first time Paul and I saw hololens was in 2015 when we saw it under NDA and then it started shipping in 2016 so we haven't seen an update since 2016 so it's pretty old that's what that Apple spent three years.
hololens 2   twit specials 337
It's a long time away, they skipped the second generation, apparently they had one but decided not to release it, yeah, word was they were hoping to have a bigger explosion before announcing a new one, so they said, you know, let's skip it. That one, although we think they will call it hololens, is actually three. Paul has already posted images of the walking cat. He is a famous Windows leaker. These seem credible to you. I think they caught me. It's clearly a Microsoft product, yes, yes, it's not surgery here, it looks something like another augmented reality headset with some kind of sunglasses, but on top of the sunglasses there is a huge thing with a suction cup on the forehead and we can, yes, here we go, an Adela taking the stage, let's go to Barcelona, ​​hello and welcome to our event today and thank you very much to everyone who is here, as well as to everyone who joined online.
hololens 2   twit specials 337
It's great to be back at MWC. It's really amazing. It is an inspiring time to be in this industry and witness the rapid transformation that is taking place today. We have a couple of very interesting announcements and I was reflecting that it was just four years ago that we introduced hololens, ensuring a new era of mixed reality that seamlessly bridges the physical and digital worlds, one of my favorite lines from our announcement that we used to describing the possibilities was when you change the way you see the world, you change, you see and it's incredible to see how people have applied those advances to achieve precisely that transformation. how medical students learn to preserve ancient cultures and historical monuments and provide hands-free assistance to frontline workers everywhere.
This new medium is just the beginning of experiencing what is possible when you connect a digital world with the physical world to transform the way we live. work, learn and play today this is more pronounced than ever computing is integrated into our world in every place and everywhere Mark Weiser captured it best when he wrote about three decades ago the most profound technologies are those that disappear, become woven into the fabric from everyday life until they are indistinguishable the chief scientist of Xerox and the world today computing is becoming part of every aspect of our work in our daily lives this computing in all places from our homes in our offices factories stadiums computing across the oil and gas industries retail agricultural financial services and this computing across everything from connected cars to connected refrigerators smart surgical tools and even smart coffee machines this era of the smart cloud a smart edge is upon us it's me , I won't make this drinking game confined to a device or even a single data center, instead it is a ubiquitous fabric that is distributed from the cloud to the edge closest to where the data is generated and with the ability to adapt to a wide range of inputs, whether touch, speech, vision or gestures.
The second is the AI ​​that we have seen. Tremendous progress in recent years achieving human parody in object recognition, speech recognition, machine reading and translation by comprehension. These are not just theoretical advances, but AI is infusing itself into every experience, mediating our interactions and distilling knowledge from everything around us and the third shift. it's about putting people at the center Steve Kirsch concisely, it is clear to what extent lending devices can be seen, but the model of interaction in the future is with computers and computing around us, it is no longer about From being device first, it is about putting humans first and includes all the devices in your lives together these advances are shaping the next phase of innovation enabling experiences that would have previously been unimaginable and technological advances that have been impossible that time. it's the world in front of us this opportunity is what grounds us in our mission to empower every person and every organization on the planet to achieve more that's an updated mission statement these are BJ you're an extra word and windows on everyone and how we build a PC and every garage function of technology in our society and in our world.
It starts with thinking about how we can help every person, every business, and even every country, how they can thrive in this new era. Our success lies in the success of our partners and customers and our ecosystem. This requires us to stop being simple passive consumers. from technology to active technology producers, we create technology so that our customers can build their own technology and this is imperative and is becoming even more important today, every company is a technology company and every organization will need to develop its own digital capability to compete to grow and For the next big technological breakthrough to thrive, the next breakthrough that will transform our lives will come not just from another technology company, but from a retailer, a healthcare provider or an automaker for organizations, that means that we must be their trusted partner and empower them to build their own business. own digital ability to not depend on Microsoft but to become independent of Microsoft, that's really an encapsulation of the biologies of our times when it's a cloud mixed reality partner, not one next to Robin mm-hmm and the customers, our partners, yes, yes, yes. so not depending on Microsoft but being independent of Microsoft is very subtle, Sheltie, but she's actually a changing mother of two young children who is proud to get a job in a factory in rural Chillicothe, Ohio, equipping the truck cabin interiors.
It was her dream job, it pays well and requires high skills, but these skills required in a job can be stressful, especially learning that intricate sequence of tasks when you are just starting out, but what if she had a tool that empowered her in the job? He guided her perfectly through every step so she could be confident that from day one, eliminating any learning curve, that's what we're building the technology for, so that's clearly a huge power, first and foremost, to thrive and fully participate in our economies, how can it be done? know how to do your job and look at it only about consumption, so you're doing it in a creation-based economy at the same time.
I am clear-eyed about the unintended consequences of these developments. This is an interesting slide. That's why we got engaged. to any privacy, cybersecurity and in technology in everything we do, Paul's privacy like Apple's, that's why I missed cybersecurity not only for the largest common responsible AI, but also for small businesses and consumers who are often the most vulnerable to cyber attacks and that is why we build AI responsibly, taking a principled approach and asking difficult questions like what computers can do or what computers should do, our collective opportunity has never been older. Let's imagine a future where every construction worker can visualize what his project will look like in two. days or even in two weeks by predicting what will happen with astonishing precision, they can understand the status of the work, no matter how complex it may be.
I wonder if I'm interested in the money if you ask me why what is the process of a staff issue asking Adela to end her half a million dollar contract to license hololens it's a big contract imagine a future it's when you understand the precursors to a fall and a nurse receives an alert before the patient falls the nurse approaches the patient potentially saving him or her life and imagines a future with students in a classroom view historical objects with intricate details as the teacher describes them can walk around artifacts change their size move them create your own learning museums and bring the past back to life, but we don't have to just imagine it this future is here, applying technology to empower every individual and every organization so that any hospital, any small company, any startup with a world-changing vision and a passion and ingenuity to see it through can have a significant impact in bending the healthcare cost curve. access to education and creation of new jobs, that is what we will show you today, so Nutella, any job Julia does very well, thank you, I always can, I present the vision at a very high level, sometimes I criticize, you painted a image of possible marketing manager. for a secure smart cloud, a smart edge experience, just a wife, let's now look at some of the ways these new experiences are developing in recent years, you've probably heard a lot about Microsoft's global smart cloud capabilities, including like your office. 365 and Dynamics 365, well today I want to focus a little deeper on the smart side of this story.
Imagine that the journalist who is there to look at the hollow lights is less interested. This is what is essentially not going well. She's also the one who sets the stage because you'll hear about Azure and you'll hear about 20 billion connections and sure enough, she was the number of people in the world today. Now the next key aspect of the edge is the sheer diversity that is the variety of edge devices. It is vast and includes a massive set of participants and that is why we have taken an ecosystem-first approach. We've worked with more than 10,000 IoT partners to create solutions that span their IoT devices and Azure cloud services, and last April we announced our $5 billion investment. in IoT until 2022 to enable the development and adoption of these IoTs by customers, so Microsoft has a pretty good IoT pitch.
What we're not trying to do is what Apple and Google are trying to do at Amazon, which is create a hub. Now a great example of this is the outdoor sphere because, as we saw, home and consumer devices are highly secure, increasingly they are not. own kitchen appliances baby monitors we all see that these consumer device manufacturers are usually not experts in cybersecurity and after some major security breaches across the industry, we knew we had to do something to help the industry and help that she is talking about this. called its sphere, which is a product of Microsoft Linux, this is a great platform for IT security and we applied it to a Linux kernel to run on a small MCU and then added other security management capabilities to provide the MCU more safest in the world capable of being executed. a broad set of cutting-edge devices, now companies like Starbucks can use Azure Spirits to connect securely.
Google and Apple companies have similar products, secure hardware cylinders that always work correctly, but they want to have one center to serve their customers that perfect cup of coffee, now another. The smart cloud aspect of smart edge solutions is the ability to bridge the digital and the physical, let's rename it. This means that a camera that isRunning on a construction site not only records video, but also understands the environment you are in. people for things and it is with this understanding that new solutions are unlocked or greater efficiency is enabled in the construction process and as we develop these powerful cloud services like Azure Digital Twins and Azure AI, we find that the industry in It actually lacked a cutting-edge device.
Able to unlock this potential and, as we did with the first fear, we looked across the business and quickly realized that we once again had unique capabilities to help our clients maximize. I realize this potential. It was almost a decade ago that we launched Microsoft Connect. Oh, with a depth sensor that allowed computers to better understand the real world, it was using Project Connect Me, it announced that it failed last year and it's the camera that's in that thing that's in the hole and brings the conspirators together. , that's really no, they didn't do it Apple. required today is really proud to announce that Microsoft Azure Connect is a new intelligent edge device that allows developers to create a wide range of experiences powered by I, Azure Connect is a small, versatile device built for developers and works with a variety of computing types .
We've put together our best-in-class depth sensor, which is one of the most advanced pieces of technology we've shipped yet, and then combined it with a high-definition camera and spatial microphone array designed and built by our devices team. from Microsoft. Azure Connect is a smart edge device that not only sees and hears, but understands if it's a surprise party. stock environment and this is an onboard computer, it has sensors, microphones and it will be Holland's camera and they sold it to the developers and they said build things with this and the depth sensor has wide or narrow view options, perfect , so it's done and use their product, it's a developer kit, smart cloud, smart edge solutions we haven't seen before, Whacking Cat is publishing, takes data mesh, it's a fast company, one of the 50 innovative companies most important in China. creating solutions for car manufacturing and a key challenge for manufacturers, workers on the old factory line have the guidance to install the correct ones, now each car has thousands of parts and many look very similar, making it a difficult challenge that old data matching has started testing Azure Connect to create a solution that compares the digital design model of the car with the physical parts in the factory, this helps ensure that factory workers are using the correct part the right way ultimately helps improve car safety and reliability and then there is even retail is a pioneer in retail store technology and is working on a solution with Azure Connect and combined with Azure AI that enables solutions high accuracy for both self-checkout and shopping competitor, the only company with AI computer vision-based patient fall prevention. system and are working with partners like Cleveland Clinic, as Satya previously spoke about fatal patient falls in hospitals.
In fact, it's occu Vera who is building this solution with Azure Connect to proactively alert nurses about a potential patient fall that eats that patient before there was one. a little dizzy for 11,000 even that is a very serious problem mm-hmm speaking on behalf of the azure team and the Microsoft devices team. I'm incredibly 400 is a good price. I think the developers can pre-order it today. today's orders let me introduce you to my dear friend my partner in crime and some might even call him magician Alex kipman ah this is the mad scientist the inventor of connect and hololens cool Alex kipman i mean he looks like a mad scientist and with a simple question how can technology adapt to people?
He is using a doctor that objects adapt to technology now the simple question has driven our work since 2008 Kinect was the beginning of the answer in the first smart device to enter our homes Kinect recognized this understood what we were saying understood. best-selling consumer device in history and anything can happen the way we play by turning voice and movement into magic and experience. I thought it was a great launch into space and making consumers mutate to find life through three-dimensional flat screens. prompted us to find a way to bring the digital experience to our physical world prompted us to create microsoft hololens the first holographic computer in 2016 hololens started the mixed reality revolution by bringing intelligence to the edge of computing in the last three years developers individual big companies into startups have been dreaming of beautiful things, useful things, inspired things, these mixed reality experiences have been used by hundreds of thousands of people, which of course is in the way that holographic lenses help us.
We communicate through a certain inclination that the national space station takes us today. The next chapter of our journey says hello to the hololens, and you're right, Mary Jo, this is exactly what the announcement means that the camera is basically the camera system of the old hololens, right, it's a new camera, okay, updated candidates, maybe it's this camera. It's ours and it's connected, so to me this is a repositioning of the holographic lenses. As a consumer technology journalist, I focused on the games and the fun things you can do with them, but they are seeing that it really is a cutting-edge smart device that is kind of recontextualizing, yes, they are really admitting that it is a device business first and foremost, but not just business, it's actually about the camera, it's about intelligence in that and I think AI combined with this becomes something very interesting, it's not. an entertainment product, has an artificial intelligence coprocessor, yes, they are showing it, prepare my motorcycle, mechanics, doctors doing surgery, visualize a heart in the patient for surgery, theater designer, see what their set will look like, places of scary, these are really interesting applications of this when they released hololens they showed minecraft they showed monsters breaking through the wall I don't think we're going to see that this time I'm very proud to present to all of you hololens - with hololens Julie said once again the high mark for the mix For you, mix reality, so the leak damage was exactly right for our customers, partners and fans, thank you from Germany to China, from Japan to the United States and around the world, we have been listening to your feedback and They have been asking us this.
The lesson to be learned with Google Glass is that industrial applications are more immersive so you can see more of the holographic landscape. Second, you've been asking us for more comfort so you can stay immersed for longer periods of time. Third, you've been asking for value. industry leading out of the box so you can get started instantly with mixed reality solutions designed for the modern workplace, so let's start today by talking about immersion, the most important aspect of immersion is defined by the amount of holographic detail you can catch your eye. perceive for each degree of style, other than 47 pixels per degree of vision, is an important number to remember now, this is important because this is what allows us to read a dot font on a well holographic website, this is what It allows us to have precise interactions with holograms. and ultimately this is what allows us to create mixed reality projectors hololens one is the only headset in the industry capable of displaying 47 pixels per degree of vision and today i am incredibly proud to announce that with hololens 2 we have more than doubled our field of vision while maintaining 47 pixels per degree of vision in holographic lenses, so that was a question: how can the field of view be twice that of a perspective?
That's good. I hope it is vertical. I like kind of a mail slot right now, it's wide, 720p. Television: a 2k television for each of your eyes. There is no such technology in the world now, so in the same way we had to invent time-of-flight sensors to connect waveguides for holographic lenses into a holographic processing unit for AI inferences at the edge. with hololens 2 we invented in the industry defining the MEMS display now these are the smallest and most energy efficient laws that exist now allow us to dramatically increase immersion while reducing the size of the scroll, but immersion is more than just the holograms replaced in world immersion is also about how you interact with them holo in the moment you adapt to you adapt your hands and go beyond custom names show the status effect Apple is building it well mentally plant the articulated hand gesture with your hand, that's great because you don't have to do that weird Click on something else.
I can touch the hologram. It's much more natural. It's much more natural. Or you're looking, which allows us to do things like understand your intent and adapt the holograms in real time to your eyes. Next, we use the same cameras that we have enabled in Windows. Hello Iris. basic biometric authentication the most secure and reliable enterprise-grade solution, that's good, so immersive plugin let's talk about comfort, we optimize hololens for you for long wear and comfort, maintaining Microsoft's tradition of inclusive design with 3D scans of The heads of thousands of people across a wide range of ages, genders and ethnicities and then we used this data to create a device that once again sets the bar higher for both onyx organ and comfort. hololens 2 has a universal fit system that works on the widest and most diverse range of people.
We call it, putting it on should be as simple as putting on your favorite hat. This is good because you've ever played the first one. It looks like a screw on the taillight and is durable in a device-ready support place, but it doesn't wait. You are using it right now as if the device is floating with its power, you feel more comfortable with it now as a result of these and hundreds of other changes. I am incredibly proud that with hololens it is more than triple the comfort of the device. The whole incident, how it is measured, but this is three times more, the innovation goes on and on, but instead of telling you about it, why don't we show you?
Please help me welcome to the stage. You think people get used to our Halloween theme, Julia, it's just become commonplace. honey, because if you only use it inside a factory or something who cares, hello world, I'm incredibly excited to be here, a very special representation, many years ago, yes, when we set out to build Holland's, we wanted to create some things that you do not. It is not necessary to learn how to use it, you just have to know it and we call this instinctive. You are free to sing, but it is folded. It's like a hat.
And the only thing is the slogan. Fits like a hat. With Windows. Hello and fire. that would be a huge problem, right, it would be huge if it was more evenly weighted and didn't rest as much on the bridge of the nose, it seems like that's the case, yeah, and this is the gesture, oh look at that, something that Microsoft did. well at Fertile Lodge let's show it so the public can see it cool and of course they're doing this. Holland not only recognizes me and my hands, but he also recognizes the world he has just touched.
Welcome to my mixed reality. It looks like this. Touch gestures to look at a mouse, I guess, and the first thing people do when they put on the device is reach out and try to touch the holograms. Oh, interesting, yes, yes, look at the way the holograms appear almost in my hand. inviting me to touch to give you the shape of the object you're looking at in a way that's better than guessing that's where it ends it's hard to do that yeah you're still looking through a slot but you have a sense of where that thing is and look what else she is doing, she is using her eyes to select objects that are different from the eye tracking part, seeing the port of interest before, it would be like you were looking at a big scene, but now she is looking at a specific thing and then she turns away. is lighting up now let's switch gears and talk about a different type of app and she's very present so let me call her out with my voice follow me oh wow Microsoft teams which is a tool that we use again.
Home to collaborate, let me see what the team has been working on. Okay, do you think you have a surprise for me in productivity apps? Yeah, I think they're trying to present that this is something that you just leave on all day and then start it. Yes, that would be a lot, so now we're going to leave my mixed reality home and enter an immersive experience, but noticethat the browser I first had was a developer kit. This could be an event like the emails that businesses will receive. participatory by developers and commercial clients as first for their frontline workers and now we will come back to that later so that you start to see people hiring them in some environments that we spent years exploring and refining the interactions for Hollins, and the yards of I just recreate A small sample of the many prototypes we built, tested and learned from our approach is basically to try as many things as we could and look for the ones that stood out, so for example here I have three sliders that each of them controls. this one will inevitably be in different ways using different interactions magically beyond focus plus another thing you tried this touch slider here so here I could just stick my finger in there don't you see there look at that with her finger she's moving this Well, we also tried this push slider, so this guy nods from side to side like he's an abacus, which was interesting.
This is a captive object interaction that really took the cake, although this pinch slider is the way it works, just pinch it. and move it wherever you want. Responsible people really like that tactile sensation of their fingers touching while grasping and then releasing and across the board for all interactions, the auditory and visual feedback was a grasping and then releasing movement. We are all very critical, but the audience. It's so satisfying I can't wait for everyone to try this, but how do the buttons press so well on Hollins? They just reach out and press them. I like the sound.
Nothing interesting we found about the buttons was the size. of the buttons actually impacted the way people interact with them, for example for the smaller one, most people would use one or maybe two fingers, but for the larger one, almost everyone uses their entire hand and this It's kind of interesting if you think about it. It's because these objects don't really weigh anything, they're just digital things, but despite that, people would treat them like she really cares a lot about this he likes it, yeah, cool, good presenter, yeah, right? How about something that uses all ten fingers well?
To test that we built a piano, so here you could just record or play the keys one at a time, so the difficult thing with this is that your finger goes through the space and doesn't actually touch it. It's all right, that's why that pinch touches his other finger, look at that hummingbird over there, it's beautiful, I wonder if it's sliding down my end, yes, this Tinker Bell, wow, this is beautiful, a little delay in the way it follows my hand, I have to say . the equipment is not a big job and in fact I don't even need to use my hands to do this because I can use my eyes and my voice that's right Collins has eye tracking too so I can just look at this browser here and look at the bottom of the screen to scroll Wow and then someone is good, how much will it take to get used to?
It will be easier than how it is now, which is how you move your hand and finger. Usually your whole head and this is you just look at something and you pick it up, so this is what we mean by instinctive interaction by combining our hands. This is, you know, an investigation, no one knows how to do this. The engine is being reinvented and all over the world. all your amazing work making this dream a reality and I'm sure I speak for all of us when I do, Bright says we can't when you're tracking a big difference the lack of direct manipulation on the first jet I can't really feel really very strange , it was terrible, yes, thank you, yes.
Frank exponent on Twitter completely there watching how the cop responds to the reaction of the tech press that ever gets in the way instead of you adapting from the hololens device to adapting to you with hololens a will be more than double emergency surprise, but who jumps onto the interaction model stage by significantly advancing the way people interact with holograms, making engagement more instinctive and more human. to write, otherwise you have to keep removing it, it takes three to six months before mixed reality creates value for a company. Now this is because code needs to be written before you can unlock business value within an industry with holographic lenses that we wanted to provide to organizations. in multiple industries immediate time to value shortening this process from months to just minutes and today I am proud to announce that with hololens 2 we will launch with the Microsoft suite of solutions and a set of solutions from our incredible industry partners, solutions that range From healthcare to architecture to manufacturing and many more, hololens 2 is ready to give professionals immediate time to value immediate value for doctors immediate value for architects immediate value for mechanics, so I start today by approaching the set At Microsoft Solutions, last year we launched the first two mixed reality solutions for remote assistance and Dynamics 365 design, and since then, frontline workers around the world are solving problems faster across their daily operations.
Remote assistant language. A design will be updated and will also be available on hololens and today we are launching. a new Dynamics 365 solution for mixed reality Dynamics 365 Guides Now Guides was designed to help fill the outstanding skills gap by enabling business processes to be distilled into the workplace. Wisdom will be preserved. The guides will help workers get up to speed faster on difficult tasks by placing step-by-step instructions right where the work is being done these are good training guides yes, you are already exploring how the guides can help you in a use case everyone is agree Thanks faster, that makes a lot of sense General Dynamics, on the other hand, is evaluating guides as a way to capture the wisdom of experienced workers, we have developed highly specialized procedures so that they can be passed on to the next generations.
The interests of workers must be easy to maintain. I am pleased to announce that the dynamic 365 guys is now available for preview. in all our hollow ends when customers and you are fully available for hololens; Later this year we are seeing incredible momentum with hololens and I am honored and extremely excited to partner with industry pioneers like Philips Healthcare Bentley system Bosch and many many others to bring it, next generation solutions to reality for our company in everyone, so let's talk about one of them: Imagine transforming any room into an infinite workplace when you can teleport your presence anywhere and effortlessly visualize and collaborate on your ideas with anyone. you will forever transform the personal computer, personal computing, a single person, a single device, a single experience, into truly collaborative computing, where devices become simple lenses in our world of connecting and mixing, and to show us the true Collaborative computing in holographic glasses.
Please help me welcome to the stage the co-founder and CEO of spatial and very good friend Anat, who is spatial Hello everyone, it's not early it doesn't have a last name in our shared mission to elevate collaboration, I want to see an opportunity to put the world's Brede modeling solutions for developers, hololens allow us to work together, so that's it. each other Crysta base the big hill to show you how that space works here wants to materialize the hygena room I don't have that Hello everyone great TV here our stage holographically it's great to have you here doodle uncanny Valley real where I can feel your life as Avatar we generate in seconds from a 2D photo and the heart is generated spatial audio and youth is not video, it is just after all, it is completely looking at our general from 2D images will transform the way they work, we know what those longer jets of the iconic toy brand Mattel on stage Hey guys, how awesome is this.
At Mattel we are undergoing a massive digital transformation that affects every aspect of our business, this includes the way we use technology to design and develop our products, our classic brands like Barbie Bear, simply put, is the difference instead of Natal develop designer toys. Engineers are using trackers. They are using Holland's to develop toys. Now you can do it. That really makes my project reduce the need to travel as much as possible. so everyone is on the same page now the creepy evans pretend to like these, they showed this hollow portability thing with hollow ends, but it never worked so well for videos or even concept art, touch your arms freely, exchange ideas and create a shared understanding and your transmission, this is not just us, this has been happening in the transmission, yeah, um, so some good potential problems much earlier in the cycle, for example, guys, look at the wheel clearance here, oh yeah, I think that's going to be a problem, yeah, so I can. pull oh my space phone app and write a quick note and then press send and it turns into a digital sticky note that I can grab, just go there, you're on the fire truck, this is a brave show right now, yeah.
We can also use the space mentor earlier in our design, first failure 98 and generate inspiration. Remember, okay guys, let's come up with some ideas for a line of water toys. Yes, they could get used to the creepy avatar. Any coho turtle, that's really cool. Let's try sharks, sharks, that is. Great, how about jellyfish? So all we have to do is say the words and it's snapshots with each television that the students didn't actually watch, it's a complete Internet search complete with 3D models, so they were very clear in seeing the Yes, I want to click on adjust the images here so we can get some good inspiration for this new aquatic line mm-hmm, make sure that every object you see in the space is physical and tactile so you can scroll or choose the images you like and throw them away. on the wall without that is crazy and we don't have to limit ourselves to limiting ourselves to digital content.
I can actually see these sketches I made on my phone last night using the same space app. I just open those photos and press send and them. You instantly transform into this digital environment. Nice drawing, it's very easy to fill your roommates' ideas, so we created a gif tool to help you quickly or get the ultimate vision board tool. This is good because they really show up at any time if they are. use an AR or VR head unit or even a PC or a mobile phone, so right now we can have the virtual, it seems to work great just the same, it is still waiting for the space spiders, although yes, the space lenses and hololents are us helping to drive improvements in our digital environment.
The design and development process changes the way we create new weights by bringing together people from around the world to collaborate in the same virtual room. We are overcoming a natural barrier to our collective success: people's desire for direct face-to-face interaction. By building engagement and trust, yes, we are very excited about going to market and reducing the need for travel, as well as the many other benefits that we will generate at Mattel as we collaborate and create the next generation of conferences. Thanks Alex and there's that special camera equipment they're using, its time value works in a variety of different environments, from construction sites to operating theaters and even the International Space Station.
Now, in many of these environments, our customers have modified the hallways to meet their specific needs. but this takes a long time and the results are not always as comfortable or as immersive as the official integrated hololens. We wanted to change that, a local company called trim, your customers will get the best and most comfortable experience right away and today I am proud to announce it. the hololens customization program, a program that will allow our parts partners to customize hololens to meet all other specific needs. The first partner to take advantage of our customization program is Trimble, a global leader leveraging cutting-edge technology to transform the construction industry and tell us more about this.
Please help me welcome Trimble's vice president of buildings to the stage at an amazing partner Roz Buick hi Roz thank you Alex hi everyone Trimble is a market leader in innovative digital technologies that transform the way the world works in industries such as agricultural transportation surveying and construction, we empower the workforce from the equipment offield to office employees and professionals by deeply understanding and optimizing operational and business workflows and for the past four years we have partnered with Microsoft to focus on mixed reality innovation. around software that provides useful information about the field and workplace in construction, those solutions are used for workflows such as quality control training, visualization of 3D constructible BIM models, off-site manufacturing and prefabrication, and I am very impressed, both you and Paula, you tell very crazy stories about what you are doing. doing this is like second, I was really ready to press a button, real working technology that adds value in the field every day, so let me tell you about a client example a few months ago, a construction team who worked on a construction project.
In Colorado, we walked the site to validate the HVAC heating and cooling system that will be installed the following week. They used hololens technology to view 3D models with the physical structure already built and when they discovered a crash or collision between mechanical components and Fortunately, the hololens solution allowed them to visualize that problem in context early so they could fix it before the team of installation to arrive on site and that was despite months of coordinating mechanical, electrical and plumbing models on a computer screen in the office, the problem. could only be discovered by viewing the systems through holographic lenses in a one-to-one real-world context and solving that problem before any physical construction began meant they avoided a delay of over a week, which we are very proud of.
Partnering with Microsoft will transform into a new era in construction using the latest Microsoft technology with Trimble's unique connectable and constructible workflows. We're actually enabling intuitive 3D for everyone on a project, so we're excited to be here today - an exciting hour in Trumbo because it's almost the spec sheet to Twitter, this is what you want to see the full spectrum in the word for frontline workers and environments in a way that's easier to use, yes, I've had it, it's actually a topic that you've heard of and the way it would be. will theoretically be distributed among workflow functions to allow the worker in the field to do their job right the first time, and by using advanced Trimble design and construction software, the XR 10 allows architects, engineers and contractors to carry the details and processes of the 3D buildable model from the office to the field to the tool so you can now visualize and build exactly what you want and this will help you deliver your projects on time and on budget.
The Trimble XR 10 will be available for first customer shipment at the same time as Microsoft Hololens grows. which we think will be by the end of the year, but they haven't said it yet. Our cloud and our edges within the elements set a price yet. I know you know that low latency at the edge and high precision AI in the cloud is a platform where the edge intelligence is autonomous and does not require connectivity and the cloud intelligence works on the different platforms, different sensor configurations and DIF, this one fits and he is a very, very smart client.
I'm excited to announce that we're doing exactly that: we're enabling developers to combine the power of Hololens with the power of Azure by introducing a set of mixed reality services, and while these are all cross-platform, Hololens 2 was designed from the ground up with these services in mind. The first service we announced is spatial anchors, a fully cross-platform service that supports the AR kit as our core and of course follows and how the company spatially the birth of the Internet of Holograms, a world where holograms can be shared with others through different devices. in different or I send you a world of holograms where each device becomes a lens in two mixed connected worlds, that's interesting, the second service we announced today, right?
I don't know what's going on with a service that will help solve a key problem facing our developer community, from automotive to manufacturing, from architecture to healthcare. Our clients need highly accurate and detailed representations of their content in 3D. This service will allow developers to use the power of Azure to directly stream high polygon content without decimating the hololens, allowing the hololens to display holograms with infinite detail, compute or render a large number of reams when we combine the power of the hololens with the power of blue that our power our partners can offer. transformative solutions so let's take a look at one of these next generation experiences created by a great partner in a global leader in industrial IOT ptc ptc is using hololens and azure together to drive digital transformation in industrial companies and to show us please Help me, welcome.
On stage, ptc CEO and an inspiring mixed reality leader, Jim Hammond, is so critical that space anchors admit it shows up on human phones. Interesting, we do this with an industrial innovation platform that includes things that work for IOT and we see forums from mixed reality, one of our clients is part of the Colfax company when you point out that it is a different solution, ultimately the Blowers believe they remove the least amount of water. This is a replacement, effectively, said that before everything works, yes, to give your customers an integrated self-service solution to avoid. Expensive and dangerous downtime to tell you more.
I'd like to invite Maria Wilson, global leader in data-driven advantages at Houghton, to join us on stage. It must be very difficult for PTC not to be an industrial IoT company. that is increasingly unacceptable to our customers, we decided to use PTC prior to their study and it is a challenge to address this critical issue and provide a true value immersive mixed reality experience to our customers by using full lenses. Today we are transmitting sensor data from our equipment. and Azure IOT Hub directly into the PTC Steamworks solution and the seamless integration provides equipment operators around the world with the right information they need to keep the blower operating at peak efficiency.
Now let's take a look at how easy it is to create content and view for your studio and I'll start by using before your studio the drag and drop interface. This is a fairly seamless process because it allows me to import existing 3D CAD models from our equipment, as well as include sensor data. I'll just drag one thing. It works with the IOT meter in the correct position and links it to the data flow from the Azure IOT hub. The seamless integration between Thing Works and Azure IOT allows our customers to see a real-time visualization of the hardened islet wind model overlaid on the actual blower using Mixed Reality to further enhance this experience, we also include instant access to other relevant Acid documents , such as drawings, maintenance history and work instructions.
Finally, with just one click, this entire experience is published to Azure and is ready for the operator to view this published experience. It can be used in two different ways: it provides experienced operators with critical information and instructions to keep equipment running, but it can also be used in hologram form to train new or less experienced workers before placing them in a real operating environment, so Alex Would you mind replacing a new blower control room operator? Okay, let them do it, and like some said, it misrepresents you a little bit, yeah, yeah, I see a lot of different training experiences here, a lot of us, all these things that they're interacting with.
Sit inside that little one, hopefully, it's a double mail slot, so Alex is now looking at the experience that Maria posted from Via Phoria Studio, so it probably won't blow her away in the field, while this experience offers benefits significant in terms of time and cost. training perspective, that's why the rotation, but now let's make it more collaborative by taking advantage of the blue space anchor service in view for your study and calf. We can seamlessly allow Maria to join Alex's experience. Really interesting and the launch of Euphoria Veal once Maria points her iPad at it. location where Alex placed the blower, she can participate in the mixed reality experience, making it much more interactive and collaborative, that's right Joe, so the way she uses it, they are streaming it to her device .
Training Scenarios Alex, let's simulate a gear failure mode, oh oh. I see that the vibration of her gear went down and I exceeded her threshold, please inspect, let's go ahead and select that, Alex. I think you might be dealing with a broken gear tooth, um, and you'll probably have to replace the gear assembly, okay, I'll roll it up. My sleeves and work a little here, do it. I'm ready. I'm going to start with the disassembly instructions for the gear assembly. This is great. I don't have any real world experience to know if they mean your assembly heaven.
He didn't do it, he does it, everyone is available and before your study, you can now lift that equipment with your back straight unless Alex is extremely strong and there is no amazing study that allows Maria in Houghton, this creates a unique mixed reality experience without worrying, yes, on which platform. I'm wondering about authorship, so I guess you can't. The CAD chose to drive the experience, my father because it allowed him to present various training scenarios. Well, Alex chose to view the experience on a full lens tool because he wanted a hands-free experience. and the ability to view and interact with the CAD bottle before the integration of the studio, as the spatial tethering services took that a step further by allowing them to seamlessly share the same mixed reality experience.
Inspiring. Thank you so much. Thank you very much Alex. Thanks Alice Jim. Thank you, it's industrial design, yes, but I mean I could watch the video and see how that would be exciting for people, since this is where all the money is for this demonstration, absolutely all the workers and for us as consumers, so It's how it starts to drip. Before, I think it will be Terkel Lambda the walls that make our world feel divided and our world feel broken as leaders in mixed reality we want to do it differently, you won the third year of computing in the era of mixed reality to be the future Ford and more culturally relevant as members of units with experience as an adult in a future mmm-hmm open to your creativity open your f here that vision now imagine what we achieve as a mixed community when barriers are removed we consider a different course for all the gardens Chris off gave up and said that Microsoft is doing now as a source of principles in all the opening of our mixed reality ecosystem, these principles define the rights of all participants of our mixed reality ecosystem, the principle Number one, we believe in an open app store model, now of course we will have the Microsoft Store, but developers will have the freedom to create their own stores as first class citizens, in our experience, similar to how Steamvr is a store popular for mixed reality content on Windows.
We will want any app store provider to feel welcome within our ecosystem. Principle two: we believe in an open web browsing model. Now, of course, we'll have Microsoft Edge, but developers will have the freedom to create web browsers as first-class citizens in our experience, and today I'm proud to announce that Firefox will be joining it. us with a holo native web browsing experience that is very interesting, yes, especially in light of the fact that Edge is now a model, you will continue to participate in Open XR so that anyone can innovate within our headphones, from the sensors that are being using even differentiated experiences. that are being created now with these principles in place imagine the innovation and imagine the advances that I have high hopes and big dreams or that I will achieve together in this ecosystem and to help us dream of this future.
It's my honor to invite an industry luminary to tell us about their dreams or a mixed reality ecosystem, epic founder and CEO Tim Sweeney Wow, okay, so there's a gaming side to this, this is the fortnight creative, thanks, hate Microsoft, no attitude, rent Xbox and Gears of War and most recently in opening fortnight. With cross-platform games costing five million dollars last year, we are now seeing the birth of a whole new generation of technology with augmented reality and glassesholographic. He's the nerd. I believe he is the main platform of the future for both work and entertainment.
We know that AR is going to play such an intimate role in our lives that we need to establish clear ground rules that respect everyone's rights—that means open platforms, open ecosystems, and privacy protections. You're right, he's not a fan, so if that makes the steam progressively worse. is Microsoft's uwp is woefully inadequate on Twitter, he said: I don't hate Microsoft, I hate Rikers house, petty, any consumer, any developer decision, a couple of years ago they changed the club games, we also make games, such once in the womb, some of them and, although I am not.
I'm here to announce a game or a consumer and our strategy, but I'm here to tell you and the epic years to come will support Poland and all our efforts will support Hollins is an open platform and we will resist attempts to build walled gardens around it. our lives, thank you very much Tim, thank you, really interested, brought Tim Sweeney on stage, which is unexpected, they didn't do well at all and Space Invaders demos, Minecraft demos, but it's still the most popular gaming planet, we have the most precise, the most open and the easiest to integrate. -platform services for mixed reality and in hololens calm, you can pre-order two hololens packages starting at just one hundred and twenty-five dollars a month or pre-order two standalone hololens two Enterprise Edition, while it used to cost five thousand dollars, it now costs three thousand five. one hundred, I have to say it used to be five, actually, yeah, $3,500, well, the camera, so one was five.
I keep building it together, you can rent it for one hundred and twenty-nine months, it starts to shape me, puzzles per user 125, but you have to do it. You have to hire a three-year contract for that and you have to hire a remote assistant. Okay, so there are additional products, but I'll still leave you, yeah, that's what we want to rent, that's how you'd be crazy to buy it unless you're developed. partner that transforms healthcare with holographic lenses into value that will allow doctors around the world to achieve more thanks, so in the battery-based image guided therapy visit, that is very important, it can be treated well because it is from the beginning, okay, yeah, unlike these virtual reality experiences. its modern surgery without at least five and we are directing many instruments into the body incisions no larger than the tip of a pencil we rely solely on X-ray images.
What did they mention? Battery duration. That means they're always oh, that's it. Interestingly, they weren't a leader in image-guided therapy and with Azorean we created an industry-leading platform that clients really love. What's really interesting is that we've leveraged new touchscreen technology to create a very powerful workplace for the doctor, so get connected. lives in the connected camera and you know, the next generation flight time flight time women's battery life is 2 to 3 hours of active use well, that's pretty good for complex procedures, you should need to go from one screen to another very quickly, now we can get these impressions only by voice recognition by tracking it is all about efficiency if the patients are being treated and the procedure can be shortened it is very beneficial for the patient at Philips we firmly believe that technology is not The technology objective should be its neighboring objective, what we want is for the doctor to be able to concentrate on the procedure and for the patient to take home faster and healthier.
This really puts these associations, no one has anything magical, yeah, and I think you can see a lot more units in the real world. world and that is also important because people feel comfortable with it mm-hmm, they see it and end it with a command like that, no, that's it, there are no goodbyes, no, nothing, simply this is the place where there should be done this Mobile World Congress. Consumer-focused journalists attended, this was an enterprise product, yeah, you know. I think since Mobile World Congress also has a lot of IOT stuff these days, you could defend them by doing this.
Microsoft talked a little about its IOT. platform and ashtag as your sphere your secure IOT platform, but actually it was hololens, the second generation of hololens, so you have experienced all the iterations of hololens, you have used it in many different places in many different ways, what think? happy so I haven't been able to try this generation number 2 yet but I really hope they double the field of view vertically because that mail slot thing is very limiting you have to keep turning your head and backing up so I'm If they fixed that, that will go a long way to making it much better.
What else am I thinking? The flip-up visor is amazing. Yes, they should have done it the first time. That's like a game changer for me. It sounds simple, but it's hard to see, you know when you try to talk to someone you have these things on top, they can turn it around and just have a normal conversation, which is good, they just went through this very quickly, but that guides The new Dynamics 365 guides app will be interesting, that's the training app and I think that's going to make a lot more companies think okay, this has some applicability to me and it's not just about CAD apps or surgical apps, there are very practical things mundane. what you can do if you have a hololens, they stay and there are three different types of ways to use it, all labeled in this dynamic 365, yes, you will have to explain to me what that is, but you mentioned that the guidesYou know, the example they used was a motor complicated and shows you how to fix it.
There's remote assistance, which is that video conferencing with the kind of creepy avatars, and then there's 365 design, which is the kind of thing a theater designer does. you could use it or an architect, they just showed how you could use it if you have a plumbing problem I guess, and how you can see where there is a conflict between the electrical and the plumbing, what the 365 dynamic is, is that one set is that other product, yes. This baffles a lot of people because Dynamics 365 is Microsoft's brand for ERP and CRM applications and then last year they started putting these apps focused on mixed reality work under that same brand, so that's when we first saw Maybe remote assistance, which is this application when you are wearing holographic glasses that allow someone you know to say that it is you, that you are repairing an elevator.
You can talk remotely without having to search for things or call someone and have them on the phone. You can just hear him tell you, “Okay, open up.” panel 3 check this light and you can do it and they're seeing what you see, they'll be like no, not that button, the one on your left, so it's a really cool app, but because they put it under the Dynamics 365 brand. a a lot of people like oh wait I don't need a PR or CRM this is cool the reason they put it there is because the headset is Microsoft's business software brand and you could argue that the stuff is business software , yes, yes, and business.
Software doesn't need the catchy name that big consumer products need, so I'm going to assume this is an appropriate name for it, even though it doesn't ring a bell, it doesn't roll off the tongue because companies don't do it. They don't care, they don't care, no, and they understand that brand as a commercial brand, a business brand, even if they are not using ERP or CRM. I think this is exactly where the whole lunch should be a brief shake of the consumer hat with Tim Sweeney and a fortnight couldn't have been shorter, probably just to acknowledge that yes, there is something that will also happen at some point in the future, but the place of demand for Microsoft is business so let me go over the pricing because this is kind of interesting yeah so if you want to buy just a hololens headset the hololens will be $3500 and then you'll get the business version which means that you'll get enterprise security, you know, BitLocker stuff that you get the full lens for. business stuff, you get a warranty and you get tuning management, you get all that stuff built in for the $3500 right now for hololens, that same package costs you $5,000, so it's fifteen hundred dollars cheaper basically than Hullins, what would that be?
Do I need to develop for hololens or is it yeah, yeah, okay, that would be all you need, but if you're more into the idea of ​​hey, you know I want a bunch of my workers to try this out, you know no, maybe not. Thousands. but maybe like ten people you might want to consider renting it and so they have these two different subscription plans where if you take the subscription plan you get the holographic lenses - hardware and then you get Dynamics 365 remote support that application I was talking about. where you can do it with someone remotely and you can rent it for $125 per user per month, which is 1500 a year, but you have to commit for three years or if you only want to commit for one year, you can do it for three hundred and twenty. -five dollars per user per month, which is three thousand nine hundred dollars per year per user, so you know for some people it's going to be like that, that makes more sense.
I want to start doing some proofs of concept and testing it in the field, but other people who are too pure developers who don't need remote testing, they just say: I just want the hardware. Can you do development with a rental version? Yes, what is the same? It's the same child, yes, because you. You would need internal Lead and Avella apps for this, this is the sweet one. I don't know what Candace looks like, but I imagine so, they should be customized for your particular applications. I think so, but you know. the reason they stopped using Dynamics 365, a remote system, there are a lot of people who would get the holographic lenses and say I don't know what to do with this, okay, I would have to hire consultants and pay a lot of money or spend all this time wasting time and now it's like here look at this look at what we did now do something like that yes yes I think it seems like a very attractive product at that price, not the direct purchase but the I think the rental price makes it very accessible for almost any company that he thinks he uses it for this.
I agree, there's already a pretty vibrant ecosystem of software and apps out there, so not really. You know, the one in Holland, they had some people build it. apps, there were some, there were some consumer apps, there were some more proof of concept apps, there are some commercial apps that are already being sold through the Microsoft Store for hololens one, but I think after this generation comes out, you're going a I see a lot more Hololens two apps in the store and of course the first generation of apps will be app tools to help you develop your own content and you also like CAD products and things like that.
Yes, you know that type of software. How about the remote assistant is so mature, we know it's available right now, yes it's available now, so the remote assistant design is already available and they're already in holographic lenses, one that you can buy right now, They already work, people are using them. In the field, they have a lot of user case studies, with people using it mainly automotive companies using it a lot and some manufacturing and retail operations using it as well. How about education? Is there a market for this in education? Yeah, that was interesting. He made a quick reference to that in his presentation today, like, yeah, you know, this would be really cool in education and I think there's educational applicability to this, but it's an expensive school, yeah, so it's actually more of a commercial product, but I think it is well positioned as an enterprise product I think this is the case.
I can't think of any competitors that are even close. There are some verticals that you already know, some purpose-built verticals that are already in this space, but I think Microsoft has a very compelling story to tell and I think I believe that. It was smart, I think it was very smart, they decided that everyone was like, oh, we want to see Minecraft with this and we want to see them know games and hear that maybe they will make them one day, but their first audience is the business audience and that's where they . You're going to make all his money, hey, hey, Joe Foley.
I'm sure you have more rights and people can read your writings on ZDNet about Microsoft communications. You can also follow her on Twitter. Both she and Paul Stoddard are already tweeting. articles Paul was in the front row there, so he will have some impressions. Don't know. I didn't get the feeling that they had a demo room. If there was a chance to try again. I know. I hope it's because. You'll be able to talk about it in Windows Wednesday weekly franchises, that's where we'll be next Windows weekly at 11 a.m. Pacific Time to 2 p.m. m.
This one every Wednesday and of course Marie Joe Foley and Paul Theroux are the stars of theshow and I suspect this topic will be the number one topic of the day. Thank you, fan day, thank you Mary Joe Foley. I appreciate your time. Thank you so much. you and i thank you all for watching live

twit

special issue 337 microsoft hololens 2 announcement we have a busy day today i will be doing the tech in about 45 minutes and this afternoon of course this weekend we will probably start early Carsten primo I don't know about you, but I'd love to watch the Academy Awards, so we've got a great panel for you and we'll get started as quickly as we can, right after the tech talk starts at 2 p.m.
Pacific 5:00 p.m. ET, thank you all for joining us on our special live journey, see you next time, bye.

If you have any copyright issue, please Contact