In Star Wars Episode 1 – released in 1999 – the separatist forces and the royalty of the planet Naboo had communicators that showed a holographic image of the person – or alien strange creature – with whom they were speaking. 22 years later, already in the era in which the Smartphone has brought us closer to that future that cinema has been selling to us for decades, we can aspire to have something like this, but in an assistant format.
Imagine that when you wake up Siri or the Google Assistant, the same thing happens to you as the Master Chief in the HALO game series: You get the virtual assistant Cortana – not the Windows one that inspired it – in holographic format. Well, that’s more or less what the Japanese companies KDDI and Mawari promise us.
Mawari, Inc. has pioneered the creation of cloud streaming and rendering technology for interactive XR experiences since 2018. KDDI Corporation offers smartphones, mobile phones, and other mobile communication services, as well as landline services. Both have signed an agreement and announced a DHaaS (Digital Human as a Service), a digital human being for rent and use which will debut this December 2021 and that takes advantage of the ultra-low latencies allowed by the AWS Wavelength technology from Amazon Web Services – yes, just the ones that caused the global crash yesterday.
This proof of concept presents un multilingual human digital guide offering indoor and outdoor orientation services in Ginza, Tokyo, all with AWS Wavelength and KDDI au’s 5G network. For example, users can experience easy navigation from the subway to a shopping center, and upon entering, navigate to specific stores and find special offers.
Your mobile assistant but in hologram
The system’s outdoor navigation capabilities use Sturfee’s Visual Positioning System (VPS), based on high-definition satellite imagery, while indoor navigation uses Immersal’s VPS, based on maps made with pre-scanned images of spaces. interiors. Moving from the outside to the inside, the system makes a smooth transition that provides a seamless user experience.
Is about create a virtual assistant that you can “see” through the window of your smartphone in augmented reality, one that can appear automatically to give you directions and interact if you point your phone at a place in the real world. If you take a look at the video in this news, you can see that it is not much more advanced than, for example, Pokémon Go.
But behind the scenes, partners claim that KDDI’s 5G network, Amazon’s low-latency AWS Wavelength edge computing nodes, and Mawari’s own codec they combine so that “digital humans” are streamed to your phone in real time rather than running natively on your phone’s chip.
In addition, in mid-December it will be available at AWS Marketplace a demo of the Human-Digital Guide, which will showcase Mawari’s patent-pending 3DXR content streaming platform for the Metaverse. This is the first of many services to run on Mawari’s 3DXR content streaming platform, and partners anticipate the implementation by third parties of these capabilities worldwide in places that include sports facilities, universities, hospitals, tourist destinations, museums and educational centers.
According to Mawari officials, “Our team is very proud to be a part of this collaboration between cutting-edge partners. Over the past 3 years, Mawari has worked closely with KDDI – one of Japan’s most visionary companies – to launch award-winning consumer-oriented AR streaming facilities in the arts, advertising and retail sectors. These projects have been fundamental for the development and delivery of the appropriate technical and aesthetic capacities to develop and deliver our CODEC and platform contributions to this project ”.
What do you think of all this? Would you like to have a holographic representation of Siri or Cortana ‘coming out’ of the mobile to help you interact with you and the world around us?