Mitsubishi Electric Develops New AI for HMI

January 29th, 2020 by

university-mitsubishi-electric-ai-hmi-vague-commands

Mitsubishi Electric, sibling company to Mitsubishi Motors and a part of Mitsubishi Motors Corp (MMC), has been making a lot of noise lately. Although initially a company that develops product lines for electric appliances and large structures dealing with electricity and energy, Mitsubishi Electric also develops automobile technology to be introduced to the Mitsubishi Motors lineup, such as AI-controlled mirrors, automotive cyber security, and autonomous technology. In 2019, Mitsubishi Electric showed up at the 2019 Consumer Electronics Show (CES) and the 2019 Tokyo Motor Show. At both, the company presented autonomous technology with its xAUTO, mobility solutions, and an innovative human-machine interface (HMI) for enhancing communication from inside and outside of the vehicle. Now, the company has developed smart AI that enhances current HMI technology like virtual assistants Amazon Alexa and Google Home.

A Smarter Virtual Assistant

Designing artificial intelligence (AI) and smart systems is no foreign land to Mitsubishi Electric. In 2018, Mitsubishi Electric created an interconnected platform that used AI to integrate and use the functions of various smart devices while on the same server or Wi-Fi. Just like a wireless computer that can print something on a wireless printer, Mitsubishi Electric’s Interconnected Platform goes a step beyond. This platform “enables networked smart appliances to use their sensors and functionalities to cooperate in new home services without the need for cloud computing or internet connection.”

Basically, the platform “talks” to other smart devices and asks as a central hub. This newest development comes from Mitsubishi Electric’s artificial intelligence (AI) technology team, also known as Maisart®, short for Mitsubishi Electric’s AI creates the State-of-the- ART in technology. Making human-to-machine conversation more fluid and human-like, the new technology can understand vague user commands through the extrapolation of missing information. Think of Google’s predictive search, when common or popular results will start popping up after typing in a few letters. This new HMI from Mitsubishi Electric does the same thing.

How does this work? The new HMI technology takes the information presented in a voice command and then plugs it into a knowledge graph. This knowledge graph is basically a database of information that the HMI platform stores in its memory banks. It then sorts through this information using three sets of components-subjects, predicates, and objects-where user information, device specifications and functionality, and external information are integrated. In response, the platform is able to deduce what the user is asking for without the entire command. In short, instead of saying “Alexa, what’s the weather”, you could just say “What’s the weather?” and this HMI will answer. It’s starting to sound a lot more like Jarvis in the Stark Tower from the Marvel Cinematic Universe.

There are also benefits with this for the platform itself. Through the use of this new methodology, the amount of computation and memory usage required to interpret vague commands is actually much less in comparison to full commands. The platform is always changing and modifies the knowledge graph by adjusting its relevance in reference to common user commands and sensing information. 2020 really is the year that technology hits a milestone.

Mitsubishi Electric plans to make this technology available in homes and automobiles by 2022. It feels so far away, but so did 2020, and here we are. Follow along with us on University Mitsubishi social media to learn more.

Photo Source/Copyright: Mitsubishi Electric