Next-Generation Automotive HMI

Price: Starting at USD 4,500
Publish Date: 18 May 2022
Code: AN-5543
Research Type: Research Report
Next-Generation Automotive HMI
RELATED SERVICE: Smart Mobility & Automotive
Actionable Benefits

Actionable Benefits

  • Identify carmakers' HMI objectives and their impact on the supply chain.
  • Assess how other auto trends (e.g., electrification and automation) will drive new HMI requirements or the availability of relevant enabling technologies for HMI.
  • Use automotive HMI market sizing forecasts for strategy formulation and product planning.
Critical Questions Answered

Critical Questions Answered

  • What are the key automotive HMI trends?
  • How will displays, voice, and cabin sensing systems evolve?
  • How will multimodal AI-based HMI approaches affect software and hardware architecture?
  • How do electrification and automation affect HMI?
Research Highlights

Research Highlights

  • Comprehensive assessment of how carmakers are adopting driver and occupant monitoring systems.
  • Analysis of how voice is evolving into personal assistants.
  • Evaluation of the main HMI challenges and strategic recommendations to carmakers and their suppliers.
  • Cabin sensing market sizing by type (diver and cabin monitoring), architecture (stand-alone and consolidated), and domain integration (digital cockpit and ADAS).
Who Should Read This?

Who Should Read This?

  • Engineers and decision-makers within Tier Two suppliers developing HMI software and automotive silicon.
  • Strategic decision-makers at car OEMs and Tier One suppliers.
  • Planners at software engineering companies helping carmakers develop HMI frameworks and software-defined vehicle platforms.

Table of Contents

1. EXECUTIVE SUMMARY 

1.1. Key Trends 
1.2. Challenges 
1.3. Implications and Strategic Recommendations

2. VOICE 

2.1. Hybrid Systems 
2.2. Integration between Digital Ecosystems5
2.3. Proprietary versus Third-Party Voice Assistants 
2.4. Next-Gen Voice Assistants: Personal Assistants 
2.5. Benefits 
2.6. Drawbacks 

3. DISPLAYS

3.1. Cluster Displays 
3.2. Head-Up Display 
3.3. AR HUD 
3.4. Transparent Surfaces
3.5. The Impact of Multi Displays on UX 
3.6. Android Automotive OS (AAOS) 

4. CABIN SENSING 

4.1. Camera-Based DMS 
4.2. Occupant Monitoring System 
4.3. Key Cabin Sensing Players 

5. OTHER HMI TRENDS 

5.1. Multimodal AI-Based HMI 
5.2. Connectivity with External Devices 

6. TRENDS AFFECTING HMI

6.1. Electrification 
6.2. Autonomous Driving 

7. KEY PLAYERS 

7.1. Ambarella 
7.2. Aptiv 
7.3. Luxoft 
7.4. Blackberry
7.5 HARMAN 
7.6. Imagination 
7.7. Intellias 
7.8. NXP 
7.9. Qualcomm 
7.10. Tata Elxsi 
7.11. TomTom IndiGO 
7.12. WDC
7.13. Wind River 

8. MARKET FORECASTS 

8.1. Voice 
8.2. Displays 
8.3. DMS and OMS 
8.4. Digital Cockpit 

Learn More About Next-Generation Automotive HMI

As carmakers look for new ways to attract customers and retain existing ones, a lot of attention is being paid to the automotive Human Machine Interface (HMI). Most car owners are already used to standard connectivity options and traditional displays. However, recent software developments are setting the stage for the driver User Experience (UX) to take a giant leap forward. These technologies are exclusive to the premium consumer, but in a few years, they will catch on in the mid-level market.

 

What Is an Automotive HMI?

In the automotive context, an HMI is what bridges the gap between driver and vehicle. This solution enables drivers or even passengers to communicate and engage with their vehicles in a more personalized way. Voice assistants, Head-Up Displays (HUDs), and sensors are just a few of the hardware and software that enables an HMI to work its magic. Not only does HMI software help keep drivers safe, but it also changes the way we interact with the outside world.

Automotive HMI Developments Bring the Next Generation of In-Car Voice Assistants

Historically, voice assistants in vehicles have been limited in terms of performance due to the limited capabilities of legacy automotive HMIs. Although most voice assistants can detect natural language, accents, and different languages, the full context of input isn’t always identified. But with advancements in multimodal approaches, next-generation “personal assistants,” as they will be called, will leverage in-vehicle sensors that account for an individual's gesture, posture, gaze, and facial expression. In tandem with location intelligence, personal assistants will deliver a driver UX that traditional voice assistants lack.

Shipments of vehicles with a personal assistant world markets: 2019 to 2030

Safety was initially the primary use case for vehicle voice control, such as avoiding hazards and monitoring drowsiness. But thanks to newer automotive HMIs, next-gen voice control goes beyond safety and aims to enable drivers to learn more about their surroundings. Mercedes MBUX, leveraging Cerence’s software, allows drivers to simply look at a nearby Point of Interest (POI) and ask questions like “tell me more about that castle” or “what is that café on my left?” The technology powering this feature uses environmental reconstruction, car sensor data like cameras and speakers, and existing hardware to identify the POI. There is also work being done to make it possible for drivers to make a payment from the POI, book reservations, buy tickets, and perform other transactions.

Choices for Carmakers to Make About Automotive HMI Design

The downside to adding voice command to an automotive HMI is the high computing and memory requirements. Carmakers can use local edge computing for small tasks like turning on the radio or Air Conditioning (AC) and send computation-heavy tasks like searching for a nearby mall to the cloud. This balance keeps production costs down (for advanced edge hardware capabilities) while maintaining adequate local computing when needed. If a vehicle has a long life span, the carmaker may choose to invest in the more reliable edge computing because it ensures that customers can always use add-on services.

Another decision that carmakers must make when deploying voice control to an automotive HMI is developing an in-house solution or using an existing solution. Some car brands like BMW, Volkswagen, and Mercedes prefer to develop their own voice assistants, while other players like Volvo/Polestar and Stellantis are happy to use Google and Amazon, respectively. On the upside, leveraging existing software reduces both development and time-to-market costs. But on the downside, these brands lose a sense of differentiation and control over UX/user data, which is highly sought after by carmakers.

How Next Generation Automotive HMIs Are Shaping the Future of Car Displays

Displays are a key component of the automotive HMI and are evolving rapidly. Not only has the size of displays increased, but the graphics power has too, allowing for new features that have never been possible. For example, the Genesis GV80 uses input from an internal camera to issue a warning when a driver gazes at the cluster display for too long. HUDs, popular among French manufacturers, show all of a vehicle’s information on the windshield to prevent drivers from looking down at the cluster display. Both the advanced cluster display solution from Genesis and HUDs are still relatively rare technologies due to expensive implementation costs.

Augmented Reality (AR) is a very promising solution that completely changes the way drivers perceive external threats. With an AR HUD, the vehicle feeds information about the surrounding environment in real time straight to the windshield. Some of the use cases include vehicle distance warnings, lane departure warnings, and blind-spot detection warnings.

In addition to supporting Advanced Driver Assistance Systems (ADAS), AR HUDs can also display information about music playing or calendar reminders. The two primary challenges of AR HUDs are finding a solution that doesn’t seem obtrusive or overwhelms the driver with too much information, and the high costs. It won’t be until 2025 that AR HUDs become available in mid-range cars.

Transparent surfaces are another component of the future automotive HMI. Continental’s technology turns the A-pillars into Organic Light-Emitting Diode (OLED) displays and shows a live image feed of the exterior, in combination with tracking the diver’s head movements. What this does is create a dynamic extension of the surrounding environment that can help drivers make safer maneuvers. Range Rover launched the ClearSight Ground View technology alongside its 2018 Evoque. This solution makes the hood transparent, allowing the driver to see the terrain below the vehicle when off-road.

An invisible A-pillar and invisible hood solution enabled by next generation automotive HMI

How Next Generation Automotive HMIs Affect Business Strategy

The automotive industry, like so many other industries, is trading the product-first approach for a user-first approach. Moreover, growing consumer expectations and government safety regulations are also key catalysts to the advancements in automotive HMIs, which are the foundation of vehicular UX.

Going forward, silicon players must focus on providing flexible and affordable solutions to gain a greater share in an ever-evolving automotive industry. And software providers must be aware that carmakers are constantly increasing the gap between hardware and software, and seeking more third-party data and software, as opposed to a complete package. It’s also advisable for new software players to consider white labeling their technology if they want to penetrate more market share. Finally, for carmakers, it’s imperative to design HMIs that can pull data from multiple points, such as voice, sensors, and cameras, to realize a truly next-gen driver experience.