Next-Generation Automotive HMI

Price: Starting at USD 3,000
Publish Date: 18 May 2022
Code: AN-5543
Research Type: Research Report
Pages: 42
Next-Generation Automotive HMI
RELATED SERVICE AND SPOTLIGHTS: Smart Mobility & Automotive Software-defined Vehicles
Actionable Benefits

Actionable Benefits

  • Identify carmakers' HMI objectives and their impact on the supply chain.
  • Assess how other auto trends (e.g., electrification and automation) will drive new HMI requirements or the availability of relevant enabling technologies for HMI.
  • Use automotive HMI market sizing forecasts for strategy formulation and product planning.
Critical Questions Answered

Critical Questions Answered

  • What are the key automotive HMI trends?
  • How will displays, voice, and cabin sensing systems evolve?
  • How will multimodal AI-based HMI approaches affect software and hardware architecture?
  • How do electrification and automation affect HMI?
Research Highlights

Research Highlights

  • Comprehensive assessment of how carmakers are adopting driver and occupant monitoring systems.
  • Analysis of how voice is evolving into personal assistants.
  • Evaluation of the main HMI challenges and strategic recommendations to carmakers and their suppliers.
  • Cabin sensing market sizing by type (diver and cabin monitoring), architecture (stand-alone and consolidated), and domain integration (digital cockpit and ADAS).
Who Should Read This?

Who Should Read This?

  • Engineers and decision-makers within Tier Two suppliers developing HMI software and automotive silicon.
  • Strategic decision-makers at car OEMs and Tier One suppliers.
  • Planners at software engineering companies helping carmakers develop HMI frameworks and software-defined vehicle platforms.

Table of Contents


1.1. Key Trends 
1.2. Challenges 
1.3. Implications and Strategic Recommendations


2.1. Hybrid Systems 
2.2. Integration between Digital Ecosystems5
2.3. Proprietary versus Third-Party Voice Assistants 
2.4. Next-Gen Voice Assistants: Personal Assistants 
2.5. Benefits 
2.6. Drawbacks 


3.1. Cluster Displays 
3.2. Head-Up Display 
3.3. AR HUD 
3.4. Transparent Surfaces
3.5. The Impact of Multi Displays on UX 
3.6. Android Automotive OS (AAOS) 


4.1. Camera-Based DMS 
4.2. Occupant Monitoring System 
4.3. Key Cabin Sensing Players 


5.1. Multimodal AI-Based HMI 
5.2. Connectivity with External Devices 


6.1. Electrification 
6.2. Autonomous Driving 


7.1. Ambarella 
7.2. Aptiv 
7.3. Luxoft 
7.4. Blackberry
7.6. Imagination 
7.7. Intellias 
7.8. NXP 
7.9. Qualcomm 
7.10. Tata Elxsi 
7.11. TomTom IndiGO 
7.12. WDC
7.13. Wind River 


8.1. Voice 
8.2. Displays 
8.3. DMS and OMS 
8.4. Digital Cockpit 

Learn More About Next-Generation Automotive HMI

As carmakers look for new ways to attract customers and retain existing ones, a lot of attention is being paid to the automotive Human Machine Interface (HMI). Most car owners are already used to standard connectivity options and traditional displays. However, recent software developments are setting the stage for the driver User Experience (UX) to take a giant leap forward. These new technologies are exclusive to the premium consumer, but in a few years, they will catch on in the mid-level market.


What Is an Automotive HMI?

In the automotive context, an HMI is what bridges the gap between driver and vehicle. This solution enables drivers or even passengers to communicate and engage with their vehicles in a more personalized way. Voice assistants, Head-Up Displays (HUDs), and sensors are just a few of the hardware and software that enables an HMI to work its magic. Not only does HMI software help keep drivers safe, but it also changes the way we interact with the outside world.

Automotive HMI Developments Bring a New Generation of In-Car Assistants

Historically, voice assistants in cars have been limited in terms of performance due to the limited capabilities of legacy automotive HMIs. Although most voice assistants can detect natural language, accents, and different languages, the full context of input isn’t always identified. But with new advancements in multimodal approaches, next-generation “personal assistants,” as they will be called, will leverage in-vehicle sensors that account for an individual's gesture, posture, gaze, and facial expression. In tandem with location intelligence, personal assistants will deliver a driver UX that traditional voice assistants lack.

Shipments of vehicles with a personal assistant world markets: 2019 to 2030

Safety was initially the primary use case for vehicle voice control, such as avoiding hazards and monitoring drowsiness. But thanks to newer automotive HMIs, next-gen car assistants will go beyond safety and aims to enable drivers to learn more about their surroundings. Mercedes MBUX, leveraging Cerence’s software, allows drivers to simply look at a nearby Point of Interest (POI) and ask questions like “tell me more about that castle” or “what is that café on my left?” The technology powering this new feature uses environmental reconstruction, car sensor data like cameras and speakers, and existing hardware to identify the POI. There is also work being done to make it possible for drivers to make a payment from the POI, book reservations, buy tickets, and perform other transactions.

Choices for OEMs to Make About New HMI Design in Cars

The downside to adding voice command to an automotive HMI is the high computing and memory requirements. Carmakers can use local edge computing for small tasks like turning on the radio or Air Conditioning (AC) and send computation-heavy tasks like searching for a nearby mall to the cloud. This balance keeps production costs down (for advanced edge hardware capabilities) while maintaining adequate local computing when needed. If a vehicle has a long life span, the automaker may choose to invest in edge computing because it ensures that customers can always use add-on services.

In the face of a new generation of HMI software, carmakers must decide whether to develop an in-house solution or use an existing solution. Some car brands like BMW, Volkswagen, and Mercedes prefer to develop their own car voice assistants, while other players like Volvo/Polestar and Stellantis are happy to use Google and Amazon, respectively. On the upside, leveraging existing automotive software reduces both development and time-to-market costs. But on the downside, these brands lose a sense of vehicle differentiation and control over UX/user data, which is highly sought after by carmakers.

How Next-Generation Automotive HMIs in Cars Are Shaping the Future of In-Vehicle Displays

In-vehicle displays are a key component of the new generation of automotive HMIs and are evolving rapidly. Not only has the size of in-vehicle displays increased, but the graphics power has too. This allows for the deployment of new features that have never been possible. For example, the Genesis GV80 uses input from an internal camera to issue a warning when a driver gazes at the cluster display for too long. HUDs, popular among French manufacturers, show all of a vehicle’s information on the windshield to prevent drivers from looking down at the cluster display. Both the advanced cluster display solution from Genesis and HUDs are still relatively rare technologies due to expensive implementation costs.

Augmented Reality (AR) is a very promising next-gen solution that completely changes the way drivers perceive external threats. With an AR HUD, the vehicle feeds information about the surrounding environment in real time straight to the windshield. Some of the use cases include vehicle distance warnings, lane departure warnings, and blind-spot detection warnings.

In addition to supporting Advanced Driver Assistance Systems (ADAS), AR HUDs can also display information about music playing or calendar reminders. The two primary challenges of AR HUDs are finding a solution that doesn’t seem obtrusive or overwhelms the driver with too much information, and the high costs. It won’t be until 2025 that this next-generation feature becomes available in mid-range cars.

Transparent surfaces are another new component that will be integral to future automotive HMIs. Continental’s technology turns the A-pillars into Organic Light-Emitting Diode (OLED) displays and shows a live image feed of the exterior, in combination with tracking the diver’s head movements. What this does is create a dynamic extension of the surrounding environment that can help drivers make safer maneuvers. Range Rover launched the ClearSight Ground View technology alongside its 2018 Evoque. This new generation solution makes the hood transparent, allowing the driver to see the terrain below the vehicle when off-road.

An invisible A-pillar and invisible hood solution enabled by next generation automotive HMI

How Next-Generation Automotive HMIs Affect Business Strategy

The automotive industry, like so many other industries, is trading the product-first approach for a user-first approach. Moreover, growing consumer expectations and government safety regulations are also key catalysts to the new generation of automotive HMIs, which are the foundation of vehicular UX.

Going forward, silicon players must focus on providing flexible and affordable vehicle HMI solutions to gain a greater share in an ever-evolving automotive industry. And vehicle software providers must be aware that carmakers are constantly increasing the gap between hardware and software, and seeking more third-party data and software. This is in contrast to seeking a complete package. It’s also advisable for new software players in the automotive space to consider white labeling their technology if they want to penetrate greater market share. Finally, for carmakers, it’s imperative to design automotive HMIs that can pull data from multiple points, such as voice, sensors, and cameras, to realize a truly next-gen driver experience.

Related Research Spotlight

Software-defined Vehicles

This Spotlight Includes:

Connected Car
Connected Car
Automotive Over-the-Air Software Updates
Automotive Over-the-Air Software Updates
Autonomous Vehicle Platforms
Autonomous Vehicle Platforms
Next-Generation Automotive HMI
Next-Generation Automotive HMI
  • All recently published research
  • Access to any updates to the research published within six months of purchase
  • Direct insight from our analysts through 60 minutes of Analyst Inquiry
View Spotlight