Understanding the occupant is moving beyond traditional camera-based monitoring.
Radar, physiological sensing, audio and vision can work together to build a richer picture of a personās physical, cognitive and emotional state, opening new possibilities for safety, wellbeing and personalisation. Diego Val, Head of Research Programs ā New Solutions & Technologies in the Innovation Department atĀ and IƱigo Mateo, Corporate Innovation Directorate at Antolin, discuss how multimodal sensing and sensor fusion could enable more robust occupant monitoring, and the challenges of integrating these technologies seamlessly into the vehicle interior.
1. Which sensor modalities contribute most to occupant understanding?
At Antolin, we believe that radar is one of the most promising sensing modalities for occupant understanding, as it can non-invasively measure heart rate and breathing rate while preserving privacy and maintaining robust performance regardless of lighting or cabin conditions. This makes it particularly valuable for detecting drowsiness, stress, fatigue, and potential health-related events.Ā
Beyond radar, Antolin sees significant value in complementary physiological sensing technologies such as EEG (Electroencephalogram), which provides insight into cognitive and emotional states; EDA (Electrodermal Activity), which can be seamlessly integrated into interior surfaces and smart textiles to monitor emotional responses; and PPG sensors for cardiovascular monitoring.Ā
Additional context can be provided by high-resolution cameras for facial-expression analysis and microphones for speech emotion recognition.Ā By integrating these technologies into vehicle interior components, Antolin envisions a multimodal sensing ecosystem capable of delivering a holistic understanding of the occupantās physiological, emotional, and cognitive state.
2. How does multimodal sensing improve robustness compared with single-sensor systems?
At Antolin, multimodal sensing is considered a key enabler of reliable occupant monitoring.Ā Rather than relying on a single sensor, AI-based orchestration platforms can combine information from radar, cameras, audio, physiological sensors, and smart interior surfaces to build a more accurate picture of the occupant’s condition.Ā
This approach provides both redundancy and complementarity. For example, if camera performance is degraded by poor lighting or occlusions, radar-based sensing can continue monitoring vital signs, while audio and physiological signals can provide additional context.Ā
For Antolin, the real value lies in embedding this sensor fusion capability directly into intelligent interior architectures, enabling more robust and reliable detection of stress, fatigue, distraction, emotional state, and wellness indicators while ensuring a seamless user experience.
3. What are the biggest technical challenges in sensor fusion inside the cabin?
One of the main challenges for Antolin is not only the fusion of sensor data, but also the physical integration of sensing technologies into vehicle interior components without compromising design, comfort, quality, or manufacturability.Ā
Many physiological sensing solutions require close contact with the occupant, making the integration of sensors intoĀ door panels, armrests, overhead systems, decorative surfaces, or smart trim components a critical challenge. Achieving reliable signal quality while maintaining premium aesthetics, durability, and industrial scalability requires deep expertise in interior systems engineering.Ā
This is why Antolin believes that multimodal sensing integration is most effective when performed by suppliers with extensive experience in surfaces, trim, lighting, electronics, and interior architecture.Ā As an interior systems integrator, Antolin can combine sensing technologies with functional and decorative cabin elements, reducing complexity for OEMs and enabling scalable deployment.Ā A single integrator accountable for quality simplifies complexity for OEMs, enabling them to interface with one trusted partner.Ā
AdditionalĀ challengesĀ include:Ā
- Managing the variability of physiological responses between individuals.Ā Ā
- Interpreting signals accurately in different contextual situations.Ā Ā
- Ensuring real-time AI inference with automotive-grade computational efficiency.Ā Ā
- Miniaturizing sensors and electronics while preserving reliability and safety.Ā Ā
- Maintaining long-term robustness under automotive environmental conditions.Ā Ā
4. Which applications will drive future adoption of multimodal sensing?
In our case, future adoption of multimodal sensing is closely linked to the transformation of the vehicle interior into an intelligent, adaptive living space focused on occupant wellbeing, safety, and personalization.Ā
One major application area is proactive health and wellness monitoring, enabling the vehicle to identify signs of fatigue, stress, distraction, or potential health issues and respond accordingly.Ā
Another key driver is the development of emotionally intelligent interiors capable of adapting in real time to the occupantās cognitive and emotional state. Based on multimodal sensing inputs, cabin systems could dynamically adjust lighting, acoustics, and even fragrance delivery to improve comfort, reduce stress, and enhance concentration.Ā
Initiatives such as Antolinās LUXIA concept demonstrate this vision by exploring advanced emotional lighting systems capable of creating adaptive ambient experiences inside the cabin.Ā By combining sensing, AI, lighting, electronics, and smart surfaces, Antolin aims to deliver personalized interior environments that actively contribute to wellbeing and user experience.Ā
Interested in exterior vehicle sensing technology?
With a pass to InCabin Europe, youāll also get full access to our
co-located sister event, AutoSens.Ā Find out more here >>
