Occupant Monitoring Systems (OMS) are evolving from regulatory necessities into intelligent platforms capable of understanding occupants, context and intent.

As legal requirements and Euro NCAP establish the baseline for safety, the next wave of innovation lies in using the same sensing infrastructure to enable proactive safety, personalised assistance, comfort and more natural human-vehicle interaction. We spoke with Dr. Frederik Diederichs, Head of Perceptual User Interfaces Group at Fraunhofer IOSB, about how agentic AI, multimodal sensing and rapid prototyping tools such as AktiMeter are helping the industry explore what comes next for intelligent in-cabin systems.

Interview With:
Dr. Frederik Diederichs

Head of Perceptual User Interfaces Group

1. How can agentic concepts expand OMS applications beyond compliance with legal and EuroNCAP requirements?

Legal and EuroNCAP functions define the minimum baseline for OMS and DMS. Agentic OMS can go beyond this by using the same sensing infrastructure for context-aware functions in domains such as: proactive safety, comfort, accessibility, personalisation and interaction.

The Fraunhofer AktiMeter Software can help the development community prototype and test these ideas by simple prompting. It provides an AI-based rapid-prototyping environment in which new agentic OMS functions can be explored with real sensor data, activity recognition, object interaction, posture, attention and multimodal context. Fraunhofer IOSB’s role is not to replace industrial OMS platforms, but to provide research-grade prototypes, evaluation methods and demonstrators up to TRL 6 that help companies assess which new functions are technically feasible, useful – and impressively amazing.

2. What new sensing capabilities are required to support these use cases?

In many cases, the key requirement is not necessarily more sensors, but better use of existing sensing. RGB and IR cameras remain central for OMS and DMS, but future agentic functions need multimodal interpretation. AktiMeter is a multimodal software platform and addresses exactly this gap. It combines visual human activity analysis with multimodal extensions such as audio interpretation and integration of MCP messages. It can integrate vehicle context and expose structured outputs for prototype agents, making it a useful testbed for companies that want to evaluate new OMS functions before committing to product-level implementation.

3. How should privacy considerations be addressed?

Privacy has to be considered from the beginning, especially for camera-based interior sensing. A central principle of AktiMeter is local processing: raw interior data should not leave the vehicle unless this is explicitly required, justified and protected. AktiMeter supports this direction by its edge AI architecture. In addition, Fraunhofer IOSB provides all GDPR experience of audio-visual mobility and interior data. All data that we provide to OMS and DMS developers is compliant to all GDPR and AI-act regulations. This includes AI dataset generation in driving simulators and road vehicles with AktiMeter. 

4. Which comfort applications are closest to commercial deployment?

The closest applications are those that use existing OMS/DMS sensing but add better context understanding. We have successfully demonstrated context-aware sleep detection, a motion sickness assistant and a “vehicle conversational assistant with eyes” that can understand who is speaking, what the occupants are doing and whether a request is plausible in the current situation. AktiMeter can provide the prototyping layer for such functions. It allows developers to test whether an OMS can recognise relevant activities, interpret multimodal context and generate structured inputs for an agentic assistant. This helps companies explore new functions at research-demonstrator level before integrating them into their own product architectures.

Here is a link to the AktiMeter software that we use for research: AktiMeter – in-cabin monitoring for intelligent, real-time behavior analysis.

Interested in exterior vehicle sensing technology?

With a pass to InCabin Europe, you’ll also get full access to our
co-located sister event, AutoSens. Find out more here >>

Want to see what you missed out on at InCabin Europe last year? Check it out below ⬇
Passes0
There are no passes in your basket!
0