As in-cabin cameras take on more responsibilities, from driver monitoring and occupant sensing to videoconferencing and user authentication, image sensors must deliver far more than high-quality pictures.

The rise of RGB-IR imaging is driving demand for High Dynamic Range (HDR) capabilities that work with global shutter technology, enabling reliable sensing in challenging lighting conditions. We spoke with Tomas Geurts, Senior R&D Director, Europe at OMNIVISION, about why HDR requirements are changing, how RGB-IR is reshaping in-cabin monitoring, and what future camera architectures will need to support the next generation of intelligent vehicle interiors.

Interview With:
Tomas Geurts

Senior R&D Director, Europe

1. How have HDR requirements evolved for in-cabin sensing applications? 

In-cabin monitoring systems (IMS) typically perform both imaging and sensing functions. The imaging function—used for human-viewing applications like videoconferencing and security—has traditionally relied on conventional “rolling shutter” High Dynamic Range (HDR) solutions. Sensing functions used for driver and occupancy monitoring have so far been deprived of this capability. 

These sensing functions require the use of a “global shutter”. Historically, combining global shutter pixels with HDR capability has been rare. While HDR was always considered desirable, system integrators previously managed to make appropriate compromises, limiting the motivation to develop dedicated solutions. This landscape has completely changed with the introduction of RGB-IR imaging. 

At InCabin 2025, OMNIVISION introduced the OX05C. This image sensor addresses addresses these new challenges. It is the only device in its class featuring a compact 2.2µm pixel size that fully supports global shutter HDR functionality. 

2. What benefits does RGB-IR imaging provide for monitoring systems? 

The primary benefit of RGB-IR technology is its ability to combine sensing and imaging functions into a single camera. As highlighted during the OMNIVISION InCabin presentation in 2025, the same image sensor can capture a standard RGB color frame for human viewing and, on the very next frame, utilize an NIR illuminator to capture a dedicated sensing image with controlled illumination across the scene. 

However, introducing RGB-IR means the sensing image will receive roughly 16 times more ambient signal from the sun compared to a conventional, NIR-only, Driver Monitoring System (DMS). This severe contrast has become the primary motivation for developing and implementing robust HDR solutions in sensing. 

3. Which imaging challenges remain unresolved inside vehicle cabins? 

New automotive functions, such as driver authentication, seatbelt and airbag control, demand affordable 3D sensing solutions that do not yet exist. Furthermore, capabilities such as vital sign sensing and intoxication detection remain in active research without a clear industry standard. Ultimately, image sensors will need to be highly flexible to accommodate these future functions, regardless of which specific technologies eventually win out.

4. How will future cabin cameras differ from today's systems?

Future vehicle cabins will deploy a significantly higher number of cameras. Each camera will operate its own independent illumination system while supporting an expanded matrix of parallel functions- combining videoconferencing, driver monitoring, user authentication, and health tracking. 

As a result, sequencing different sensors and synchronizing their respective illuminators will become increasingly complicated. Sensors must offer unmatched operational flexibility in shuttering modes, making the availability of global shutter HDR functionality an absolute necessity. To select the right hardware, the industry must now establish standardized performance and image quality metrics tailored to these hybrid use cases. 

Interested in exterior vehicle sensing technology?

With a pass to InCabin Europe, you’ll also get full access to our
co-located sister event, AutoSens. Find out more here >>

Want to see what you missed out on at InCabin Europe last year? Check it out below ⬇
Passes0
There are no passes in your basket!
0