What Makes e-con Systems’ STURDeCAM57 An Ideal Camera for Driver & Occupant Monitoring

Traditionally, the go-to imaging solution for driver and occupant monitoring was a monochrome camera equipped with a rolling shutter sensor and infrared illumination (IR). However, modern vehicles demanded more. ADAS platforms simply became more advanced while safety regulations raised the bar. This led to imaging limitations of traditional setups becoming impossible to ignore.

Enter e-con Systems’ STURDeCAM57, a 5MP RGB-IR GMSL2 camera for the full automotive lifecycle.

This camera captures full-color and infrared data simultaneously and comes with a global shutter sensor, thereby enabling DMS and OMS systems to perform reliably across all real-world driving conditions.

In this blog, you learn why combining RGB and IR capabilities in a single camera like STURDeCAM57 is critical for DMS and OMS, the IR exposure safety problem it addresses, and more.

Why RGB and IR in One Camera For Driver & Occupant Monitoring?

Driver monitoring and occupant monitoring may seem like closely related tasks, but they place very different demands on the imaging system. A single RGB-IR camera is uniquely equipped to meet both.

Accurate driver monitoring

Driver Monitoring Systems (DMS) are primarily concerned with the driver’s face: eye openness, gaze direction, head pose, and micro-expressions that signal distraction or drowsiness. For these tasks, consistent and reliable facial illumination matters more, which is why infrared imaging is the backbone of DMS.

IR illumination, particularly at 940nm (invisible to the human eye), provides steady, controlled illumination of facial landmarks regardless of ambient lighting. Day or night, the IR channel delivers high-contrast facial data that DMS algorithms can depend on.

e-con Systems’ STURDeCAM57 integrates 940nm IR LEDs directly into the camera, eliminating the need for a separate illumination module. This ensures consistent IR output aligned with the sensor’s field of view.

Detailed occupant monitoring

Occupant Monitoring Systems (OMS) scan the entire cabin. They detect passengers, identify objects (child seats, bags, firearms, knives), and analyze behavior patterns. Color data is critical for these tasks.

RGB imaging equips OMS algorithms to distinguish objects by their visual characteristics (shape, texture, and color). An IR-only camera may detect the presence of an object, but can’t reliably classify it. Adding RGB data improves the accuracy of in-cabin object detection and behavior analysis.

Varied lighting performance

Vehicle cabins face constantly changing light, from bright sunlight to near-total darkness within seconds. e-con Systems’ STURDeCAM57 streams RGB and IR as separate channels. During daylight conditions, the RGB channel provides rich color data for OMS tasks. As lighting diminishes, the system transitions to the IR channel for facial and occupant detection.

Such a dual-channel approach means a single STURDeCAM57 can cover DMS and OMS functions across the full range of in-cabin lighting conditions.

Driver & Occupant Monitoring: The IR Exposure Challenge

IR illumination is key to in-cabin monitoring but rolling shutter cameras introduce a safety problem that is often overlooked, namely, prolonged IR exposure to vehicle occupants. Here’s how that happens.

• Rolling shutter sensors don’t capture the entire frame at once
• They read the image row by row, from top to bottom
• The shutter is effectively “open” for the duration of the entire frame readout
• The IR illumination must remain active throughout so that every row of the image is properly lit

Over time or at high frame rates, cumulative exposure can violate optical radiation safety standards. Movement also causes image distortion. Increasing illumination or frame rate to compensate further raises IR exposure.

How STURDeCAM57 Helps Manage the IR Exposure Challenge

STURDeCAM57’s global shutter sensor captures all pixels simultaneously. The entire image is exposed and read out in a single instant, rather than line by line. Therefore, the LED only needs to be active for the duration of that single exposure instant. This enables precise synchronization between the camera’s exposure and the IR illumination pulse.

This synchronization also eliminates the motion artifacts that make rolling shutter IR images unreliable. It means that:

• Every pixel in the frame reflects the scene at exactly the same moment
• Facial geometry is preserved accurately
• Eye openness, gaze direction, and head pose are captured without skew
• DMS algorithms receive clean, consistent IR frames they can trust

Furthermore, STURDeCAM57 includes a built-in Image Signal Processor (ISP), fine-tuned by e-con Systems, that handles RGB-IR separation, demosaicing, and color reconstruction directly inside the camera.

On platforms like NVIDIA AGX Orin, the host processor receives fully processed RGB and IR frames ready for inference.

Why e-con Systems’ STURDeCAM57 is Perfect for DMS & OMS

Since 2003, e-con Systems has been designing, developing, and manufacturing OEM and ODM camera solutions for several industries. Building on this experience, we are about to introduce STURDeCAM57 — a 5MP global shutter RGB-IR GMSL camera designed for driver monitoring, occupant monitoring systems, industrial automation and so on.

Explore STURDeCAM57

Please visit our Camera Selector Page to check out our end-to-end portfolio.

Need technical guidance or have questions about integrating STURDeCAM57 into your DMS or OMS platform? Reach out to our engineering team at camerasolutions@e-consystems.com.

FAQs

1) What is STURDeCAM57, and why does it suit DMS and OMS?

e-con Systems’ STURDeCAM57 is a 5MP RGB-IR global shutter GMSL camera aimed at driver and occupant monitoring through the full automotive lifecycle. It captures full-color and infrared data together, helping DMS track facial cues such as eye openness, gaze direction, and head pose, while giving OMS the color detail needed for passenger, object, and behavior analysis.

2) Why do DMS and OMS need both RGB and IR in one camera?

DMS depends heavily on infrared imaging because facial landmarks need steady illumination in day and night cabin conditions. OMS has a wider job, since it scans the cabin, identifies passengers and objects, and reads visual traits such as shape, texture, and color. A single RGB-IR camera helps cover both tasks by using IR for facial analysis and RGB for richer in-cabin scene understanding.

3) How does STURDeCAM57 handle changing light inside the vehicle cabin?

Vehicle interiors can shift from bright sunlight to near-darkness within seconds. e-con Systems’ STURDeCAM57 streams RGB and IR as separate channels, so the system can use the RGB channel during brighter conditions and move to the IR channel as cabin light drops. This gives DMS and OMS a more dependable imaging path through the full lighting cycle inside the vehicle.

4) How does STURDeCAM57 help manage the IR exposure issue in DMS and OMS?

Rolling shutter cameras read the frame row by row, which keeps IR illumination active for the full readout period and raises cumulative exposure as frame rate or illumination rises. e-con Systems’ STURDeCAM57 uses a global shutter sensor that captures all pixels at the same instant, so the LED only needs to fire for that exposure instant. This creates tighter synchronization between exposure and the IR pulse while also removing motion artifacts from the captured image.

5) How does the onboard ISP help DMS and OMS platforms?

e-con Systems’ STURDeCAM57 includes a built-in ISP fine-tuned by e-con Systems for RGB-IR separation, demosaicing, and color reconstruction inside the camera itself. On platforms such as NVIDIA AGX Orin, the host receives processed RGB and IR frames ready for inference, which reduces raw image processing work on the host side and leaves more compute for AI tasks and application logic.