OmniVision, Ambarella and Smart Eye Partner on Driver Monitoring, Videoconferencing Camera Solution
November 10, 2020 | Business WireEstimated reading time: 3 minutes
OmniVision Technologies, Inc., a leading developer of advanced digital imaging solutions, Ambarella, Inc., an AI vision silicon company, and Smart Eye, a world leader in developing AI-powered eye, mouth and head tracking technology, announced in advance of AutoSens Detroit the automotive industry’s first complete solution for dual-mode camera applications. This joint solution simultaneously monitors drivers while capturing vehicle occupants for one-way videoconferencing.
It features OmniVision’s automotive industry-first OV2312 image sensor, with a dual-mode global shutter that captures both RGB color images and IR images under low-light conditions. These dual captures are then processed simultaneously by Ambarella’s CV22AQ CVflow® computer vision processor, which runs Smart Eye’s algorithms to analyze the driver’s state and alert the vehicle to any unsafe indicators, such as drowsiness.
The companies worked together to integrate and fine tune this solution, which is available as a complete reference design, allowing automotive designers to focus on differentiating their final application while simplifying the overall design effort.
The companies are currently in discussions with automotive OEMs regarding the implementation of this reference design in upcoming car models. This joint solution enables the full range of driver and cabin monitoring implementations, from safety applications to augmented reality displays and interior sensing with deep neural networks and AI. The solution’s one-way video conferencing allows remote conference participants to see those in the vehicle, while the vehicle receives only audio to reduce driver distraction.
“Our CV22AQ offers best-in-class image processing and high performance AI computing at low power consumption, typically below 2.5 watts,” said Fermi Wang, president and CEO of Ambarella. “While we have worked together to pretune this joint solution, designers still have the flexibility to further customize it to the needs of their specific implementations.”
“Our AI software makes it possible for automotive OEMs and tier-1s to deploy a new generation of driver and in-cabin monitoring systems with advanced AI features, increasing safety and convenience for drivers and passengers,” said Martin Krantz, CEO of Smart Eye. “This dual-mode joint solution has the unique ability to monitor the driver while simultaneously capturing images for videoconferencing, regardless of lighting conditions.”
“Our OV2312 is the only automotive image sensor that offers the combination of dual-mode RGB-IR capture and a global shutter,” said Mario Heid, vice president of OmniVision Europe. “Without this combined functionality, the camera system designers would have to use two separate image sensors, which is too expensive for most vehicles. At the same time, the European Union (through Euro NCAP) is requiring that all new cars sold in Europe have a driver monitoring system (DMS) camera by 2022, and our joint solution gives OEMs the flexibility to differentiate their vehicle features while meeting this mandate.”
The OmniVision OV2312 is a dual-mode automotive image sensor, enabling single-camera driver state monitoring and viewing applications, such as the videoconferencing capability in this reference design. It remains the automotive industry’s only RGB-IR global shutter image sensor, while offering the smallest size in its class of 2MP sensors. The OV2312 provides advanced ASIL functional safety and industry-leading near-infrared (NIR) light performance of 14% quantum efficiency at the 940nm wavelength, along with excellent modulation transfer function (MTF). Its power consumption is also industry leading, consuming just 190mW in typical conditions. The end result is that the OV2312 reduces the number of image sensors in the system, saving both power and space by eliminating the need for multiple rolling shutter sensors.
The OV2312 is the latest member of OmniVision’s automotive global shutter image sensor family. It is pin-to-pin compatible with the OV2310 and OV2311 family members, which provides designers with the flexibility to choose the best feature set for their needs.
Ambarella’s scalable CVflow processor family provides a full range of systems on chip (SoCs) across multiple performance and price points. The company’s powerful image signal pipeline (ISP), with support for OmniVision’s dual-mode RGB-IR color filter arrays, enables high-accuracy detection and monitoring, even in low-light, in-cabin environments. Its high dynamic range (HDR) processing extracts maximum image detail in high-contrast scenes, further enhancing the chip’s computer vision capabilities and the performance potential of Smart Eye algorithms.
Smart Eye’s DMS solution offers eye tracking software for integration in passenger cars and other vehicles to facilitate better safety and other functions that improve the user experience. By carefully studying eye, facial and head movement, Smart Eye’s interior vehicle algorithms can draw conclusions about a person’s alertness, attention and focus.
Suggested Items
Inkjet Solder Mask ‘Has Arrived’
04/10/2024 | Pete Starkey, I-Connect007I was delighted to be invited to attend an interactive webinar entitled “Solder Mask Coating Made Easy with Additive Manufacturing,” hosted by SUSS MicroTec Netherlands in Eindhoven. The webinar was introduced and moderated by André Bodegom, managing director at Adeon Technologies, and the speakers were Mariana Van Dam, senior product manager PCB imaging solutions at AGFA in Belgium; Ashley Steers, sales manager at Electra Polymers in the UK; and Dr. Luca Gautero, product manager at SUSS MicroTec Netherlands.
NetVia Group Acquires Direct Imaging from Mivatek
04/09/2024 | Miva TechnologiesMiva Technologies is pleased to announce NetVia Group, Irving, TX has acquired a new Miva 2400NG Dual Tray Direct Imaging System with 30-micron capabilities for inner, outer and soldermask imaging.
Teledyne to Acquire Adimec
02/13/2024 | TeledyneTeledyne Technologies Incorporated announced that it has entered into an agreement to acquire Adimec Holding B.V. and its subsidiaries.
Real Time with... productronica 2023: MivaTek Global Advances Technology With High-res Imaging System
12/08/2023 | Real Time with...productronicaMivaTek's Brendan Hogan talks about how the company employs Digitally Adaptive Rasterization Technology (DART) in their high-res imaging equipment. He also shares how the blurred line between semiconductors and microelectronics is driving broader application of the imaging process.
Keysight Enables Validation of Arbe 4D Imaging Radar Chipset
11/30/2023 | Keysight Technologies, Inc.Keysight Technologies, Inc. announces that Arbe has selected the E8719A Radar Target Solution (RTS) to test the Arbe 4D imaging radar chipset for automotive applications.