OmniVision is sampling an entry-level driver monitoring system (DMS) ASIC with 1GB of on-chip DDR3 SDRAM achieved by using stacked die.
The OAX8000 claims to be the only dedicated DMS processor to integrate a neural processing unit (NPU) and image signal processor (ISP), which provides dedicated processing speeds up to 1.1 trillion operations per second for eye gaze and eye tracking algorithms.
These processing speeds with 1K MAC of convolutional neural network (CNN) acceleration, along with integrated SDRAM, still allow the the OAX8000 and OmniVision automotive image sensor to consume 1 watt in typical conditions, combined.
The OAX8000’s on-chip NPU is supported by the TensorFlow, Caffe, MXNet and ONNX tool chains. Additionally, this ASIC embeds quad Arm Cortex A5 CPU cores with Neon technology for accelerated video encoding/decoding and on-chip video analytics algorithms, along with hardware for image processing, video encoding and RGB/IR processing.
Its high dynamic range (HDR) processing capability allows the ASIC to accept input from RBG/IR image sensors and support high quality output, for videos taken during the day or at night, in conditions with widely contrasting bright and dark images.
The integrated video encoder accepts up to 5 megapixel captures from OmniVision’s automotive image sensors, and outputs up to 2K resolution video at 30 frames per second (fps).
Samples of the new OAX8000 ASIC are available now in a BGA196 package. It is AEC-Q100 Grade 2 certified.
