January 11th, 2021, Santa Clara, California, USA
Ambarella (hereinafter referred to as “AMBA Semiconductor”, NASDAQ: AMBA, a semiconductor company focusing on artificial intelligence vision) announced the launch of CV5, the latest chip in CVflow® series. This artificial intelligence vision processor can support 8K video recording or 4K video stream recording with four independent image inputs. The new SoC chip CV5 will promote the further development of intelligent car camera system, consumer-grade UAV, motion camera and 360 panorama camera, as well as robot vision system. The perfect integration of Anba Semiconductor CVflow AI engine and dual-core Arm®A76 processor provides excellent performance for various mainstream artificial intelligence algorithms. CV5 has a high-performance image signal processor (ISP), which can be optimized for video coding to improve the visual perception of human eyes, and optimized for machine vision algorithms to improve the accuracy. CV5 adopts the advanced process of 5nm, and the power consumption for shooting 8Kp30 video is less than 2 watts.
Fermi Wang, CEO of Anba Semiconductor, said: “The advent of CV5 enables Anba Semiconductor to provide a new revolutionary solution for the next generation of smart cars, consumer cameras and robot vision. Our excellent CVflow AI engine is combined with 8K video recording and multi-channel 4K video stream recording, so that the camera has excellent image processing and novel artificial intelligence. ”
In the remote processing application of automobile video stream, CV5 can support multi-channel video stream coding, including front ADAS, driver monitoring, cabin monitoring and side camera. With the help of CVflow artificial intelligence engine, CV5 can simultaneously run advanced driver assistance system (ADAS) algorithms (such as lane departure and front collision warning) and driver monitoring algorithms (such as driver fatigue driving detection). The perfect combination of multi-channel high-resolution video capture and advanced artificial intelligence processing can support ADAS camera to identify target objects at a long distance with higher accuracy.
CV5 is an ideal solution for those ultra-low-power sports cameras that can be held by your hands, especially those video devices that support high frame rate recording and playback of 8K video, 360-degree panorama and VR.
In the application of consumer robots and unmanned aerial vehicles, CV5′ s CVflow artificial intelligence engine can accelerate SLAM operation, realize path planning, obstacle detection, obstacle avoidance, autonomous positioning and navigation, etc. For UAV aerial photography, CV5 can record videos up to 8Kp60 while performing flight control and navigation functions.
CV5 shares the same SDK and computer vision algorithm optimization (CV) tools with other CVflow series chips of Anba Semiconductor, which simplifies the camera development process in various price ranges and different performance options. A complete set of machine vision tools includes compiler and debugger, and supports industry-standard machine learning frameworks such as PyTorch™, ONNX™, Caffe™ and TensorFlow™, as well as a complete guide for performance optimization of convolutional neural networks (CNN), which can help customers quickly transplant their neural networks to CV5.
Key features of CV5 chip:
CVflow architecture supporting DNN
Dual-core 1.6 GHz ARM Cortex-A76 comes with NEON™DSP extension and FPU
High-speed SLVS-EC, MIPI-CSI (C/D PHY) interface, which can access up to 14 cameras.
Multi-channel ISP with processing capacity up to 8KP60
Rgbb, RCCB, RCCC, RGB-IR and monochrome sensors are natively supported.
Multi-exposure high dynamic range (HDR) processing
Real-time hardware accelerated fisheye lens distortion correction (LDC)
Support multi-stream AVC and HEVC coding up to 8Kp60.
A variety of peripheral interfaces, including 4-channel PCIe, CAN FD, Gigabit network port, USB 3.1 (master/slave mode), three SD card controllers, MIPI DSI/CSI-2 and HDMI output.
• support LPDDR4x/LPDDR5/LPDDR5x up to 32GB, 64-bit data bus
The equipment information security can be realized, including safe startup, supporting TrustZone®, TRNG, OTP, memory isolation, memory encryption and virtualization.
5 nm process
16× 16 FBGA package with ball pitch of 0.5mm.
About Ambarella (Anba Semiconductor)
Ambarella’s products are widely used in the fields of human and computer vision, including video security, advanced driver assistance system (ADAS), electronic rearview mirror, driving recorder, intelligent monitoring of drivers and cabins, driverless cars and robot applications. Ambarella’s low-power processor can be used in smart cameras design, which supports ultra-high definition image processing, video compression and deep neural network acceleration, and can extract valuable data from high-resolution video.