With the widespread application of intelligent image and video analysis, multiple identification is an important application in today's image surveillance systems. In this process, multiple image and video streams are used for analysis and identification, which is helpful for data analysis and security operations. Multiple recognition requires higher-performance computing and the use of deep learning to implement the multiple recognition function. Based on this principle, Novatek, a leading IC design manufacturer, provides the use of its own high-performance chip NT98336 through the PCIe Gen3 interface combined with the Hailo-8™ artificial intelligence processor with up to 26 trillion operations per second (TOPS) to develop high-performance back-end intelligent image and video analysis solutions.
Novatek NT98336 is a professional SoC chip designed for multi-channel H265 HD DVR/HVR systems. It has built-in ARM Cortex CA53 quad-core CPU, H.264/H265 codec, MJPEG codec, Novatek CNN Gen2.5 - 2.25T hardware accelerator, 2D graphics acceleration engine, multi-channel HD video capture, 4K UHD display controller, RGMII Ethernet controller, USB3.0 and USB2.0 ports, PCIe Gen3, SATA3.0 port and AMBA The bus architecture provides users with high-performance HD DVR/HVR. NT98336 also provides video pre- and post-processing and supports multi-format video input for high video quality HD DVR/HVR applications.
(Novatek NT98336 Evaluation Kit)
The Hailo-8™ artificial intelligence processor uses the Hailo-8™ M.2 module, which is an AI accelerator module suitable for AI applications. The AI module is based on the Hailo-8™ artificial intelligence processor with 26 trillion operations per second (TOPS) and is highly energy efficient. The M.2 AI accelerator features a complete PCIe Gen-3.0 2-lane interface, delivering unprecedented AI performance and delivering low-power deep neural network inference to a broad range of markets. Leveraging Hailo's comprehensive dataflow compiler and its support for standard AI frameworks, its neural network model Hailo-8 can be easily ported to deliver high-performance AI products.
(Hailo-8™ M.2 AI Acceleration Module)
(Hailo-8™ M.2 AI Acceleration Module + PCIe adapter board)
How to use the application board
Connect the application board and peripheral related devices (ex. 12V power supply, HDMI screen, camera)
Turn on the intelligent image video analysis display from the HDMI port output to mark people or objects in a frame.
►Scenario application diagram
Smart city, smart home, smart retail
Hailo-Hailo-8™ M.2 starter kit user guide
►Display board photo
►Solution block diagram
►Core technology advantages
(1) Image monitoring combined with AI computing actions is more accurate (2) Support DVR/HVR hybrid application (3) Supports multiple image display output interfaces HDMI/VGA/CVBS (4) Achieve real-time, low-latency, and high-efficiency artificial intelligence reasoning (5) Proprietary new structure-driven data flow architecture (6) Provide scalable functions through chip cascading (7) Achieve simultaneous processing of multiple streams and multiple models (8) High-precision simultaneous processing of multiple people and high-quality image and video recognition analysis (9) Improve video analysis and be cost-effective (10) Most cost effective (TOPS/$) compared to existing solutions
►Project specifications
(1) ARM Cortex-CA53 Quad Cores NT98336 core chip (2) 4CH, 8CH, 16CH Multi-channel encoding up to 1080p@300fps (3) 26 tera operations per second (TOPS) Hailo-8™ M.2 AI accelerator module (4) Hailo-8™ supports frameworks TensorFLow, TensorFlow Lite, ONNX, Keras, and Pytorch (5) Complete PCIe Gen-3.0 2-lane interface (6) Linux OS system (7) Power input uses 12V/2A Q&A Q1. What operating systems does the solution support? A: NT98336 supports Linux, Novatek HDAL system framework, maintains consistent API interface, and is universal across platforms/chips. Q2. What image format output can the solution support? A: NT98336 HDMI can output up to 4K2K, and VGA can output up to 1080P/60fps. Q3. Does the solution provide a storage device interface? A: NT98336 provides a storage device interface that supports 2 SATA 3.0 Q4. What are the artificial intelligence processor support frameworks in the solution? A: Hailo-8™ supports frameworks such as TensorFLow, TensorFlow Lite, ONNX, Keras, and Pytorch Q5. What is the temperature range of the AI processor in the solution? A: Hailo-8™ supports an extended temperature range of -40°C to 85°C Q6. What is the power consumption of the artificial intelligence processor in the solution? A: Hailo-8™ generally consumes 2.5 watts Q7. What are the advantages of the artificial intelligence processor in the solution? A: Hailo-8™ features up to 26 TOPS and best-in-class energy efficiency
