[Star Vision Technology] SmartSens Sensor security monitoring solution
Based on the NOVATEK NT98530 chip, it is a new generation of security products. Traditional security products are mostly used in the field of monitoring, such as home anti-theft evidence collection, security monitoring of the elderly and children, and also used for police traffic monitoring, such as intersection monitors, remote video conferencing for computers, etc. Various applications have penetrated into daily life. The new generation of products has added AI functions, which has expanded the application level. For example, anti-theft can include facial recognition. It can issue warnings to strangers, and notify relevant people if an elderly person or child falls accidentally; when a fire breaks out, it can notify relevant units; in terms of transportation, it can do license plate recognition, vehicle speed detection, traffic monitoring and ADAS applications. In terms of business, it can do big data analysis of people flow, analyze the preferences of different age groups for different products, etc. Other AIOT applications, such as gesture control switches, lighting, etc., are becoming more and more abundant.
NT98530 integrates four ARM Cortex A53 cores, can capture 8Mp60 images, has advanced AI capabilities, the computing model is HW-CNN 2.5, the computing power is 2T, and can analyze face recognition. The image has a variety of input interfaces, including MIPI/LVDS/BT656/BT1120...etc., and the output interfaces include YUV/RGB/BT656/LCD Parallel/MIPI-DSI/HDMI/USB and Ethernet. There are also Video codec and Audio codec.
Image Sensor is an important component of the security monitoring system. A good Sensor determines the clarity, color saturation, brightness adjustment and strong light suppression. Therefore, many related technologies are derived, such as pixel merging, WDR, HDR, 3A adjustment, etc. SmartSens has been deeply involved in the sensor field for many years and has considerable market share and praise. In the field of security monitoring, SmartSens enhances technology in starlight night vision, HDR, Near-infrared gain and low image noise have achieved good results.
Novatek's IPCam processor and SmartSens Sensor have achieved very good results after optimization and adjustment. Therefore, we have also integrated a series of SmartSens Sensors into the NT98530 solution, such as the 8M SC850SL, the 5M SC530AI/SC5239, and the 2M SC2336. This year's main product SC850SL is particularly recommended. The maximum image rate can be 8Mp60, which can be used in car video recorders and network cameras. The module photos are as follows:
1. Hardware design
1.1 MIPI-CSI sensor
1.2 Storage
1.3 LPDDR4
1.4 LCD
2. Linux version and software architecture
2.1 Linux version
Linux 4.19
2.2 Software architecture
HDAL is the Hardware Device Abstraction Layer, which is used to replace the HAL layer of the existing software architecture. It was developed by Novatek and is applicable to many of its chips. The SDK uses HDAL as the main body to develop API interfaces that are independent of different chips and shared, so that the chips can perform better. It also provides many custom interfaces such as ISP, AI, IQ and other Vendor APIs, allowing users to implement many functions.
3. Image display setting steps
3.1 Connect the network cable between EVB and Notebook,
3.2 Setting Ethernet IPv4 settings are as follows,
3.3 After starting the computer, write the following command in the console
pq_video_rtsp 18 0 2 0 0 6
Run this command on boot to turn on the imx415+os02k10 sensor
3.4Execute VLC.exe
3.5 (SC850SL) Input network streaming location: rtsp://192.168.0.3/stream0
You can see the image later#
3.6 (SC2336) Enter the network streaming location: rtsp://192.168.0.3/stream1
You can see the image later#
4. List of available documents
4.1 Circuit diagram of NT98530 application motherboard
4.2 List of parts used
4.3 Layout file of NT98530 application motherboard
4.4 Mainboard parts location diagram
4.5 Mainboard wiring specifications
4.6 Application specifications of NT98530 design
4.7 NT98530 datasheet
4.8 SDK for NT98530
►Scenario application diagram
►Product entity diagram
►Display board photo
►Solution block diagram
►Core technology advantages
(1) Image monitoring combined with AI face recognition makes movements more precise; (2) There are high, medium and low series platforms to meet different market needs; (3) Sensor+ISP calibration technology; (4) Supports multiple sensor input interfaces, including MIPI-CSI/sub-LVDS/HiSPi/Parallel; (5) Supports multiple image resolutions up to 8Mp60; (6) Supports multiple image output interfaces, including LCD Parallel/MIPI_DSI/HDMI/USB/Ethernet;
►Project specifications
(1) The core of the chip is Qual Cortex-A53; (2) AI computing power is 2T; (3) The power input is 12V/1A; (4) The system OS is Linux; (5) Combine Video Codec and Audio Codec;
