SIYI AI tracking module supports collaborative control with SIYI optical pods and gimbal cameras to achieve real-time tracking and capture of targets and can highlight the tracking target in the picture through real-time focus and zoom.

It supports the anti-lost function. During the tracking process, if the target is blocked or briefly leaves the monitoring screen, the AI tracking module can automatically recognize and continue tracking when it re-enters the monitoring screen.

To ensure you a good experience of the product, please read this manual carefully.

INTRODUCTION

Product Features

4T Computing Power

SIYI AI tracking module has a computing power of up to 4Tops @ INT8, has strong performance in processing big-data artificial intelligence calculations, supports real-time AI recognition and tracking control of drones in the air, and can be widely used in surveillance, agriculture, forestry and plant protection, environmental monitoring, logistics and transportation and many other popular fields.

Human, Vehicle, and Boat Recognition Multi-Target Monitoring

SIYI AI tracking module supports target recognition and tracking based on artificial intelligence technology, automatically recognize and record pedestrians, vehicles (including cars, trucks, and buses), and boats in the monitoring area, and support simultaneous monitoring of multiple targets.

Gimbal Camera Collaborative Anti-Lost Tracking

SIYI AI tracking module supports collaborative control with SIYI optical pods and gimbal cameras to achieve real-time tracking and capture of targets and can highlight the tracking target in the picture through real-time focus and zoom.

It supports the anti-lost function. During the tracking process, if the target is blocked or briefly leaves the monitoring screen, the AI tracking module can automatically recognize and continue tracking when it re-enters the monitoring screen.

Mini Size & Lightweight Abundant Features

Specifically optimized for drone application scenarios, the SIYI AI tracking module adopts a small size, lightweight, and low power consumption design. It also has Ethernet output and HDMI output video streams.

Interface & Pinouts

Technical Specification

Mark

Please format the SD card to FAT32 before the camera firmware upgrade.

Packing List

1 x SIYI AI Tracking Module

1 x SIYI Gimbal Power Cable (Power supply cable for SIYI gimbal)

1 x SIYI AI Tracking Module to SIYI Gimbal Ethernet Cable

(Connect SIYI AI tracking module’s Ethernet port to SIYI gimbal’s Ethernet port)

1 x SIYI AI Tracking Module to SIYI Link Cable

(Connect SIYI AI tracking module’s Ethernet port to SIYI MK15 / HM30 air unit’s Ethernet port)

1 x SIYI AI Tracking Module to SIYI Link Y Cable

(A Y cable that connects the SIYI AI tracking module with the SIYI MK15 / HM30 air unit for powering the AI tracking module, transferring video stream, and controlling signal)

Indicator Definition

There are two indicators on the SIYI AI tracking module to indicate the system’s working or abnormal status: power indicator and status indicator.

Power Indicator

Solid Red: The module is powered normally.

Status Indicator

Solid Yellow: Under firmware upgrade.

Yellow Blinks: The camera is not connected.

Solid Green: The system is starting.

Green Blinks: The system is running normally.

Red-Yellow Blinks: Parameter resets successfully.

GET READY TO USE SIYI AI TRACKING MODULE

Typical Connection Diagram

ZT30

ZT6

ZR30

ZR10

A8mini

SIYI AI tracking module supports target recognition and tracking. Recognizable target types are Human, Auto Mobile (Car, Truck, Bus), and Boat.

Function ON / OFF

1. Please refer to Chapter 2.1 in this manual to connect the SIYI AI tracking module with the SIYI gimbal and SIYI link.

2. Confirm if the gimbal camera’s firmware has been upgraded to be compatible with the SIYI AI tracking module.

3. Confirm if the SIYI FPV app has been upgraded to be compatible with the SIYI AI tracking module.

4. Run the SIYI FPV app, go to “Settings – Addresses”, and select “SIYI AI Camera”.

5. Return to the main image, and touch the AI tracking function button to enable the function.

6. Touch the button again to disable the function.

Mark

Using the SIYI AI tracking module with multiple-sensor optical pods, in the SIYI FPV app, the mainstream of the optical pod should be configured as a zoom camera.

Target Recognition

When the AI tracking module is enabled, and recognizable targets go in the image, they will be surrounded by white recognition boxes. A function is working normally.

Target Tracking

Touch the white recognition box in the image, the box turns blue, and the AI tracking function button turns green. The Gimbal camera starts to track the target.

Mark

The zoom camera will zoom simultaneously during target tracking to keep the target displayed in the center of the image. And the zoom multiples will be displayed as well.

HOW TO CONFIGURE THE MODULE

SIYI AI tracking module can be configured through an SD card, and so does firmware upgrade.

Mark

It is suggested to format the SD card to FAT32 before the firmware upgrade.

It is suggested to insert the SD card into the AI tracking module and run it for a while, then you will see the files related to the module configuration.

The two “.txt” files in the root category of the SD card are for checking and changing module configuration.

“curip.txt” for checking the current IP addresses. “setip.txt” for customers to change IP addresses.

IP Addresses

Check IP Addresses

Open the “curip.txt” file, you will see the current IP addresses and gateway of the AI tracking module.

“192.168.144.60” is the factory default module IP address. “192.168.144.12” is the factory default module gateway.

Change IP Addresses

Open the “setip.txt” file, and input the IP addresses you need after “IP = ”.

Then insert the SD card to the module and power it. After three to five minutes,

the new IP addresses will be flashed into the module. Then we restart the module to finish changing IP addresses.

Mark

In the SIYI FPV app, the default IP address for “SIYI AI Camera” is “192.168.144.60”. After changing module IP addresses, it is necessary to manually input the relevant IP addresses in the SIYI FPV app to acquire video & data stream from the AI tracking module.

When you are using the SIYI AI tracking module with SIYI gimbals and SIYI links, please configure its IP addresses within “192.168.144.X” and avoid conflicting with their existing IP addresses. Please refer to the “Common IP Addresses” chapter in the SIYI link and SIYI gimbal manuals for details.

Client (Gimbal Camera) Addresses

Check Client Addresses

Open the “curip.txt” file, you will see the current client addresses and communication port of the AI tracking module.

“192.168.144.25” is the current client address. “37256” is the client communication port.

Change Client Addresses

Open the “setip.txt” file, input the client addresses you need after “VideoAddress

= ”, input the communication port after “VideoPort = ”.

Then insert the SD card to the module and power it. After three to five minutes, the new IP addresses will be flashed into the module. Then we restart the module to finish changing IP addresses.

Mark

The default IP address for SIYI cameras is “192.168.144.25”. If you have changed camera IP addresses, it is necessary to manually input the relevant client addresses for the SIYI AI tracking module to establish a video & data stream between the AI tracking module and the gimbal camera.

Firmware Upgrade
Check Firmware Version

Open the “curip.txt” file, you will see the current firmware version of the AI tracking module.

Firmware Upgrade Steps

Before upgrading, it is necessary to prepare the tools, software, and firmware below.

SD / TF card

Mark

Customers should prepare the above tools.

SIYI AI Tracking Module Firmware

Mark

The above tools can be downloaded from the “Downloads” page on the SIYI official website.

Steps

1. Save the module firmware’s “.bin” file to the SD / TF card’s root directory and do not change the file name.

2. Insert the SD card with saved firmware into the SIYI AI tracking module and power it.

3. Wait for three to five minutes, camera firmware will be flashed automatically and disappear from the SD card.

4. Restart the module to make the configuration work.

Reset Module Configuration

You can reset the SIYI AI tracking module to the factory configuration by pressing the RST button for five seconds.

Common IP Addresses

SIYI AI Tracking Module’s Default IP Addresses: 192.168.144.60

SIYI Optical Pod / Gimbal Camera’s Default IP Addresses: 192.168.144.25 (NEW) SIYI Optical Pod / Gimbal Camera’s Default RTSP Addresses:

• SIYI AI Camera: rtsp://192.168.144.60/video1
• Main Stream: rtsp://192.168.144.25:8554/video1
• Sub Stream: rtsp://192.168.144.25:8554/video2(NEW) SIYI FPV App’s Private Video Stream Protocol’s Addresses:
• SIYI AI Camera: 192.168.144.60:37256
• SIYI Camera 1 Main Stream: 192.168.144.25: 37256
• SIYI Camera 1 Sub Stream: 192.168.144.25: 37255
• SIYI Camera 2 Main Stream: 192.168.144.26: 37256
• SIYI Camera 2 Sub Stream: 192.168.144.26: 37255

Mark

SIYI cameras were released after ZT30 (including ZT30) started to use the new addresses.

SIYI cameras released before ZT30 (including ZR30, A2 mini, A8 mini, ZR10, and R1M) are still using the old addresses.

5 SIYI FPV APP

SIYI FPV is an Android application developed by SIYI to configure many SIYI products for video display, camera stream settings, and communication link status monitoring.

Mark

This chapter is edited based on SIYI FPV App v2.5.15.679.

SIYI FPV App can be downloaded from the “Downloads” page on this official website (https://siyi.biz/en).

SIYI FPV App compatible SIYI devices

• SIYI AI Tracking Module
• ZT30 Four-Sensor Optical Pod
• ZR30 4K AI 180X Hybrid Zoom Optical Pod
• A2 mini Ultra-Wide-Angle FPV Gimbal
• MK32 / MK32E Enterprise Handheld Ground Station
• A8 mini AI Zoom Gimbal Camera
• ZR10 2K 30X Hybrid Zoom Optical Pod
• R1M HD Recording FPV Camera
• Air Unit HDMI Input Converter
• HM30 Full HD Image Transmission System
• MK15 / MK15E Mini Handheld Ground Station

SIYI FPV App OSD Information Definition

SIYI FPV Camera Function Icon Definition

Settings

In the “Settings” page, you can select camera type with stream type, select or input video stream IP addresses, custom app interface, and switch video decoding type.

About Settings

Camera IP: Select SIYI AI Camera, between SIYI Camera 1 and SIYI Camera 2, between main stream and substream, select or input video stream RTSP addresses, disable the image, or rotate the relevant image in 180 degrees.

Cross Sight: Enable/disable a cross sight in the center of the image.

Map: Enable/disable the map box over the left-bottom corner of the image. OSD Color: Customize the color of all OSD information.

Decoding Type: Switch between “Hardware Decoding” and “Software Decoding”. Please refer to your camera and your device to display video for the best decoding type.

Link Status

Display the link status directly over the FPV image.

About Link Status

OSD: Enable/disable standard OSD information.

Mavlink OSD: Enable/disable Mavlink OSD information.

Speed Unit: Switch speed unit between meters per second and kilometer per hour. Longitude and Latitude: Enable/disable information.

Gimbal Camera

Configure the abundant functions of the SIYI optical pod and gimbal camera.

About Gimbal Camera

Boot Record: Enable/disable automatic video recording by SD card as soon as the gimbal camera is powered.

File Manager: Preview stored images in TF card. Format the TF card.

Laser Calibration: The target position in the camera image may need to be calibrated to match the accurate laser rangefinder orientation.

Full Image Thermometric: Enable/disable the full image temperature measurement

feature in the thermal imaging camera.

Synchronize Zoom: Enable/disable simultaneous zooming of the thermal camera and the zoom camera.

Main / Sub Stream: Configure the mainstream and the sub-stream separately for their camera source and parameters.

Image Mode: Select the video stream’s image type and camera source. Single image or split image. Zoom camera, wide-angle camera, or thermal imaging camera.

Stream Resolution: Decide to switch the output resolution of the current video stream or not according to the camera source. Max output resolution is Ultra HD (1080p).

Record Resolution: Decide to switch the recording resolution or not according to the camera source. The maximum record resolution is 4K.

Gimbal Working Mode: Switch the gimbal working mode among Lock Mode, Follow Mode, and FPV Mode.

• Lock Mode: Horizontally, the gimbal does not follow when the aircraft rotates.
• Follow Mode: Horizontally, the gimbal follows when the aircraft rotates.
• FPV Mode: The Gimbal rotates simultaneously as the aircraft rolls to get an FPV view, and output images with enhanced stability.
• AI Tracking Mode: When the gimbal is connected to the AI tracking module and the function is enabled, there will be only AI tracking mode displayed.Camera Firmware Version: Display the current camera firmware version. Gimbal Firmware Version: Display the current gimbal firmware version. Zoom Firmware Version: Display the current gimbal firmware version.

About SIYI FPV

Displays the software version of SIYI FPV and common contact information of SIYI Technology.

SIYI FPV App Update Log

SIYI FPV SDK

SIYI provides the SIYI FPV SDK to help professional Android application developers integrate the unique features of the SIYI FPV app into their own GCS.

Access Method

Add “fpvlib” to Your Project

Copy the “fpvlib.aar” file to the “libs” folder in your “module” like below:

Revise the “build. gradle” file:

Configure “AndroidManifest” File

Add USB reading authorization to the “AndroidManifest” file in your “module” and configure the “intent-filter” file.

Add FPV Display Function into Code

Add JNI Library

Like the example below, add the JNI library file into the “main” directory, then the “so” library file can be copied from the “demo” to your project directory.

Add FPV Video Display to Code

Please pay attention to the below points for your code:

• Firstly, use the static method “getInstances()” of “ConnectionManager” to get the “ConnectionManager” object. Then call the “ConnectionManager.checkConnectWithIntent()” method in the lifecycle method “onCreate()” and “onNewIntent()”.
• Video stream should be displayed through “SurfaceView”. So, we create a “SurfaceView” object and need to call “ConntionManager.notifySurfaceCreate()” and “notifySurfaceDestroy” methods from “surface created()” and “surfaceDestroy()”

mSurfaceView.getHolder().addCallback(new SurfaceHolder.Callback() {

@Override

public void surfaceCreated(SurfaceHolder holder) { Logcat.d(TAG, “onSurfaceCreated…”); connection manager.notifySurfaceCreate(holder.get surface());

}

@Override

public void surface changed(SurfaceHolder holder, int format, int width

, int height) {

}

@Override

public void surfaceDestroyed(SurfaceHolder holder) { mConnectionManager.notifySurfaceDestroy(holder.getSurface());

}

});

• Dual-Channel FPV Display: Dual-channel FPV display supports Ethernet connection only. It does not support AOA or USB connection. For dual-channel FPV display, we should configure the IP addresses first, then create two “SurfaceView” for image display. Whether the second video stream is required or not can be judged by the connection type through connection status. You can refer to “demo” for details.
• When you quit the application, please do not forget to call the “UsbConnectionManager.release()” method. For more detail, please refer to the codes in “demo”.

Interface Instructions

ConnectionManager

SettingsConfig

SYSDKCameraManager

SIYI FPV SDK Update Log