Vision

Zero-01 platform has a 1080p camera mounted on the head of the robot.

Video Streaming

OpenLCH SDK provides a function to start video streaming from the robot.

openlch start-video-stream
openlch get-video-stream-urls

Currently, the video stream is available over RTSP, HLS, MSE and WebRTC.

Image Processing and Object Detection

Neural acceleration is available via CVITEK’s NPU. Here is a list of models tested by manufacturer:

To learn more about the neural acceleration, please refer to the Milk-V documentation.

Specifications

Sensor Features

• Resolution: 1920 x 1080 (2MP)
• Optical Size: 1/3 inch
• Pixel Size: 2.7μm × 2.7μm FSI
• Frame Rate: 30fps at full resolution
• Dynamic Range: 74dB
• Output Format: Raw Bayer 10bit/8bit

Lens Specifications

• Focal Length: 4mm ±5%
• Aperture: f/2.0
• Focus Range: 0.2m to infinity
• Field of View:
  • Diagonal: 88°
  • Horizontal: 67°
  • Vertical: 50°

Source Code

The source code for the camera streaming is available here. Please refer to the original repository for the neural model usage example.