Skip to content
MACT.ai
All work

AI Vision Device

A compact vision module that runs detection and tracking entirely on device.

2025Edge AI · Computer Vision · Embedded Linux
AI Vision Device

Project Overview

A palm-sized vision device for environments where video cannot leave the room. Detection, tracking and event classification all run locally on an NPU, and only structured events reach the cloud.

Challenge

The product needed continuous multi-stream inference under 4 W, with no video egress for privacy reasons, and a bill of materials that survived a consumer price point.

Solution

We paired a quantized detection backbone with a lightweight tracker so the heavy model runs at a reduced cadence while tracking holds identity between inferences. The result is a stable 30 fps pipeline on hardware that could not brute-force it.

Architecture

01

Hardware

A quad-core SoC with an integrated 6 TOPS NPU, MIPI CSI-2 camera input, and a 6-layer board with a controlled-impedance camera interface.

  • SoC with integrated NPU and ISP
  • Global-shutter sensor on MIPI CSI-2
  • 6-layer PCB, EMC pre-compliance passed first pass
  • Passive thermal design, no fan
02

AI

An INT8 detection model deployed to the NPU, with a Kalman-based tracker and a small temporal classifier for event logic.

  • INT8 quantization with per-channel calibration
  • Accuracy retained within 1.4% of the FP32 baseline
  • 18 ms inference latency at 640×640
  • Event classifier runs on CPU in under 2 ms
03

Software

An embedded Linux image built with Yocto, a GStreamer-based capture pipeline, and a web console for configuration and live event review.

  • Yocto image with A/B OTA and rollback
  • Zero-copy buffers from ISP to NPU
  • Local event store with cloud sync
  • Web console for zones, rules and review

Result

  • 30 fps sustained inference within a 3.8 W envelope
  • No raw video leaves the device — only structured events
  • Under 12 s cold boot to first inference
  • Field fleet updated over the air with staged rollout

Technology Stack

Hardware

SoC + NPUMIPI CSI-26-layer PCB

AI

ONNXINT8 QuantizationTracking

Embedded

Embedded LinuxYoctoGStreamerOTA

Cloud

MQTTEvent APIFleet Console