Tengine is a lite, high performance, modular inference engine for embedded device

Efficient Inference of Transformer models

Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

TinyVision - A Tiny Linux Board / IPC / Server / Router / And so on...

FREE TPU V3plus for FPGA is the free version of a commercial AI processor (EEP-TPU) for Deep Learning EDGE Inference

Windows app for developers. Learn what you can do and how to add AI with local models and APIs in your Windows app.

Easy usage of Rockchip's NPUs found in RK3588 and similar chips

YoloV5 NPU for the RK3566/68/88

hardware design of universal NPU(CNN accelerator) for various convolution neural network

Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series

ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference

Simplified AI runtime integration for mobile app development

C/C++ development kit for Sipeed Maix ecosystem boards

Run your yolov7 object detection with Rockchip NPU platforms (RK3566, RK3568, RK3588, RK3588S, RV1103, RV1106, RK3562).

Advanced driver-assistance system with Google Coral Edge TPU Dev Board / USB Accelerator, Intel Movidius NCS (neural compute stick), Myriad 2/X VPU, Gyrfalcon 2801 Neural Accelerator, NVIDIA Jetson Nano and Khadas VIM3

YoloV8 NPU for the RK3566/68/88

Kotlin bindings for Edgerunner

NPUsim: Full-system, Cycle-accurate, Value-aware NPU Simulator

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU