6 docs tagged with "AI Inference"

Developer guide for Cinfer model parameter specifications. Learn how to define YAML schemas for model inputs, outputs, and processing strategies for ONNX models.

Learn how to install and run Ollama on NeoEdge NG4500 for local LLM inference with CUDA acceleration. Supports DeepSeek-R1 and other mainstream models.

Deploy a real AI inference application Person Detection on NE503, mastering Python SDK calls, model and video stream discovery, permission configuration, and Web console verification.

Quick start guide for Cinfer, CamThink's Vision AI inference software. Learn to deploy ONNX models via Docker, manage services, and integrate APIs for image recognition.

Learn how to use Cinfer for AI model management, token authorization, and standardized API requests. Complete guide for software operations.

Deploy YOLOv8 object detection to edge devices with NeoMind's first AI inference extension — full engineering walkthrough of lazy model loading, ONNX Runtime dylib governance, and capability-based device frame acquisition