2 docs tagged with "AI Inference"

Learn how to install and run Ollama on NeoEdge NG4500 for local LLM inference with CUDA acceleration. Supports DeepSeek-R1 and other mainstream models.

Deploy YOLOv8 object detection to edge devices with NeoMind's first AI inference extension — full engineering walkthrough of lazy model loading, ONNX Runtime dylib governance, and capability-based device frame acquisition