标签:端侧 / 边缘

9 条
#仓库Stars
1triton-inference-server/server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
11k
2RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
10k
3cactus-compute/engine
2bit quants, kernels and runtime for consumer devices.
6.2k
4absmach/magistrala
IoT Platform Framework
2.7k
5openvinotoolkit/model_server
A scalable inference server for models optimized with OpenVINO™
956
6llama-farm/llamafarm
Deploy any AI model, agent, database, RAG, and pipeline locally or remotely in minutes
836
7lobehub/lobe-tts
🎤 Lobe TTS - A high-quality & reliable TTS/STT library for Server and Browser
810
8tbrowser/Turbo-Browser
Turbo Browser, 涡轮浏览器, 一款纯粹的高效浏览器;启动快、跑分高;Chrome / Edge 双商店、账号同步、数据导入、鼠标手势、截图、垂直标签、分屏对照、沉浸模式、小号标签,Windows / macOS 开箱即用
323
9Bisonai/awesome-edge-machine-learning
A curated list of awesome edge machine learning resources, including research papers, inference engines, challenges, books, meetups and others.
281