… 2665). 🔧 Added retry and verbose options to the TurboMind API for get ppl and get ll ( 2650, 2652). --- 🐛 Bug Fixes 🔧 Fixed reasoning parsing in the OpenAI, OpenAISDK
… feat: support structural tag response format for turbomind and pytorch engines by @windreamer in https://github.com/InternLM/lmdeploy/pull/4906 🐞 Bug fixes fix(turbomin
…ded LiteLLM as an AI gateway backend and extended TurboMind API capabilities with PPL evaluation support ( 2441, 2510). ✨ Broader Benchmark Coverage: Added new evaluation
…ttps://github.com/InternLM/lmdeploy/pull/4835 Add TurboMind ViT support for InternVL and Qwen VL models by @irexyc in https://github.com/InternLM/lmdeploy/pull/4719 feat:
…tps://github.com/InternLM/lmdeploy/pull/4559 feat(turbomind): memory allocator, object cache, and scheduler integration by @lzhangzz in https://github.com/InternLM/lmdepl
… 2266) 🔧 Fixed duplicate engine config update in TurboMindModelwithChatTemplate ( 2276) 🔧 Fixed torchrun to avoid unexpected PATH environment ( 2269) 🔧 Fixed the None