Skip to content

[WIP]: Support prefix caching with routed experts#4171

Draft
RunningLeon wants to merge 4 commits intoInternLM:mainfrom
RunningLeon:block-trie-experts
Draft

[WIP]: Support prefix caching with routed experts#4171
RunningLeon wants to merge 4 commits intoInternLM:mainfrom
RunningLeon:block-trie-experts

Commits

Commits on Nov 28, 2025

Commits on Dec 2, 2025