Skip to content

fix: register cache_{k,v} as buffers in llama{3,4}#380

Open
omegacoleman wants to merge 1 commit intometa-llama:mainfrom
omegacoleman:register-kvcache-buffers
Open

fix: register cache_{k,v} as buffers in llama{3,4}#380
omegacoleman wants to merge 1 commit intometa-llama:mainfrom
omegacoleman:register-kvcache-buffers

Commits

Commits on Jul 19, 2025