MLX performance improvement with in-place KVCache #201
Description
#124 adds MLX support. We need to adopt the in-place KV cache update pattern to improve performance.
{{ message }}
#124 adds MLX support. We need to adopt the in-place KV cache update pattern to improve performance.