Is quantization possible for deepseek-ocr? #40
scratch-er
started this conversation in
Ideas
Replies: 1 comment
-
|
Currently, this is not simple, still alot work need to be done, but we have plans to support a smaller PaddleOCR (0.9B). |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
My laptop has 8 GiB of VRAM, it is not sufficient for deepseek-ocr? Is it possible to run a quantized version? If quantization is viable, is it possible for deepseek-ocr.rs to support quantization?
Beta Was this translation helpful? Give feedback.
All reactions