GitHub - joshualu777/LLM-SpecDec

Speculative Decoding with models using different tokenizers.

Name		Name	Last commit message	Last commit date
Latest commit History 76 Commits
imgs		imgs
sampling		sampling
.DS_Store		.DS_Store
.gitignore		.gitignore
LICENSE.txt		LICENSE.txt
Qwen_Qwen2-7Bxfacebook_opt-125m.json		Qwen_Qwen2-7Bxfacebook_opt-125m.json
README.md		README.md
alignment.py		alignment.py
benchmark.py		benchmark.py
facebook_opt-125mxQwen_Qwen2-7B.json		facebook_opt-125mxQwen_Qwen2-7B.json
globals.py		globals.py
main.py		main.py
mapping.json		mapping.json
requirements.txt		requirements.txt
serving.py		serving.py
statistics.json		statistics.json

Provide feedback