Change the repository type filter
All
Repositories list
21 repositories
grps_trtllm
PublicHigher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, support…grps
PublicDeep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming modes. It is dual-languag…TensorRT-LLM
PublicHSTU-Tensorflow
PublicHGCDR
PublicFPARec
PublicControlTalk
Publicgrps_examples
Publicgrps_vllm
Publicnn-infer-opt
Publiceasy-ngo
Publiceasy-ngo-website
Publiceasy-ngo-doc
Public archiveCSCE-Net
Publiceasy-ngo-examples
Publiceasy-ngo-layout
Publiceasy-ngo-tools
Publicngo
Public archivengo-demo
Public archivenetease-media.github.io
PublicPAMM-HiA-T5
Public