Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Faster Open-Source Llama3 Serving with SGLang Runtime (vs. TensorRT-LLM, VLLM) (lmsys.org)
4 points by yvbbrjdr on July 25, 2024 | hide | past | favorite


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: