SmartNews
Interests
Topics
Top Domains
History
About
Topics
MLC-LLM
Hackernews posts about MLC-LLM
Benchmarking LLM Inference Back Ends: VLLM, LMDeploy,
MLC-LLM
, TensorRT-LLM, TGI
(www.bentoml.com)
15 points by
chaoyu
almost 2 years ago
|
1 comments
Benchmarking LLM Inference Back Ends: VLLM, LMDeploy,
MLC-LLM
, TRT-LLM, and TGI
(bentoml.com)
12 points by
sherlockxu
almost 2 years ago
|
2 comments
Comparing LLM Optimization Tools: VLLM, LMDeploy,
MLC-LLM
, TensorRT-LLM, and TGI
(www.bentoml.com)
2 points by
bbzjk7
almost 2 years ago
|
discuss
Nyth AI – Local LLM Inference on iOS Using
MLC-LLM
and TVM
(apps.apple.com)
1 points by
rida123
about 1 month ago
|
discuss
Show HN: Aotol AI – Offline LLM app runs on iOS with voice and multilingual
(apps.apple.com)
1 points by
doublez78
8 months ago
|
discuss