SmartNews
Interests
Topics
Top Domains
History
About
Topics
MLC-LLM
Hackernews posts about MLC-LLM
Show HN: Aotol AI – Offline LLM app runs on iOS with voice and multilingual
(apps.apple.com)
1 points by
doublez78
18 days ago
|
discuss
Benchmarking LLM Inference Back Ends: VLLM, LMDeploy,
MLC-LLM
, TensorRT-LLM, TGI
(www.bentoml.com)
15 points by
chaoyu
about 1 year ago
|
1 comments
Benchmarking LLM Inference Back Ends: VLLM, LMDeploy,
MLC-LLM
, TRT-LLM, and TGI
(bentoml.com)
12 points by
sherlockxu
over 1 year ago
|
2 comments
Comparing LLM Optimization Tools: VLLM, LMDeploy,
MLC-LLM
, TensorRT-LLM, and TGI
(www.bentoml.com)
2 points by
bbzjk7
over 1 year ago
|
discuss
MLC LLM
: Universal Language Model Deployment Across Diverse Hardware and Apps
(llm.mlc.ai)
1 points by
georgehill
almost 2 years ago
|
discuss
Show HN: The fastest way to run Mixtral 8x7B on Apple Silicon Macs
18 points by
woadwarrior01
over 1 year ago
|
22 comments