SmartNews
Interests
Topics
Top Domains
History
About
Topics
MLC-LLM
Hackernews posts about MLC-LLM
Benchmarking LLM Inference Back Ends: VLLM, LMDeploy,
MLC-LLM
, TensorRT-LLM, TGI
(www.bentoml.com)
15 points by
chaoyu
11 months ago
|
1 comments
MLC LLM
: 70B Llama-2-4bit on MacBook at 50%-80% speed of A100
(twitter.com)
12 points by
junrushao1994
almost 2 years ago
|
3 comments
Benchmarking LLM Inference Back Ends: VLLM, LMDeploy,
MLC-LLM
, TRT-LLM, and TGI
(bentoml.com)
12 points by
sherlockxu
about 1 year ago
|
2 comments
Comparing LLM Optimization Tools: VLLM, LMDeploy,
MLC-LLM
, TensorRT-LLM, and TGI
(www.bentoml.com)
2 points by
bbzjk7
about 1 year ago
|
discuss
MLC LLM
: Universal Language Model Deployment Across Diverse Hardware and Apps
(llm.mlc.ai)
1 points by
georgehill
over 1 year ago
|
discuss
Show HN: The fastest way to run Mixtral 8x7B on Apple Silicon Macs
18 points by
woadwarrior01
about 1 year ago
|
22 comments
Ask HN: What open source LLM and diffusion projects do you rely on?
5 points by
tikkun
almost 2 years ago
|
1 comments