Hackernews posts about TensorRT-LLM

1. Show HN: LLGTRT: TensorRT-LLM+Rust server w/ OpenAI-compat and Structured Output (github.com)
   6 points by mmoskal almost 2 years ago | discuss
2. TensorRT-LLM runtime now open-source (github.com)
   4 points by mmoskal over 1 year ago | 1 comments
3. Show HN: TensorRT-LLM running natively on Windows (no WSL) (baremetalrt.ai)
   2 points by brianhabana123 about 1 month ago | discuss
4. TensorRT LLM (github.com)
   2 points by kristianpaul 4 months ago | discuss
5. 5x Faster Time to First Token with Nvidia TensorRT-LLM KV Cache Early Reuse (developer.nvidia.com)
   2 points by sandwichsphinx almost 2 years ago | discuss
6. Comparing GenAI Inference Engines: TensorRT-LLM, VLLM, HF TGI, and LMDeploy
   1 points by juliensalinas over 1 year ago | 1 comments
7. Qwen2-7B-Instruct with TensorRT-LLM: consistently high tokens/SEC (www.inferless.com)
   1 points by agcat almost 2 years ago | 1 comments
8. Automating Inference Optimizations with NVIDIA TensorRT LLM AutoDeploy (developer.nvidia.com)
   1 points by matt_d 6 months ago | discuss
9. Tuning TensorRT-LLM for Optimal Serving (www.bentoml.com)
   1 points by djhu9 almost 2 years ago | discuss
10. Zero-Shot Text Classification on a low-end CPU-only machine?
    8 points by backend-dev-33 almost 2 years ago | 12 comments
11. Show HN: Sweep, AI autocomplete for JetBrains that rewrites code (sweep.dev)
    5 points by williamzeng0 11 months ago | discuss
12. Show HN: LLMOne – Deploy LLMs from bare metal to production in hours (github.com)
    5 points by pescn about 1 year ago | discuss
13. Show HN: Small hardware box that runs local LLMs and exposes an OpenAI API (axis-one-psi.vercel.app)
    2 points by mjupp1 9 months ago | discuss
14. Defining a Metric for LLM Responsiveness
    1 points by Thomas-Mecattaf almost 2 years ago | 1 comments