Hackernews posts about TensorRT-LLM

1. 01
   

   newShow HN: LLGTRT: TensorRT-LLM+Rust server w/ OpenAI-compat and Structured Outputgithub.com

   ▲ 6mmoskal704ddiscusssavesaved
2. 02
   

   newTensorRT-LLM runtime now open-sourcegithub.com

   ▲ 4mmoskal572d💬 1savesaved
3. 03
   

   newShow HN: TensorRT-LLM running natively on Windows (no WSL)baremetalrt.ai

   ▲ 2brianhabana12387ddiscusssavesaved
4. 04
   

   newTensorRT LLMgithub.com

   ▲ 2kristianpaul169ddiscusssavesaved
5. 05
   

   new5x Faster Time to First Token with Nvidia TensorRT-LLM KV Cache Early Reusedeveloper.nvidia.com

   ▲ 2sandwichsphinx693ddiscusssavesaved
6. 06
   

   newComparing GenAI Inference Engines: TensorRT-LLM, VLLM, HF TGI, and LMDeploy

   ▲ 1juliensalinas545d💬 1savesaved
7. 07
   

   newAutomating Inference Optimizations with NVIDIA TensorRT LLM AutoDeploydeveloper.nvidia.com

   ▲ 1matt_d235ddiscusssavesaved
8. 08
   

   newZero-Shot Text Classification on a low-end CPU-only machine?

   ▲ 8backend-dev-33729d💬 12savesaved
9. 09
   

   newShow HN: Sweep, AI autocomplete for JetBrains that rewrites codesweep.dev

   ▲ 5williamzeng0362ddiscusssavesaved
10. 10
    

    newShow HN: LLMOne – Deploy LLMs from bare metal to production in hoursgithub.com

    ▲ 5pescn470ddiscusssavesaved
11. 11
    

    newShow HN: Small hardware box that runs local LLMs and exposes an OpenAI APIaxis-one-psi.vercel.app

    ▲ 2mjupp1320ddiscusssavesaved

· edit