Hackernews posts about H100s

  1. Tracing tokens through Llama 3.1 8B inference on H100s (krithik.xyz)
    3 points by krithik_7 13 days ago | 1 comments
  2. Show HN: Gpu.fund, live GPU cloud rental prices (gpu.fund)
    4 points by justacatbot 16 days ago | 1 comments
  3. Open-Source Inference is growing 10% week over week this year
    2 points by luew 27 days ago | 1 comments
  4. Story of Two GPUs: Characterizing the Resilience of Hopper H100 and Ampere A100 (arxiv.org)
    2 points by rbanffy 18 days ago | discuss
  5. GPU at $2.25/HR or $12.29/HR: The Infrastructure Layer That Determines Price
    2 points by jaynamburi 24 days ago | discuss
  6. Why isn't AMD's MI300X competitive? (newsletter.semianalysis.com)
    46 points by colonCapitalDee 25 days ago | 36 comments
  7. $2 H100s: How the GPU Rental Bubble Burst (www.latent.space)
    403 points by swyx over 1 year ago | 279 comments
  8. Furiosa: 3.5x efficiency over H100s (furiosa.ai)
    212 points by written-beyond 4 months ago | 160 comments
  9. Musk confirms 12K H100s ordered for Tesla were instead prioritized for xAI (www.theregister.com)
    21 points by mfiguiere almost 2 years ago | 2 comments
  10. Show HN: Prime Intellect GPU Cloud. H100s starting at $1.65/HR on demand (app.primeintellect.ai)
    7 points by johannesha almost 2 years ago | discuss
  11. Show HN: A GPU group-buying layer to get enterprise rates (~50% off H100s) (trysaga.ai)
    5 points by DdotR over 1 year ago | discuss
  12. The "setup tax" on AWS H100s is killing iterative research
    3 points by miyamotomusashi 5 months ago | 2 comments
  13. A100s are more cost-efficient than H100s for small training tasks (cloudbreakr.substack.com)
    3 points by jack_nclx 5 months ago | 1 comments
  14. Scaling Coding-Agent RL to 32x H100s. 160% Improvement on Stanford's TBench (github.com)
    2 points by Danau5tin 7 months ago | 1 comments
  15. Free H100s for All .EDU User Emails (app.hyperbolic.xyz)
    2 points by hyperbolic_labs about 1 year ago | discuss
  16. Who's Hoarding Nvidia H100s? (sherwood.news)
    2 points by jonathanmkeegan almost 2 years ago | discuss
  17. CUDA Programming for Nvidia H100s (www.freecodecamp.org)
    1 points by eigenBasis about 1 month ago | discuss
  18. Flux Fast: Making Flux Go Brrr on H100s (pytorch.org)
    1 points by sayak_paul_hf 11 months ago | discuss
  19. Show HN: Terminal-Bench-RL: Training long-horizon terminal agents with RL (github.com)
    125 points by Danau5tin 10 months ago | 12 comments
  20. Show HN: H100cloud.com – Dutch Auction Cloud Exchange (h100cloud.com)
    11 points by zandrew almost 2 years ago | discuss
  21. Show HN: I built a website where you can easily fine-tune Llama 3.1 models (www.tunellama.com)
    8 points by hamadafm over 1 year ago | 4 comments
  22. Ask HN: Is anyone using AMD GPUs for their AI workloads?
    6 points by technoabsurdist 11 months ago | 2 comments
  23. Ask HN: Where do you rent GPUs from?
    2 points by kd1996 about 2 months ago | discuss
  24. Show HN: Airbnb for GPUs (www.gpudeploy.com)
    2 points by lschneider almost 2 years ago | discuss
  25. A claudeism that I want to confirm if anyone else is experiencing
    1 points by ramenprofitable 3 months ago | 1 comments
  26. So you want to rent an NVIDIA H100 cluster? 2024 Consumer Guide (www.photoroom.com)
    297 points by ea016 almost 2 years ago | 139 comments
  27. Deploying DeepSeek on 96 H100 GPUs (lmsys.org)
    285 points by GabrielBianconi 9 months ago | 80 comments
  28. AMD's MI300X Outperforms Nvidia's H100 for LLM Inference (www.blog.tensorwave.com)
    280 points by fvv almost 2 years ago | 264 comments
  29. Processing Strings 109x Faster Than Nvidia on H100 (ashvardanian.com)
    216 points by ashvardanian 8 months ago | 26 comments
  30. Huawei's Ascend 910C delivers 60% of Nvidia H100 inference performance (www.tomshardware.com)
    118 points by sien over 1 year ago | 61 comments
  31. Exploring inference memory saturation effect: H100 vs. MI300x (dstack.ai)
    57 points by latchkey over 1 year ago | 12 comments
  32. Colossus AI Supercluster with over 100k Nvidia H100 GPUs (twitter.com)
    47 points by DeathArrow over 1 year ago | 33 comments
  33. Processing Strings 109x Faster Than Nvidia on H100 (ashvardanian.com)
    34 points by samspenc 8 months ago | 3 comments
  34. How to train a model on 10k H100 GPUs? (soumith.ch)
    33 points by bobrenjc93 over 1 year ago | discuss
  35. Dual RTX 5090 Beats $25,000 H100 in Real-World LLM Performance (www.hardware-corner.net)
    29 points by mdp2021 about 1 year ago | 12 comments
  36. XAI's Memphis Supercluster has gone live, with up to 100,000 Nvidia H100 GPUs (www.datacenterdynamics.com)
    21 points by belter almost 2 years ago | 9 comments