Hackernews posts about Llama-3.1 70B

1. Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU (github.com)
   395 points by xaskasdf 7 months ago | 101 comments
2. Cerebras Inference now 3x faster: Llama3.1-70B breaks 2,100 tokens/s (cerebras.ai)
   147 points by campers almost 2 years ago | 84 comments
3. Nvidia releases weights for Llama-3.1-Nemotron-70B-Instruct (huggingface.co)
   9 points by rvnx almost 2 years ago | 3 comments
4. Nvidia Llama-3.1-Nemotron-70B-Instruct (build.nvidia.com)
   9 points by KenHV almost 2 years ago | discuss
5. Insights from 84,000 comments on "Ask HN: Who Is Hiring" using Llama3.1-70B-FP16 (exxa.notion.site)
   8 points by Blue_Cosma almost 2 years ago | 1 comments
6. Llama 3.1 70B compressed by 6.4x using AQLM-PV, now released (huggingface.co)
   8 points by annaerma almost 2 years ago | discuss
7. Llama 3.1 Nemotron 70B: Open model closing the gap with GPT-4o and Sonnet-3.5 (huggingface.co)
   7 points by victormustar almost 2 years ago | discuss
8. Cerebras runs Llama 3.1 70B at 2,100 tokens per second, live demo available (twitter.com)
   6 points by modeless almost 2 years ago | discuss
9. Cerebras Inference now runs Llama 3.1-70B at 2100 tokens/s (cerebras.ai)
   6 points by cs-fan-101 almost 2 years ago | discuss
10. Llama-3.1-Nemotron-70B-Instruct Model (build.nvidia.com)
    2 points by lapnect almost 2 years ago | discuss
11. Show HN: Slash your LLM Inference Costs with Overnight Processing
    5 points by Blue_Cosma almost 2 years ago | 1 comments
12. Show HN: Mixlayer – code and deploy LLM prompts using JavaScript (www.mixlayer.com)
    5 points by zackangelo almost 2 years ago | discuss
13. Is it just me or are LLM chat bots still useless in many cases?
    3 points by pthr almost 2 years ago | 2 comments
14. Free Qwen 2.5, Llama Nemotron, OpenBioLLM, Gemini Exp 1121, and LearnLM 1.5 Pro
    2 points by gizai almost 2 years ago | 1 comments
15. Show HN: LLM-use – Open-source tool to route and orchestrate multi-LLM tasks
    2 points by justvugg 7 months ago | discuss
16. Show HN: Which LLM Finds Obscure Knife-Brand URLs Cheapest? (8-Model Benchmark) (new.knife.day)
    2 points by p-s-v over 1 year ago | discuss
17. Show HN: Slashing LLM Costs for Overnight Batch Inference
    2 points by Blue_Cosma almost 2 years ago | discuss
18. Show HN: I Used Llama-70B Logprobs for Better, Cheaper and Faster Chunking (github.com)
    1 points by ghita_ almost 2 years ago | discuss
19. Show HN: Most Efficient Batch API for Open-Source and Custom Models (withexxa.com)
    1 points by Blue_Cosma almost 2 years ago | discuss
20. Open-source 70B model surpass GPT-4o and Claude 3.5 on Arena Hard (huggingface.co)
    8 points by openbuilder almost 2 years ago | discuss
21. Nvidia Nemotron (huggingface.co)
    2 points by vincent_s almost 2 years ago | discuss
22. Show HN: Unfat, a library to easily train and distill LoRAs for LLMs (github.com)
    6 points by reissbaker over 1 year ago | discuss
23. Show HN: Sleeping LLM – A language model that remembers by sleeping (github.com)
    2 points by vbaranov87 7 months ago | discuss
24. Vakgpt: Open-Source Chat Wrapper for Rapid AI Prototyping
    1 points by krishna-vakx over 1 year ago | discuss
25. Show HN: LLM Fine-tuning platform with integrated data labeling (ubiai.tools)
    1 points by Mesterniz almost 2 years ago | discuss
26. Ask HN: How is GPU power draw measured at scale?
    6 points by anax32 3 months ago | 2 comments