Hackernews posts about Llama2

Llama2 is a large language model that has achieved impressive performance in natural language processing tasks, outperforming ChatGPT and other models in various benchmarks.

1. Llama-Factory: Unified, Efficient Fine-Tuning for 100 Open LLMs (github.com)
   132 points by jinqueeny 14 days ago | 19 comments
2. Llama.cpp: Deterministic Inference Mode (CUDA): RMSNorm, MatMul, Attention (github.com)
   6 points by diwank 17 days ago | discuss
3. Meta's AI system Llama approved for use by US Government agencies (www.reuters.com)
   5 points by TMWNN 10 days ago | 1 comments
4. Load Llama-3.2 WebGPU in the browser from a local folder (simonwillison.net)
   3 points by indigodaddy 24 days ago | discuss
5. Launch HN: Cactus (YC S25) – AI inference on smartphones (github.com)
   123 points by HenryNdubuaku 14 days ago | 63 comments
6. Show HN: Entropy-Guided Loop – How to make small models reason (github.com)
   33 points by andrewmonostate 29 days ago | 4 comments
7. Show HN: STT –> LLM –> TTS pipeline in C (github.com)
   11 points by RhinoDevel 16 days ago | discuss
8. Show HN: I built an AI that roasts your website and gives tips to fix it (ai-roast-vert.vercel.app)
   7 points by happy_malone 21 days ago | 4 comments
9. How are you securing your GenAI apps from malicious prompts?
   4 points by letters_digits 13 days ago | discuss
10. Show HN: VeritasGraph,An on-premise Graph RAG with verifiable source attribution (github.com)
    3 points by Bibinprathap 25 days ago | 1 comments
11. Show HN: Prompt-to-proof: reproducible LLM eval with hash-chained receipts (github.com)
    3 points by Qendresahoti 28 days ago | discuss
12. Ask HN: What in your opinion is the best model for vibecoding? My thoughts below
    1 points by adinhitlore 16 days ago | 2 comments
13. Show HN: Mixture of Voices–Open source goal-based AI router-uses BGE transformer
    1 points by KylieM 15 days ago | 1 comments
14. LLM Inference Providers – Recommendations?
    1 points by ane-multiverse 16 days ago | discuss
15. Show HN: Aotol AI – Offline LLM app runs on iOS with voice and multilingual (apps.apple.com)
    1 points by doublez78 18 days ago | discuss
16. We bought the whole GPU, so we're damn well going to use the whole GPU (hazyresearch.stanford.edu)
    461 points by sydriax 4 days ago | 88 comments
17. Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5 (github.com)
    347 points by b4rtazz 27 days ago | 161 comments
18. Pdf to Text .NET CLI Converter (github.com)
    4 points by optiklab 12 days ago | discuss
19. Good starting point for professional AI workstation? (www.llamabuilds.ai)
    3 points by ericdotlee 15 days ago | 3 comments
20. Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2 (github.com)
    320 points by jjwiseman almost 2 years ago | 55 comments
21. Fast and Portable Llama2 Inference on the Heterogeneous Edge (www.secondstate.io)
    313 points by 3Sophons almost 2 years ago | 98 comments
22. JetMoE: Reaching LLaMA2 performance with 0.1M dollars (research.myshell.ai)
    272 points by gyre007 over 1 year ago | 90 comments
23. M2 Ultra can run 128 streams of Llama 2 7B in parallel (github.com)
    268 points by behnamoh almost 2 years ago | 173 comments
24. Fast Llama 2 on CPUs with Sparse Fine-Tuning and DeepSparse (neuralmagic.com)
    238 points by mwitiderrick almost 2 years ago | 26 comments
25. SlowLlama: Finetune llama2-70B and codellama on MacBook Air without quantization (github.com)
    156 points by behnamoh almost 2 years ago | 54 comments
26. SEQUOIA: Exact Llama2-70B on an RTX4090 with half-second per-token latency (infini-ai-lab.github.io)
    131 points by zinccat over 1 year ago | 61 comments
27. LlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAs (arxiv.org)
    124 points by PaulHoule about 1 year ago | 29 comments
28. LoRA Fine-Tuning Efficiently Undoes Safety Training from Llama 2-Chat 70B (www.lesswrong.com)
    112 points by Tomte almost 2 years ago | 84 comments
29. Run Llama 2 uncensored locally (ollama.com)
    109 points by robertlagrant over 1 year ago | 30 comments
30. Energy-Efficient Llama 2 Inference on FPGAs via High Level Synthesis (arxiv.org)
    94 points by PaulHoule over 1 year ago | 29 comments
31. Llama2-shepherd a CLI tool to install multiple implementations of the llama2 (github.com)
    59 points by mikepapadim over 1 year ago | 8 comments
32. Yi-34B, Llama 2, and common practices in LLM training (blog.eleuther.ai)
    41 points by helloericsf over 1 year ago | 3 comments
33. Llama2.c running on a Silicon Graphics Indigo2 workstation (twitter.com)
    35 points by lambdaba over 1 year ago | 10 comments
34. EfficientQAT: LLM Quantization, gets a 2-bit llama2-70B outperform regular 13B (old.reddit.com)
    21 points by jackbravo about 1 year ago | discuss
35. Meta revokes Llama 2 licenses for anyone making a copyright claim (twitter.com)
    20 points by andy99 over 1 year ago | 12 comments
36. Microsoft releases Phi-2, a small model that outperforms Llama 2, Mistral 7B (venturebeat.com)
    20 points by mjirv almost 2 years ago | 1 comments
37. Show HN: Llama 2 Uncensored 70B as API (woolapi.com)
    18 points by chernikovalexey almost 2 years ago | 11 comments
38. Activations inside Llama-2 show an internal model of the world (twitter.com)
    16 points by mindwok almost 2 years ago | 8 comments
39. Nvidia Tops Llama 2, Stable Diffusion Speed Trials (spectrum.ieee.org)
    16 points by rbanffy over 1 year ago | 5 comments
40. Llama-2 with 40% of layers removed on par with original (twitter.com)
    14 points by drexlspivey over 1 year ago | 1 comments
41. Scaling LLama2-70B with Multiple Nvidia/AMD GPU (blog.mlc.ai)
    13 points by junrushao1994 almost 2 years ago | 6 comments
42. Llama 2 LLM on DOS (yeokhengmeng.com)
    11 points by ingve 6 months ago | discuss
43. Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral (www.braintrustdata.com)
    10 points by ankrgyl almost 2 years ago | 19 comments
44. Show HN: Llama2.c on a Commodore C64 (github.com)
    10 points by AMICABoard 7 months ago | 7 comments
45. Llama 2: The Missing Manual (www.pinecone.io)
    10 points by gk1 almost 2 years ago | 2 comments
46. 1M tokens for $0.5 on Llama 2 70B-Cheaper than OpenAI GPT3.5-turbo by 3x (www.cerebrium.ai)
    9 points by za_mike157 almost 2 years ago | discuss
47. NousResearch/Nous-Hermes-2-Llama-2-70B (huggingface.co)
    8 points by tosh over 1 year ago | 2 comments
48. Llama2.c64: a port of llama2.c to the Commodore C64 (github.com)
    8 points by adunk 5 months ago | discuss
49. L2E llama2.c running in a PDF in a Shroedinger PNG [pdf] (github.com)
    6 points by AMICABoard 9 months ago | 2 comments