Hackernews posts about MMLU

1. Graph-based multi-agents smash long-context benchmarks–89% MMLU-Pro on 8B models (github.com)
   1 points by FeelTheAGI2 5 days ago | 1 comments
2. Show HN: AIBenchy – Independent AI Leaderboard (aibenchy.com)
   1 points by XCSme 3 days ago | 1 comments
3. Show HN: MarginDash – See which AI customers are profitable (margindash.com)
   1 points by gdhaliwal23 5 days ago | 1 comments
4. Show HN: MarginDash – See which AI customers are profitable (margindash.com)
   1 points by gdhaliwal23 8 days ago | 1 comments
5. 430k-year-old well-preserved wooden tools are the oldest ever found (www.nytimes.com)
   511 points by bookofjoe 25 days ago | 261 comments
6. Show HN: DetectZeStack – REST API to detect any website's technology stack (detectzestack.fly.dev)
   1 points by mlugo-apx 10 days ago | discuss
7. What I learned from 500k LOC built with AI (mmlac.com)
   2 points by mmlac 4 days ago | discuss
8. The Only Reason to Explore Space (twitter.com)
   2 points by MrBuddyCasino 22 days ago | discuss
9. The Macroeconomics of Agentic AI: Are We the Peasant or the Horse? (mlumiste.com)
   1 points by skandium 1 day ago | discuss
10. The Bear Case for AI (twitter.com)
    1 points by MrBuddyCasino 26 days ago | discuss
11. GitHub: Competitive Intelligence and Monitoring List (github.com)
    2 points by mlukaszczyk 18 days ago | 1 comments
12. What 8 Agent Memory Systems Do (synix.dev)
    1 points by mlubin01 3 days ago | 1 comments
13. Show HN: DetectZeStack – Tech stack detection API with 4 detection layers (detectzestack.fly.dev)
    1 points by mlugo_apb 6 days ago | discuss
14. The Complete Competitive Intelligence Resource Guide (parano.ai)
    1 points by mlukaszczyk 18 days ago | discuss
15. Show HN: Parano.ai – Continuous Competitor Monitoring (parano.ai)
    1 points by mlukaszczyk 19 days ago | discuss
16. RlmUI- the HTML/CSS User Interface Library (github.com)
    1 points by kreco 22 days ago | discuss
17. New medical LLM beats Med-PaLM-2, GPT-4 on MMLU benchmarks (huggingface.co)
    16 points by samjulien over 1 year ago | 2 comments
18. Show HN: Run MMLU benchmark on any LLM endpoint (mmlu.borgcloud.ai)
    2 points by lostmsu 10 months ago | discuss
19. LLM Comparison/Test: 25 SOTA LLMs (Including QwQ) Through 59 MMLU-Pro CS Runs (huggingface.co)
    2 points by ororm about 1 year ago | discuss
20. Multilingual MMLU Dataset from OpenAI (OpenAI/Mmmlu) (huggingface.co)
    2 points by ekojs over 1 year ago | discuss
21. New Phi-3 Models (3B, 7B,14B), including 128k vision with impressive MMLU scores (twitter.com)
    2 points by brianjking over 1 year ago | discuss
22. MMLU-Pro: Advanced edition of MMLU & new Leaderboard (huggingface.co)
    1 points by nopinsight almost 2 years ago | 1 comments
23. iAsk Pro LLM achieves 93.89% on MMLU, beats GPT-4o and Claude 3.5 Sonnet (iask.ai)
    1 points by fariszr over 1 year ago | discuss
24. MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Bench (huggingface.co)
    1 points by Morinee over 1 year ago | discuss
25. Multitask Language Understanding (MMLU) on Helm (crfm.stanford.edu)
    1 points by tosh almost 2 years ago | discuss
26. OLMo 1.7–7B: A 24 point improvement on MMLU (blog.allenai.org)
    1 points by tosh almost 2 years ago | discuss
27. Show HN: AutoThink – Boosts local LLM performance with adaptive reasoning
    397 points by codelion 9 months ago | 68 comments
28. Show HN: Arch-Router – 1.5B model for LLM routing by preferences, not benchmarks
    66 points by adilhafeez 8 months ago | 15 comments
29. Show HN: BenchFlow – run AI benchmarks as an API (github.com)
    24 points by xdotli 11 months ago | 1 comments
30. Show HN: QwQ-32B APIs – o1 like reasoning at 1% the cost
    17 points by ozgune about 1 year ago | 3 comments
31. Show HN: Open-source study to measure end user satisfaction levels with LLMs (open-llm-initiative.com)
    12 points by sparacha over 1 year ago | 2 comments
32. LLM Benchmark: Frontier models now statistically indistinguishable
    7 points by js4ever 2 months ago | 4 comments
33. Show HN: I built the LLM Comparison Tool I wish existed (llm-stats.com)
    7 points by JonathanChavez about 1 year ago | 3 comments
34. Show HN: Claude Code 2.0 router – preference-aligned routing to multiple LLMs (github.com)
    4 points by adilhafeez 5 months ago | 1 comments
35. Show HN: Forecaster Arena – Testing LLMs on real events with prediction markets (forecasterarena.com)
    4 points by setrf 2 months ago | discuss
36. Show HN: 1.5B LLM routing model that aligns to preferences, not leaderboards (huggingface.co)
    4 points by honorable_coder 7 months ago | discuss
37. Show HN: MALLM – A Multi-Agent Framework for Task Solving (github.com)
    4 points by jpwahle 8 months ago | discuss
38. Show HN: Model-literals, model-aliases, and preference-aligned routing for LLMs (docs.archgw.com)
    2 points by honorable_coder 5 months ago | discuss
39. Show HN: LLM Benchmarking Suite (github.com)
    2 points by Dhyaneesh 11 months ago | discuss
40. Show HN: OptiLLMBench – Test how inference optimization tricks scale up LLMs
    2 points by codelion about 1 year ago | discuss
41. Ask HN: Are LLMs getting better, how can you tell?
    1 points by ahamilton454 about 1 year ago | 1 comments
42. The most widely used benchmarks for evaluating LLMs
    1 points by kavaivaleri almost 2 years ago | 1 comments
43. Show HN: Mafia Arena – LLMs play social deduction games against each other (mafia-arena.com)
    1 points by mohsen1 about 2 months ago | discuss
44. Show HN: Arch-Router – Aligning LLM Routing with Human Preferences (arxiv.org)
    1 points by honorable_coder 7 months ago | discuss
45. Show HN: Atlas: Independent Evals and Benchmarking for Generative AI Models (app.layerlens.ai)
    1 points by Arch223 9 months ago | discuss
46. Show HN: Tokenkit – Convert LLMs to new tokenizers (incl byte-level Llama/Gemma) (github.com)
    1 points by bminixhofer 10 months ago | discuss