Hackernews posts about HumanEval

  1. Q Evaluation Harness: open-source evals for LLMs on q/kdb+ (github.com)
    1 points by erfan_mhi 8 days ago | discuss
  2. Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34B (www.phind.com)
    813 points by rushingcreek almost 2 years ago | 284 comments
  3. Refact Code LLM: 1.6B LLM for code that reaches 32% HumanEval (refact.ai)
    181 points by kateklink almost 2 years ago | 100 comments
  4. Telling Mixtral it is "ChatGPT developed by OpenAI" boosts humaneval score by 6% (twitter.com)
    4 points by reqo over 1 year ago | discuss
  5. WizardCoder-34B-Python surpasses GPT-4 on HumanEval (twitter.com)
    3 points by Xeophon almost 2 years ago | 1 comments
  6. Fine-tuned CodeLlama beats GPT-4 on HumanEval (huggingface.co)
    3 points by jumploops almost 2 years ago | discuss
  7. BigCodeBench: The Next Generation of HumanEval (github.com)
    2 points by t1t1 about 1 year ago | discuss
  8. WizardCoder 34B surpasses GPT4 on HumanEval (twitter.com)
    1 points by bytefactory almost 2 years ago | 1 comments
  9. Show HN: Aflow achieves 96.2% on HumanEval at 4.55% of GPT-4's cost (twitter.com)
    1 points by metagpt 10 months ago | discuss
  10. HumanEval is saturated: new coding LLM benchmark released (bigcode-bench.github.io)
    1 points by eitanturok about 1 year ago | discuss
  11. Running HumanEval Safely with Riza (riza.io)
    1 points by stanleydrew about 1 year ago | discuss
  12. Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context (www.phind.com)
    891 points by rushingcreek almost 2 years ago | 347 comments
  13. Show HN: I built the LLM Comparison Tool I wish existed (llm-stats.com)
    7 points by JonathanChavez 8 months ago | 3 comments
  14. Show HN: Fine-Tuning Index of Open-Source LLMs vs. OpenAI (predibase.com)
    4 points by abhaym over 1 year ago | discuss
  15. RES-Q: A New Benchmark for Differentiating Frontier Model Capability
    3 points by becklabs about 1 year ago | discuss
  16. The most widely used benchmarks for evaluating LLMs
    1 points by kavaivaleri over 1 year ago | 1 comments
  17. Show HN: Atlas: Independent Evals and Benchmarking for Generative AI Models (app.layerlens.ai)
    1 points by Arch223 3 months ago | discuss
  18. Beat GPT-4o at Python by searching with 100 dumb LLaMAs (modal.com)
    4 points by thundergolfer about 1 year ago | 1 comments
  19. Beat GPT-4o at Python with 100 dumb LLaMAs (modal.com)
    1 points by pierremenard about 1 year ago | discuss
  20. HumaneAI pin maker selling itself for $1B (gizmodo.com)
    26 points by alangibson over 1 year ago | 46 comments
  21. Valuing Humans in the Age of Superintelligence: HumaneRank (roadtoartificia.com)
    10 points by jlaporte 9 months ago | 35 comments
  22. Humanimals (twitter.com)
    9 points by dr_dshiv over 1 year ago | 1 comments
  23. Refactoring Humanely and "Accidental Pomodoro" (melatonin.dev)
    6 points by wlll 10 months ago | discuss
  24. How to Kill Bugs Humanely (reducing-suffering.org)
    5 points by LlamaTrauma 4 months ago | discuss
  25. Show HN: Find humanely raised animal-based products (findhumane.com)
    2 points by findhumane over 1 year ago | 1 comments
  26. Vivarium: The keeper of a lab's animals stumbles onto a secret [fiction] (jsomers.net)
    71 points by jsomers 4 months ago | 17 comments
  27. What is the most humane way to kill a cane toad? (www.abc.net.au)
    5 points by adrian_mrd over 1 year ago | 1 comments
  28. SAT/Act Scores by Detailed Race/Ethnicity from Applicants on 2021 Common App (humanvarieties.org)
    2 points by rahimnathwani almost 2 years ago | discuss
  29. Increased efficiency By automating repetitive tasks (humanavatars.aibuildr.app)
    1 points by profitin 12 months ago | discuss
  30. A simple guide to local LLM fine-tuning on a Mac with MLX (apeatling.com)
    2 points by humanetable99 over 1 year ago | 1 comments