Optimizing LLMs to be proficient at particular tests backfires on Meta, Stability.
-.
-.
-.
-.
-.
-.
-
When you acquire through links on our site, we may earn an affiliate commission. Here's how it works.
Hugging Face has released its second LLM leaderboard to rank the very best language models it has tested. The brand-new leaderboard seeks to be a more challenging consistent requirement for testing open large language design (LLM) efficiency across a variety of jobs. Alibaba's Qwen designs appear dominant in the leaderboard's inaugural rankings, taking 3 spots in the top 10.
Pumped to announce the brand brand-new open LLM leaderboard. We burned 300 H100 to re-run brand-new examinations like for yogicentral.science all significant open LLMs!Some learning:- Qwen 72B is the king and Chinese open designs are controling overall- Previous assessments have actually become too easy for wiki.monnaie-libre.fr recent ... June 26, 2024
Hugging Face's 2nd leaderboard tests language models throughout four tasks: understanding testing, thinking on exceptionally long contexts, complicated mathematics abilities, and direction following. Six standards are utilized to check these qualities, with tests consisting of fixing 1,000-word murder secrets, explaining PhD-level concerns in layperson's terms, and a lot of challenging of all: high-school math formulas. A full breakdown of the benchmarks used can be discovered on Hugging Face's blog site.
The frontrunner of the new leaderboard is Qwen, Alibaba's LLM, which takes 1st, 3rd, and 10th location with its handful of versions. Also appearing are Llama3-70B, Meta's LLM, and a handful of smaller open-source jobs that handled to surpass the pack. Notably missing is any indication of ChatGPT
1
If there's Intelligent Life out There
jorja02906954 edited this page 3 months ago