Evaluate Comparison

https://github.com/huggingface/evaluate/

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

evaluate-bot updated a Space about 8 hours ago

evaluate-comparison/mcnemar

evaluate-bot updated a Space about 8 hours ago

evaluate-comparison/exact_match

evaluate-bot updated a Space 29 days ago

evaluate-comparison/exact_match

View all activity

updated 2 Spaces about 8 hours ago

McNemar

Exact Match

authored a paper 6 months ago

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

Paper • 2510.08697 • Published Oct 9, 2025 • 39

authored 3 papers 6 months ago

Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model

Paper • 2211.02001 • Published Nov 3, 2022

Hype, Sustainability, and the Price of the Bigger-is-Better Paradigm in AI

Paper • 2409.14160 • Published Sep 21, 2024 • 3

From Efficiency Gains to Rebound Effects: The Problem of Jevons' Paradox in AI's Polarized Environmental Debate

Paper • 2501.16548 • Published Jan 27, 2025

authored a paper 10 months ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

Paper • 2506.20920 • Published Jun 26, 2025 • 78

authored a paper about 1 year ago

SmolVLM: Redefining small and efficient multimodal models

Paper • 2504.05299 • Published Apr 7, 2025 • 207

authored a paper about 1 year ago

Fully Autonomous AI Agents Should Not be Developed

Paper • 2502.02649 • Published Feb 4, 2025 • 35

authored 2 papers about 1 year ago

SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Paper • 2502.02737 • Published Feb 4, 2025 • 257

Towards Best Practices for Open Datasets for LLM Training

Paper • 2501.08365 • Published Jan 14, 2025 • 62

authored a paper over 1 year ago

SelfCodeAlign: Self-Alignment for Code Generation

Paper • 2410.24198 • Published Oct 31, 2024 • 24

updated 2 Spaces over 1 year ago

Exact Match

McNemar

authored 2 papers almost 2 years ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25, 2024 • 102

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28, 2024 • 12

authored a paper about 2 years ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 155

authored 2 papers over 2 years ago

Power Hungry Processing: Watts Driving the Cost of AI Deployment?

Paper • 2311.16863 • Published Nov 28, 2023 • 6

What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus

Paper • 2105.02732 • Published May 6, 2021

authored a paper over 2 years ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 123