Remote Labor Index: Measuring AI Automation of Remote Work
AIs have made rapid progress on research-oriented benchmarks of knowledge and
reasoning, but it remains unclear how these gains translate into economic value
and automation. To measure this, we introduce the Remote Labor Index (RLI), a
broadly multi-sector benchmark comprising real-world, economically valuable
projects designed to evaluate end-to-end agent performance in practical
settings. AI agents perform near the floor on RLI, with the highest-performing
agent achieving an automation rate of 2.5%. These results help ground
discussions of AI automation in empirical evidence, setting a common basis for
tracking AI impacts and enabling stakeholders to proactively navigate AI-driven
labor automation.
690415cf2c556835fa67efd3
Mantas Mazeika
690415cf2c556835fa67efd4
Alice Gatti
690415cf2c556835fa67efd5
Cristina Menghini
690415cf2c556835fa67efd6
Udari Madhushani Sehwag
690415cf2c556835fa67efd7
Shivam Singhal
690415cf2c556835fa67efd8
Yury Orlovskiy
690415cf2c556835fa67efd9
Steven Basart
690415cf2c556835fa67efda
Manasi Sharma
claimed_verified
2025-11-17T10:32:19.594Z
6912801e7487825c90d8e5eb
/avatars/2d9a6c83ba5c4b7b6276f8fa266a6307.svg
Manasi Sharma
manasisharma
user
manasisharma
690415cf2c556835fa67efdb
Denis Peskoff
690415cf2c556835fa67efdc
Elaine Lau
690415cf2c556835fa67efdd
Jaehyuk Lim
690415cf2c556835fa67efde
Lachlan Carroll
690415cf2c556835fa67efdf
Alice Blair
690415cf2c556835fa67efe0
Vinaya Sivakumar
690415cf2c556835fa67efe1
Sumana Basu
690415cf2c556835fa67efe2
Brad Kenstler
690415cf2c556835fa67efe3
Yuntao Ma
690415cf2c556835fa67efe4
Julian Michael
690415cf2c556835fa67efe5
Xiaoke Li
690415cf2c556835fa67efe6
Oliver Ingebretsen
690415cf2c556835fa67efe7
Aditya Mehta
690415cf2c556835fa67efe8
Jean Mottola
690415cf2c556835fa67efe9
John Teichmann
690415cf2c556835fa67efea
Kevin Yu
690415cf2c556835fa67efeb
Zaina Shaik
690415cf2c556835fa67efec
Adam Khoja
690415cf2c556835fa67efed
Richard Ren
690415cf2c556835fa67efee
Jason Hausenloy
690415cf2c556835fa67efef
Long Phan
690415cf2c556835fa67eff0
Ye Htet
690415cf2c556835fa67eff1
Ankit Aich
690415cf2c556835fa67eff2
Tahseen Rabbani
690415cf2c556835fa67eff3
Vivswan Shah
690415cf2c556835fa67eff4
Andriy Novykov
690415cf2c556835fa67eff5
Felix Binder
690415cf2c556835fa67eff6
Kirill Chugunov
690415cf2c556835fa67eff7
Luis Ramirez
690415cf2c556835fa67eff8
Matias Geralnik
690415cf2c556835fa67eff9
Hernán Mesura
690415cf2c556835fa67effa
Dean Lee
690415cf2c556835fa67effb
Ed-Yeremai Hernandez Cardona
690415cf2c556835fa67effc
Annette Diamond
690415cf2c556835fa67effd
Summer Yue
690415cf2c556835fa67effe
Alexandr Wang
690415cf2c556835fa67efff
Bing Liu
690415cf2c556835fa67f000
Ernesto Hernandez
690415cf2c556835fa67f001
Dan Hendrycks
Remote Labor Index: Measuring AI Automation of Remote Work
AIs have made rapid progress on research-oriented benchmarks of knowledge and
reasoning, but it remains unclear how these gains translate into economic value
and automation. To measure this, we introduce the Remote Labor Index (RLI), a
broadly multi-sector benchmark comprising real-world, economically valuable
projects designed to evaluate end-to-end agent performance in practical
settings. AI agents perform near the floor on RLI, with the highest-performing
agent achieving an automation rate of 2.5%. These results help ground
discussions of AI automation in empirical evidence, setting a common basis for
tracking AI impacts and enabling stakeholders to proactively navigate AI-driven
labor automation.
The Remote Labor Index evaluates AI performance in real-world, economically valuable projects, showing limited automation capabilities and providing a benchmark for AI impacts.
Remote Labor Index AI automation end-to-end agent performance