Can Agent Conquer Web? Exploring the Frontiers of ChatGPT Atlas Agent in
  Web Games
OpenAI's ChatGPT Atlas introduces new capabilities for web interaction,
enabling the model to analyze webpages, process user intents, and execute
cursor and keyboard inputs directly within the browser. While its capacity for
information retrieval tasks has been demonstrated, its performance in dynamic,
interactive environments remains less explored. In this study, we conduct an
early evaluation of Atlas's web interaction capabilities using browser-based
games as test scenarios, including Google's T-Rex Runner, Sudoku, Flappy Bird,
and Stein.world. We employ in-game performance scores as quantitative metrics
to assess performance across different task types. Our results show that Atlas
performs strongly in logical reasoning tasks like Sudoku, completing puzzles
significantly faster than human baselines, but struggles substantially in
real-time games requiring precise timing and motor control, often failing to
progress beyond initial obstacles. These findings suggest that while Atlas
demonstrates capable analytical processing, there remain notable limitations in
dynamic web environments requiring real-time interaction. The website of our
project can be found at https://atlas-game-eval.github.io.
690414fd2c556835fa67efce
Jingran Zhang
claimed_verified
2025-10-31T14:27:22.235Z
67fdc24ad2c9d1369d390f01
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/51JiReMgHiFHZiJ9OVdaf.png
Jingran Zhang
zhangjingran
user
zhangjingran
690414fd2c556835fa67efcf
Ning Li
690414fd2c556835fa67efd0
Justin Cui
Can Agent Conquer Web? Exploring the Frontiers of ChatGPT Atlas Agent in
  Web Games
OpenAI's ChatGPT Atlas introduces new capabilities for web interaction,
enabling the model to analyze webpages, process user intents, and execute
cursor and keyboard inputs directly within the browser. While its capacity for
information retrieval tasks has been demonstrated, its performance in dynamic,
interactive environments remains less explored. In this study, we conduct an
early evaluation of Atlas's web interaction capabilities using browser-based
games as test scenarios, including Google's T-Rex Runner, Sudoku, Flappy Bird,
and Stein.world. We employ in-game performance scores as quantitative metrics
to assess performance across different task types. Our results show that Atlas
performs strongly in logical reasoning tasks like Sudoku, completing puzzles
significantly faster than human baselines, but struggles substantially in
real-time games requiring precise timing and motor control, often failing to
progress beyond initial obstacles. These findings suggest that while Atlas
demonstrates capable analytical processing, there remain notable limitations in
dynamic web environments requiring real-time interaction. The website of our
project can be found at https://atlas-game-eval.github.io.
ChatGPT Atlas excels in logical reasoning tasks within web games but struggles in real-time games requiring precise timing and motor control.
web interaction browser-based games T-Rex Runner Sudoku Flappy Bird Stein.world in-game performance scores logical reasoning real-time games motor control