Atlas Game Eval

Can Agent Conquer Web? Exploring the Frontiers of Atlas Agent in Web Games

Jingran Zhang1, Ning Li1, Justin Cui2

1UC San Diego · 2UCLA

Abstract

OpenAI's ChatGPT Atlas introduces new capabilities for web interaction, enabling the model to analyze webpages, process user intents, and execute cursor and keyboard inputs directly within the browser. While its capacity for information retrieval tasks has been demonstrated, its performance in dynamic, interactive environments remains less explored. In this study, we conduct an early evaluation of Atlas's web interaction capabilities using browser-based games as test scenarios, including Google's T-Rex Runner, Sudoku, Flappy Bird, and Stein.world. We employ in-game performance scores as quantitative metrics to assess performance across different task types. Our results show that Atlas performs strongly in logical reasoning tasks like Sudoku, completing puzzles significantly faster than human baselines, but struggles substantially in real-time games requiring precise timing and motor control, often failing to progress beyond initial obstacles. These findings suggest that while Atlas demonstrates capable analytical processing, there remain notable limitations in dynamic web environments requiring real-time interaction.

Videos

Sudoku

Flappy Bird

2048

T-Rex Runner

Game Screenshots

Chrome Dino 1
T-Rex Runner
Chrome Dino 2
2048
Flappy Bird
Flappy Bird
Sudoku 2
Sudoku
Sudoku 3
RPG - Stein.world

BibTeX

@misc{zhang2025agentconquerwebexploring,
      title={Can Agent Conquer Web? Exploring the Frontiers of ChatGPT Atlas Agent in Web Games}, 
      author={Jingran Zhang and Ning Li and Justin Cui},
      year={2025},
      eprint={2510.26298},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2510.26298},     
}

This project page design was adapted from Nerfies.