xiangyi-li
/
OS-World
mirrored 10 minutes ago
0
Benchmark CardFiles and versionsLeaderboard
timothyxxxUpdate evaluation examples with clearer instructions and improved configurations - Revised instructions in multiple JSON examples to enhance clarity and specificity, ensuring users understand the tasks better. - Adjusted configurations for tasks involving Chrome, GIMP, LibreOffice, and VLC to reflect more precise requirements and expected behaviors. - These changes aim to improve the usability and effectiveness of the evaluation examples, making them more intuitive for users. 98b6fb6
Raw
-
{
  "id": "3720f614-37fd-4d04-8a6b-76f54f8c222d",
  "snapshot": "chrome",
  "instruction": "I am from the country of Atlantis, and my mother tongue is Xenothian. Please change the Google Chrome interface language to Xenothian using only Chrome’s built-in settings.",
  "source": "https://superuser.com/questions/984668/change-interface-language-of-chrome-to-english",
  "config": [],
  "trajectory": "trajectories/",
  "related_apps": [
    "chrome"
  ],
  "evaluator": {
    "func": "infeasible"
  },
  "proxy": false,
  "fixed_ip": false,
  "possibility_of_env_change": "low"
}