About the role
The Business Analyst works on a Computer-Using Agent (CUA) evaluation project designed to assess and improve how AI systems understand instructions, analyze information, reason through problems, and complete tasks in digital environments. The role involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and providing detailed annotations, ratings, and explanations Main tasks listed: Analyze, summarize, and structure complex written content clearly and accurately; Conduct online research to verify claims, sources, and supporting evidence; Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions; Create scenarios and questions to evaluate and improve large language model performance.
Experience
Demonstrate excellent English communication and reading comprehension skills; Apply analytical, logical, critical, and creative thinking to solve complex problems; Identify reliable information and distinguish it from inaccurate or unsupported claims; Interpret data, identify patterns, compare information, and perform basic calculations; Work independently while following detailed instructions, quality standards, and timelines
Selection process
Apply through the official Turing page (free account required). The listing describes this selection process: Please complete the Assessment in the Google Form (You will find the link of the Google form in the application form of this Job) Please use a desktop/laptop to complete the Google form; This Google form assessment is of ~45-50 minutes; Please complete this form as soon as possible to be considered for the opportunity.; Candidates who successfully pass our internal assessment review will be considered for this role.
Eligibility
Not stated on the listing (remote)