About the role
We are seeking highly motivated Team Management to support the evaluation and improvement of cutting-edge Large Language Models (LLMs). In this role, you will analyze structured data, create challenging prompts, evaluate AI-generated responses for factual accuracy and reasoning quality, and provide evidence-backed feedback to improve model performance. We are looking for curious, detail-oriented professionals who enjoy solving complex problems and evaluating AI systems. Main tasks listed: Create challenging prompts that evaluate an LLM's ability to retrieve, analyze, and reason over structured data; Assess AI-generated responses for factual accuracy, logical reasoning, and completeness; Identify model failures, inconsistencies, hallucinations, and reasoning gaps; Validate model outputs using provided datasets and supporting evidence.
Experience
Experience working with Large Language Models (LLMs) or Generative AI; Familiarity with prompt engineering, AI evaluation, data annotation, or model testing; Experience working with structured datasets (CSV, Excel, databases, etc.); Ability to identify edge cases and design prompts that expose model limitations; Opportunity to work on cutting-edge AI projects; Competitive compensation
Selection process
Apply through the official Turing page (free account required). The listing describes this selection process: Shortlisting based on qualifications and assessment scores.
Eligibility
Not stated on the listing (remote)