About the role
We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language Models (LLMs). You will apply your subject-matter expertise to assess AI-generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning. Main tasks listed: Create complex, domain-specific prompts to test LLM capabilities; Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality; Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses; Develop challenging test cases and edge cases that expose model limitations.
Experience
Experience working with LLMs or Generative AI; Familiarity with prompt engineering, AI evaluation, or model testing; Experience designing challenging prompts, identifying edge cases, or stress-testing AI models; Ideal Candidate; The ideal candidate is curious, detail-oriented, and deeply knowledgeable in their field. They enjoy solving complex problems, challenging assumptions, and identifying subtle factual or reasoning errors. Experience designing prompts that uncover model limitations and improve AI performance will be a strong advantage
Selection process
Apply through the official Turing page (free account required). The listing does not describe further selection steps.
Eligibility
Not stated on the listing (remote)