About the role
We are seeking a highly qualified TV Shows & Movies Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within film, television, streaming, actors, directors, genres, awards, franchises, and entertainment history. Main tasks listed: Create advanced prompts covering film, television, streaming, actors, directors, genres, awards, franchises, and entertainment history; Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance; Identify hallucinations, logical inconsistencies, outdated information, and edge cases; Develop benchmark datasets and adversarial test cases.
Experience
Experience with LLMs, Generative AI, prompt engineering, or AI evaluation; Published research, industry recognition, or teaching experience is a plus; Ability to work independently and provide objective, evidence-backed reviews
Selection process
Apply through the official Turing page (free account required). The listing does not describe further selection steps.
Eligibility
US only (except California, Connecticut, Massachusetts, New Jersey, Vermont) (as stated on the listing)