About the role
We are seeking a highly qualified Music Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within music theory, genres, composers, artists, production, instruments. Main tasks listed: Create advanced prompts covering music theory, genres, composers, artists, production instruments; Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance; Identify hallucinations, logical inconsistencies, outdated information, and edge cases; Develop benchmark datasets and adversarial test cases.
Experience
Experience with LLMs, Generative AI, prompt engineering, or AI evaluation; Published research, industry recognition, or teaching experience is a plus; Ability to work independently and provide objective, evidence-backed reviews
Selection process
Apply through the official Turing page (free account required). The listing does not describe further selection steps.
Eligibility
Not stated on the listing (remote)