About the role
We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research. SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality. Main tasks listed: Review AI conversations involving real-world interpersonal and everyday decision-making scenarios; Identify missing context and recommend relevant follow-up questions; Evaluate whether additional information would have changed the AI's recommendations; Distinguish between critical ("load-bearing") and non-essential information.
Experience
Candidates should have at least 3–5 years of direct practicerelevant qualifications and professional experience in at least one of the following areas:; Licensed Social Work; MSW or equivalent graduate-level qualification in Social Work; LCSW, LICSW, LMSW, or equivalent applicable social work license/credential; Experience with client assessment, case review, interviewing, counseling, or related social-work practice; Counseling, Therapy, or Psychology
Selection process
Apply through the official Turing page (free account required). The listing does not describe further selection steps.
Eligibility
Context Elicitation & Conversation Evaluation Specialists - USA, Canada, Western Europe (as stated on the listing)