About the role
Review AI responses for relevance and accuracy in personal contexts.
About Turing:
Turing’s mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality data, evaluations, and reinforcement learning environments that improve model capabilities in coding, reasoning, tool use, and multimodality. In coding, Turing is the largest and longest-running data provider in the category. Turing also works with Fortune 500 enterprises across Financial Services, Life Sciences, Healthcare, Retail, Automotive, and CPG to build and deploy end-to-end agentic AI systems inside mission-critical workflows.
Role Overview: Join an innovative AI evaluation project focused on improving how AI understands personal context and delivers relevant, personalized responses. As a Mobile AI Rater, you will review AI-generated outputs using selected data from G-Suite Apps, along with relevant content from Google Messages and device SMS. Your feedback will help assess the accuracy, relevance, and quality of AI personalization in real-world scenarios.
Project Snapshot:
- Rates – $15/hr (approx)
- 16-week project (with potential chances of extension)
- Commitment up to 40 hours/week
- Fully remote | Paid in USD
- Potential Start date – As soon as possible
What You’ll Do
- Review AI-generated prompts and responses in English.
- Evaluate responses for relevance, accuracy, helpfulness, and personalization.
- Assess how well AI understands everyday context, preferences, relationships, routines, and experiences.
- Provide clear ratings, explanations, and feedback.
- Follow project guidelines and maintain a high level of consistency.
- Help improve the quality and reliability of next-generation AI systems.
Who can apply?
- Users with a primary Samsung Android Smartphone.
- Users with Android 16 or higher.
- Regular users of the Google Messages app for personal SMS/RCS conversations.
- Individuals comfortable reviewing AI content in English.
Why Join?
- Gain hands-on experience working on a leading AI project, with the flexibility to contribute over a 16-week engagement.
Next Steps –
- Please fill the application form (with accurate information)
- Talents will be selected based on the Internal Profile and Client Review
Selection process
Apply through the official Turing page (free account required). The listing does not describe further selection steps.
Turing: pay, legitimacy and all open roles →
Similar open jobs
- AI Evaluation Rubric Reviewer · Expert talent network · $40-$75/hour · Remote
- AI Conversation Evaluator · micro1 · $40-$70/hour · Remote
- QC Packaging Engineer · Turing · Not stated on the listing · 8 countries
- AI Assistant Rater (US based) · Turing · Not stated on the listing · United States
- Tooling Engineer · Turing · Not stated on the listing · Remote
- Quality Analyst-Multimodality · Turing · Not stated on the listing · Remote
Eligibility
Not stated on the listing (remote)
Flexible remote tasks
Fluent in English? Outlier's Project Aether pays for evaluating AI images, video and chat replies. No degree or technical background needed, and applying is free.
How Aether works and how to pass the test →