Expertise: AI Evaluation

Evaluation Specialist / Recent Grad

Remote contract work for recent graduates and generalists: write original, challenging multi-step question-and-answer pairs across diverse subjects, research and triangulate sources, test questions against AI models and adjust their difficulty, and document each answer with clear citations. No prior AI experience is required.

Senior Character Animator

Part-time work for senior character animators with a leading AI lab building a performance transfer model: define quality standards for how well an actor’s performance carries over (body mechanics, facial nuance, timing, emotional intent), critique generated performances shot by shot, build benchmark sets of reference performances and help calibrate the human reviewer pool.

Sales and Marketing Expert

Remote hourly contract for senior sales and marketing professionals: build evaluation tasks for AI systems in Fortune 500 go-to-market settings, including enterprise sales scenarios, marketing and ABM tasks, RevOps workflows, reference deal strategies and rubrics that capture senior operator judgment.

AI Assistant User – Weekly Feedback Study

Ongoing weekly study for existing users of the Meta Muse or Instinct assistant app: keep using the assistant in at least three areas of your life, log and rate the proactive messages it sends you, and export your weekly conversations with personal details removed. This study involves sharing your own app conversations: read the privacy and consent terms on the official page before applying.

Image Annotation QA

We are seeking creative and detail-oriented Image Annotation QA who can create high-quality stylized assets from briefs and references. The ideal candidate should have strong skills in 3D modeling, texturing, lighting, shading, rendering, and material creation. Estimated earning potential of approximately $7hour Up to 40 hours/week; Full-time artists working up to 20 hours/week are welcome Main tasks listed: Create stylized 3D models and digital assets; Work with low-poly, voxel, handcrafted, and material-driven styles; Recreate textures such as clay, fabric, paper, and textiles; Apply strong skills in topology, UV mapping, lighting, shading, and rendering.

Personal Account Generalist Raters (US)

We are seeking US-based generalist raters to participate in Gemini Personalization Evals. In this role, raters will perform generalist evaluation work using personalized prompts designed to retrieve context and data across connected Google apps. This work may involve recording or sharing personal data (for example voice, video or account activity): read the consent and privacy terms on the official page before applying.

Quality Analyst-Multimodality

In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills. The ideal candidate should have the ability to read, summarize, review and break down large content into smaller logical blocks, conduct research online, validate claims made in content through online research, and work with the LLM (Large Language Models) to solve puzzles! The projects will also help you learn how to leverage AI to be a better analyst. Main tasks listed: You would spend time answering a variety of interesting analytical questions and creating scenarios that can train the LLM models to get better. Here are a couple of examples which models might get wrong and you would have to give the correct answer and explanation to enable the models to learn:; Based on a given distribution of sales by month across locations, could you analyze which location has grown the most? (Hint: what time period should we look at? should we account for sudden variability at the beginning?); In a small town, there are four distinct neighborhoods: Oak, Pine, Maple, and Elm. A postman is assigned to deliver mail and can only deliver to two neighborhoods in one day, with certain rules (e.g. Oak is always visited before Pine). If he delivers to Oak and Elm on the first day, which neighborhoods does the carrier deliver to on the second day?; Note: No other prior specialized domain experience is needed.

Quality Analyst – US

We are looking for a detail-oriented QA Analyst to evaluate and compare responses generated by multiple chatbots. The role involves reviewing outputs against defined guidelines, identifying inaccuracies or quality issues, and providing a clear final assessment for each evaluation task. Main tasks listed: Evaluate and compare responses generated by multiple chatbots; Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines; Identify errors, inconsistencies, missing information, and potential quality issues; Provide structured feedback and final assessments for each task.

Video Data Annotation Specialist

About Turing:Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from…

Video Data QA Specialist

We are looking for experienced Video Data QA Specialists to support the OpenAI Egocentric project. The selected professionals will be responsible for reviewing video annotations and performing quality assurance checks to ensure that the data meets project requirements and quality standards. Review and QA video annotations according to project-specific guidelines. Validate the accuracy, completeness, and consistency of annotated video data. Identify, document, and correct annotation issues.

​