Expertise: AI Evaluation

Generative AI Analyst | French (Canada)

We are looking for detail-oriented Generative AI Analysts to support a variety of AI training, data annotation, evaluation, and quality review projects. Job Title:Generative AI Analyst – French (Canada)

AI Agent Tester – Real-World Tasks

Remote contract work testing two AI agents side by side on everyday errands (bills, returns, bookings, shopping, travel, forms) using your own accounts on your phone: approve or stop key steps, screen record each run and score the results.

Generalist

Remote contract work for generalists on an AI training project: carry out real-world online tasks with AI tools (including purchase and cancellation workflows, with reimbursement procedures), document them with screenshots and give structured feedback on AI outputs. micro1 lists 50 openings.

AI Trainer – Data Annotation Specialist (Safety)

Non-coding remote project: evaluate AI responses in single- and multi-turn conversations against safety policies, give 1–5 ratings and write short evidence-based justifications. Content includes sensitive topics such as self-harm, violence and abuse. Hourly pay; 1–2 weeks with possible extension, starting around 23 October.

AI Safety Annotation Reviewer

Remote quality-review role on an AI safety project for a US AI company: audit trainers’ evaluations for policy misapplication, incomplete reasoning, scoring drift, schema errors and inconsistent annotations, apply a detailed AI safety policy framework, give corrective feedback and document recurring error patterns. The listing states that the project includes sensitive content (self-harm, violence and abuse), with waivers and wellbeing support.

Personal Account Generalist Raters (Android Smartphone Users)

16-week remote AI evaluation project (with possible extension): review AI-generated prompts and responses in English that use selected data from your own Google apps, Google Messages and device SMS, and rate them for relevance, accuracy, helpfulness and personalization. This work uses your personal account data: read the privacy and consent terms on the official page before applying.

Domain Contributor – Evaluation Specialist

Flexible remote contract (about 15 hours per week) for experts in history, law, finance, journalism or technology: design domain-specific tasks and questions that probe the limits of AI models and surface flaws in their reasoning. Pay is per accepted task; the hourly range is the one shown on micro1’s job board.

Research Evaluation Specialist (PhD or Masters / Researcher / Professor)

Remote contract work (about 15 hours per week) for researchers and academics: create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline, verify and document answers with primary sources and citations, test questions against AI systems and raise their difficulty while keeping them accurate.

​