OpenJob database

Find the right opportunity, not just another listing.

Filter by language, expertise, location eligibility and work mode. Pay and verification details are shown consistently.

Flexible remote tasks

Fluent in English? Outlier's Project Aether pays for evaluating AI images, video and chat replies. No degree or technical background needed, and applying is free.

How Aether works and how to pass the test →

Opportunities

217 jobs

Turing

Senior Software Engineer – LLM Evaluation (US/Canada/WEU based)

English Canada, France, Germany, United States Not stated on the listing

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance enterprise-level AI-driven coding…

Last verified 2026-11-10
View role
Turing

Dockerfile Data Validation Engineer

English 10 countries — see eligibility Not stated on the listing

We are seeking an engineer responsible for designing, implementing, and maintaining data-validation workflows inside Docker-based build pipelines. This role involves creating and managing Dockerfile labels, metadata standards, and validation scripts that ensure datasets, schemas, and model artifacts meet quality and compliance requirements before deployment. Main tasks listed: Develop and optimize Dockerfiles with built-in data-validation steps; Implement LABEL metadata for dataset versions, schemas, and lineage; Create validation scripts (Python/Bash) for schema checks, data integrity, and quality control; Integrate validation steps into CI/CD pipelines and enforce fail-on-bad-data checks.

Last verified 2026-11-10
View role
Turing

Data Scientist/Analyst

English Not stated on the listing

We are actively seeking talented Data Scientists & Analysts proficient in Python to join our ambitious team dedicated to pushing the frontiers of AI technology. This opportunity is tailored for professionals who thrive on developing innovative solutions and aspire to be at the forefront of AI advancements. You will work with companies in the US looking to develop cutting-edge commercial and research AI solutions. Main tasks listed: Design, develop, and maintain efficient, high-quality code to train and optimize AI models; Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement; Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria; Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.

Last verified 2026-11-10
View role
Turing

Senior Python Developer

English Not stated on the listing

This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models. One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first, as a basis for fine-tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models. Main tasks listed: Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models; Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement; Familiarity with Python frameworks and libraries; Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.

Last verified 2026-11-10
View role
Turing

Python + Full-Stack (JS) Developer

English Not stated on the listing

We are actively seeking talented developers proficient in Python & Javascript/Typescript to join our ambitious team dedicated to pushing the frontiers of AI technology. This opportunity is tailored for professionals who thrive on developing innovative solutions and aspire to be at the forefront of AI advancements. You will work with different companies in the US who are looking to develop cutting-edge commercial and research AI solutions. Main tasks listed: Design, develop, and maintain efficient, high-quality code to train and optimize AI models; Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement; Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria; Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.

Last verified 2026-11-10
View role
Turing

Senior LLM Engineer

English India Not stated on the listing

Focus: Hands-on engineering role focused on designing, building, and deploying Generative AI and LLM-based solutions. The role requires deep technical proficiency in Python and modern LLM frameworks with the ability to contribute to roadmap development and cross-functional collaboration. Design and develop GenAI/LLM-based systems using tools such as Langchain and Retrieval-Augmented Generation (RAG) pipelines. Main tasks listed: Design and develop GenAI/LLM-based systems using tools such as Langchain and Retrieval-Augmented Generation (RAG) pipelines; Implement prompt engineering techniques and agent-based frameworks to deliver intelligent, context-aware solutions; Collaborate with the engineering team to shape and drive the technical roadmap for LLM initiatives; Translate business needs into scalable, production-ready AI solutions.

Last verified 2026-11-10
View role
Turing

Senior Software Engineer – LLM Evaluation

English Not stated on the listing

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance enterprise-level AI-driven coding…

Last verified 2026-11-10
View role
Turing

Senior Software Engineer – Python (LLM Evaluation & Repository Validation)

English 9 countries — see eligibility Not stated on the listing

About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems. One of our approaches, in this project, is to build verifiable SWE tasks based on public repository histories in a synthetic approach with human-in-the-loop; while expanding the dataset coverage to different types of tasks in terms of programming language, difficulty level, and etc. Main tasks listed: Analyze and triage GitHub issues across trending open-source libraries; Set up and configure code repositories, including Dockerization and environment setup; Evaluating unit test coverage and quality; Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.

Last verified 2026-11-10
View role
Alignerr

Senior Software Engineer — Agentic Coding

English $80–$120/hour

Remote, flexible hourly contract for senior software engineers working on agentic AI: design and refine workflows where AI plans, writes, tests and iterates on code, evaluate AI-generated code for correctness, efficiency and security, create real-world coding challenges and benchmarks, identify failure modes of autonomous agents and improve evaluation rubrics and test harnesses. Task-based, asynchronous work on your own schedule.

Last verified 2026-10-16
View role
Alignerr

Senior Software Engineer — AI Evaluation & Benchmarks

English $80–$100/hour

Remote hourly contract for senior software engineers: design coding benchmarks and data pipelines used to evaluate frontier AI models, analyse AI-generated code for correctness and quality, build realistic evaluation scenarios and give detailed technical feedback. The listing states a 3-month initial contract with possible extension; full-time availability is preferred.

Last verified 2026-10-16
View role
Expert talent network

Kubernetes Task Auditor

English United States $70–$90/hour

Evaluate the quality, correctness, and production-readiness of Kubernetes tasks used to train and evaluate a frontier AI lab's models. You'll assess cluster-operations scenarios, manifest correctness, and failure-mode troubleshooting — and provide clear, rubric-based written feedback. Basic Qualifications • 3+ years hands-on production Kubernetes experience (EKS/GKE/AKS or self-managed) • Deep understanding of cluster internals: CNI/DNS/ingress, PV/PVC storage, RBAC, and failure modes (CrashLoopBackOff, OOMKilled, scheduling/eviction) • Experience authoring and reviewing manifests / Helm chart

Last verified 2026-11-10
View role
Expert talent network

SWE-Bench Task Auditor

English United States $70–$90/hour

Evaluate the quality, correctness, and reproducibility of software-engineering benchmark tasks used to train and evaluate a frontier AI lab's models. You'll assess repository-level tasks, reference patches, test harnesses, and grading integrity — and provide clear, rubric-based written feedback. Basic Qualifications • 3+ years professional software engineering • Real open-source contribution or maintainer experience (merged PRs, committer / maintainer roles) • Strong ability to audit reference patches, test runners, and Docker isolation, and to detect answer leakage / reward hacking • Fluency

Last verified 2026-11-10
View role
Expert talent network

Electrical Test Automation Engineer

English $70–$85/hour

Mercor is partnering with a leading technology organization to recruit experienced Electrical Test Automation Engineers for a short-term project. Engineers will apply hands-on industry experience in electrical testing, automation, instrumentation, and hardware validation to solve complex technical problems. Design and implement automated test systems, procedures, and test sequences for electrical and electronic hardware.

Last verified 2026-11-10
View role
Expert talent network

Data Scientist Talent Network

English $100–$150/hour

Mercor is building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work. There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.

Last verified 2026-11-10
View role
Expert talent network

Machine Learning Engineer Talent Network

English $70–$250/hour

About Mercor’s talent network . Join our Machine Learning Engineer Expert Network to connect with leading AI labs and companies seeking your expertise. This is an open application for future contract opportunities that match your background and interests.

Last verified 2026-11-10
View role
LILT

AI Benchmark Engineer | Native Language Specialist – Spanish (Spain)

English, Spanish Spain Pay not disclosed

We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity

Last verified 2026-11-10
View role
LILT

AI Benchmark Engineer | Native Language Specialist – German (Germany)

English, German Germany Pay not disclosed

We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity

Last verified 2026-11-10
View role
Outlier / Scale AI

AI Training – Programming Expertise (Italian)

Italian 41 countries — see eligibility $25–$50/hour (core project work)

Outlier is looking for programmers who can explain technical concepts fluently in Italian to help train generative-AI models: writing and answering computer-science questions and ranking AI-generated code. Freelance, fully remote, $25–$50 per hour for core project work.

Last verified 2026-10-28
View role
Expert talent network

Infrastructure / Site Reliability Engineer

English $200/hour

Infrastructure / Site Reliability Engineer. Remote AI-training work for professionals in this field, posted on an expert talent network for AI labs.

Last verified 2026-11-10
View role
​