← All jobs
Expert talent network

Applied Engineer, Evaluations Role

English remote United States
$100–$120/hour
Verified 2026-10-28
Apply on the official platform

You will continue to the official application page.

The application link may earn OpenJob a commission. It does not affect how listings are ordered or assessed.

📢 Get new remote AI jobs for your region every day on Telegram →

About the role

Mercor is seeking software engineers to build and refine evaluations. You’ll turn completed pull requests into engineering tasks and use our in-house evaluation framework to multiple frontier coding agents, including Claude Code, Codex and more. We work alongside an in-house research team and have produced industry leading benchmarks to compare the performance of frontier large language models.

Experience

are ambiguous. . Relevant experience can come from open-source, private, or enterprise repositories. Familiarity with a particular language or ecosystem is helpful; the ability to learn the repository and make sound engineering judgments matters more than its popularity or your public contribution history. We provide onboarding to the evaluation framework and ongoing review feedback. After onboarding, you’ll be expected to own task selection, eva

Selection process

Apply on the official platform. The listing does not describe further selection steps.

Eligibility

US

Get roles like this one on Telegram

This role lists countries covered by OpenJob Americas: two messages a day, at 7:52 and 17:52 New York time (ET). The channel covers several countries, so check each listing's eligibility.

🌎 Join OpenJob Americas

​