Language: English

We are looking for a Software Engineer with hands-on experience in full-stack development and some exposure to DevOps practices. You will contribute to building and operating applications that support critical engineering workflows. This role is ideal for someone who can independently deliver features, understands how systems run in production, and is looking to grow into owning services end-to-end. Main tasks listed: Design, develop, and maintain full-stack applications using React, TypeScript, and Python Build and enhance backend APIs and services for scalability and performance Collaborate with engineers and stakeholders to define and deliver technical solutions Participate in code reviews and contribute to improving engineering standards Debug and resolve issues across frontend, backend, and deployment environments Work with cloud platforms to deploy and operate applications Contribute to CI/CD pipelines and improve development and release workflows Help improve observability, monitoring, and reliability of applications.

We are seeking Life Sciences Subject Matter Experts to design advanced scientific-reasoning tasks for LifeSciBench. This is a non-coding role focused on biological knowledge, experimental interpretation, data analysis, and rigorous scientific reasoning. You will create challenging, objectively defensible problems based on realistic research scenarios, experimental results, biological data, figures, sequences, structures, and literature-style evidence. Main tasks listed: Design novel, graduate-level life sciences problems grounded in realistic research contexts; Develop clear questions and rigorous reference answers with defensible scientific reasoning; Interpret experiments, datasets, figures, sequences, structures, and other biological evidence; Validate biological claims, calculations, assumptions, and conclusions.

We are looking for experienced Software Engineers with a strong background in developing and operating large-scale production systems. The ideal candidate has worked extensively on enterprise software, understands how production systems fail, has experience identifying security vulnerabilities in code, and has successfully implemented secure fixes and mitigations. Main tasks listed: Design and build realistic coding-agent benchmark tasks using production-like repositories, tests, configs, documentation, and runtime scenarios; Create benign engineering tasks such as bug fixes, feature additions, CI repairs, config migrations, integration updates, and runtime-state fixes; Define clear utility requirements to verify that the coding agent completes the requested task correctly; Define safety/alignment requirements to ensure the agent preserves system constraints, developer intent, data integrity, privacy, permissions, and oversight mechanisms.

We are seeking Bioinformatics and Computational Genomics experts to design challenging, agentic genomics tasks and reference solutions for GeneBench Pro. You will create realistic computational biology problems that require an AI agent to interpret biological data, write and execute code, work across scientific files, and produce objectively verifiable outputs. Main tasks listed: • Design novel, challenging tasks in computational genomics and bioinformatics; • Design tasks that test higher-order scientific judgment, including handling ambiguous or messy data, identifying artifacts, selecting appropriate analytical approaches, revising assumptions based on intermediate results, and determining when conclusions are decision-ready; • Build tasks involving realistic scientific data such as FASTA/FASTQ, VCF, BAM/SAM, BED, TSV/CSV, sequence annotations, expression data, and germline or somatic variant data; • Develop tasks requiring multi-step analysis using Python, command-line tools, or established bioinformatics libraries.

We are seeking Engineering experts to contribute advanced technical expertise to data curation and evaluation for frontier AI models and labs. This senior reviewer role focuses on reviewing complex engineering problems, developing evaluation frameworks, and advising client teams assessing AI-generated technical outputs.

We are hiring US-based academic dermatologists to contribute senior clinical expertise to data curation for frontier AI models and labs. The work supports a longitudinal dermatology dataset used by AI developers, regulatory teams, and academic groups. This is the senior reviewer track of the project. You will lead clinical review on complex cases, contribute to the development of clinical evaluation frameworks, and serve as expert advisor for client teams reviewing AI model outputs. Main tasks listed: Lead senior-level clinical review on complex or ambiguous cases; Facilitate structured resolution of clinical disagreement among reviewers; Contribute to the development of clinical evaluation frameworks; Provide expert advisory hours to client teams reviewing AI model outputs. The listing says the work can involve sensitive or graphic content.

We are seeking Chemistry experts to contribute advanced scientific expertise to task design, data curation, and evaluation for frontier AI models and labs. This role focuses on developing rigorous chemistry tasks, reviewing complex scientific outputs, and advising client teams assessing AI-generated solutions.

Turing invites Legal Experts to join projects that fine-tune AI models. If you enjoy applying legal reasoning, analyzing complex cases, and providing clear, structured feedback, this is your chance to put your expertise to work in a new way. Your background in U.S. law is exactly what’s needed to shape how the next generation of AI understands and reasons about legal systems. Main tasks listed: Review and evaluate AI-generated responses to U.S. legal hypotheticals across multiple areas of law; Apply a structured legal rubric to assess issue spotting, accuracy, reasoning, and application of law; Identify gaps, edge cases, and blind spots in legal reasoning, helping define benchmarks for legal AI performance; Provide detailed, high-quality annotations and written feedback to refine AI models.

We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research. SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality. Main tasks listed: Review AI conversations involving real-world interpersonal and everyday decision-making scenarios; Identify missing context and recommend relevant follow-up questions; Evaluate whether additional information would have changed the AI’s recommendations; Distinguish between critical (“load-bearing”) and non-essential information.

We are seeking Physical Sciences experts to develop realistic, terminal-based scientific tasks for Terminal Bench Science. You will translate authentic physics, chemistry, materials science, astronomy, and computational science workflows into reproducible benchmark environments.