Expertise: science_expert

We are seeking experienced in Biology help evaluate and enhance large language model (LLM) outputs related to nutrition, dietary habits, and healthy eating. You’ll assess AI-generated content for scientific accuracy, safety, and relevance — contributing to the development of responsible AI in nutrition and wellness. Selected talents will label and evaluate data related to food intake, dietary patterns, and nutrition information to support AI models focused on nutrition tracking, coaching, or research. Main tasks listed: Annotate food items, portion sizes, meal composition, and nutrient content from text, images, or logs; Classify dietary patterns (e.g., macronutrient balance, meal timing, dietary restrictions/preferences); Verify accuracy of nutritional data against trusted references (e.g., food composition databases); Identify and flag mislabeled, inconsistent, or culturally ambiguous food entries.

Commitments Required: At least 6 hours per day and a minimum of 40 hours per week, with a 4-hour overlap with PST. Employment Type: Contractor assignment; no medical or paid leave. Main tasks listed: Design challenging, realistic agentic scientific workflows across the life sciences; Create tasks requiring multiple computational steps rather than single-script or simple question-and-answer solutions; Develop realistic input files, scientific datasets, instructions, constraints, and expected deliverables; Build tasks requiring agents to inspect data, select appropriate methods, execute analyses, troubleshoot problems, and synthesize results.

We are seeking Bioinformatics and Computational Genomics experts to design challenging, agentic genomics tasks and reference solutions for GeneBench Pro. You will create realistic computational biology problems that require an AI agent to interpret biological data, write and execute code, work across scientific files, and produce objectively verifiable outputs. Main tasks listed: • Design novel, challenging tasks in computational genomics and bioinformatics; • Design tasks that test higher-order scientific judgment, including handling ambiguous or messy data, identifying artifacts, selecting appropriate analytical approaches, revising assumptions based on intermediate results, and determining when conclusions are decision-ready; • Build tasks involving realistic scientific data such as FASTA/FASTQ, VCF, BAM/SAM, BED, TSV/CSV, sequence annotations, expression data, and germline or somatic variant data; • Develop tasks requiring multi-step analysis using Python, command-line tools, or established bioinformatics libraries.

We are seeking Chemistry experts to contribute advanced scientific expertise to task design, data curation, and evaluation for frontier AI models and labs. This role focuses on developing rigorous chemistry tasks, reviewing complex scientific outputs, and advising client teams assessing AI-generated solutions.

We are seeking Physical Sciences experts to develop realistic, terminal-based scientific tasks for Terminal Bench Science. You will translate authentic physics, chemistry, materials science, astronomy, and computational science workflows into reproducible benchmark environments.

As a Task Executor – Bioinformatics, you will use UGENE to complete assigned sequence-analysis and molecular-biology workflows. You will receive the required files, values, and step-by-step instructions, and you will execute them exactly as provided. Tasks may include sequence alignment, phylogenetic tree construction, plasmid annotation, workflow execution, and result export. You will save the requested outputs, record your screen when required, and report any ambiguity or mismatch without guessing or improvising. Main tasks listed: Open provided sequence files, plasmid maps, alignments, and tree files in UGENE; Perform instructed operations such as MUSCLE or ClustalW alignments, tree building, plasmid annotation, and workflow execution; Inspect sequence data, annotations, alignments, and analysis results for task-specific verification; Export aligned FASTA files, annotated GenBank files, reports, screenshots, and other requested outputs. This work may involve recording or sharing personal data (for example voice, video or account activity): read the consent and privacy terms on the official page before applying.

We are seeking Life Sciences Subject Matter Experts to develop advanced scientific reasoning tasks for LifeSciBench. Unlike coding-focused benchmarks, this role emphasizes deep biological knowledge, scientific interpretation, and rigorous reasoning. You will create challenging questions based on realistic scientific scenarios, experimental results, biological data, figures, literature-style evidence, and research problems. This is a non-code benchmark: tasks are not executed, and no programming is required. Main tasks listed: Design novel, graduate-level life sciences problems grounded in realistic research contexts; Develop clear questions and rigorous reference answers with defensible scientific reasoning; Interpret experiments, datasets, figures, sequences, structures, and other biological evidence; Validate biological claims, calculations, assumptions, and conclusions.

We are seeking Life Sciences Subject Matter Experts to design advanced scientific-reasoning tasks for LifeSciBench. This is a non-coding role focused on biological knowledge, experimental interpretation, data analysis, and rigorous scientific reasoning. You will create challenging, objectively defensible problems based on realistic research scenarios, experimental results, biological data, figures, sequences, structures, and literature-style evidence. Main tasks listed: Design novel, graduate-level life sciences problems grounded in realistic research contexts; Develop clear questions and rigorous reference answers with defensible scientific reasoning; Interpret experiments, datasets, figures, sequences, structures, and other biological evidence; Validate biological claims, calculations, assumptions, and conclusions.

We are seeking Earth Sciences experts to develop realistic, terminal-based scientific tasks for Terminal Bench Science. You will create computational workflows involving environmental data, climate systems, atmospheric processes, geophysics, oceanography, geology, and related fields. You will design tasks that require AI agents to inspect scientific datasets, process geospatial or time-series data, run models, troubleshoot pipelines, and generate objectively verifiable scientific outputs. Main tasks listed: Translate authentic Earth-science workflows into self-contained terminal benchmark tasks; Prepare geospatial, climate, atmospheric, geological, hydrological, or oceanographic datasets; Build reproducible computational environments with appropriate scientific libraries and command-line tools; Create expert solutions using Python, R, Bash, Julia, or domain-specific software. The listing says the work can involve sensitive or graphic content.

We are seeking a highly qualified Art Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within fine arts, visual arts, architecture, design, art history, museums, and artists. Main tasks listed: Create advanced prompts covering fine arts, visual arts, architecture, design, art history, museums, and artists; Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance; Identify hallucinations, logical inconsistencies, outdated information, and edge cases; Develop benchmark datasets and adversarial test cases.