OpenJob database
Filter by language, expertise, location eligibility and work mode. Pay and verification details are shown consistently.
Opportunities
We are seeking Engineering experts to contribute advanced technical expertise to data curation and evaluation for frontier AI models and labs. This senior reviewer role focuses on reviewing complex engineering problems, developing evaluation frameworks, and advising client teams assessing AI-generated technical outputs.
We are seeking a Dataset Enablement Manager to bridge the technical gap between scientific data pipelines and centralized commercial teams. In this role, you will package complex technical datasets into high-impact collateral, educate client-facing teams on domain-specific benchmarks, and drive the multi-client sell-through of our OTS dataset portfolio to leading global AI labs. Main tasks listed: Pipeline Tracking & Visibility: Maintain real-time oversight of active dataset pipelines across all frontier science, math, and scientific software engineering teams; Technical Collateral & Sample Packaging: Assemble production-grade sample packs, schema definitions, benchmark comparisons, and technical documentation to effectively showcase dataset quality; Commercial Enablement & Training: Lead regular deep-dives and training sessions for sales, account, and solutions teams to communicate value propositions, methodology, and target LLM use cases; Sell-Through Performance & Monetization: Track multi-client utilization metrics, identify under-monetized dataset assets, and drive performance reporting to maximize commercial sell-through.
Urgent hire: ASAP start, 4 week contract. Applications reviewed on a rolling basis, apply early. Main tasks listed: Use AI coding agents throughout development, QA, and validation; Participate in onboarding, calibration, and quality reviews; deliver to the quality bar on agreed milestones.
We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models. In this role, you will leverage your expertise in board games, game mechanics, strategic reasoning, probability, and complex rule systems to create, review, and evaluate high-quality datasets that improve AI performance.
We are looking for experienced Software Engineers to help evaluate, benchmark, and improve the coding capabilities of frontier AI models. In this role, you will assess AI-generated code, validate solutions against real-world software engineering tasks, identify correctness and quality issues, and contribute to the development of high-quality evaluation datasets and benchmarks.
Job Title: Mid-Senior Azure DevOps Engineer (LangGraph Experience) We are seeking a Mid-Senior Azure DevOps Engineer with strong experience in Azure DevOps and hands-on expertise in LangGraph to support the deployment, automation, and management of AI-powered applications. The ideal candidate will have experience building scalable CI/CD pipelines, managing Azure cloud infrastructure, and deploying LLM-based agentic applications. Main tasks listed: Design, implement, and optimize CI/CD pipelines using Azure DevOps; Deploy, configure, and maintain applications and AI workflows on Microsoft Azure; Build, deploy, and support LangGraph-based agentic AI applications; Automate infrastructure provisioning using Terraform, Bicep, or ARM templates.
Compensation: $100-$150/hour, please provide a specific hourly rate expectation Availability: 20-40 hours/week, with at least 6 hours of Pacific Time overlap/day Main tasks listed: Design, refine, and iterate on rubrics and evaluation criteria for preference data; Review and label data with a high quality bar, catching subtle issues others might overlook; Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows; Synthesize findings from data work into clear write-ups, updates, and recommendations for the team.
We are looking for experienced Software Engineers (SWE Bench – Data Engineer / Data Science) to contribute to benchmark-driven evaluation projects focused on real-world data engineering and data science workflows. This role involves hands-on work with production-like datasets, data pipelines, and data science tasks to help evaluate and improve the performance of advanced AI systems.
We are looking for experienced Data Analysts (MLE Bench) to contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on analytical work with production-like datasets, metrics, and ML outputs to help evaluate, diagnose, and improve the performance of advanced AI systems.
Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems. One of our approaches, in this project, is to build verifiable SWE tasks based on public repository histories in a synthetic approach with human-in-the-loop; while expanding the dataset coverage to different types of tasks in terms of programming language, difficulty level, and etc. Main tasks listed: Analyze and triage GitHub issues across trending open-source libraries; Set up and configure code repositories, including Dockerization and environment setup; Evaluating unit test coverage and quality; Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems. One of our approaches, in this project, is to build verifiable SWE tasks based on public repository histories in a synthetic approach with human-in-the-loop; while expanding the dataset coverage to different types of tasks in terms of programming language, difficulty level, and etc. Main tasks listed: Analyze and triage GitHub issues across trending open-source libraries; Set up and configure code repositories, including Dockerization and environment setup; Evaluating unit test coverage and quality; Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
A well-established company that is leveraging the advanced power of technology to help realize the science-fiction fantasy of collaborative and open-ended computer dialogues, is looking for Go develoeprs. The engineer will be working together on the definition, design, and delivery of new features with cross-functional teams. The company is developing the next generation of dialog agents, which will have a wide range of uses in areas including education, entertainment, and general question-answering. Main tasks listed: Review the code / solutions generated by an AI system, ensuring adherence to quality standards and best practices; Organize the development cycle, effectively manage project priorities, and specify goals and deadlines; Use your expertise in Go programming to help resolve difficult coding issues that come up during AI validation; Create a collaborative environment within the team that encourages innovation, communication, and continued improvement.
We’re looking for a ML Developer to drive the design, development, and delivery of advanced machine learning solutions. The ideal candidate is not just a strong individual contributor but also a technical leader capable of setting direction, mentoring team members, and ensuring that ML initiatives align with business goals. Competitive ML experience (e.g., Kaggle, benchmarks) is a strong plus. Main tasks listed: Own end-to-end DS/ML solution development — from data pipelines and model design to deployment and monitoring; Translate business objectives into robust ML architectures that accurately capture business logic and context; Collaborate cross-functionally with Product, Engineering, and Business stakeholders to define problem statements and success metrics; Evaluate and optimize models for performance, scalability, and accuracy using state-of-the-art techniques.
As a Delivery Leader for our LLM Training business, you will play a pivotal role in leading our efforts to develop high-quality, foundational LLMs. This position requires managing large teams of software engineers and data scientists dedicated to performing various Supervised Fine Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF) tasks. Your leadership will ensure the delivery of superior SFT and RLHF datasets, achieving optimal outcomes in terms of quality, throughput, and cost. Main tasks listed: Lead and manage large teams (20+) of Python, JavaScript, Java (and other long tail of languages) developers to execute technical tasks effectively; Collaborate closely with researcher clients, ensuring their satisfaction with the delivered work; Maintain rigorous review processes to ensure the highest quality of datasets; Oversee the transition of projects from initiation to stable states, taking full responsibility for delivery.
As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance enterprise-level AI-driven coding…
We are seeking an engineer responsible for designing, implementing, and maintaining data-validation workflows inside Docker-based build pipelines. This role involves creating and managing Dockerfile labels, metadata standards, and validation scripts that ensure datasets, schemas, and model artifacts meet quality and compliance requirements before deployment. Main tasks listed: Develop and optimize Dockerfiles with built-in data-validation steps; Implement LABEL metadata for dataset versions, schemas, and lineage; Create validation scripts (Python/Bash) for schema checks, data integrity, and quality control; Integrate validation steps into CI/CD pipelines and enforce fail-on-bad-data checks.
We are actively seeking talented Data Scientists & Analysts proficient in Python to join our ambitious team dedicated to pushing the frontiers of AI technology. This opportunity is tailored for professionals who thrive on developing innovative solutions and aspire to be at the forefront of AI advancements. You will work with companies in the US looking to develop cutting-edge commercial and research AI solutions. Main tasks listed: Design, develop, and maintain efficient, high-quality code to train and optimize AI models; Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement; Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria; Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models. One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first, as a basis for fine-tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models. Main tasks listed: Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models; Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement; Familiarity with Python frameworks and libraries; Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
We are actively seeking talented developers proficient in Python & Javascript/Typescript to join our ambitious team dedicated to pushing the frontiers of AI technology. This opportunity is tailored for professionals who thrive on developing innovative solutions and aspire to be at the forefront of AI advancements. You will work with different companies in the US who are looking to develop cutting-edge commercial and research AI solutions. Main tasks listed: Design, develop, and maintain efficient, high-quality code to train and optimize AI models; Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement; Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria; Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
We are actively seeking talented developers proficient in Javascript/Typescript to join our ambitious team dedicated to pushing the frontiers of AI technology. This opportunity is tailored for professionals who thrive on developing innovative solutions and aspire to be at the forefront of AI advancements. You will work with different companies in the US who are looking to develop cutting-edge commercial and research AI solutions. Main tasks listed: Design, develop, and maintain efficient, high-quality code to train and optimize AI models; Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement; Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria; Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.