We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models. In this role, you will leverage your expertise in board games, game mechanics, strategic reasoning, probability, and complex rule systems to create, review, and evaluate high-quality datasets that improve AI performance.
We are seeking Senior Accounting & Finance Professionals with hands-on experience in QuickBooks Online (QBO) and Omni Chat support. This role involves handling both general help inquiries and complex, data-heavy accounting and finance questions that require strong analytical and advisory capabilities. Main tasks listed: Analyze financial data and provide accounting guidance; Handle complex accounting, bookkeeping, and finance-related questions; Provide advisory-based recommendations using financial data.
We are seeking a highly qualified Music Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within music theory, genres, composers, artists, production, instruments. Main tasks listed: Create advanced prompts covering music theory, genres, composers, artists, production instruments; Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance; Identify hallucinations, logical inconsistencies, outdated information, and edge cases; Develop benchmark datasets and adversarial test cases.
We are seeking a highly qualified Art Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within fine arts, visual arts, architecture, design, art history, museums, and artists. Main tasks listed: Create advanced prompts covering fine arts, visual arts, architecture, design, art history, museums, and artists; Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance; Identify hallucinations, logical inconsistencies, outdated information, and edge cases; Develop benchmark datasets and adversarial test cases.
Job Title: Mid-Senior Azure DevOps Engineer (LangGraph Experience) We are seeking a Mid-Senior Azure DevOps Engineer with strong experience in Azure DevOps and hands-on expertise in LangGraph to support the deployment, automation, and management of AI-powered applications. The ideal candidate will have experience building scalable CI/CD pipelines, managing Azure cloud infrastructure, and deploying LLM-based agentic applications. Main tasks listed: Design, implement, and optimize CI/CD pipelines using Azure DevOps; Deploy, configure, and maintain applications and AI workflows on Microsoft Azure; Build, deploy, and support LangGraph-based agentic AI applications; Automate infrastructure provisioning using Terraform, Bicep, or ARM templates.
We are seeking a highly qualified Sports Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within global sports, leagues, athletes, tournaments, rules, statistics, analytics. Main tasks listed: Create advanced prompts covering global sports, leagues, athletes, tournaments, rules, statistics, analytics; Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance; Identify hallucinations, logical inconsistencies, outdated information, and edge cases; Develop benchmark datasets and adversarial test cases.
We are seeking a highly qualified Politics Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within political science, governance, elections, public policy, international relations. Main tasks listed: Create advanced prompts covering political science, governance, elections, public policy and international relations; Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance; Identify hallucinations, logical inconsistencies, outdated information, and edge cases; Develop benchmark datasets and adversarial test cases.
We are seeking a highly qualified TV Shows & Movies Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within film, television, streaming, actors, directors, genres, awards, franchises, and entertainment history. Main tasks listed: Create advanced prompts covering film, television, streaming, actors, directors, genres, awards, franchises, and entertainment history; Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance; Identify hallucinations, logical inconsistencies, outdated information, and edge cases; Develop benchmark datasets and adversarial test cases.
We are building an evaluation benchmark for frontier AI browsing agents. Your job is to design research problems that a state-of-the-art AI cannot solve, even with full web access and multiple attempts. This is not a subject matter expert role, nor is it a content-writing role. It is investigative research. You will start from a verifiable fact, work backwards to construct a question that makes that fact extremely hard to locate, and then prove your work with a complete, auditable evidence trail.
Use your research, reasoning, and analytical skills to help improve leading AI models. We’re looking for students and working professionals to research information, solve analytical problems, and evaluate AI-generated responses. 20 hours/week commitment, with eligibility for up to 40 hours/week Main tasks listed: Research online sources and verify information; Analyze complex content and logical problems; Summarize information into clear, concise insights; Review AI-generated responses and identify or correct errors.