Anyone AI is seeking Neuroscience Experts to create tasks that test AI agents’ ability to reason through neuroscience research and analysis. You will develop original problems and reference solutions, then assess agents completing workflows with relevant tools and software.
Help shape the future of AI by designing realistic financial analysis and accounting tasks that challenge advanced AI agents.
Help shape the future of AI by designing realistic healthcare and medical tasks that challenge advanced AI agents.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with…
Talent network for Italian speakers run by Welo Data: join the contributor database for flexible remote projects in annotation, evaluation of search results, ads or chatbot responses, and prompt creation. This is not an active job opening; Welo Data contacts you when a project matches, with scope, timeline and pay.
Remote video data collection for small business owners and their employees in commercial or industrial settings (for example restaurants, construction, workshops, cleaning, logistics or retail): wear a smartphone head mount and record first-person videos of everyday work tasks for AI and robotics development. The listing asks for at least 2 hours of recording per day and for consent from workplace managers before recording. This work involves filming at your workplace: read the consent and privacy terms on the official page before applying.
This role is part of a project supporting leading LLM companies. The primary objective is to help these foundational LLM companies improve their Large Language Models. We support companies in enhancing their models by offering high-quality proprietary data. This data can be used as a basis for fine-tuning models or as an evaluation set to benchmark the performance. Main tasks listed: Translate CUDA/C++ code into equivalent Python implementations using PyTorch and NumPy, ensuring logical and performance parity; Analyze CUDA kernels and GPU-accelerated code for structure, efficiency, and function before translation; Evaluate LLM-generated translations of CUDA/C++ code to Python, providing technical feedback and corrections; Collaborate with prompt engineers and researchers to develop test prompts that reflect real-world CUDA/PyTorch tasks.
We are seeking an AI Prompt & Policy Specialist to help design, evaluate, and improve how AI systems interact with tools, APIs, and users across multiple locales. In this role, you will work at the intersection of prompt engineering, policy design, and safety, ensuring that AI-driven workflows are accurate, compliant, and user-friendly.
We are looking for experienced Software Engineers (SWE Bench – Data Engineer / Data Science) to contribute to benchmark-driven evaluation projects focused on real-world data engineering and data science workflows. This role involves hands-on work with production-like datasets, data pipelines, and data science tasks to help evaluate and improve the performance of advanced AI systems.
We are looking for experienced Data Analysts (MLE Bench) to contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on analytical work with production-like datasets, metrics, and ML outputs to help evaluate, diagnose, and improve the performance of advanced AI systems.