We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases…
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases…
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases…
We are looking for experienced Government professionals to support a cutting-edge AI benchmarking project focused on Mexican public sector environments. As a Subject Matter Expert, you will create and review realistic, high-quality scenarios that reflect operational, administrative, compliance, public safety, social…
We are looking for professional or semi-professional voice talents with a passion for language and technology for an exciting project. FEMALE, “MATURE” (~35–55 YEARS OLD), NATURAL RATHER THAN POLISHED/ROBOTIC — RETAINING NATURAL PAUSES, DISFLUENCIES, AND NATURAL WORD EMPHASIS.
We are looking for professional or semi-professional voice talents with a passion for language and technology for an exciting project. FEMALE, “MATURE” (~35–55 YEARS OLD), NATURAL RATHER THAN POLISHED/ROBOTIC — RETAINING NATURAL PAUSES, DISFLUENCIES, AND NATURAL WORD EMPHASIS.
We are looking for professional or semi-professional voice talents with a passion for language and technology for an exciting project. FEMALE, “MATURE” (~35–55 YEARS OLD), NATURAL RATHER THAN POLISHED/ROBOTIC — RETAINING NATURAL PAUSES, DISFLUENCIES, AND NATURAL WORD EMPHASIS.
We are seeking experienced professionals in Mathematics to contribute to a cutting-edge AI benchmarking project in the target language. As a Subject Matter Expert, you will create and review high-quality, real-world mathematical scenarios that evaluate AI systems in the target locale-specific contexts. Your expertise will directly shape how AI understands and performs in the compliant mathematical environments.
We are seeking detail-oriented human reviewers with a strong understanding of their local cultural context to support a range of AI training and evaluation projects. In this role, you will work across diverse task types, including evaluating prompts and AI-generated outputs, reviewing and correcting text, analyzing multimedia content, contributing voice recordings, among others. You will contribute to ensuring high-quality results by applying careful judgment to factors such as accuracy, clarity, cultural appropriateness, brand alignment, and overall effectiveness in meeting task objectives. This work requires strong analytical skills, attention to detail, and nuanced judgment informed by re
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model’s ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity