About the role
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity
Experience
Experience: 1+ years of industry experience in software or prompt engineering.; Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.; Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.; Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.; Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.; Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:; Encoding/decoding robustness and Un
Selection process
1 – Submit your application including an updated copy of your CV in English 2 – Next, complete a GenAI assessment to evaluate your skills 3 – Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
Eligibility
Germany (remote). The listing notes that contractors in embargoed or sanctioned regions cannot be engaged.