About the role
Compensation: $100-$150/hour, please provide a specific hourly rate expectation Availability: 20-40 hours/week, with at least 6 hours of Pacific Time overlap/day Main tasks listed: Design, refine, and iterate on rubrics and evaluation criteria for preference data; Review and label data with a high quality bar, catching subtle issues others might overlook; Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows; Synthesize findings from data work into clear write-ups, updates, and recommendations for the team.
Experience
5+ years of hands-on software engineering experience; Strong proficiency in Python, TypeScript/JavaScript, Go, or another major production language; Experience working in substantial real-world codebases; Strong code-review skills and technical judgment; Ability to clearly explain why an implementation is correct, incorrect, or could be improved; Strong written communication
Selection process
Apply through the official Turing page (free account required). The listing describes this selection process: AI interview (~25 minutes); Practical code/AI evaluation exercise (~30 minutes); Hiring manager interview (~20 minutes); The practical exercise focuses on your ability to review and evaluate AI-generated code, not competitive programming or algorithm puzzles.
Eligibility
North America (Only) (as stated on the listing)