About the role
This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models. One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first, as a basis for fine-tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models. Main tasks listed: Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models; Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement; Familiarity with Python frameworks and libraries; Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
Experience
3+ years of strong experience with Python programming language; Industry experience and knowledge of code quality, formatting, and best practices of software development; Experience with Python’s testing ecosystem, including unit, integration, and property-based testing; Knowledge of multi-threading and asynchronous programming in Python; Ability to work with architectural patterns and refactor code without introducing regressions; Strong debugging skills, including fixing memory and concurrency issues
Selection process
Apply through the official Turing page (free account required). The listing describes this selection process: Two rounds of interviews (60 min technical + 15 min cultural &, offer discussion).
Eligibility
Not stated on the listing (remote)