About the role
In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills. The ideal candidate should have a solid foundation in STEM, particularly at the level expected in engineering entrance exams, as well as graduate or PhD-level programs. You should be able to break down complex STEM concepts into simple, clear explanations and work efficiently. Main tasks listed: Design and solve challenging STEMs problems to probe the limitations of large language models; Create clear, high-quality, step-by-step solutions with well-articulated reasoning; Collaborate with LLM researchers to align problems with evaluation goals, especially in areas where models typically struggle (e.g., abstraction, multi-step reasoning, symbolic manipulation); Help define new evaluation benchmarks based on Physics curricula spanning early undergraduate to PhD-level topics.
Experience
Analytical Skills: Good research and analytical skills; Feedback Skills: Ability to provide constructive feedback and detailed annotations; Creative Thinking: Creative and lateral thinking abilities; Communication: Excellent structured communication and collaboration skills in a remote setting; Independence: Self-motivated and able to work independently in a remote setting; Technical Setup: Desktop/Laptop set up with a good internet connection
Selection process
Apply through the official Turing page (free account required). The listing does not describe further selection steps.
Eligibility
Not stated on the listing (remote)