Job Description

About the Role

We're looking for a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You'll craft and assess challenging physics problems, probe model reasoning at the frontier, and help identify where models fail under rigorous scientific scrutiny.

What You'll Do

• Develop and evaluate high-difficulty physics prompts spanning classical mechanics, quantum mechanics, electromagnetism, thermodynamics, and related areas

• Use adversarial prompting techniques to expose errors in model reasoning and problem-solving

• Provide expert critique of AI-generated responses, assessing both correctness and depth

• Work closely with project leads to uphold quality benchmarks

What We're Looking For

• PhD in Physics or a closely related field

• Graduate-level expertise across multiple areas of physics

• Prior hands-on experience in AI data annotation or RLHF

• Excellent written communication and analytical skills

• Experts based out of the US, Canada, Mexico, UK, Ireland, Australia, New Zealand, and Spain

Extra Credit

• Publications in peer-reviewed physics or astronomy journals.

• Experience with adversarial prompting, model evaluation, or AI red teaming strongly preferred

• Teaching, tutoring, or curriculum development experience in physical chemistry or theoretical sciences.

• Background in scientific annotation or technical quality assurance.

Additional Information

• Location: Fully remote (no visa sponsorship available if based in the US)

• Schedule: Flexible hours — contribute as much or as little as you’d like each week. (No minimum hours per week, capped at 40hrs/week.)