Clera

Senior Software Engineer, Model Evaluation

Clera  •  $180k - $250k/yr  •  San Francisco, CA (Onsite)  •  3 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

About the Role

Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.

What You'll Do

  • Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
  • Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.
  • Train and fine-tune models, using evaluation results to guide experiments.
  • Identify agent failures, improve production systems, and measure whether changes work.
  • Help establish the team's research and evaluation practices.

What We're Looking For

  • At least 3 years of experience, operating at a senior or staff level.
  • Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.
  • Practical experience training and fine-tuning models, not only using models through APIs.
  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
  • Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.

Compensation & Benefits

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.

Location

Hybrid in San Francisco, California, United States.

Clera

About Clera

Clera is the intro company. We introduce people to the founders who need them, and founders to the people they’d hire.

Looking for your next role?

Stop applying. Start getting introduced. Tell Clera what you want next, and we introduce you to hiring managers at 900+ startups backed by a16z, Index, YC and more. 8 days from signup to first interview.

Hiring?

Stop sorting through applicants. Clera introduces you to people who already want the move and fit your roles. Nobody reaches your shortlist without talking to Clera first.

Based in San Francisco. Introducing people in SF, New York, London, Berlin, Munich and Stockholm.

getclera.com

Industry
IT & Software
Company Size
11-50 employees
Headquarters
San Francisco
Year Founded
2025
Social Media