Retool

Engineering Manager, AI

Retool  •  San Francisco, CA (Onsite)  •  7 days ago
Apply
Save Job
Mark Applied Mark Interviewed Mark Offered
Hide Job Report Job
AI can make mistakes so check important info. Chat history is never stored.

Job Description

WHY WE’RE LOOKING FOR YOUAs Retool’s AI surface area grows, quality becomes the product. In this role, you’ll lead the team responsible for defining, measuring, and continuously improving quality across Retool’s Assist experience and related platform capabilities. Your mission is to build the systems, tools, and culture that help teams answer a deceptively hard question: “Is this actually good and how do we make it better?”
This work sits at the intersection of AI, product, and platform engineering. While some of the problems involve LLMs and AI evaluation, success in this role is less about prior specialization in AI research and more about strong instincts for building scalable quality systems—the kind that make correctness, relevance, and reliability measurable and repeatable as products evolve.
Prior experience with LLMs or AI evaluation tools is helpful, but not required. We’re excited about leaders who bring strong quality instincts and are eager to apply them to an emerging problem space. The systems you build will shape how our customers trust AI-powered software. You’ll influence not just what we ship, but how we ship: faster, more confidently, and with quality baked in from the start.
You’ll lead engineers working on:
  • Evaluation & experimentation platforms that let teams compare performance across models, configurations, and releases
  • Quality systems that define rubrics, metrics, and feedback loops for both AI and non-AI experiences
  • Data curation & feedback pipelines grounded in real-world usage
  • Search, retrieval, and relevance quality, ensuring results are accurate, fast, and trustworthy
  • Reusable infrastructure that other teams can leverage to ship higher-quality features with confidence
  • A culture of continuous improvement, where measurement, iteration, and learning are the default


IN THIS ROLE, YOU WILL
  • Lead and grow a team of engineers, supporting their development through coaching, feedback, and clear expectations
  • Partner closely with Product, Design, and other Engineering leaders to define quality goals aligned with business outcomes
  • Translate ambiguous problem spaces into clear strategies, roadmaps, and execution plans
  • Build scalable, repeatable processes that help teams ship faster without sacrificing quality
  • Establish standards and tooling that enable rapid iteration with confidence
  • Act as a multiplier across the organization by building platforms other teams rely on
  • Partner with Recruiting to build a diverse, high-performing team of motivated engineers

THE SKILLSET YOU’LL BRING
  • 3+ years of experience leading and managing engineering teams
  • Experience designing or operating systems that measure quality, correctness, or performance at scale
  • Strong technical curiosity. You enjoy engaging in architecture, reviewing designs, and getting hands-on when it matters
  • A track record of leading teams through change and ambiguity
  • The ability to set clear strategy while staying grounded in execution and impact
  • A product-minded approach: you care deeply about customers, outcomes, and long-term maintainability
  • Thoughtfulness around engineering culture, process, and team health
  • Clear, structured communication and strong stakeholder management skills
  • A collaborative mindset and comfort partnering across functions

Retool

About Retool

Build internal software better with AI. Create apps, agents, and workflows with any LLM, datasource, or API to deploy AI across your business.

Retool is the application layer for AI and leading platform for internal software development, trusted by over 10,000 companies worldwide, including Amazon, Stripe, Brex, and Orangetheory Fitness. Using Retool, developers deploy sophisticated apps and agents dramatically faster without sacrificing quality or control, combining powerful building blocks with the flexibility of custom code.

To learn more and start building for free today, visit https://retool.com

Industry
IT & Software
Company Size
201-500 employees
Headquarters
San Francisco, California
Year Founded
2017
Website
retool.com
Social Media