Job Description

Staff Backend Engineer, AI Infrastructure

Location: Not specified

Employment Type: Full-time

Experience: 8+ years

Focus: Distributed Systems, AI Infrastructure, Backend Engineering, Media Processing, Reliability

About Our Client

Our client is building AI-powered healthcare technology that transforms how clinicians capture, process, and document patient interactions.

Their Ambient AI products use speech processing, machine learning, and large language models to turn clinical conversations into structured, actionable information.

The company is looking for an experienced backend infrastructure engineer to build and scale the systems that power these AI workflows across mobile and web applications.

About the Role

Our client is hiring a Staff Backend Engineer, AI Infrastructure to design, build, and operate the distributed systems behind its Ambient AI products.

This is a hands-on engineering role focused on reliability, scalability, observability, and orchestration of long-running AI inference workflows.

You'll own critical backend infrastructure supporting audio ingestion, transcription, speaker diarization, LLM processing, clinical data extraction, and summarization.

The ideal candidate has experience building distributed systems at scale, understands how to operate compute-heavy workloads in production, and has a track record of making systems measurably more reliable.

What You'll Do

• Design and operate scalable backend systems supporting AI-powered healthcare applications.
• Build infrastructure for long-form audio ingestion, media processing, and real-time and asynchronous streaming.
• Own orchestration for multi-stage AI inference workflows, including transcription, diarization, LLMs, clinical extraction, and summarization.
• Build reliable scheduling, queueing, retries, timeouts, dead-letter handling, idempotency, and replay systems.
• Improve system resilience through graceful degradation and recovery mechanisms.
• Support mobile and web workflows operating under poor connectivity, unstable networks, and offline conditions.
• Define and maintain service-level objectives (SLOs) for critical production workflows.
• Build observability through structured logging, metrics, distributed tracing, dashboards, and alerting.
• Lead incident response, root-cause analysis, and long-term reliability improvements.
• Design and improve APIs, data models, cloud infrastructure, and deployment systems.
• Balance infrastructure cost, latency, reliability, and model quality.
• Mentor other engineers and establish standards for distributed systems and operational readiness.

What We're Looking For

• 8+ years of backend or infrastructure engineering experience (7+ for exceptional candidates).
• Experience designing, building, and operating production distributed systems at scale.
• Strong understanding of asynchronous processing, message queues, and workflow orchestration.
• Experience building reliable systems for long-running, compute-intensive workloads.
• Strong knowledge of retries, idempotency, timeouts, dead-letter queues, and fault tolerance.
• Experience designing production APIs, backend services, and cloud infrastructure.
• Deep understanding of observability, monitoring, distributed tracing, and incident response.
• Demonstrated ability to improve system reliability, scalability, and performance.
• Experience owning production systems end-to-end, including operational support.
• Ability to make architecture decisions in fast-moving, ambiguous environments.
• Strong technical leadership and ability to mentor engineers.

Bonus Experience

• Current or previous Staff Engineer, Tech Lead, or equivalent technical leadership experience.
• Experience building audio, speech, media processing, or real-time streaming infrastructure.
• Experience orchestrating multi-stage AI or ML inference pipelines.
• Experience with mobile backend systems and unreliable network environments.
• Experience building AI applications used in healthcare or clinical settings.
• Background combining healthcare technology experience with large-scale engineering at a major technology company.
• Familiarity with EHR systems, clinical workflows, or enterprise healthcare infrastructure.

Why This Opportunity

• Own critical infrastructure behind production AI applications used in healthcare.
• Solve challenging distributed systems problems involving audio, streaming, and multi-stage AI inference.
• Build systems where reliability directly affects clinician workflows.
• Work across backend infrastructure, AI, mobile, and product engineering.
• Influence architectural decisions and operational engineering standards.
• Help scale AI-powered healthcare applications through better reliability, observability, and infrastructure.

Ideal Candidate Profile

The ideal candidate is a Staff-level Backend or Infrastructure Engineer who has built and operated complex distributed systems in production.

They understand how to orchestrate long-running workloads, design fault-tolerant systems, debug failures across distributed services, and make infrastructure measurably more reliable.

They are deeply hands-on, comfortable owning production reliability, and excited to build infrastructure that supports sophisticated AI applications in healthcare.