Job Description

Senior AI Engineer

Department: Backend

Employment Type: Full Time

Location: USA

We're looking for a hands-on AI Engineer who combines strong backend engineering fundamentals with hands-on experience building production Generative AI systems. You'll design and ship RAG pipelines, integrate LLMs into real products, and build the backend services that support them, writing code daily, not just architecting on paper.

This is a purely technical IC role, not a managerial one. You’ll lead by example, mentor through code reviews, and own end-to-end technical delivery.

Key Responsibilities

Design and build RAG systems, embeddings, vector search, chunking, and evaluation pipelines.
Build and maintain multi-agent orchestration workflows (LangGraph, AutoGen, CrewAI, or similar).
Develop backend services and APIs (Python — Flask/FastAPI) that expose AI workflows to production systems.
Deploy and scale AI workloads in cloud-native environments, using serverless or containerized patterns.
Implement LLMOps practices: prompt versioning, cost tracking, monitoring, and evaluation.
Write clean, tested code, and use AI-assisted tools (Copilot, Cursor, Claude Code) to move faster without cutting corners.
Work with data and platform engineers to ship GenAI features quickly, from prototype to production.

Skills, Knowledge and Expertise

5+ years of backend experience, with strong Python coding skills.
Proven experience shipping RAG systems (vector DBs, embeddings, chunking).
Familiarity with orchestration frameworks (LangGraph, LangChain, AutoGen, or similar).
Experience with APIs, microservices, and cloud-native development (AWS preferred).
Familiarity with distributed systems concepts (async, message queues, caching).

Experience with unstructured data (PDFs, tables, images).

Builder mindset: thrives on writing, debugging, and improving production code.
Collaborative, humble, and open to feedback.
Strong communicator who explains design decisions clearly.

Influences through contribution, not hierarchy.

About Emumba

Founded in 2011, Emumba is a software services company serving as an innovation arm for enterprises. With a commitment to engineering excellence, we have garnered the trust of global industry leaders and established a reputation for delivering high quality solutions.

At Emumba, we don’t just provide services; we partner with our clients to push the boundaries of what’s possible, leaving a lasting impact. Our strong relationships with industry giants like Microsoft and Salesforce, along with our role as an AWS Partner, reflect our dedication to consistent, exceptional results.

Our success is built on a foundation of exceptional talent and a unique cultural DNA that prioritizes integrity, collaboration, and innovation. We pride ourselves on attracting and retaining the top 2% of industry professionals, supported by a global network of consultants and PhDs.

Our core services include:

~GenAI Solutions: Harnessing the power of Generative AI to drive business transformation

~Data Platforms: Constructing robust infrastructures for seamless data management and analytics

~Cloud-Native Enterprise Applications: Creating scalable and secure cloud solutions

~DevOps and Cloud Infrastructure: Ensuring efficient, automated, and reliable IT operations

~Test Automation: Implementing comprehensive testing frameworks to enhance product quality

~Design UI/UX: Crafting user-centric designs that elevate the digital experience

At Emumba, we are dedicated partners in our clients' progress. Our collective effort, expertise, and commitment to reimagining what’s possible drive us to make a positive impact on the world.

Have Questions? Reach out to us at hello@emumba.com. Let’s explore how we can innovate together.

Industry

IT & Software

Company Size

201-500 employees

Headquarters

Sunnyvale, California

Year Founded

2011

Website

emumba.com

Social Media