Are you passionate about leading engineering teams that power the world's largest real-time AI inference systems? Are you customer-obsessed and excited about building the foundational infrastructure that enables the next generation of Alexa experiences? If so, the Alexa AI Logistics for Infrastructure, Cost, and Efficiency (ALICE) team is looking for a Software Development Manager to lead critical work at the intersection of AI infrastructure, inference service engineering, and cloud-scale systems.
Alexa is shaping the future of AI voice-based personal assistants, and we need your help to own and lead large-scale technical programs that power the next generation of Alexa experiences. Alexa is the Amazon cloud AI service and brain that powers Echo and Alexa-enabled devices worldwide. We believe voice is the most natural user interface for interacting with technology across many domains — we are inventing the future. At ALICE, we are passionate about continuously improving infrastructure efficiency, cost optimization, and capacity management to enable amazing customer experiences at scale.
Key job responsibilities
You will lead a team of Software Development Engineers responsible for critical inference service components within ALICE's portfolio, with a primary focus on building and operating a centralized inference management service that sits at the heart of Alexa's AI infrastructure.
Your team will be responsible for:
- Owning and operating a centralized inference service that manages model access, capacity utilization, and intelligent traffic prioritization and throttling at massive scale
- Ensuring inference services meet Alexa's stringent latency and throughput requirements, with comprehensive observability and monitoring
- Building solutions that maximize the efficiency of GPU and compute resources, including scheduling systems that optimize workload execution across real-time and offline inference traffic
- Driving infrastructure expansion into new AWS regions to support Alexa's international growth
- Collaborating with teams across Alexa, AGI, and AWS to align inference service capabilities with evolving product and infrastructure needs
You must be able to thrive and succeed in an entrepreneurial environment, and not be hindered by ambiguity or competing priorities. This means you are not only able to develop and drive high-level strategic initiatives, but can also roll up your sleeves, dig in and get the job done. You will anticipate bottlenecks, provide escalation management, anticipate and make tradeoffs, and balance business needs versus technical constraints. Maturity, high judgment, negotiation skills, ability to influence, analytical talent, and leadership are essential to success in this role.
- 3+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- 8+ years of leading the definition and development of multi tier web services experience
- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
- Experience partnering with product or program management teams
- Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
- Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers
- Experience delivering products against plan in a fast-paced, multi-disciplined, distributed-responsibility and often ambiguous environment
- Experience in many disparate technologies, typically ranging from front-end user interfaces through to back-end systems and all points in between
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits
USA, CA, Sunnyvale - 212,700.00 - 287,700.00 USD annually
USA, WA, Bellevue - 184,900.00 - 250,200.00 USD annually
Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. We are driven by the excitement of building technologies, inventing products, and providing services that change lives. We embrace new ways of doing things, make decisions quickly, and are not afraid to fail. We have the scope and capabilities of a large company, and the spirit and heart of a small one.
Together, Amazonians research and develop new technologies from Amazon Web Services to Alexa on behalf of our customers: shoppers, sellers, content creators, and developers around the world.
Our mission is to be Earth's most customer-centric company. Our actions, goals, projects, programs, and inventions begin and end with the customer top of mind.
You'll also hear us say that at Amazon, it's always "Day 1." What do we mean? That our approach remains the same as it was on Amazon's very first day - to make smart, fast decisions, stay nimble, invent, and focus on delighting our customers.
