Job Description

Microsoft Search & AI platform team delivers the cutting-edge infrastructure for Microsoft search and feeds experience which is used by billions of users. We are looking for a passionate platform developer to join us building the next generation of compute and storage fabric using in-house and open-source technologies. You will be hands-on in a massively scaled and distributed system. You will have the opportunity to work with cutting-edge cloud and machine learning technologies.

• Share accountability of a wide array of assets and be comfortable with learning a broad array of technologies.
• Design and implement features in a distributed environment using data to guide and measure success.
• Debug and mitigate incidents in live production environments.
• Participate in regular team scrums and communicate regularly and clearly with team members and leads.
• Look for opportunities to use open-source technologies in our service or to share learnings, services and tools we have created with Microsoft broadly or the open-source community.

We are a fast-paced team with product releases every week. If you are self-motivated and want to make a large impact in the cloud serving area, then we are looking forward to meeting you!

This is a core engineering team dealing with tens of thousands production servers, sub-millisecond latency and millions of RPS traffic. We develop advanced vector search algorithms, optimize model acceleration kernels, and build large scale distributed deep learning serving system. Our system leverages popular open-source components including ONNX, PyTorch, TensorFlow, Docker, Kafka, g-RPC, etc. We work on wide range of CPU and GPU hardware for high-performance serving.

We are expanding our established deep learning platform to the largest scale in industry, in order to serve the growing demand of search volume, office intelligence and Dynamics experience. To do that, we are looking for a solid system engineer on performance analysis, components scaling-up, distributed system debugging, and new feature/algorithm development. Our projects collaborate with the Microsoft Research deeply. This is a great opportunity to work on a large production system with cutting-edge technology innovation.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.

Responsibilities

• Share accountability of a wide array of assets and be comfortable with learning a broad array of technologies.
• Design and implement features in a distributed environment using data to guide and measure success.
• Debug and mitigate incidents in live production environments.
• Participate in regular team scrums and communicate regularly and clearly with team members and leads.
• Look for opportunities to use open-source technologies in our service or to share learnings, services and tools we have created with Microsoft broadly or the open-source community.

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Preferred Qualifications:

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• 10+ years of experience in building high-performance computing systems, parallel or distributed systems (e.g., in open-source projects or production systems).
• Experience on high performance computing (e.g., cache/memory optimization, high-performance GPU programming, compiler-based optimization, fine-grained parallel library and runtime) or distributed systems (e.g., communication optimization, network architecture design, network programming).
• Theory and practice on the approximate nearest neighborhood search.
• Experience on building Machine Learning/Deep Learning systems.
• Experience on performance analysis and optimization for both CPUs and GPUs, as well as good understanding on software-hardware codesign.

#MicrosoftAI #SearchAIPlatform #Search #Bing

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.