Job Description

Come join Microsoft Office AI team to work on state-of-the-art services, AI solutions, platforms, distributed systems, and modern technology to deliver the next generation of intelligent productivity experiences used by hundreds of millions of users daily! We are looking for Software Engineer II who can help us further grow our products, business, and culture!

As a Software Engineer II in the Office AI team, you will help lead the evolution of Office productivity through AI-driven experiences (such as Microsoft Copilot) across key applications. The team builds the core platforms and experiences that bring large language models (LLMs) and real-time intelligence into Office applications, combining the power of LLMs with enterprise data and native integration to streamline content creation, navigation and comprehension. 

We are looking for a creative  Software Engineer II who will collaborate with software engineers, researchers, and product managers to express product needs as well-defined machine learning problems, push the state of the art in LLMs and bring prototypes all the way to planet scale production. You’ll build the engineering that makes AI work in production: you will build APIs, platforms and services around AI features; design data pipelines and feedback loops; deploy and finetune state of the art deep learning models; orchestrate prompts and tools; and monitor AI specific signals - such as drift, hallucinations, safety and cost - alongside traditional service reliability metrics. 

Responsibilities

• Design and implement scalable, reliable, and secure AI services on Azure, optimizing performance, cost and compliance.

• Apply knowledge of generative AI, large language models, and modern frameworks to develop intelligent features and automation within the service. 

• Participate actively in code reviews, bug/issue triage with the feature teams, and support well informed decisions towards business and engineering goals

• Contribute to fixing, enhancing, and supporting our services in production, including periodic on-call duties where necessary

• Have sense of ownership and drive on well-defined but ambiguous problems

• Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products

• Work with international teams within Microsoft

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science OR related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, Typescript, C#, Java, JavaScript, or Python

• OR equivalent experience. 

Preferred Qualifications:

• Distributed systems and cloud scale, proven ability to design, implement and operate scalable, fault-tolerant microservices and distributed storage on cloud platforms such as Azure; experience building APIs and services, designing data pipelines and feedback loops, and implementing secure, compliant solutions.  

• AI and machine learning mastery, hands-on experience with state-of-the-art generative AI and ML frameworks and deep understanding of large language models, embeddings, prompt engineering and model fine-tuning. 

• Technical leadership, demonstrated experience leading complex initiatives from concept to production, mentoring engineers, and driving technical decision-making while working with cross-functional teams.  

• Security and compliance, ability to meet Microsoft’s and customers’ security and background requirements and to ensure that solutions adhere to responsible AI and data privacy standards.

• Demonstrated passion for mentoring, fostering an inclusive team culture, and collaborating closely with product, research and design partners to drive strategy and deliver user value. 

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.