Job Description

Minimum qualifications:

Bachelor’s degree or equivalent practical experience.
5 years of experience with software development in one or more programming languages.
Experience evaluating large language models (LLMs), including hallucinations, faithfulness, and retrieval-augmented generation (RAG) quality.
Experience with C++ and Python and building scalable test automation frameworks for non-deterministic AI systems.

Preferred qualifications:

Experience testing multimodal systems (Voice/Audio) and agents that perform actions (tool use).
Experience launching and maintaining high-availability consumer-facing AI products.
Understanding of retail workflows (e.g., catalog, cart, checkout) and customer support nuances to design user-centric test scenarios.
Ability to work in a 0-to-1 environment with evolving requirements.
Passion for "breaking" AI models to discover edge cases and safety vulnerabilities.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

In this role, you will build the operational foundation for modern commerce, embedding intelligence directly into a retailer’s infrastructure to strengthen customer relationships. You will be launching a deployable, multimodal Shopping Agent—a full-stack concierge capable of reasoning, virtual try-on, and seamless business and support. By leveraging Google’s foundational AI (Gemini and Vertex AI), you will aim to ensure every new agent enhances the entire ecosystem. You will help improve the quality of a product designed to transform brands from invisible warehouses into hyper-personalized, intelligent destinations.

The Cloud Applied AI (AAI) powers business growth with Gemini Enterprise. Our portfolio includes Gemini Enterprise for Customer Experience (Shopping Agent, CX Agent Studio, Agent Assist, Vertex AI Search - Commerce, Customer Experience Insights), along with other vertical and domain packaged solutions. We enable high adoption and speed to value by building solutions that are quickly deployed, delivering new 0-to-1 capabilities with startup agility. Team members operate at the forefront of AI, collaborating directly with model builders with unprecedented speed. Join us to work on cutting-edge projects and shape the future of AI in a fast-paced, collaborative, and impactful environment.

The US base salary range for this full-time position is $174,000-$252,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google

Responsibilities

Lead the definition and execution of quality metrics for the Shopping Agent, ensuring response accuracy, safety, and brand alignment across multimodal interactions (e.g., text, voice, and image).
Design and implement automated evaluation pipelines and "golden datasets" for complex shopping journeys, including virtual try-on, reasoning, and support queries.
Collaborate with research and modeling teams to perform quality evaluations for foundational models, optimizing prompts and grounding to reduce hallucinations and improve conversion outcomes.
Develop integration tests for agentic actions (e.g., add-to-cart and checkout).
Ensure seamless interoperability between the Shopping Agent and Customer Service Agent platforms.

About Google

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Check out our career opportunities at goo.gle/3DLEokh

Industry

IT & Software

Company Size

10,000+ employees

Headquarters

Mountain View, CA

Year Founded

Unknown

Website

google.com

Social Media