Google logo

Group Product Manager, AI Infra

Google
On-site
Sunnyvale, California, United States
$227,000 - $320,000 USD yearly
Product Manager
In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:
Health, dental, vision, life, disability insurance
Retirement Benefits: 401(k) with company match
Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
Sick Time: 40 hours/year (statutory, where applicable); 5 days/event (discretionary)
Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
Baby Bonding Leave: 18 weeks
Holidays: 13 paid days per yearNote: By applying to this position you will have an opportunity to share your preferred working location from the following: Sunnyvale, CA, USA; Seattle, WA, USA.

Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 10 years of experience in product management or a related technical role.
  • 5 years of experience taking technical products from conception to launch (e.g., ideation to execution, end-to-end, 0 to 1, etc).
  • Experience with open source technologies and inference.

Preferred qualifications:

  • Master's degree in a technology or a business related field.
  • 7 years of experience working cross-functionally with engineering, UX/UI, sales finance, and other stakeholders.
  • 7 years of experience in a business function or role (e.g., marketing, business operations, consulting).
  • 5 years of experience in software development or engineering.
  • 5 years of experience in a role preparing and delivering technical presentations to executive leadership.
  • Knowledge of, or continued interest in building accessibility best practices, and curiosity for incorporating accessibility into product development methodologies.


About the job

At Google, we put our users first. The world is always changing, so we need Product Managers who are continuously adapting and excited to work on products that affect millions of people every day.

In this role, you will work cross-functionally to guide products from conception to launch by connecting the technical and business worlds. You can break down complex problems into steps that drive product development.

One of the many reasons Google consistently brings innovative, world-changing products to market is because of the collaborative work we do in Product Management. Our team works closely with creative engineers, designers, marketers, etc. to help design and develop technologies that improve access to the world's information. We're responsible for guiding products throughout the execution cycle, focusing specifically on analyzing, positioning, packaging, promoting, and tailoring our solutions to our users.

In this role, you will drive customer adoption of our custom accelerators by making it effortless for any customer to serve their models on the platform. You will deliver excellent price-performance and developer experience for model serving on our accelerators and Google Cloud Platform.

A central part of this strategy involves engaging with the open-source community to ensure our hardware is the goal for modern inference. You will lead our efforts to integrate with and contribute to the Large Language Model (LLM) or Structured Generation Language (SGLang) community and ecosystem, building a seamless path from research to the deployment.

The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide.

We're the driving team behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.

The US base salary range for this full-time position is $227,000-$320,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.



Responsibilities

  • Define and execute a multi-year roadmap for the machine learning software stack, with a specific focus on model serving and an inference.
  • Lead Google’s product engagement with inference engines like vLLM or SGLang; ensure that our hardware features are natively supported and optimized within these community-led frameworks.
  • Identify and remove barriers to entry for customers migrating to custom accelerators. Own the goal for "effortless" deployment, focusing on developer-friendly APIs, orchestration, and tooling.
  • Partner with engineering teams to optimize the software-to-silicon path. Focus on delivering the industry’s best price-performance metrics, ensuring customers can maximize throughput and minimize latency.
  • Collaborate with Google Cloud Platform (GCP) teams (e.g., Google Kubernetes Engine (GKE) and Vertex Artificial Intelligence (Vertex AI)) to build a unified experience for managing distributed Machine Learning (ML) workloads across various hardware configurations.