Product Manager II, AI Hardware and Software Co-design

Product Manager II focusing on AI hardware and software co-design at Google, steering products from ideation through launch while aligning engineering, research, and external partners to optimize the AI compute stack.

Responsibilities

• Define and execute the product strategy for your designated focus area, making decisions about areas of investment and prioritizing/deprioritizing features to keep cross-functional teams focused on high-impact outcomes.
• Partner with internal product areas and external customers to anticipate and synthesize complex future requirements, translating them into hardware and software specifications.
• Direct the resolution of difficult, ambiguous problems (for example, balancing model quality and latency) through evidence-based, data-driven arguments.
• Collaborate closely with engineering to determine optimal technical implementation and scheduling. Drive the hardware through physical milestones and establish project processes to ensure alignment across distributed teams.
• Utilize AI to enhance your personal impact, identify new ultra-specialized product opportunities, and maintain a comprehensive working knowledge of the AI powered product development lifecycle.

Requirements

• Bachelor's degree or equivalent practical experience.
• 5 years of experience in product management or related technical role.
• 2 years of experience taking technical products from conception to launch (e.g., ideation to execution, end-to-end, 0 to 1).
• Experience with AI/ML foundations, LLM/ML serving infrastructure, hardware accelerators, or silicon development.
• Experience working cross-functionally with engineering, research, and infrastructure teams to launch technical products.

Education

• Master’s degree or PhD

Location

New York, NY (onsite)

Compensation

The base salary range for this US role is $163,000 to $237,000 per year, with additional bonus, equity, and benefits. Salary ranges are determined by role, level, and location; recruiters will share more details about the specific range for your location. Compensation details listed reflect base pay and do not include bonus, equity, or benefits.

Technologies

• transformers
• mixture of experts

About the job

Google emphasizes user focus in product decisions. As a Product Manager II, you will adapt to a changing environment and work on products that affect millions daily. The role involves cross functional collaboration to move ideas from concept to launch by linking technical and business perspectives and breaking problems into concrete steps that drive development.

Collaborative product management at Google blends work with engineers, designers, and marketers to design and develop technologies that improve access to information. PMs guide products through the execution cycle, focusing on analysis, positioning, packaging, promoting, and tailoring solutions to user needs.

The Research Compute Systems team within Google Research operates at the frontier of AI hardware-software co-design, aiming to improve compute-system metrics across the AI stack from data centers to chips, models, and applications.

The role combines ownership of products and programs with hands-on contribution. In early phases, you will define requirements and help de-risk experimental paths. In later stages, you will engage with internal and external customers to understand workloads, negotiate technical tradeoffs, and drive hardware milestones toward pilots.

The base salary for this role in the US is listed as $163,000 to $237,000 per year, plus bonus, equity, and benefits. Salary ranges are determined by role, level, and location, and recruiters can share location-specific details. Base pay reflects salary alone and does not include bonus, equity, or benefits.