ProductJobs.io
← Back to all jobs

Job Description

This role sits within Facebook Product Operations and focuses on improving product quality and operational excellence for Facebook Social’s hypergrowth app releases, including AI-powered automation. You will own end-to-end quality programs, build autonomous AI agents for bug triage and resolution, and use data, evals, and cross-functional partnership to drive measurable improvements.

Responsibilities

  • Develop expertise in the health and quality of Facebook’s Social and AI products by identifying trends, regressions, and user pain points through data analysis and hands-on product usage
  • Own end-to-end product quality programs for your area, covering launches, dogfooding, root cause analyses, incident reviews, and app health regressions while automating first steps and operating with high reliability
  • Design, build, and operate autonomous AI agents and workflows for your product area, including bug triage, prioritization, classification, deduplication, and resolution
  • Partner with engineering and product teams to drive resolution of high-priority issues and to influence the product roadmap using quality insights
  • Create communication materials and progress tracking for multiple audiences, including updates delivered to leadership stakeholders
  • Collect, analyze, and leverage data to identify quality trends and inform product decisions
  • Build dashboards and metrics to enable data-driven decision making
  • Build and maintain an evaluation (evals) practice for your area to ensure AI solutions meet accuracy thresholds using LLM judges, labellers, and governance frameworks
  • Assess and improve AI solutions within scope, driving migration to standard platforms and partnering with AI Implementations leadership on scaling decisions
  • Coordinate with cross-functional teams and Foundations partners to align on org-wide priorities and share best practices
  • Design and operate AI workflows that comply with Facebook data sensitivity guardrails, ensuring quality signals are collected and processed within encryption boundaries and privacy-first constraints

Requirements

  • Bachelor’s degree in a directly related field, or equivalent practical experience
  • 5+ years of related strategy, operations, consulting, or data analyst experience
  • Analytical experience using data to tell a story and influence product direction using intermediate to advanced SQL
  • Experience building or deploying AI/ML solutions or automation in production workflows
  • Strong communication skills with the ability to influence multiple cross-functional stakeholders and senior leadership
  • Experience breaking down ambiguous issues into component parts to develop and implement solutions
  • Experience with AI products or platforms, including understanding of mobile-first product behaviors, encryption, and multi-platform feature parity

Technologies

  • SQL
  • AI/ML
  • LLM judges
  • Encryption

Preferred Qualifications

  • Prior experience working on or with Facebook or comparable large-scale messaging products
  • Experience in product quality, QA, or technical program management
  • Familiarity with LLMs, AI agents, or ML evaluation frameworks
  • Experience operating effectively in organizations with minimal hierarchy, taking ownership of workstreams with high individual autonomy
  • Experience working with global or remote teams

Location

Menlo Park, CA (onsite)

Compensation

USD 123,000 - 179,000 per year

Experience Level

5+ years minimum related experience

Education

Bachelor’s degree required

Similar Jobs