Ai Evals Product Jobs

1 job found

Today

Product Manager for AI Solution

Photon United States

United States

Today

$54k - $189k/yr Contract Ai Evals Ai Orchestration Ai Workflows

Apply Now

Job Description

Photon is building AI-powered workflows across the Clover ecosystem, with a focus on measurable outcomes and strong user trust. This contract Product Manager role is based in the United States (onsite) and brings together product strategy and hands-on AI execution, from use-case definition to evaluation, governance, and launch planning.

What you’ll focus on

Define and prioritize AI-powered workflow use cases, partnering with engineering, data science, and design to identify high-value automation opportunities.
Translate business processes into agentic experiences that give merchants flexibility while keeping end-user experiences simple.
Define success metrics, manage complex product requirements, and create a prioritized roadmap using behavioral data and market trends.
Ensure AI solutions deliver measurable business outcomes while maintaining user trust, security, and control.

How the work gets delivered

Build and implement agent evaluation frameworks, including confidence scoring and prompt iteration cycles to monitor production accuracy and performance.
Implement enterprise AI governance mechanisms such as human-in-the-loop review, audit trails, and approval workflows to support reliability, security, and compliance across agent pipelines.
Use hands-on prototyping tools to rapidly validate prompts, agent workflows, and evaluation harnesses to speed alignment and deployment.
Collaborate with vertical PMs to educate and onboard them into AI development, using their subject matter expertise to help develop agents for vertical areas.

What you bring

7+ years of Product Management experience (at least Senior level), ideally in POS, e-commerce, or complex fintech enterprise systems.
Hands-on expertise across Generative AI and practical agent systems, including multi-agent orchestration, tool-calling/tool-use frameworks, and RAG & embeddings, along with prompt engineering and workflow automation.
Comfort working with complex data structures such as catalogs, taxonomies, and item relationships.
A track record of leading large-scale cross-functional initiatives from concept to launch, with strong analytics for defining metrics and iterating based on data.
Experience building evaluation harnesses (evals, confidence scoring), managing human-in-the-loop feedback loops, and designing audit-ready workflows for enterprise AI systems.
Ability to run hands-on rapid prototyping of agent workflows and prompt systems alongside engineering to validate product architecture.

Compensation and benefits

Compensation range: USD 54,000 to USD 189,000 per year
Compensation is based on actual experience and qualifications of the candidate (reasonable and good faith estimate).
Job type: Independent contractors (contract)
Benefits: medical, vision, and dental; 401k retirement plan; variable pay/incentives; paid time off; paid holidays

Note: No applications will be considered if received more than 120 days after the date of this post.

View full job page →

Get Ai Evals Product Jobs alerts

New Ai Evals Product Jobs, daily.