AI Technical Product Owner

Altak Group seeks a Technical Product Owner to lead an enterprise AI platform delivering production-ready GenAI capabilities. This role owns the GenAI and LLMOps roadmap, drives secure platform architecture evolution, and coordinates delivery across engineering and regulated stakeholders.

Role Overview

You will orchestrate the full lifecycle of an enterprise backend platform for Generative AI, with a focus on scaling, security, compliance governance, and infrastructure reliability. The work includes roadmap and backlog ownership, architectural decomposition into actionable delivery plans, and clear communication of risks and progress to both technical teams and executive business stakeholders.

Key Responsibilities

• Own and execute the platform roadmap, backlog, prioritization matrix, and enterprise release plans.
• Support and scale foundational platform capabilities, including LLM service orchestration, multi-model routing, fallback mechanisms, and token optimization.
• Drive product strategy for advanced retrieval components, including enterprise vector search infrastructure, embeddings pipelines, and semantic data chunking strategies.
• Define platform patterns for autonomous, multi-step AI agent frameworks and secure tool calling execution environments.
• Partner with Cybersecurity, Legal, and Compliance teams to enforce guardrails for Generative AI deployment.
• Bake programmatic guardrails into the platform for PII/PHI data masking, data leakage prevention, and model bias validation.
• Translate healthcare compliance frameworks such as HIPAA, HITRUST, and SOC2 into automated backend platform features, enabling the most secure deployment path for internal developers.
• Deliver internal APIs, SDKs, and model-hosting documentation with internal developers and data scientists as the primary customers.
• Optimize platform unit economics by tracking and managing token usage, model inference costs, and cloud compute footprints while maintaining performance.
• Balance the rollout of advanced AI capabilities with infrastructure scalability, technical debt reduction, and system reliability.
• Deconstruct complex architectural initiatives into epics, user stories, and quantitative acceptance criteria.
• Lead Scrum and Agile ceremonies, including sprint planning, daily stand-ups, backlog refinement, and cross-team dependency mapping.
• Communicate roadmap progress, architectural risks, and delivery status to deeply technical engineers and executive business stakeholders.

Required Experience

• 5+ years of explicit experience driving technical product ownership, technical product management, or platform management in large-scale enterprise environments.
• Demonstrated delivery experience for infrastructure components tied to AI/ML pipelines, MLOps, deep enterprise data platforms, or highly distributed backend systems.
• Direct experience working with data complexity and strict security architectures in regulated ecosystems, including Healthcare, HealthTech, and Health Insurance.
• Technical depth to challenge architectural decisions, review API contracts, and communicate effectively with LLM engineers and Principal Architects (without needing to write production code).
• Strong familiarity with data governance frameworks, security compliance standards such as HIPAA and HITRUST, and AI safety or risk mitigation protocols.
• Advanced Scrum/Agile mastery at scale, including enterprise tracking tool proficiency such as Jira and Confluence for managing cross-team dependencies.

Technologies

LLM service orchestration, multi-model routing, RAG, vector search infrastructure, embeddings pipelines, semantic data chunking strategies, autonomous multi-step AI agent frameworks, secure tool calling execution environments, PII/PHI data masking, model bias validation, HIPAA, HITRUST, SOC2, Scrum, Agile, Jira, Confluence, API contracts, SDKs.

Employment Details

• Employment type: Full-time / Contract
• Pay: USD 65.00 to USD 70.00 per hour
• Work location: Remote
• Minimum experience: 5 years