Remote Jobs RockRemote Jobs Rock

Principal Product Manager, AI Platform

📅 Aug 4
Product ManagementAI Platform StrategyInfrastructure Product ManagementMachine Learning Platforms
Apply Now

📜 Description

  • Set the roadmap for a model-agnostic AI Gateway with routing, cost attribution, rate limits, provider failover, and spending controls.
  • Define evaluation systems, quality gates, and versioned prompt management to catch regressions before they reach users.
  • Establish trust and autonomy criteria that govern how agents gain independence, including approvals and rollback logic.
  • Lead the production platform for self-hosted LLMs, open-weight models, and traditional ML workloads.
  • Instrument platform health and business-impact metrics, including cost and ROI telemetry.
  • Partner across engineering, architecture, data science, and business teams; manage roadmap trade-offs and communicate outcomes.

🛠️ Requirements

  • 8+ years of experience in Product Management, with at least 4 years focused on infrastructure, platforms, ML/AI systems, or other technical products serving internal engineering or data-science customers.
  • Proven track record scaling technical platforms from inception through maturity for demanding internal customers.
  • Demonstrated ability to use telemetry and cost data (model performance, eval results, adoption analytics, spend data) to diagnose bottlenecks and drive product strategy.
  • Hands-on familiarity with LLM gateways/proxies (e.g., LiteLLM), evaluation and observability tooling (e.g., Langfuse), and model serving frameworks (e.g., KServe, SageMaker, Bedrock, Ray).
  • Experience with prompt management and versioning, LLM fine-tuning, or self-hosted/open-weight model serving in production.
  • Familiarity with agent governance concepts — guardrails, PII controls, prompt-injection protection, and autonomy/trust frameworks — and with the tension between agent velocity and cost control.
  • Experience operating a platform across competing tracks and stakeholders, sequencing revenue-critical stabilization work alongside a new strategic build-out.
  • Exceptional leadership skills with a history of influencing cross-functional teams without direct authority.

✨ Benefits

  • The salary band for this position ranges from $190,000 – $280,000 commensurate with experience and performance. Compensation may vary based on factors such as geographic location.
  • This position will be eligible for a competitive year end performance bonus & equity package.
  • Full medical
  • Dental
  • Vision package to fit your needs
  • Flexible vacation policy; work hard and take time when you need it
  • Pet discount plans & retirement plan with company match (401K)
Full job description

For over 30 years, Angi has powered the future of the home services industry, creating an environment where homeowners and pros benefit from more jobs done well.

For homeowners, our platform is a reliable way to find skilled pros. For pros, we're a reliable business partner who helps them find the winnable work they want, when they want. For employees, we're an amazing place to call home. We can't wait to welcome you.

Angi at a glance:

  • Founded in 1995 as Angie’s List and rebranded in 2021

  • Global company with 9 brands in 8 countries and employees worldwide

  • Homeowners have turned to us for 300 million home projects and counting

About the team

This Principal Technical Product Manager will own the vision, strategy, and roadmap for the AI Platform: the shared, governed entry point every model and agent workload at Angi runs through. As generative AI moves from experiment to production across the company, this team manages the common platform with routing, cost attribution, quality evaluation, and guardrails built in rather than rebuilt by every team.

The ideal candidate is a technical product manager who treats infrastructure as a product and has a strong thesis on how AI is reshaping the way software and models get built and served. You will own the platform that our product engineering, data science and their associated agents depend on: a model-agnostic AI Gateway, eval-gated prompt management, self-hosted and fine-tuned model serving, and the trust-and-autonomy ladder that governs how much independence each agent earns. Your measure of success is not just adoption and scale, but are we meaningfully improving our products and enabling our internal teams.

What you'll do

Product Management

  • AI Gateway & Cost Governance: Own the vision for a governed, model-agnostic gateway that all model and agent traffic routes through, with per-team and per-use-case cost attribution, flexible model routing, rate limiting, provider failover, and automatic spending caps and stop switches. Make model-swap and cost decisions changeable once at the gateway, not per service.

  • Evaluation & Quality Enforcement: Define the roadmap for the eval engine and the pass/fail gate that runs on it, eval-gated prompt management with versioning and rollback, and per-agent accuracy scoring — so quality regressions are caught before they reach users rather than surfacing downstream in business metrics.

  • Trust & Autonomy Ladder: Define and champion the trust-and-autonomy ladder — the thresholds, progression criteria, evidence, approvals, and rollback logic that govern when an agent earns more independence — so agentic adoption scales with accountability instead of governance gaps.

  • LLM & ML Serving Infrastructure: Own the production path self-hosted LLM /open-weight model serving and traditional ML with the goal to consolidate both ML and LLM workloads under one standardized observable platform.

  • Cost & ROI Telemetry: Define and instrument the metrics that track the platform health as well as business impact to the platform.

Execution And Leadership

  • Cross-Functional Partnership: Establish deep partnerships with product engineering, architecture and data science to drive adoption and make sure the platform reflects how teams actually build and serve models.

  • Technical Roadmap Management: Manage a complex platform backlog spanning parallel tracks and under real capacity constraints. Make and communicate authoritative sequencing and trade-off decisions with concise and clear communications.

  • Stakeholder Communication: Act as the primary interface between technical platform teams and business stakeholders, translating infrastructure investment into clear business outcomes

Who you are

Minimum Qualifications

  • 8+ years of experience in Product Management, with at least 4 years focused on infrastructure, platforms, ML/AI systems, or other technical products serving internal engineering or data-science customers.

  • Proven track record scaling technical platforms from inception through maturity for demanding internal customers.

  • Technical fluency across the modern AI/ML stack — model serving and inference, API gateways/proxies, evaluation and testing frameworks, and cloud/Kubernetes infrastructure — sufficient to “swim with the fishes” with engineers and data scientists on architecture trade-offs.

  • Demonstrated ability to use telemetry and cost data (model performance, eval results, adoption analytics, spend data) to diagnose bottlenecks and drive product strategy.

Preferred Qualifications

  • Hands-on familiarity with LLM gateways/proxies (e.g., LiteLLM), evaluation and observability tooling (e.g., Langfuse), and model serving frameworks (e.g., KServe, SageMaker, Bedrock, Ray).

  • Experience with prompt management and versioning, LLM fine-tuning, or self-hosted/open-weight model serving in production.

  • Familiarity with agent governance concepts — guardrails, PII controls, prompt-injection protection, and autonomy/trust frameworks — and with the tension between agent velocity and cost control.

  • Experience operating a platform across competing tracks and stakeholders, sequencing revenue-critical stabilization work alongside a new strategic build-out.

  • Exceptional leadership skills with a history of influencing cross-functional teams without direct authority.

Compensation & Benefits

  • The salary band for this position ranges from $190,000 – $280,000 commensurate with experience and performance. Compensation may vary based on factors such as geographic location.

  • This position will be eligible for a competitive year end performance bonus & equity package.

  • Full medical, dental, vision package to fit your needs

  • Flexible vacation policy; work hard and take time when you need it

  • Pet discount plans & retirement plan with company match (401K)

  • The rare opportunity to work with sharp, motivated teammates solving some of the most unique challenges and changing the world

We value diversity. We know that the best ideas come from teams where diverse points of view uncover new solutions to hard problems. We welcome and value individuals who bring diverse life experiences, educational backgrounds, cultures, and work experiences.

Our hiring process may utilize artificial intelligence (AI) tools to assist in candidate screening and assessment. Our AI tools are designed to complement, not replace, human decision-making.

#LI-Remote

Ensono

Senior Offering Manager - Mainframe Managed Services

🕒 2 days ago
Ensono👥 1001 - 5000 employees🏢 Information Technology And Services

Own the commercialization roadmap for mainframe managed services, turning platform and AI-enabled capabilities into standardized, priced, sellable offerings while aligning product, pricing, delivery, and sales.

Product ManagementOffer ManagementService Portfolio ManagementManaged Services
Thinkific

Senior Product Manager

🕒 2 days ago
Thinkific🏢 Education Technology

Own strategy and execution for Thinkific Commerce and related product lines, improving payments, checkout, subscriptions, pricing, onboarding, and site building to drive customer value, revenue, conversion, retention, and Plus wins.

Product StrategyProduct ManagementCommercePayments
Shopltk

Principal Product Manager, Creator

🕒 2 days ago
Shopltk👥 501 - 1000 employees🏢 Computer Software

Lead the vision and multi-quarter strategy for creator experiences, improving how creators discover opportunities, create shoppable content, and grow their businesses through AI-powered products and data-informed iteration.

Product ManagementProduct StrategyCreator PlatformsE-commerce
Temporal

Staff Product Manager, Core Primitives

🕒 3 days ago
Temporal👥 201 - 500 employees🏢 Computer Software

As a Staff Product Manager for Core Primitives, you will define the product strategy and roadmap, enhancing developer experience and operational efficiency for Temporal's core capabilities.

Product ManagementPlatform DevelopmentInfrastructureDeveloper Tools
Jobgether

Product Manager, Payments Infrastructure

🕒 3 days ago
Jobgether👥 11 - 50 employees🏢 Staffing And Recruiting

Own the technical roadmap for payment infrastructure, shaping payment processing, settlement, ledger systems, and banking integrations to enable reliable, scalable money movement across currencies and markets.

Product ManagementPayment InfrastructurePayment RailsLedger Systems

Trusted by Remote Workers