Remote Jobs RockRemote Jobs Rock

Technical Product Manager - Inference

🕒 yesterday
Product StrategyProduct RoadmapModel InferenceModel Serving
Apply Now

📜 Description

  • Own the strategy, roadmap, delivery, and iteration of NEXUS inference offerings.
  • Translate customer needs and performance, capacity, reliability, and cost tradeoffs into product priorities and clear offerings.
  • Work directly with enterprise ML, platform, and IT teams to shape production capabilities.
  • Define model deployment and administration features, including versioning, upgrades, rollback, monitoring, and alerts.
  • Develop managed-service and customer-controlled deployment offerings, partnering on packaging and pricing.
  • Own enterprise administration and governance capabilities, including access controls, auditability, usage visibility, and data-handling controls.

🛠️ Requirements

  • 7+ years of product management experience in model inference, infrastructure, developer platforms or API products, with a track record of owning technical products from early development through launch and measurable adoption or revenue growth.
  • Strong understanding of inference, model serving and cloud infrastructure, with the ability to evaluate architecture and API choices and translate latency, throughput, capacity, reliability and cost tradeoffs into product decisions.
  • Strong commercial judgment and understanding of infrastructure economics, with experience using customer needs, usage patterns and cost drivers to shape product offerings and priorities in partnership with engineering and go-to-market teams.
  • Experience working directly with enterprise ML, platform or IT teams to understand production requirements, distinguish reusable capabilities from customer-specific requests, and make difficult prioritization decisions.
  • Experience turning ambiguous product goals into executable delivery plans with clear owners, milestones and dependencies, and driving cross-functional delivery through launch by tracking progress and resolving blockers.
  • Experience defining product success metrics and establishing the analytics and tracking needed to measure adoption, usage, performance, reliability and cost, using those insights to identify risks and prioritize improvements.
  • Direct experience owning inference or model-serving products is preferred.
  • Experience shaping pricing and packaging for technical products.
  • Previous experience in software, infrastructure or ML engineering before moving into product management.
  • Experience bringing products into customer-controlled environments, such as customer VPCs, and addressing the integration, security, administration and support requirements needed for production adoption.

✨ Benefits

  • Competitive compensation with salary and equity
  • Comprehensive health coverage for you and your dependents
  • Paid parental leave for all new parents, inclusive of adoptive and surrogate journeys
  • Relocation support for employees moving to join the team in one of our office locations
  • A high-trust, low-ego culture that values diversity of thought, ownership and initiative
Full job description

About Fundamental

Fundamental is an AI research lab pioneering the future of enterprise decision-making. Our flagship model, NEXUS is the world's most powerful Large Tabular Model (LTM) - purpose-built for the structured records that contain trillions of dollars in business value. With $275m in funding from leading investors and trusted by Fortune 100 companies, Fundamental is giving businesses the Power to Predict.

At Fundamental, you'll work on unprecedented technical challenges in foundation model development and build technology that transforms how the world's largest companies make decisions. This is your opportunity to be part of a category-defining company from the ground-up. Join the team defining the future of enterprise AI.

About the role

You’ll own the product strategy and roadmap for NEXUS inference offerings, with a focus on customer adoption, performance, reliability and economics. You’ll also shape the deployment capabilities and enterprise controls customers need to integrate and operate these offerings reliably into the platform.

You’ll work on state-of-the-art infrastructure in close collaboration with our engineering, research and applied AI teams. Your job is to turn that infrastructure into products enterprises can consume, with clear capabilities, performance levels and economics tradeoffs.

This is a senior, hands-on and highly strategic individual contributor product role. You’ll also work closely with our customers to define their needs and build and communicate our production offering for our GTM teams.

What you’ll do

  • Inference strategy and delivery: Own the strategy, roadmap and delivery of NEXUS inference offerings. Benchmark the landscape and translate customer needs and performance and cost tradeoffs into clear offerings. Partner with Engineering on scope, dependencies, capacity needs and delivery milestones. Prioritize, ship, measure and iterate.

  • Inference economics: Own adoption, usage and costs for inference products. Use customer demand, usage and serving costs to guide the roadmap, working with engineering and go-to-market teams to improve product economics.

  • Customer discovery: Spend time directly with enterprise customers running our models in advanced production workloads. Work with their ML, platform and IT teams, alongside Applied AI, to turn constraints around latency, throughput, compliance, reliability and cost into roadmap choices.

  • Engineering partnership: Work daily with inference and other engineering teams on capacity planning, product priorities and timeline.

  • Model admin operations: Own the capabilities customers need to deploy and operate NEXUS models reliably, including deployment versioning, controlled upgrades and rollback, and monitoring and alerts.

  • Deployment offerings and pricing: Define how customers consume NEXUS across managed services and customer-controlled environments, including deployment, integration, upgrade and support requirements. Partner with product marketing and go-to-market teams on packaging and pricing for inference and deployment offerings.

  • Enterprise administration: Own the product roadmap for administrative and governance capabilities, including the customer portal, user and API key management, access controls, auditability, usage visibility and data-handling controls.

Must have experience

  • 7+ years of product management experience in model inference, infrastructure, developer platforms or API products, with a track record of owning technical products from early development through launch and measurable adoption or revenue growth.

  • Strong understanding of inference, model serving and cloud infrastructure, with the ability to evaluate architecture and API choices and translate latency, throughput, capacity, reliability and cost tradeoffs into product decisions.

  • Strong commercial judgment and understanding of infrastructure economics, with experience using customer needs, usage patterns and cost drivers to shape product offerings and priorities in partnership with engineering and go-to-market teams.

  • Experience working directly with enterprise ML, platform or IT teams to understand production requirements, distinguish reusable capabilities from customer-specific requests, and make difficult prioritization decisions.

  • Experience turning ambiguous product goals into executable delivery plans with clear owners, milestones and dependencies, and driving cross-functional delivery through launch by tracking progress and resolving blockers.

  • Experience defining product success metrics and establishing the analytics and tracking needed to measure adoption, usage, performance, reliability and cost, using those insights to identify risks and prioritize improvements.

Nice to have experience

  • Direct experience owning inference or model-serving products is preferred.

  • Experience shaping pricing and packaging for technical products.

  • Previous experience in software, infrastructure or ML engineering before moving into product management.

  • Experience bringing products into customer-controlled environments, such as customer VPCs, and addressing the integration, security, administration and support requirements needed for production adoption.

  • Experience building enterprise security, identity and access management product capabilities, or integrations with data and ML platforms.

Benefits

  • Competitive compensation with salary and equity

  • Comprehensive health coverage for you and your dependents

  • Paid parental leave for all new parents, inclusive of adoptive and surrogate journeys

  • Relocation support for employees moving to join the team in one of our office locations

  • A high-trust, low-ego culture that values diversity of thought, ownership and initiative, with respect for personal boundaries and working styles

Cobalt

Senior Technical Product Manager

🕒 8 days ago
Cobalt👥 201 - 500 employees🏢 Computer & Network Security

Own product vision, discovery, roadmap, and end-to-end delivery for autonomous and continuous pentesting, translating enterprise security needs into measurable customer value and business outcomes.

Product ManagementProduct StrategyProduct DiscoveryUser Research
Tether

Senior Technical Product Manager - Keet (100% Remote)

🕒 17 days ago
Tether👥 201 - 500 employees🏢 Cryptocurrency

As a Senior Technical Product Manager for Keet, you will define the product vision and lead its growth to compete with major messaging apps, ensuring a seamless user experience.

Product VisionP2P ArchitectureAI PrototypingStakeholder Communication
ServiceNow

Technical Product Manager, Legal AI and Platforms

🕒 2 days ago
ServiceNow👥 10,000+ employees🏢 Computer Software

Own the roadmap and delivery of legal AI and platform initiatives, prototyping and evaluating AI agents while partnering across legal, product, and engineering teams to improve workflows and measure impact.

Technical Product ManagementProduct Roadmap OwnershipEnterprise Workflow PlatformsGenerative AI
Westernacher

Technical Product Manager

🕒 3 days ago
Westernacher👥 501 - 1000 employees🏢 Management Consulting

Own the technical direction and lifecycle of enterprise products and SaaS offerings, combining product ownership and hands-on development to deliver scalable solutions and advance AI-enabled product development.

Technical Product OwnershipDigital Product DevelopmentAgentic AISAP BTP

Trusted by Remote Workers