Remote Jobs RockRemote Jobs Rock

Technical Program Manager, Compute Infrastructure

🕒 2 days ago
Program ManagementGPU ClustersInfrastructure DeploymentCross-functional Team Management
Apply Now

📜 Description

  • Lead end-to-end delivery of New Compute SKUs and large-scale GPU clusters across an external partner ecosystem.
  • Drive multi-threaded bring-up programs spanning hardware, networking, power, and cooling.
  • Interface with chip providers to manage onboarding to new hardware platforms.
  • Build and operationalize program mechanisms like roadmaps and risk registers.
  • Partner with engineering to improve cluster turn-up reliability and automation.
  • Coordinate cross-functional readiness to ship production-ready compute.

🛠️ Requirements

  • 5+ years of experience in program management for major projects, including hyperscaler infrastructure deployment.
  • Demonstrated track record of delivering complex projects.
  • Experience managing cross-functional and cross-company teams.
  • Technical expertise and experience partnering with engineering teams.
  • Experience interfacing with external vendors and managing complicated dependencies.
Full job description

About the Team

The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting training workloads for our next generation of models. We provide a unified platform for OpenAI teams to run production Applied AI and Research training workloads.

Our work spans cloud providers, bare metal infrastructure, data centers, and the foundational services that make compute usable. We partner across Engineering, Research, Product, Capacity Planning, Finance, and Data Center Infrastructure to bring new capacity online and support OpenAI’s growing compute needs.

We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.

About the Role

As a Technical Program Manager for Compute Infrastructure, you will own the supply signal for all GPUs entering our fleet: a reliable view of what capacity is arriving, where and when it will arrive, and when it is expected to become usable. You will own the roadmap, requirements, delivery, and adoption of the tools, data, and platform behind that signal, partnering with Engineering to build systems that support planning and execution across OpenAI.

You will also lead programs that turn incoming supply into usable compute. Working across cloud providers, Data Center Infrastructure, and compute engineering teams, you will connect physical site readiness with the CPU, storage, network, GPU, and foundational services required to bring new sites and clusters online.

You will be part of an engineer-first TPM team, managing a broad portfolio of infrastructure programs and making dependencies, risks, and decisions clear from working teams through leadership. Your work will help teams plan with confidence, respond to supply changes, and deliver capacity on time.

In this role, you will:

  • Own the GPU supply signal across the fleet. Maintain a trusted view of incoming capacity across providers, sites, and clusters, including quantities, delivery forecasts, acceptance and readiness milestones, and expected dates for production use. Make changes and their downstream effects visible.

  • Build and scale the tools, data, and platform behind that signal. Own the roadmap, requirements, delivery, and adoption, partnering with Engineering on data models, integrations, quality checks, and planning workflows. Serve Product TPMs, Capacity TPMs, and Compute TPMs, alongside Finance, Accounting, leadership, Engineering, and Research.

  • Connect supply with capacity planning. Partner with Capacity Planning on supply and demand management, allocation planning, and scenario analysis. Ensure plans reflect current supply forecasts, infrastructure constraints, and the effects of early or late deliveries.

  • Coordinate physical readiness for new capacity. Work closely with Data Center Infrastructure and cloud service providers to align ready-for-service dates, site construction, power and cooling readiness, supply-chain convergence, equipment delivery, and commissioning. Track dependencies and drive resolution of gaps that threaten deployment.

  • Lead logical readiness across infrastructure resources. Coordinate CPU, storage, network, GPU, Kubernetes, and dependent compute foundation services so new clusters can support their intended workloads. Make clear which missing services or resources could delay GPU use.

  • Drive deployment across cloud and bare metal environments. Lead integrated plans across AWS, GCP, Azure, OCI, and other infrastructure partners, accounting for provider-specific dependencies while establishing consistent readiness criteria and handoffs.

  • Establish Delivery Scorecards for cloud providers and internal infrastructure teams. Track delivery commitments, forecast changes, actual delivery, readiness milestones, and time to usable capacity. Use these scorecards to identify recurring gaps, clarify recovery actions, and improve delivery predictability.

  • Improve the reliability and repeatability of cluster bringup. Partner with Engineering to scale automation, runbooks, validation, and deployment processes. Reduce manual coordination and the time between capacity delivery and production use.

  • Manage the critical paths across concurrent programs. Establish clear milestones, owners, dependencies, and escalation paths. Resolve cross-team blockers and drive decisions that keep site and cluster deployments moving.

  • Communicate progress, risks, and tradeoffs clearly. Give technical and business stakeholders the information they need to understand capacity availability, assess changes to the plan, and make timely decisions.

You might thrive in this role if you:

  • Have 5+ years of experience leading major technical programs, including compute infrastructure, hyperscaler deployments, capital projects, or similarly complex infrastructure work.

  • Possess a degree in a hard science or engineering discipline, or have a demonstrated track record of equivalent engineering expertise.

  • Are familiar with Kubernetes deployments and have worked with at least one major cloud provider—such as AWS, GCP, Azure, or OCI—to scale compute infrastructure. Experience coordinating deployments across multiple providers is valuable.

  • Are familiar with bare metal GPU capacity and the provisioning, inventory, and planning systems used to bring it into service.

  • Have worked with Capacity Planning teams on supply and demand management, allocations, constraints, and supporting tools. You understand how changes in delivery or readiness affect downstream capacity plans.

  • Have experience defining requirements for operational data and internal platforms. You can work with engineers to establish useful data models, improve data quality, and build tools that teams adopt and rely on.

  • Understand how site readiness, power and cooling, equipment delivery, commissioning, and ready-for-service milestones affect cluster deployment. You can coordinate these dependencies without losing sight of when the intended workload can run.

  • Have a record of owning and delivering complex technical programs across internal teams and external partners, including cloud providers, equipment suppliers, or data center infrastructure teams.

  • Are technically adept and comfortable working with Engineering and Research to understand dependencies, evaluate tradeoffs, and turn complex problems into executable plans.

  • Build simple, scalable processes and communicate clearly with both technical teams and business stakeholders. You are resourceful in ambiguous environments and follow issues through to resolution.

  • Are interested in and thoughtful about the impacts of AGI.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Cape

Technical Program Manager, Network

📅 Oct 6
Cape👥 51 - 200 employees🏢 Telecommunications

As a Technical Program Manager on the network team, you will own task tracking, ensure accountability, and facilitate communication across engineering, business development, and vendors to enhance network operations.

JiraTask TrackingNetwork EngineeringVendor Management
Runpod

Technical Program Manager (Software Engineer)

🕒 25 days ago
Runpod👥 51 - 200 employees🏢 Computer Software🧠 AI-native

As a Technical Program Manager at Runpod, you'll lead complex cross-functional programs, ensuring the successful delivery of our AI Developer Cloud platform while managing risks and stakeholder communications.

Technical Program ManagementDistributed SystemsCloud InfrastructureRisk Management
Indra-UK

Technical Site Coordinator / Assistant Project Engineer

📅 Oct 6
Indra-UK👥 10,000+ employees🏢 Defense & Space

The Technical Site Coordinator will oversee the delivery of Intelligent Transport Systems projects, coordinating site activities and managing subcontractors across the UK.

Technical Site CoordinationIntelligent Transport Systems (its)Project ManagementElectrical Engineering
3E

Technical Project Manager (AI)

🕒 15 days ago
3E👥 51 - 200 employees🏢 Computer Software

Own cross-program software delivery outcomes by connecting product intent with engineering execution, using AI, automation, and delivery metrics to surface risks, improve predictability, and scale effective practices.

📍 🇺🇸 Bethesda - Hybrid💰 $90k - $105k / year💼 Full-Time🎹 Mid-level💪 Technical Project Manager📢 🇩🇪 German Required📢 🇫🇷 French Required
Software DeliveryProgram ManagementScrumKanban
OpenAI

Technical Program Manager, Research Compute Services

🕒 2 days ago
OpenAI👥 10,000+ employees🏢 Research Services🧠 AI-native

Own the tools, data, and platform that translate research plans into compute demand and allocations, partnering with researchers and infrastructure teams to improve scheduling, utilization, and workload execution.

Technical Program ManagementCapacity PlanningCompute AllocationDistributed Systems

Trusted by Remote Workers