Design and build secure, highly available platform infrastructure, enabling product teams to deploy rapidly while scaling Kubernetes, CI/CD, GitOps, monitoring, and multi-region systems.
Software Engineer (SE / Sr SE), Data & ML Platform
📜 Description
- Operate and evolve production Kubernetes clusters, including provisioning, control planes, node lifecycle, GPU runtime, networking, and storage.
- Build repeatable GitOps delivery for platform services and user applications using tools such as Argo CD, Helm, and Kustomize.
- Develop multi-tenant capabilities for scheduling, resource isolation, storage, networking, access control, secrets, and observability.
- Improve CPU/GPU utilization and cost efficiency across shared platform workloads.
- Build reusable distributed batch and workflow platforms for Spark processing and GPU-based replay and simulation.
- Follow QMS requirements and contribute to continuous improvement.
🛠️ Requirements
- BS, MS, or PhD in Computer Science or a related technical field, or equivalent practical experience
- Hands-on experience operating production Kubernetes clusters — node lifecycle, upgrades, troubleshooting — plus GitOps and infrastructure-as-code experience
- Experience with GPU or ML workload scheduling, queueing and priorities, fractional GPU sharing, autoscaling, or multi-tenant resource management
- Self-driven with a strong sense of ownership: a quick learner who is eager to take responsibility and drive projects forward end to end
- Experience with Ray or Kubeflow
- Experience with lakehouse technologies such as Delta Lake or Apache Iceberg
- Experience operating large-scale distributed data-processing and workflow systems, with hands-on depth in a system such as Apache Spark and working knowledge of Argo Workflows or an equivalent orchestrator
Full job description
All key offline workloads — large-scale data processing, simulation, auto-labeling, scenario mining, and model training — run on the compute platform this role owns. In this role, you will improve the reliability and efficiency of our Kubernetes infrastructure, make workload onboarding simpler and more self-service, and build reusable batch and workflow capabilities for petabyte-scale processing. We are looking for strong Kubernetes and platform-engineering fundamentals, depth in at least one adjacent area—distributed data processing, ML/GPU infrastructure, or multi-tenant compute systems—and the curiosity and ownership to grow across the others.
We are open to candidates at either the Software Engineer or Senior Software Engineer level. Level will be determined by experience, technical depth, scope of ownership, and demonstrated impact. You do not need experience with every technology in our stack; we value strong fundamentals, ownership, and the ability to learn.
Responsibilities:
-
Operate and evolve our production Kubernetes clusters end to end: bare-metal provisioning automation, highly available control planes, node lifecycle, GPU container runtime, networking, and storage
-
Build safe, repeatable GitOps-based delivery for platform services and user applications using tools such as Argo CD, Helm, and Kustomize
-
Develop shared multi-tenant platform capabilities for scheduling, resource isolation, storage, networking, access control, secrets, and observability while improving CPU/GPU utilization and cost efficiency
-
Build and improve reusable distributed batch and workflow platforms for Spark data processing and GPU-based replay and simulation
-
Ensure that your work is performed in accordance with the company’s Quality Management System (QMS) requirements and contribute to continuous improvement efforts
Required Skills:
BS, MS, or PhD in Computer Science or a related technical field, or equivalent practical experience
Hands-on experience operating production Kubernetes clusters — node lifecycle, upgrades, troubleshooting — plus GitOps and infrastructure-as-code experience
Experience with GPU or ML workload scheduling, queueing and priorities, fractional GPU sharing, autoscaling, or multi-tenant resource management
Self-driven with a strong sense of ownership: a quick learner who is eager to take responsibility and drive projects forward end to end
Preferred Skills:
Experience with Ray or Kubeflow
Experience with lakehouse technologies such as Delta Lake or Apache Iceberg
Experience operating large-scale distributed data-processing and workflow systems, with hands-on depth in a system such as Apache Spark and working knowledge of Argo Workflows or an equivalent orchestrator
Similar jobs
Search more Platform Engineer jobsBuild and evolve a self-service cloud platform that helps engineering teams deploy and operate applications reliably, securely, and efficiently through automation, observability, and scalable infrastructure.
Build and evolve a self-service cloud platform that helps engineering teams deploy, monitor, and operate applications securely and reliably, improving developer experience, scalability, and platform efficiency.
As a Senior Platform Engineer, you will architect and operate cloud platforms, ensuring reliable infrastructure and automated processes to support scientific breakthroughs.
Design and improve platform infrastructure for autonomy products, helping engineering teams build systems that are secure, reliable, scalable, and operable in production.
