Remote Jobs RockRemote Jobs Rock

Senior Infrastructure Engineer, Research

📅 Aug 6
ML InfrastructureDistributed TrainingNeural Operator ArchitecturesNVIDIA DGX
Apply Now

📜 Description

  • Design and operate distributed training infrastructure for neural operator architectures on NVIDIA DGX B200.
  • Optimize training pipelines for throughput, fault tolerance, and cost efficiency.
  • Build and maintain experiment tracking and observability systems for researchers.
  • Solve data loading bottlenecks for large-scale mesh datasets.
  • Build serving infrastructure for pre-trained models, ensuring reproducibility and reliability.

🛠️ Requirements

  • 5+ years of experience building and operating ML infrastructure at scale.
  • Deep expertise in distributed training and debugging NCCL hangs.
  • Strong systems fundamentals: Linux, networking, storage I/O, and performance optimization.
  • Production experience with Kubernetes and SLURM for job orchestration on GPU clusters.
  • Proficiency in Python and ML frameworks, preferably PyTorch.

✨ Benefits

  • Learn alongside exceptional people
  • Influence over hierarchy
  • We operate with a flat structure: good ideas win - wherever they come from. Questioning assumptions and challenging the status quo isn't
  • Sustainable pace, long-term ambition
  • 🚀 Equity options - share meaningfully in the company you're helping to build.
  • 🏦 10% employer pension contribution - because investing in future matters.
  • 🍽️ Free office lunches - to keep you energised and focused.
  • 🍼 YellowNest nursery scheme - to help working parents manage childcare costs.
Full job description

About us

Re-architecting Engineering for the Age of Intelligence

PhysicsX is the physics AI company for industrials. The company’s mission is to accelerate hardware innovation by overhauling what industrial engineering and manufacturing look like today. PhysicsX is building a new simulation software stack to deliver deep physics AI enablement across the entire engineering lifecycle. The company partners with leading organisations in aerospace & defence, automotive, semiconductors, materials, and energy & renewables, supporting them on some of their most critical and complex challenges. PhysicsX is headquartered in the United Kingdom, with offices in London, New York, and Singapore and an expanding presence in the Bay Area.

Who we’re looking for

Our Research team runs large-scale training jobs and data generation workflows for CAE and LPM training on an HPC cluster comprising of 304 B200s, orchestrated via SLURM on Kubernetes. We’re looking for a Senior Infrastructure Engineer to help us build, scale, and operate this platform - and to work directly with researchers to keep their jobs running fast, safely, and reliably.

This role is split roughly evenly between platform engineering (building, hardening, and optimising the infrastructure everything runs on), and hands-on support (debugging job failures, optimising throughput, and helping Research get the most out of the cluster).

What you will do

  • Design, build, and maintain our SLURM-on-Kubernetes infrastructure, supporting large-scale distributed training and data generation workloads
  • Own cluster reliability, efficiency, and utilization across hundreds of GPUs
  • Partner directly with the Research team to debug job failures, diagnose performance bottlenecks, and improve iteration speed
  • Build and maintain containerized job job environments (Docker, Enroot/Pyxis) for reproducible research workflows
  • Manage high-performance storage systems to support data-intensive CAE workloads
  • Develop tooling, automation, and observability to reduce operational overhead and catch issues before they impact the Research team
  • Contribute to capacity planning and infrastructure roadmap as the cluster and team scale
  • Build and implement a technical and scaling strategy for Research’s use of high-performance computing to achieve efficient large-scale model training and data generation workloads

What you bring to the table

  • 4-6 years of experience in infrastructure, platform, or HPC engineering roles
  • Hands-on experience with SLURM and Kubernetes, ideally running them together in production environments
  • Experience with containerization and orchestration for compute-heavy workloads (Docker, Enroot/Pyxis, etc)
  • Working knowledge of high-performance networking (Infiniband, RDMA, NCCL) in the context of distributed training
  • Experience managing HPC/ML storage systems at scale
  • Strong debugging skills across the stack - from scheduling and networking to individual job failures
  • Comfortable working directly with researchers and translating their needs into infrastructure improvements
  • Solid scripting/automation skills

Nice to have

  • Experience operating GPU clusters at scale (hundreds of GPUs or more)
  • Background in CAE or simulation-driven data generation
  • Experience with GPU cluster health monitoring and fault tolerance for long-running training jobs
  • Familiarity with infrastructure-as-code tools (Terraform, Helm, etc)

What we offer

Build what actually matters

Help shape an AI-native engineering company at a formative stage, tackling problems that genuinely matter for industry and society. This is work with real-world impact - and something you can be proud to stand behind.

Learn alongside exceptional people

Work with a high-caliber, collaborative team of engineers, scientists, and operators who care deeply about doing great work, and about helping each other get better. We come from diverse backgrounds, but we share a commitment to operating at the highest level and addressing some of the most complex challenges out there. If you’re ambitious, thoughtful, and driven by impact, you’ll feel at home.

Influence over hierarchy

We operate with a flat structure: good ideas win - wherever they come from. Questioning assumptions and challenging the status quo isn’t just welcomed, it’s expected.

Sustainable pace, long-term ambition

Building meaningful technology is a marathon, not a sprint. We believe in balancing focused, ambitious work with a life beyond it. Our hybrid model blends time together in our Shoreditch office with work-from-home days, giving you the flexibility to work sustainably while staying connected in person.

We value diversity and are committed to equal employment opportunity regardless of sex, race, religion, ethnicity, nationality, disability, age, sexual orientation or gender identity. We strongly encourage individuals from groups traditionally underrepresented in tech to apply. To help make a change, we sponsor bright women from disadvantaged backgrounds through their university degrees in science and mathematics.
We collect diversity and inclusion data solely for the purpose of monitoring the effectiveness of our equal opportunities policies and ensuring compliance with employment and equality legislation. This information is confidential, used only in aggregate form, and will not influence the outcome of your application.
Doctolib

Senior Agents Platform Engineer (x/f/m)

🕒 3 days ago
Doctolib👥 1001 - 5000 employees🏢 Computer Software

Build and operate a secure, reliable AI agents platform, owning its runtime, GenAI gateway, rollout controls, observability, and evaluation infrastructure for healthcare products.

PythonLitellmGoogle Agent Development Kit (adk)LLM-based Agent Systems
Sopra Steria

AI Engineer Göteborg

🕒 3 days ago
Sopra Steria👥 10,000+ employees🏢 Information Technology And Services

Designs and implements generative AI solutions for customer environments, taking LLM, RAG, and agent-based systems from prototypes to scalable production integrations across cloud platforms and business processes.

📍 🇸🇪 Göteborg - Hybrid💼 Full-Time🎸 Senior🤖 AI Engineer📢 🇸🇪 Swedish Required📢 🇬🇧 English Required
Generative AILarge Language Models (llms)Retrieval-augmented Generation (rag)AI Agents
Stefanini Group

Desenvolvedor(a) Mobile Sênior – Flutter & AI Integration

🕒 3 days ago
Stefanini Group👥 5001 - 10,000 employees🏢 Management Consulting

Desenvolve e mantém aplicações mobile escaláveis e de alta performance com Flutter, integrando serviços de IA generativa, agentes e soluções RAG, além de contribuir para arquitetura, APIs e pipelines de CI/CD.

FlutterGerenciamento De EstadoArquitetura LimpaPython

Desenvolve e evolui soluções de IA integradas ao OMS, usando LLMs, prompts e pipelines RAG para automatizar fluxos, otimizar o processamento de pedidos e reduzir trabalho manual operacional.

PythonAPIs RESTAPIs De LLMsOpenai

Trusted by Remote Workers