Build and operate software systems for autonomy-focused foundation models, spanning multimodal data pipelines, model training and evaluation, simulator tooling, and production inference.
Machine Learning Engineer - Pre Training
📜 Description
- Build scalable foundation-model pre-training pipelines optimized for throughput and efficiency.
- Implement distributed training across GPUs, TPUs, and high-performance clusters.
- Work with researchers to turn experiments into production-ready workflows.
- Develop monitoring and fault-tolerance systems for reliable large-scale training.
- Benchmark and tune performance across hardware and software stacks.
🛠️ Requirements
- Bachelor's, Master's, or PhD in Computer Science, Engineering, or a related field, or equivalent experience.
- 2+ years of experience with large-scale model training and distributed systems.
- Strong Python skills and familiarity with PyTorch, TensorFlow, or JAX.
- Experience with GPU scheduling, memory optimization, and parallelism strategies.
- Familiarity with Docker and Kubernetes.
- Understanding of high-performance computing and networking bottlenecks.
Full job description
About Mindbeam
We are building the next-generation AI infrastructure for open source and enterprise. Our work is deeply research-oriented and passionate about developing ground-breaking innovations to take state-of-the-art AI applications to the next level.
What drives us is not only advancing technology, but empowering the people behind it. We are a community of researchers, engineers, and visionaries who believe that collaboration, curiosity, and openness fuel progress. If you’re motivated by impact and inspired to build tools that others can build upon, you’ll be in the right place.
Mission
Design and optimize large-scale pre-training systems that power Mindbeam’s generative AI models.
Role Expectations
• Build scalable pre-training pipelines for foundation models, optimizing throughput and efficiency.
• Implement distributed training strategies across GPUs/TPUs and high-performance clusters.
• Collaborate with researchers to translate experimental setups into production-ready workflows.
• Develop monitoring and fault-tolerance systems to ensure reliable large-scale training.
• Continuously benchmark and tune performance across hardware and software stacks.
Background
• Bachelor’s, Master’s, or PhD in Computer Science, Engineering, or related field—or equivalent experience.
• 2+ years of experience with large-scale model training and distributed systems.
• Strong coding skills in Python and familiarity with ML frameworks (PyTorch, TensorFlow, JAX).
• Experience with GPU scheduling, memory optimization, and parallelism strategies.
• Comfort with containerized and orchestrated environments (Docker/Kubernetes).
• Understanding of high-performance computing and networking bottlenecks.
About You
You thrive on scale and complexity. You enjoy solving system-level bottlenecks, pushing hardware and software to their limits, and working closely with researchers to accelerate cutting-edge AI development.
Similar jobs
Search more Machine Learning Engineer jobsBuild and scale Tower’s machine learning research platform, enabling reproducible experimentation, GPU-accelerated training, simulation, and efficient compute across HPC and cloud environments.
Machine Learning Engineer, Prediction & Planning
Develop machine learning models for autonomous vehicle prediction and planning, turning real-world driving challenges into robust systems that support safe, smooth behavior and integrate into production software.
Machine Learning Performance Engineer (Inference)
Optimize deep learning inference pipelines for microsecond-level latency, evaluating heterogeneous hardware, developing GPU kernels, and improving model efficiency, reliability, and deployment performance.
Build and maintain data pipelines and versioned datasets for autonomous perception, while developing training workflows, engineering tools, and diagnostics that improve model evaluation and pipeline reliability.
