🕒 4 days ago
Design, train, evaluate, and deploy robotics models for navigation and manipulation, while building datasets and tools and collaborating with research, engineering, and product teams on applied AI projects.
Research Engineer, Forge
📅 Sep 4
PythonPytorchJAXLLM Training
📜 Description
- Build post-training and evaluation workflows for CPT, SFT, RL, and distillation.
- Develop pipelines for synthetic data generation, data curation, training, evaluation, and deployment.
- Debug and harden large-scale ML systems, including distributed training, scheduling, checkpointing, observability, and reproducibility.
- Improve the Forge codebase with clear APIs, tests, documentation, and maintainable abstractions.
- Advance the RL training stack, including high-throughput rollouts and scalable post-training systems.
- Adapt Forge deployments to varied client hardware, software stacks, cloud, and on-premises environments.
🛠️ Requirements
- Strong Python engineering skills and experience working in large codebases (testing, code review, CI, operational ownership).
- Hands‑on experience with PyTorch, JAX, or similar.
- Strong systems and infrastructure fundamentals.
- Experience with LLM training or post‑training: fine‑tuning, RL, distillation, evaluation, and/or data pipelines.
- Excellent debugging skills in ambiguous systems (distributed jobs, data issues, quality regressions, infra failures).
- Clear communication with technical and non‑technical stakeholders.
- High agency, low ego, and comfort in fast‑moving, under‑specified environments.
- Distributed training experience (FSDP, DeepSpeed, Megatron, etc.).
- Cluster/orchestration experience (SLURM, Ray, Kubernetes, Kueue, Karpenter, Skypilot, etc.).
- Experience building reliable ML infrastructure, evaluation systems, or large‑scale data processing pipelines.
✨ Benefits
- Healthcare coverage may be available, depending on country.
- Parental leave may be available, depending on country.
- Retirement plans may be available, depending on country.
- Relocation support may be available, depending on country.
- Wellness programs may be available, depending on country.
- Meal and transportation allowances may be available, depending on country.
Full job description
About Mistral
Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.
We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.
Role summary
As a Research Engineer on Forge, you will turn real customer requirements into reliable training and deployment workflows. You’ll work end‑to‑end across model adaptation and post‑training (CPT/SFT/RL/distillation), evaluation, data, and infrastructure. The role bridges research experimentation and production constraints.
This role sits in Applied Science, with direct impact on client outcomes. You’ll collaborate closely with scientists, engineers, product, and customer‑facing teams to ensure Forge projects ship, are maintainable, and can be trusted by others.
Interview focus can vary (algorithms, infrastructure, evals, or data). You don’t need to match every bullet below to apply.
What you will do
Build and improve post‑training and evaluation workflows (CPT/SFT/RL/distillation), turning prototypes into repeatable Forge “recipes”.
Develop tools and pipelines for synthetic data generation, data curation, training, evaluation, and deployment.
Debug and harden large‑scale ML systems: distributed training, scheduling/execution, checkpointing, observability, and reproducibility.
Improve the Forge codebase via clear APIs, tests, documentation, and maintainable abstractions.
Push the frontier of our RL training stack (e.g., high-throughput async rollout and scalable post‑training systems at frontier-model scale)
Make sure Forge deployment is seamless and adaptable to a diversity of clients (hardware access, software stack, cloud and on-premises, …)
Partner with researchers and infrastructure engineers to translate bottlenecks into concrete system improvements.
About you
Strong Python engineering skills and experience working in large codebases (testing, code review, CI, operational ownership).
Hands‑on experience with PyTorch, JAX, or similar.
Strong systems and infrastructure fundamentals.
Experience with LLM training or post‑training: fine‑tuning, RL, distillation, evaluation, and/or data pipelines.
Excellent debugging skills in ambiguous systems (distributed jobs, data issues, quality regressions, infra failures).
Clear communication with technical and non‑technical stakeholders.
High agency, low ego, and comfort in fast‑moving, under‑specified environments.
Nice to have
Distributed training experience (FSDP, DeepSpeed, Megatron, etc.).
Cluster/orchestration experience (SLURM, Ray, Kubernetes, Kueue, Karpenter, Skypilot, etc.).
Experience building reliable ML infrastructure, evaluation systems, or large‑scale data processing pipelines.
Research experience in LLMs, agents, multimodal models, reasoning, code, or domain adaptation.
Open‑source contributions, publications, or widely used internal tooling.
Experience training multi‑billion‑parameter models (pre‑training or RL). Experience training on petabyte- and exabyte-scale datasets.
Ability to identify bottlenecks across the stack and drive improvements from first principles.
What We Offer
We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.
For the most up-to-date details on benefits available in your location, please refer to our Benefits page.
Privacy Policy
Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy.
Similar jobs
Search more Research Engineer jobs🕒 17 days ago
As a Research Engineer on the Inference Foundation team, you will optimize Mistral's inference stack, focusing on performance, capacity, and serving infrastructure for advanced AI models.
📅 Sep 17
Develop computer vision algorithms and production-ready systems for spatial intelligence, connecting research to real-world products and interfaces across devices, robots, and urban infrastructure.
🕒 yesterday
Develop algorithms and numerical methods for efficient LLM inference on in-memory hardware, co-designing with hardware teams and validating performance through simulation, FPGA prototypes, and silicon.
Security Engineer / Research Engineer, RL Security
🕒 3 days ago
Anthropic👥 10,000+ employees🏢 Research Services🤝 B2B
🕒 3 days ago
Build and operate security controls for large-scale reinforcement learning systems, reviewing code and designs, developing shared tooling and observability, and balancing security with training correctness and performance.