Remote Jobs RockRemote Jobs Rock

Research Scientist / Engineer — Foundation Model (Agent)

📅 Jul 24
Machine LearningFoundation ModelsAgentic SystemsMultimodal Models
Apply Now

📜 Description

  • Architect multimodal agentic models for complex, multi-step tasks involving reasoning, planning, coding, and tool use.
  • Build data pipelines to construct, enrich, and filter large pixel datasets, and formulate new tasks.
  • Train large-scale multimodal models on massive datasets using GPU clusters.
  • Develop evaluation frameworks to measure multimodal agent capabilities.
  • Improve agentic capabilities such as reasoning, tool use, or coding, and validate them with new evaluations.

🛠️ Requirements

  • Strong foundation in machine learning, foundation models, and agentic systems.
  • Deep understanding of agentic systems and LLM/VLM reasoning, coding models, and tool calling.
  • Hands-on PyTorch and large-scale training (distributed, mixed precision, large datasets).
  • Experience with state-of-the-art foundation models in reasoning, coding, or tool calling, or state-of-the-art multimodal agents.
Full job description

You'll build and train large-scale multimodal agentic models — systems that reason, plan, code, and call tools to do complex, multi-step work over pixels. This is core research shaping how users interact with what Luma's models can do.

It's a multi-stack research role across modeling, data, systems, and evaluation, on novel problems with no existing playbook, treating science and engineering as equally important. It fits someone grounded in foundation models and agentic systems who's trained models at real scale. If you want to work in only one layer of the stack, this deliberately spans several.

What You'll Own

  • Architect large-scale multimodal agentic models that use reasoning, planning, coding, and tool calling for complex, multi-step work.

  • Design, build, and run robust data pipelines to construct, enrich, and filter massive pixel datasets, and formulate new tasks.

  • Train large-scale multimodal models on massive datasets and GPU clusters.

  • Define and build novel evaluation frameworks to measure multimodal agents.

First 90 Days

One way the first 90 could unfold.

  • Days 1–30 — Immerse & Diagnose: Learn the current models, agentic approaches, and where evaluation and data are weakest.

  • Days 30–60 — Ship & Validate: Improve an agentic capability (reasoning, tool use, or coding) and prove it with a new eval.

  • Days 60–90 — Scale & Systemize: Scale the approach across datasets and clusters and harden the evaluation framework.

What You Bring

  • Strong foundation in machine learning, foundation models, and agentic systems.

  • Deep understanding of agentic systems and LLM/VLM reasoning, coding models, and tool calling.

  • Hands-on PyTorch and large-scale training (distributed, mixed precision, large datasets).

Nice to Have

  • Experience with state-of-the-art foundation models in reasoning, coding, or tool calling, or state-of-the-art multimodal agents.

About Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.

Q-Ctrl

Senior Scientist, Quantum Sensing (Modeling and Control)

🕒 6 days ago
Q-Ctrl👥 51 - 200 employees🏢 Computer Software

Develop quantum control, modeling, and signal-processing methods for sensitive, robust quantum magnetometers, using statistical filtering and simulations to improve sensor performance in noisy, real-world environments.

Quantum SensingQuantum ControlOptically Pumped MagnetometersHigh-precision Magnetometry
Q-Ctrl

Senior Research Scientist, Quantum Error Correction

🕒 12 days ago
Q-Ctrl👥 51 - 200 employees🏢 Computer Software

Design and implement quantum algorithms and workflows focused on quantum error correction, collaborating with teams to translate research into impactful software solutions.

Quantum Error CorrectionQuantum AlgorithmsControl TheoryOptimization
Vaxcyte

Senior Associate Scientist, Research

🕒 8 days ago
Vaxcyte👥 501 - 1000 employees🏢 Biotechnology

Performs and optimizes polysaccharide–protein conjugation for vaccine development, characterizes conjugates using analytical methods, and collaborates across research and development teams to advance projects.

Polysaccharide-protein ConjugationConjugate Vaccine DevelopmentCovalent CouplingCrosslinking Chemistry
Stradaeducation

Senior Researcher

🕒 14 days ago
Stradaeducation👥 51 - 200 employees🏢 Higher Education

Lead quantitative research projects from question development through analysis and publication, producing rigorous, reproducible findings that inform education and workforce policy and communicating them to scholarly and policymaker.

Quantitative ResearchQuasi-experimental DesignsLongitudinal DataStata
Headway

Staff Quantitative Researcher (Market Research)

🕒 28 days ago
Headway👥 1001 - 5000 employees🏢 Mental Health Care

As a Staff Quantitative Researcher, you will lead market research strategies, uncover insights, and drive user-centricity to support Headway's mission in mental healthcare.

Quantitative ResearchMarket ResearchStatistical AnalysisSurvey Research

Trusted by Remote Workers