Remote Jobs RockRemote Jobs Rock

Research Engineers, Post-Training

📅 Jul 7
Post-trainingFine-tuningPreference OptimizationReinforcement Learning
Apply Now

📜 Description

  • Design post-training workflows to improve AI system behavior, reliability, and usefulness.
  • Develop datasets, preference signals, evaluation suites, reward models, fine-tuning workflows, and feedback loops.
  • Investigate how post-training techniques affect behavior across enterprise workflows and production constraints.
  • Build infrastructure for experimentation, model comparison, regression testing, and behavior analysis.
  • Analyze model outputs, failure modes, human feedback, and production traces to identify improvements.
  • Collaborate with researchers, engineers, and customer stakeholders to adapt and deploy robust AI systems.

🛠️ Requirements

  • Experience Improving Model Behavior: You have worked with fine-tuning, preference optimization, reinforcement learning, reward modeling, synthetic data, evals, or related post-training techniques
  • Strong Programming and Experimentation Skills: You can build training and evaluation pipelines, run controlled experiments, analyze results, and iterate quickly
  • Research-Oriented Builder: You care about understanding why behavior changes, not just whether a benchmark improves
  • AI Systems Mindset: You understand that model behavior is shaped by data, prompts, tools, retrieval, evaluators, and deployment context—not model weights alone
  • AI-Native Working Style: You use AI tools daily to accelerate coding, analysis, debugging, experimentation, and research exploration
  • Bias Towards Measurement: You make behavioral improvements concrete through evaluations, comparisons, regression tests, and production-relevant metrics
  • Comfort with Applied Constraints: You can balance research ambition with practical constraints around cost, latency, reliability, data availability, and customer requirements
  • Ownership Mentality: You take responsibility for whether post-training work improves real system outcomes, not just offline scores

✨ Benefits

  • 100% coverage of medical
  • Dental
  • Vision insurance for employee and dependents
  • Flexible time off
  • Retirement and financial planning benefits, including access to pre-tax HSA, FSA, and commuter accounts, 401(k), and financial coaching resources
  • Physical fitness
  • Fertility and family-building benefits through Carrot
  • Complimentary in-office lunches and snacks provided
  • Access to state-of-the-art AI models, generous usage of modern AI tools, and real-world business problems
  • Ownership of high-impact projects across top enterprises
Full job description

About Distyl AI

Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical operations for the frontier of AI. Our customers include the largest companies in telecom, healthcare, insurance, manufacturing, consumer goods, and global social organizations.

We research and deploy technologies that power AI-native operations — both for our partners and for Distyl itself. Our work spans research into self-constructing systems, the development of the most reliable execution of AI systems, and products that transform mission-critical workflows. As a result, Distyl's technologies affect some of the world's largest operations — from hundreds of millions of consumer interactions to tens of millions of supply chain transactions and millions of patient journeys.

Distyl is backed by leading investors including Lightspeed Venture Partners, Khosla Ventures, Coatue, DST Global, and the board-members of 20+ F500s.

What We Are Looking For

At Distyl, Research Engineers build the bridge between frontier AI research and production systems that deliver real business value. This role is for engineers who are excited to investigate how AI systems should be designed, rapidly prototype new ideas, and turn promising concepts into reliable systems that work inside real customer environments.

Research Engineers operate at the intersection of applied research, systems engineering, and customer-facing deployment. They design and implement compound AI systems, run experiments to understand system behavior, build evaluation frameworks, and collaborate closely with AI Researchers, AI Engineers, and customer stakeholders. Their work is not limited to demos or isolated prototypes: they help turn new techniques into robust systems that can be measured, operated, and improved in production.

Key Responsibilities

  • Design and run post-training workflows that improve the behavior, reliability, and usefulness of AI systems

  • Develop datasets, preference signals, evaluation suites, reward models, fine-tuning workflows, and feedback loops for applied AI use cases

  • Investigate how different post-training techniques affect system behavior across enterprise workflows and production constraints

  • Build infrastructure for experimentation, model comparison, regression testing, and behavior analysis

  • Partner with AI Researchers to explore new post-training methods and with AI Engineers to apply successful techniques in deployed systems

  • Analyze model outputs, failure modes, human feedback, and production traces to identify opportunities for behavioral improvement

  • Create repeatable processes for adapting AI systems to customer domains while preserving robustness, transparency, and maintainability

  • Communicate clearly with internal teams and customer stakeholders about model behavior, evaluation results, limitations, and tradeoffs

Who You Are

  • Experience Improving Model Behavior: You have worked with fine-tuning, preference optimization, reinforcement learning, reward modeling, synthetic data, evals, or related post-training techniques

  • Strong Programming and Experimentation Skills: You can build training and evaluation pipelines, run controlled experiments, analyze results, and iterate quickly

  • Research-Oriented Builder: You care about understanding why behavior changes, not just whether a benchmark improves

  • AI Systems Mindset: You understand that model behavior is shaped by data, prompts, tools, retrieval, evaluators, and deployment context—not model weights alone

  • AI-Native Working Style: You use AI tools daily to accelerate coding, analysis, debugging, experimentation, and research exploration

  • Bias Towards Measurement: You make behavioral improvements concrete through evaluations, comparisons, regression tests, and production-relevant metrics

  • Comfort with Applied Constraints: You can balance research ambition with practical constraints around cost, latency, reliability, data availability, and customer requirements

  • Ownership Mentality: You take responsibility for whether post-training work improves real system outcomes, not just offline scores

What We Offer

  • The base salary range for this role is $150K – $250K, depending on experience, location, and level. In addition to base compensation, this role is eligible for meaningful equity, along with a comprehensive benefits package

  • 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible time off

  • Retirement and financial planning benefits, including access to pre-tax HSA, FSA, and commuter accounts, 401(k), and financial coaching resources

  • Comprehensive wellness benefits, including physical fitness, mental well-being, and fertility and family-building benefits through Carrot

  • Complimentary in-office lunches and snacks provided

  • Access to state-of-the-art AI models, generous usage of modern AI tools, and real-world business problems

  • Ownership of high-impact projects across top enterprises

  • A mission-driven, fast-moving culture that values curiosity, pragmatism, and excellence

Distyl has offices in San Francisco and New York. This role follows a hybrid collaboration model with 3+ days per week (Tuesday–Thursday) in‑office.

#LI-Hybrid

We believe diverse perspectives make our work stronger and more impactful. We are an equal opportunity employer and evaluate all applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other legally protected characteristic. We encourage candidates from all backgrounds to apply.

Harvey

Research Engineer / Scientist, Reinforcement Learning

🕒 7 days ago
Harvey👥 10,000+ employees🏢 Software Development🤝 B2B🧠 AI-native

Own the post-training research agenda for legal AI models, designing SFT and reinforcement learning methods, reward systems, and evaluations, then scaling experiments into reliable models used by customers.

Reinforcement LearningLLM Post-trainingSupervised Fine-tuning (sft)Preference Optimization
Harvey

Research Engineer / Scientist, Reinforcement Learning

🕒 7 days ago
Harvey👥 10,000+ employees🏢 Software Development🤝 B2B🧠 AI-native

Own post-training research for legal AI models, designing SFT and reinforcement learning experiments, reward functions, and evaluations, then scaling training runs and turning improvements into models used by customers.

PythonLarge Language ModelsReinforcement LearningSupervised Fine-tuning
Anthropic

Research Engineer, Cybersecurity RL

🕒 yesterday
Anthropic👥 10,000+ employees🏢 Research Services🤝 B2B🧠 AI-native

Develop and implement reinforcement learning approaches for defensive cybersecurity, designing environments, running experiments and evaluations, and delivering work into production training runs for safer AI models.

Cybersecurity ResearchMachine LearningSoftware EngineeringReinforcement Learning
Anthropic

Research Engineer, Cybersecurity RL (Reinforcement Learning)

🕒 4 days ago
Anthropic👥 10,000+ employees🏢 Research Services🤝 B2B🧠 AI-native

Develop and evaluate reinforcement-learning environments and agentic systems that advance AI capabilities in defensive cybersecurity, translating research into production training runs and collaborating across research and security teams.

Machine LearningCybersecurity ResearchSoftware EngineeringReinforcement Learning
Ramp

Research Engineer, Benchmarks & Evaluation

🕒 7 days ago
Ramp👥 10,000+ employees🏢 Financial Services🤝 B2B

Own benchmarking for finance-focused AI agents by turning real workflows into evaluation suites, designing reliable graders, and using results to guide model selection and post-training.

LLM BenchmarkingEvaluation DesignPythonSoftware Engineering

Trusted by Remote Workers