Remote Jobs RockRemote Jobs Rock

Research Engineer, Model Evaluations

🕒 14 days ago
PythonDistributed SystemsData PipelinesData Visualization

📜 Description

  • We're looking for Research Engineers to build the evaluations that tell us — and the world — what Claude can actually do.
  • Your work will turn ambiguous notions of "intelligence" into clear, defensible metrics that researchers, leadership, and the public can rely on.
  • You'll design and implement evaluations across the full spectrum of Claude's capabilities and personality, and build the infrastructure that runs them reliably at scale.
  • You'll partner closely with researchers throughout the lifecycle of a new capability — from defining what to measure, to running the eval against live training checkpoints, to interpreting the results.
  • The goal is to make Anthropic the leader in extremely well-characterized AI systems, with performance that is exhaustively measured and validated across the tasks that matter.

🛠️ Requirements

  • Strong Python programming skills, including production or research infrastructure
  • Experience building or operating distributed systems, data pipelines, or other infrastructure that needs to be reliable at scale
  • Clear written and verbal communication, especially when explaining technical results to non-specialists
  • Comfort operating in an on-call or production-support capacity when training runs are live
  • Care about the societal impacts of your work and an interest in steering powerful AI to be safe and beneficial

Benefits

  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
Anthropic

Research Engineer, Knowledge Team

Anthropic👥 10,000+ employees🏢 Research Services🤝 B2B
🕒 14 days ago

Research Engineers will design new information architectures and train language models to enhance interactions with external data sources, focusing on innovative solutions in a world of LLMs.

PythonMachine LearningLarge Language ModelsReinforcement Learning
Anthropic

Research Engineer, Machine Learning (Reinforcement Learning)

Anthropic👥 10,000+ employees🏢 Research Services🤝 B2B
🕒 7 days ago

As a Research Engineer in Reinforcement Learning, you will advance the capabilities and safety of large language models through innovative research and engineering practices.

PythonAsync ProgrammingMachine Learning FrameworksPytorch
Anthropic

Research Engineer, RL Engineering

Anthropic👥 10,000+ employees🏢 Research Services🤝 B2B
🕒 14 days ago

As an ML Systems Engineer on the Reinforcement Learning Engineering team, you will build and enhance systems that train AI models, focusing on performance, robustness, and usability.

Software EngineeringMachine LearningReinforcement LearningPython

Trusted by Remote Workers