Remote Jobs RockRemote Jobs Rock

Strategic Project Lead - AI Post-Training (United States)

🕒 yesterday
AI Post-trainingPreference DataModel EvaluationRLHF
Apply Now

📜 Description

  • Own project scope, timelines, budgets, staffing, risks, and end-to-end delivery.
  • Lead client communications, status reporting, planning sessions, and escalations.
  • Translate model improvement goals into data requirements, workflows, rubrics, and evaluation plans.
  • Set quality standards and acceptance criteria for preference data, model comparisons, and evaluation outputs.
  • Monitor delivery quality, investigate inconsistencies, and resolve unclear requirements with clients.
  • Create reusable guidelines and QA frameworks, mentor Operations Specialists, and support scoping and pilots.

🛠️ Requirements

  • 1–2+ years of experience in AI data operations, project coordination, or delivery, ideally in a GenAI or frontier AI environment.
  • Familiarity with at least one AI post-training or model evaluation workflow.
  • Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients.
  • Understanding of data quality, annotation workflows, and quality assurance methods.
  • Ability to translate evolving requirements into clear workflows, rubrics, and measurable quality standards.
  • Strong troubleshooting and organizational skills, with the ability to manage multiple priorities.
  • Interest in current AI developments, including frontier models and post-training approaches.
  • Experience with reinforcement learning from human feedback (RLHF), preference data, or model response evaluation.
  • Familiarity with rubric design, model comparison, benchmark development, or evaluation creation.
  • Experience assessing model responses for quality, accuracy, reasoning, or instruction following.
Full job description

About the Role

The Strategic Project Lead – AI Post-Training will help lead AI companies develop and improve frontier models through high-quality data programs. We’re looking for someone with experience in AI post-training, preference data, or model evaluation to lead projects that shape how models respond, reason, and perform.

You’ll own delivery while bringing practical knowledge of the data, evaluation methods, and quality standards behind model improvement. Working closely with clients and internal teams, you’ll help translate evolving AI research needs into clear workflows, reliable datasets, and measurable outcomes.

Your Impact

  • Own end-to-end project delivery, including scope, timelines, budgets, staffing, and risk management.
  • Lead client communication, status reporting, planning sessions, and escalations.
  • Translate model improvement objectives into data requirements, workflows, rubrics, and evaluation plans.
  • Define quality standards and acceptance criteria for preference data, model comparisons, and evaluation outputs.
  • Monitor delivery quality, investigate inconsistencies, and resolve ambiguous requirements with clients.
  • Advise on data design, evaluation approaches, and project feasibility based on your domain expertise.
  • Develop reusable guidelines, SOPs, and QA frameworks to improve consistency across programs.
  • Mentor Operations Specialists and contribute to project scoping, pilots, and new capability development.
  • What You Bring

  • 1–2+ years of experience in AI data operations, project coordination, or delivery, ideally in a GenAI or frontier AI environment.
  • Familiarity with at least one AI post-training or model evaluation workflow.
  • Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients.
  • Understanding of data quality, annotation workflows, and quality assurance methods.
  • Ability to translate evolving requirements into clear workflows, rubrics, and measurable quality standards.
  • Strong troubleshooting and organizational skills, with the ability to manage multiple priorities.
  • Interest in current AI developments, including frontier models and post-training approaches.
  • Nice to Have

  • Experience with reinforcement learning from human feedback (RLHF), preference data, or model response evaluation.
  • Familiarity with rubric design, model comparison, benchmark development, or evaluation creation.
  • Experience assessing model responses for quality, accuracy, reasoning, or instruction following.
  • Exposure to AI companies, frontier AI labs, or model evaluation programs.
  • Bilingual capabilities, particularly German or a Nordic language.
  • Why You'll Love Working Here

    At Appen, we foster a culture of innovation, collaboration, and excellence. We value curiosity, accountability, and a commitment to delivering the highest quality AI solutions for frontier models.

    You'll work on complex challenges that shape the future of AI across industries and geographies, alongside talented people in a culture that values humility over ego. You'll have the flexibility to deliver in a way that works for you and your team, supported by tools, resources, and development opportunities to continue to build your capability over time.

    About Appen

    Appen has been a leader in AI training data for over 30 years. We specialise in human generated data to train, fine tune, and evaluate models across generative AI, large language models, computer vision, and speech recognition. Our AI assisted data annotation platform and global crowd of more than 1 million contributors in over 200 countries support model pre training, supervised fine tuning, evaluation and benchmarking, safety and red teaming, and multilingual global expansion.
    Blue Projects

    Junior Project Manager - Construction (M/F/D)

    🕒 2 days ago
    Blue Projects👥 201 - 500 employees🏢 Management Consulting

    Supports planning, budgets, and technical oversight for industrial construction projects while coordinating clients, contractors, suppliers, and project teams to keep work on schedule and compliant.

    📍 🇵🇱 Warsaw - Remote💼 Full-Time🥁 Junior📅 Project Manager📢 🇬🇧 English Required📢 🇵🇱 Polish Required
    Construction Project ManagementSite ManagementIndustrial ProjectsMS Project
    Miratech

    Junior Project Coordinator

    🕒 2 days ago
    Miratech👥 501 - 1000 employees🏢 Information Technology And Services

    Coordinate PMO operations, documentation, reporting, and stakeholder communication while building lightweight automations and tools to improve project efficiency and support data-informed decisions.

    Project CoordinationPMO OperationsPythonJavaScript
    Sigma Software

    Strong Junior Project Manager

    🕒 7 days ago
    Sigma Software👥 1001 - 5000 employees🏢 Computer Software

    Coordinate software delivery for a complex enterprise project, managing plans, scope, schedules, risks, and stakeholder expectations while supporting the team and aligning engineering work with business goals.

    Project ManagementSoftware DevelopmentProject PlanningEstimation
    Sigma Software

    Strong Junior Project Manager

    🕒 7 days ago
    Sigma Software👥 1001 - 5000 employees🏢 Computer Software

    Coordinate software delivery for an enterprise project by planning milestones and resources, managing scope, risks, and budgets, clarifying requirements, and keeping engineering teams and stakeholders aligned.

    Project ManagementSoftware DeliveryProject PlanningEstimation
    M3USA

    Translation Project Manager - US hours (Remote)

    🕒 7 days ago
    M3USA👥 201 - 500 employees🏢 Computer Software

    Manage multiple translation and localization projects from planning through delivery, coordinating language professionals and clients to meet timelines, quality expectations, scope, and service-level agreements.

    Translation Project ManagementLocalization Project ManagementProject PlanningProject Scheduling

    Trusted by Remote Workers