Remote Jobs RockRemote Jobs Rock

Assessment Design Lead

🕒 26 days ago
Assessment DesignPsychometricsLanguage ProficiencyConstruct Validity

📜 Description

  • Our mission is to reinvent the way people learn, starting with language.
  • Learning a language can change a life by opening doors to new cultures, careers, and communities. Two billion people around the world are actively trying to learn a language, but the best way to learn (one-on-one
  • Speak first launched in South Korea in 2019, where Speak has now become the number one language learning app, and we now serve learners across many markets and 15+ languages. Speak is one of the world’s leading AI
  • Define Constructs & Build the Rubric/Blueprint Layer — Translate fuzzy goals like "measure fluency" or "measure pronunciation" into concrete, scoreable constructs, item blueprints, and rubrics that an item writer can
  • Own Validity & the Quality Bar — Sign off on content validity for every assessment that ships. Decide what "mastery" or a passing score operationally means, catch cases where an assessment is measuring the wrong thing

🛠️ Requirements

  • Must-Haves
  • Assessment/Psychometric Design: 4+ years designing rubrics, blueprints, and item specs for a real, shipped language assessment product (or equivalent depth in closely related psychometric/measurement work) — not just
  • Language Proficiency Domain Expertise: Deep familiarity with frameworks like CEFR (or ACTFL, IELTS/TOEFL band descriptors) and what separates "did you learn what we taught you" from "how good is your speaking overall."
  • Fairness Across Learner Populations: Can identify whether an item or rubric unfairly penalizes specific L1 backgrounds or accents (differential item functioning) — essential for a speech-based test serving learners
  • Translates Qualitative → Technical: Can turn a construct like "pronunciation quality" into something concrete enough for an ML engineer to build a scoring pipeline against, without either oversimplifying or getting lost
Fivetran

Senior Instructional Designer

Fivetran👥 10,000+ employees🏢 Software Development🤝 B2B
🕒 yesterday

As a Senior Instructional Designer at dbt Labs, you'll be at the heart of how our sales and go-to-market teams learn, grow, and perform. Reporting to the Director of Enablement, you'll be responsible for designing and building high-quality.

Instructional DesignCurriculum DevelopmentE-learningContent Creation
🕒 9 days ago

The Senior Technical Assistance Consultant will lead initiatives to enhance community college outcomes, focusing on work-based learning and support for underserved populations.

Technical AssistanceWork-based LearningProject ManagementData Analysis

The Director of College Partnerships will build and manage university partnerships to enhance college enrollment and completion for KIPP students and alumni across the Western portfolio.

Partnership And Alliance BuildingWritten And Oral CommunicationEffective CollaborationSelf-management
Covista

Mental Health Counseling Faculty

Covista👥 1001 - 5000 employees🏢 Education Management
📅 Aug 5

Faculty for the Clinical Mental Health Counseling program are sought to teach and mentor students in their role as mental health counselors. The Mental Health Counseling program focuses on preparing students academically, professionally.

Online TeachingBlackboardMicrosoft OfficeResearch Supervision

Trusted by Remote Workers