Annotate de-identified clinical documents by mapping relevant concepts to SNOMED CT, applying detailed coding guidelines, flagging ambiguous cases, and participating in quality adjudication.
Registered Nurse - AI ChatBot Reviewer (US, Remote)
π Description
- Score AI responses against a predefined rubric, applying criteria consistently across high volumes of items.
- Identify potential patient harm, including missed red flags, unsafe advice, and failures to escalate or direct patients to care.
- Assess clinical content for accuracy, completeness, and alignment with guidelines.
- Provide specific rationales for failed responses and guidance for improvement.
π οΈ Requirements
- Licensure: Active RN license for US
- Experience: Minimum 2 years of clinical nursing practice.
- Knowledge: Strong grounding in clinical guidelines, patient safety and scope-of-practice boundaries.
- Attention to detail: Proven accuracy and consistency in clinical documentation or review work.
- Technical proficiency: Comfortable using structured review tools and digital platforms.
- Language: Native or near-native written English.
β¨ Benefits
- Flexible Work Arrangements: Part-time, remote and fully asynchronous.
- Competitive Compensation: Hourly rate
- Professional Development: Hands-on experience in AI evaluation and model fine-tuning, shaping how AI is deployed in patient care.
Full job description
We are seeking experienced US registered nurses to review and assess AI-generated responses from a health coaching agent, with a focus on safety, regulatory compliance, and clinical content accuracy.
You will work asynchronously on a dedicated review platform, performing short, structured evaluations to help train and refine AI models for patient-facing health guidance.
This is a remote, flexible and short-term project.
Key Responsibilities:
Structured Grading: Score AI agent responses against a pre-defined rubric, applying the highest-priority criteria consistently across a large volume of items.
Safety Review: Identify responses that could cause patient harm missed red flags, unsafe advice, failure to escalate or signpost to care.
Clinical Accuracy: Assess factual correctness, completeness and guideline alignment of clinical content.
Written Feedback: Provide brief, specific rationale for each failed response and general guidance on how it could be improved.
Qualifications
Licensure: Active RN license for US
Experience: Minimum 2 years of clinical nursing practice.
Knowledge: Strong grounding in clinical guidelines, patient safety and scope-of-practice boundaries.
Attention to detail: Proven accuracy and consistency in clinical documentation or review work.
Technical proficiency: Comfortable using structured review tools and digital platforms.
Language: Native or near-native written English.
Legal Status
You will have the right to work in your country of residence.
You will work as an independent contractor.
Why Join Us?
Flexible Work Arrangements: Part-time, remote and fully asynchronous.
Competitive Compensation: Hourly rate
Professional Development: Hands-on experience in AI evaluation and model fine-tuning, shaping how AI is deployed in patient care.
Similar jobs
Search more Medical Reviewer jobsAssociate Medical Science Liaison - Southwest (AZ, CA, NM, or NV)
The Associate Medical Science Liaison builds relationships with healthcare professionals and key opinion leaders, delivers medical education, supports clinical programs and studies, and shares field insights across teams.
Document patient encounters in real time, maintain accurate electronic health records, and support healthcare providers with clinical documentation and visit administration while protecting sensitive patient information.
Medical Science Liaison/Senior Medical Science Liaison - Oncology - Lone Star
Serve as a field-based scientific expert in GU oncology, building relationships with healthcare professionals and sharing compliant, evidence-based insights on NMIBC, clinical research, and patient care.
Medical Science Liaison/Senior Medical Science Liaison - Oncology - Great Lakes
Serve as a field-based scientific expert in GU oncology, engaging healthcare professionals in compliant scientific exchange, building external relationships, and sharing evidence-based insights on non-muscle invasive bladder cancer.
