Remote Jobs RockRemote Jobs Rock

Evaluators for AI training (English language)

📅 May 23, 2024
EnglishAI Response EvaluationResponse ComparisonGuideline-based Assessment
Apply Now

📜 Description

  • Evaluate AI agent replies according to provided guidelines
  • Identify and assess differences between two possible responses
  • Compare responses, determine which is better and by how much, and assign each an overall rating
  • Complete provided online training

🛠️ Requirements

  • At least B2+ English, primarily for reading and some writing
  • Attention to detail
  • Time-management skills
  • Proactive approach
  • Curious mind

✨ Benefits

  • Flexible schedule
Full job description
We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).
The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.
Full online training is provided.
The role is fully remote with the possibility of having a flexible schedule.
We are open to both full-time and part-time candidates.
We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).    The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.   Full online training is provided.   The role is fully remote with the possibility of having a flexible schedule. We are open to both full-time and part-time candidates.

Requirements:

  • at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
  • attention to detail
  • time-management skills
  • proactive approach
  • curious mind
  • Responsibilities:

  • evaluate replies of the AI agent according to the provided guidelines
  • recognize and evaluate differences between two possible responses to a request
  • compare the responses overall by determining which response is better in general, by how much, and then giving each response an absolute overall rating
  • Similar jobs

    Support adult nonfiction Christian publishing by evaluating submissions, researching titles and market trends, and contributing editorial insights and positioning materials throughout the publishing process.

    Editorial EvaluationReader’s ReportsBacklist EvaluationRepackaging Evaluation

    Evaluate children's Christian and general-market book submissions, prepare reader reports, learn editorial administration, and contribute reading insights in virtual meetings with the WaterBrook editorial team.

    Editorial EvaluationReader ReportsChildren's PublishingChristian Publishing
    Datavant

    Health Information Specialist I - Miami, FL. - Onsite

    🕒 5 days ago
    Datavant👥 10,000+ employees🏢 Software Development🤝 B2B

    Processes patient medical-record requests, assembles and digitizes records, and supports patients and healthcare facilities while protecting confidential information and following HIPAA requirements.

    Release Of Information (roi)HIPAAMedical Records ManagementPatient Privacy And Confidentiality
    Spie Batignolles

    Elagueur - H/F

    🕒 5 days ago
    Spie Batignolles👥 1001 - 5000 employees🏢 Construction And Public Works

    Réalisez en autonomie des travaux d’élagage, d’abattage et de démontage d’arbres, sécurisez les interventions et contribuez à la préservation du patrimoine végétal.

    ÉlagageAbattage D’arbresDémontage D’arbresTaille Sanitaire Et Esthétique

    Trusted by Remote Workers