Remote Jobs RockRemote Jobs Rock

Evaluators for AI training (English language)

๐Ÿ“… May 23, 2024
EnglishAI Response EvaluationResponse ComparisonContent Safety Assessment
Apply Now

๐Ÿ“œ Description

  • Evaluate AI agent replies according to provided guidelines
  • Compare two possible responses and identify their differences
  • Determine which response is better and by how much, then assign each an overall rating
  • Complete the provided online training

๐Ÿ› ๏ธ Requirements

  • at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
  • attention to detail
  • time-management skills
  • proactive approach
  • curious mind
Full job description
We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).
The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.
Full online training is provided.
The role is fully remote with the possibility of having a flexible schedule.
We are open to both full-time and part-time candidates.
We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).ย  ย  The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer. ย  Full online training is provided. ย  The role is fully remote with the possibility of having a flexible schedule. We are open to both full-time and part-time candidates.

Requirements:

  • at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
  • attention to detail
  • time-management skills
  • proactive approach
  • curious mind
  • Responsibilities:

  • evaluate replies of the AI agent according to the provided guidelines
  • recognize and evaluate differences between two possible responses to a request
  • compare the responses overall by determining which response is better in general, by how much, and then giving each response an absolute overall rating
  • Gen-Tech

    Middle Data Analyst

    ๐Ÿ•’ yesterday
    Gen-Tech๐Ÿ‘ฅ 501 - 1000 employees๐Ÿข Internet

    Analyze marketing, product, payment, and subscription data to uncover growth opportunities, explain product metrics and user behavior, and deliver insights, reports, and dashboards that guide business decisions.

    SQLTableauPower BIA/B Testing
    Enterprise Horizon Consulting Group

    Splunk Data Analyst

    ๐Ÿ•’ 3 days ago
    Enterprise Horizon Consulting Group

    Analyze Splunk security and vulnerability data to build searches, dashboards, and metrics that connect vulnerabilities to applications and communicate risk posture and remediation progress to stakeholders.

    SplunkSplunk SearchesSplunk DashboardsData Models
    La Moda

    ANALISTA DE ANALYTICS

    ๐Ÿ•’ 4 days ago
    La Moda๐Ÿ‘ฅ 501 - 1000 employees๐Ÿข Apparel & Fashion

    Mensura e analisa a performance do e-commerce, implementando tracking em GA4 e GTM e transformando dados das jornadas dos clientes em insights para apoiar decisรตes e melhorias digitais.

    Google Analytics 4 (ga4)Google Tag Manager (gtm)Implementaรงรฃo De Eventos E TagsDatalayer
    Talent First

    Fraud Data Analyst

    ๐Ÿ•’ 4 days ago
    Talent First๐Ÿ‘ฅ 1 - 10 employees๐Ÿข Information Technology And Services

    As a Fraud Data Analyst, you will monitor threats, investigate alerts, and collaborate with teams to enhance security and customer satisfaction in payment processes.

    Threat MonitoringFraud DetectionData AnalysisPython
    Pacific Health Group

    Data Administrator

    ๐Ÿ•’ 4 days ago
    Pacific Health Group๐Ÿข Healthcare

    Maintains accurate, compliant healthcare data by managing health plan submissions, member eligibility and authorizations, system records, operational reporting, and research that supports care delivery and organizational decisions.

    Healthcare Data AdministrationHealth Plan Compliance SubmissionsData ValidationMember Eligibility

    Trusted by Remote Workers