Remote Jobs RockRemote Jobs Rock

Evaluators for AI training (English language)

šŸ“… May 23, 2024
AI Response EvaluationContent SafetyResponse ComparisonEnglish
Apply Now

šŸ“œ Description

  • Evaluate AI agent replies according to provided guidelines
  • Identify and assess differences between two possible responses
  • Compare responses, determine which is better and by how much, and assign each an overall rating

šŸ› ļø Requirements

  • at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
  • attention to detail
  • time-management skills
  • proactive approach
  • curious mind

✨ Benefits

  • Full online training provided
  • Flexible schedule
Full job description
We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).
The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.
Full online training is provided.
The role is fully remote with the possibility of having a flexible schedule.
We are open to both full-time and part-time candidates.
We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).Ā  Ā  The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer. Ā  Full online training is provided. Ā  The role is fully remote with the possibility of having a flexible schedule. We are open to both full-time and part-time candidates.

Requirements:

  • at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
  • attention to detail
  • time-management skills
  • proactive approach
  • curious mind
  • Responsibilities:

  • evaluate replies of the AI agent according to the provided guidelines
  • recognize and evaluate differences between two possible responses to a request
  • compare the responses overall by determining which response is better in general, by how much, and then giving each response an absolute overall rating
  • SD Solutions

    SafetyTech Client #1 | Adversarial Task Writer for AI Security RL Gyms

    šŸ•’ 6 days ago
    SD SolutionsšŸ‘„ 201 - 500 employeesšŸ¢ Staffing And Recruiting

    Design YAML-based adversarial prompt injection scenarios, test them against frontier models, and validate successful tasks that assess whether AI agents can be manipulated into violating safety policies.

    Prompt InjectionAdversarial TestingYAMLDocker
    Descript

    Applied Research Scientist, AI Research

    šŸ“… Aug 25
    DescriptšŸ‘„ 51 - 200 employeesšŸ¢ Computer Software

    This role focuses on building multimodal understanding systems that enable Descript's AI editing features to reason over visual and audio content, enhancing the editing workflow.

    Deep LearningPytorchMultimodal UnderstandingVision-language Models
    Tipalti

    Applied AI Scientist

    šŸ•’ 5 days ago
    TipaltišŸ‘„ 1001 - 5000 employeesšŸ¢ Financial Services

    Design, build, and deploy production-grade AI agents that automate complex business workflows, owning agent architecture, knowledge systems, evaluation, and cross-functional delivery across enterprise functions.

    AI/ML EngineeringAI AgentsAgentic WorkflowsPython
    Manara

    Education & AI Policy Researcher

    šŸ•’ 4 days ago
    ManarašŸ‘„ 51 - 200 employeesšŸ¢ Internet

    Research education, AI, and technology policy across MENA markets, mapping government priorities and stakeholders and turning findings into practical recommendations for institutional adoption and engagement.

    šŸ“ šŸ‡ŖšŸ‡¬ Any - Remoteāš–ļø Part-TimešŸŽ¹ Mid-level🪔 Research AnalystšŸ“¢ šŸ‡¬šŸ‡§ English RequiredšŸ“¢ šŸ‡¦šŸ‡Ŗ Arabic Required
    Policy ResearchEducation PolicyAI PolicyGovernment Strategies And Regulations

    Trusted by Remote Workers