🕒 5 days ago
Design, build, and deploy production-grade AI agents that automate complex business workflows, owning agent architecture, knowledge systems, evaluation, and cross-functional delivery across enterprise functions.
Evaluators for AI training (English language)
📅 May 23, 2024
📍 🇺🇦 Ivano-Frankivsk - Remote🎹 Mid-level🧠 AI Research Scientist📢 🇬🇧 English Required⏳ Temporary/Contract
AI Response EvaluationContent SafetyResponse ComparisonEnglish Reading
📜 Description
- Evaluate AI agent replies according to provided guidelines
- Identify and assess differences between two possible responses
- Compare responses, determine which is better and by how much, and assign each an overall rating
🛠️ Requirements
- at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
- attention to detail
- time-management skills
- proactive approach
- curious mind
✨ Benefits
- Full online training provided
- Flexible schedule
Full job description
We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).
The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.
Full online training is provided.
The role is fully remote with the possibility of having a flexible schedule.
We are open to both full-time and part-time candidates.
Requirements:
Responsibilities:
Similar jobs
Search more AI Research Scientist jobs
📅 Sep 1
Design real-world strategy tasks and evaluation criteria for AI models, drawing on hands-on experience with strategy readouts, market sizing, competitive landscapes, and due diligence work.
SafetyTech Client #1 | Adversarial Task Writer for AI Security RL Gyms
🕒 6 days ago
SD Solutions👥 201 - 500 employees🏢 Staffing And Recruiting
🕒 6 days ago
Design YAML-based adversarial prompt injection scenarios, test them against frontier models, and validate successful tasks that assess whether AI agents can be manipulated into violating safety policies.
📅 Aug 25
This role focuses on building multimodal understanding systems that enable Descript's AI editing features to reason over visual and audio content, enhancing the editing workflow.
📅 Jul 24
Du entwickelst Retrieval-Pipelines weiter, überführst Forschung aus Information Retrieval, NLP und Machine Learning in Produktverbesserungen und etablierst systematische Evaluationen für bessere KI-Systeme.