Remote Jobs RockRemote Jobs Rock

AI Coding Evaluator

📅 Oct 12
📍 🇦🇷 Argentina - Remote🎹 Mid-level🎲 Other📢 🇳🇱 Dutch Required📢 🇫🇷 French Required💼 Full-Time
CodingJSONTechnical Content EvaluationAI Response Evaluation
Apply Now

📜 Description

  • Review AI-generated customer service responses and technical content.
  • Assess clarity, helpfulness, natural language, and overall quality.
  • Use coding knowledge to evaluate technical correctness and identify errors.
  • Validate and troubleshoot JSON structure, syntax, and formatting.
  • Check outputs against formatting requirements and project guidelines.
  • Provide clear, well-reasoned evaluation feedback.

🛠️ Requirements

  • Fluency in one or more of the supported language varieties listed below.
  • A solid understanding of JSON, including syntax, structure, validation, and troubleshooting.
  • Coding knowledge sufficient to assess technical content and identify errors.
  • Strong judgment when evaluating customer service responses.
  • Excellent attention to detail and strong written communication skills.
  • Ability to follow detailed evaluation guidelines consistently.
  • Previous experience in AI evaluation, quality assurance, or technical support.
  • Experience working with APIs and structured data.
  • A background in customer service, software development, or technical writing.
Full job description

Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses.

  • Location: Remote

  • Type: Independent contractor / Part-time

  • Project duration: up to 3 months

About the role

At Anyone AI, we create high-quality training and evaluation data for frontier AI models.

We’re looking for multilingual experts with coding knowledge and a solid understanding of JSON to evaluate AI-generated technical content and customer service responses.

In this role, you’ll assess whether outputs are clear, helpful, natural, technically accurate, and aligned with project guidelines. Your evaluations will help improve both the customer experience and the technical reliability of AI systems.

What you’ll do

  • Review AI-generated customer service responses and technical content.

  • Evaluate responses for clarity, helpfulness, natural language, and overall quality.

  • Assess technical correctness using your coding knowledge.

  • Read, validate, and troubleshoot JSON, identifying structural and formatting issues.

  • Check outputs for formatting accuracy and adherence to project guidelines.

  • Provide clear, well-reasoned feedback explaining your evaluations.

What we’re looking for

  • Fluency in one or more of the supported language varieties listed below.

  • A solid understanding of JSON, including syntax, structure, validation, and troubleshooting.

  • Coding knowledge sufficient to assess technical content and identify errors.

  • Strong judgment when evaluating customer service responses.

  • Excellent attention to detail and strong written communication skills.

  • Ability to follow detailed evaluation guidelines consistently.

Supported languages/locales

  • Dutch — Netherlands

  • Welsh — United Kingdom

  • French — Canada

  • German — Germany

  • Italian — Italy

  • Portuguese — Brazil

  • Greek — Greece

Nice to have

  • Previous experience in AI evaluation, quality assurance, or technical support.

  • Experience working with APIs and structured data.

  • A background in customer service, software development, or technical writing.

Voice response instructions

When completing the voice response, speak naturally and spontaneously, as if responding in real time. Do not pre-plan, write, or script your answer—we are evaluating natural voice cadence.

Responses may be up to one minute long. A few sentences are sufficient if that feels natural.

Similar jobs

Isaac Health

Neurology Nurse Practitioner (Active Nebraska license required)

🕒 2 days ago
Isaac Health👥 51 - 200 employees🏢 Hospital & Health Care

Provide evidence-based neurology and dementia care through patient evaluations and follow-ups, partnering with therapists and neurologists to coordinate treatment and support patients and families.

📍 🇺🇸 NE - Remote⚖️ Part-Time🎹 Mid-level🎲 Other📢 🇬🇧 English Required📢 🇪🇸 Spanish Required
NeurologyNurse Practitioner CareDementia CareCognitive-behavioral Disorders
Covista

PMHNP (Adjunct)

🕒 2 days ago
Covista👥 1001 - 5000 employees🏢 Education Management

Teach and support nursing students in an online learning environment by facilitating course discussions, assessing student work, providing timely feedback, and mentoring learners in psychiatric mental health nursing.

Psychiatric Mental Health NursingPMHNPOnline TeachingCanvas
DENTEGO

Odontólogo(a) en Francia H/M

🕒 2 days ago
DENTEGO👥 201 - 500 employees🏢 Medical Practice

El/la odontólogo/a realizará tratamientos dentales polivalentes y podrá colocar implantes o tratar casos con alineadores si cuenta con la formación adecuada, integrándose en un equipo clínico con apoyo dedicado.

OdontologíaProfilaxisEndodonciaCirugía Dental Menor

Trusted by Remote Workers