As an Applied Scientist intern, you will develop LLM-based Rider Agents and agent-based simulation systems to enhance product iteration and experimentation at Lyft.
AI Quality Evaluator - Hindi (12-month contract)
📜 Description
- Label, annotate, and evaluate photos, graphics, videos, and designs in Hindi for quality and accuracy.
- Assess AI-generated content against Canva's standards for Hindi users.
- Build and contribute to Hindi-specific datasets for AI feature internationalisation.
- Deliver labelled assets on time, meeting output targets and guidelines.
- Review and refine labels based on feedback for accuracy and consistency.
- Collaborate with Data Labelling teams in the Philippines and EU for quality alignment.
🛠️ Requirements
- Native Hindi speaker with strong written and spoken English.
- Attention to detail and high quality standards on repetitive tasks.
- Self-directed with the ability to manage multiple projects.
- Adaptable to new guidelines and consistent in task execution.
- Curious about AI and interested in building language experiences.
Full job description
Company Description
Join the team redefining how the world experiences design.
Hey, g'day, mabuhay, kia ora, 你好, hallo, vítejte, Namaste!
Thanks for stopping by. We know job hunting can be a little time consuming and you're probably keen to find out what's on offer, so we'll get straight to the point.
Where and how you can work
Alongside our global campuses, we also collaborate with talented contractors and freelancers from all over the world to help us achieve our crazy big goals. While we support flexible, remote-friendly ways of working, for this role we're focusing on India so we can best support our teams and keep collaboration flowing.
This role is a 12-month engagement, working full-time hours.
Job Description
What you'd be doing in this role
As Canva scales change continues to be part of our DNA. But we like to think that's all part of the fun. So this will give you the flavour of the type of things you'll be working on when you start, but this will likely evolve. At the moment, this role is focused on:
- Labelling, annotating, and evaluating photos, graphics, videos, stickers, and designs in Hindi — assessing linguistic quality, accuracy, and cultural appropriateness
- Evaluating AI-generated content against Canva's quality bar for Hindi users, helping shape how AI experiences land in your language
- Building and contributing to Hindi-specific datasets to support the internationalisation of Canva AI features
- Delivering labelled assets on time, meeting output targets across a variety of task types and labelling guidelines
- Reviewing and refining your own labels based on feedback to maintain accuracy and consistency
- Collaborating with in-house Data Labelling teams across the Philippines and EU for ongoing quality alignment
You're probably a match if
- You're a native Hindi speaker with strong written and spoken English — you can move fluidly between both languages with confidence
- You sweat the details — inconsistencies catch your eye and you hold yourself to a high quality bar even on repetitive tasks
- You're self-directed and can manage your own time across multiple concurrent projects without needing to be chased
- You're adaptable — you can pick up new guidelines quickly and apply them consistently across different task types
- You're genuinely curious about AI and excited to be part of building language experiences that work for Hindi users
- You thrive in a fast-paced environment where the work evolves and no two weeks look exactly the same
About the team
Canva's Localisation team sits within the International Supergroup and is responsible for bringing Canva's product and AI experiences to users in their language, across the world. With international users representing almost 60% of Canva's user base, localisation is a core strategic priority. We partner closely with the CORE Research and AI Platform teams to deliver in-language AI evaluations, dataset creation, and quality assurance across Canva's pioneer markets.
Other stuff to know
We make hiring decisions to engage contractors based on your experience, skills and passion. When you signify interest in the Project, please tell us the pronouns you use and any reasonable adjustments you may need during the contractor-accreditation interview process. Please note that contractor-accreditation meetings are conducted virtually. We celebrate all types of skills and backgrounds at Canva so even if you don't feel like your skills quite match what's listed above — we still want to hear from you! Check out lifeatcanva.com for more info.
Qualifications
Additional Information
Similar jobs
Search more AI Engineer jobsSpeech AI Evaluation Specialist - Japanese (Japan)
As a Speech AI Evaluation Specialist, you will enhance AI-generated content in Japanese by evaluating AI responses and providing feedback based on established guidelines.
Build and improve AI applications and internal tools, implementing LLM, retrieval, and agent workflows while turning prototypes into reliable systems for enterprise automation.
2027 US AI Engineering – New College Graduate
As a New College Graduate at Bitdeer AI, you will develop large-scale AI cloud services and contribute to cutting-edge AI infrastructure and platforms.
AI & Data Automation Developer Co-Op (2027 Spring Semester)
Develop AI and automation solutions for internal business teams, from stakeholder discovery and prototyping through testing, deployment, and documentation, using Microsoft tools to improve workflows and deliver measurable impact.
