Analyze customer, marketing, and onsite data to improve campaigns, build and evaluate machine-learning models, automate insight delivery, and develop marketing-focused self-service BI solutions on GCP.
Member of Technical Staff, Video Data & Model Evaluation
📜 Description
- Define quality standards for video generation, including realism, motion, consistency, instruction following, and text rendering.
- Evaluate model iterations, analyze failure patterns, and recommend data, training, and prompting improvements.
- Lead end-to-end training data projects, from sourcing and annotation through quality control and delivery.
- Develop labeling systems, annotation standards, and evaluation processes for video generation, editing, and multi-reference tasks.
- Build automated annotation, filtering, and synthetic-data workflows using vision-language models and quality-scoring models.
- Train and calibrate annotation teams and external partners, audit quality, and collaborate across research, engineering, product, and creative teams.
🛠️ Requirements
- Hands-on experience in data strategy, dataset development, annotation, or model evaluation for generative image, video, or multimodal models.
- Experience supporting model development across continued training, supervised fine-tuning, post-training, or evaluation.
- Strong understanding of generative media tasks, including image and video generation, multimodal generation, and instruction-based editing.
- Experience developing labeling taxonomies, annotation guidelines, captioning standards, quality thresholds, and evaluation frameworks.
- Strong visual judgment and the ability to translate subjective quality expectations into measurable data and evaluation standards.
- Experience managing large-scale data-production or annotation projects and collaborating with research, engineering, creative, and external partner teams.
- Familiarity with automated captioning, synthetic-data generation, vision-language models, prompt design, Python, SQL, or other data and workflow automation tools is a plus.
✨ Benefits
- Competitive salary and generous company equity
- Personal time off and paid holidays
- Health insurance
- Global travel insurance: Covers you when traveling internationally
- Monthly spending stipend: $500 (~S$635)
- Equipment: All equipment needed for your home office
Full job description
About Cantina:
Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.
About the Role:
Cantina is looking for a Member of Technical Staff to join our growing Singapore research team. In this role, you will shape the data and evaluation strategies behind our video generation models.
You will own the full data lifecycle—from defining data requirements and annotation standards to building high-quality datasets, evaluating model outputs, and translating findings into actionable recommendations for model improvement. You will work closely with research scientists, machine learning engineers, product teams, and external data partners to strengthen the data–model–evaluation feedback loop.
What You’ll Do
Define quality standards for video generation across aesthetics, realism, composition, motion, temporal consistency, instruction following, subject consistency, editing preservation, and text rendering.
Evaluate model iterations, analyze failure patterns, and translate findings into actionable data, training, and prompting strategies.
Own end-to-end training data projects, including sourcing, construction, annotation, captioning, quality control, and delivery.
Develop labeling systems that support dataset segmentation, coverage analysis, quality filtering, training-data mixtures, and model performance attribution.
Design annotation and captioning standards for video generation, editing, and multi-reference tasks.
Create and evaluate synthetic-data workflows based on their stability, usability, quality, and training value.
Develop automated annotation and filtering workflows using vision-language models, system prompts, and quality-scoring models.
Build structured model evaluation processes covering test-set design, evaluation criteria, failure attribution, and reporting.
Establish feedback loops connecting model evaluation and negative-case analysis with data strategy and model iteration.
Train and calibrate annotation teams and external data partners, conduct quality audits, and improve delivery standards.
Partner with research, engineering, product, and creative teams to execute data initiatives and identify future model capabilities.
What You’ll Bring
Hands-on experience in data strategy, dataset development, annotation, or model evaluation for generative image, video, or multimodal models.
Experience supporting model development across continued training, supervised fine-tuning, post-training, or evaluation.
Strong understanding of generative media tasks, including image and video generation, multimodal generation, and instruction-based editing.
Experience developing labeling taxonomies, annotation guidelines, captioning standards, quality thresholds, and evaluation frameworks.
Strong visual judgment and the ability to translate subjective quality expectations into measurable data and evaluation standards.
Experience managing large-scale data-production or annotation projects and collaborating with research, engineering, creative, and external partner teams.
Familiarity with automated captioning, synthetic-data generation, vision-language models, prompt design, Python, SQL, or other data and workflow automation tools is a plus.
Benefits We Offer:
Competitive salary and generous company equity
Personal time off and paid holidays
Health insurance
Global travel insurance: Covers you when traveling internationally
Monthly spending stipend: $500 (~S$635)
Equipment: All equipment needed for your home office
Similar jobs
Search more Data Scientist jobsDesign and deliver bespoke data science solutions, shaping project architecture and technical direction while advising clients and guiding teams to produce rigorous, scalable AI for high-stakes decisions.
Desenvolve e avalia modelos de machine learning, transforma desafios de negócio em experimentos e insights e apoia pipelines, implantação e monitoramento de soluções de dados e IA.
Build and deploy machine learning models, analyze complex customer data, and deliver commercial insights that guide decisions across brands and regions, with a focus on engagement, retention, and lifetime value.
Designs and deploys machine learning, AI, and data analytics solutions, applying NLP, computer vision, graph analytics, and geospatial tools to uncover insights and support operational workflows.
