We are seeking a highly skilled and detail-oriented Policy & Data Quality Specialist to join our team as a Contingent Worker (Contract). The successful candidate will be responsible for training cutting edge AI models that strictly adhere to policies, for ensuring the quality and accuracy of decisions, creating golden sets, calibrating vendor sites, and managing vendor relationships.
This is an excellent opportunity for someone who is passionate about policy analysis and quality assurance to make a meaningful impact on our organization. Experience in content moderation is valuable but not required.
This role will involve exposure to potentially objectionable content including but not limited to graphic images, videos and writings, offensive or derogatory language, and other potential objectionable material i.e. child exploitation, graphic violence, animal abuse, self-injury and other content which may be considered offensive or disturbing.
Policy & Data Quality Assurance: Review and evaluate decisions made by expert models and vendors to ensure accuracy, consistency, and adherence to policies and guidelines.
Golden Set Creation: Develop and maintain golden sets of content to test and calibrate expert models and vendor performance, ensuring that they meet our quality standards.
Vendor Site Calibration: Collaborate with vendor sites to identify areas for improvement, provide feedback, and implement calibration plans to enhance their performance.
Vendor Management: Build and maintain strong relationships with vendors, providing guidance, support, and performance metrics to ensure they meet our quality expectations.
Process and Policy Improvement: Identify opportunities to improve policies and processes, workflows, and tools, and collaborate with internal stakeholders to implement changes.
Data Analysis: Analyze data and metrics to identify trends, patterns, and insights that inform quality assurance strategies and vendor performance.
Communication: Communicate effectively with internal stakeholders, including operations teams, policy teams, engineering teams and leadership, to ensure alignment and collaboration on quality assurance initiatives.
Training and Development: Participate in training and development programs to stay up-to-date on policies, procedures, and industry best practices.
4+ years of experience in technology consulting, content moderation, quality assurance, or a related field.
Strong understanding of policy development, moderation procedures, and guidelines.
Experience developing evals and golden sets.
Familiarity with data analysis and reporting tools preferred.
Strong attention to detail and ability to maintain accuracy in a fast-paced environment.
Excellent analytical, problem-solving, and communication skills.
Ability to work independently and collaboratively as part of a team.
Experience working with vendors or external partners is valuable.
Experience with content moderation platforms and tools.
Knowledge of industry best practices and standards for content moderation and quality assurance.
Certification in content moderation, developing AI evals, or a related field.
This will be a hybrid-role in an office setting.
Must be able to work in a fast-paced environment with multiple priorities and deadlines.
This role is expected to encounter and engage with objectionable content
Conduct bluesign® assessments of chemical companies, evaluate documentation and onsite practices, write reports, and guide follow-up implementation to achieve compliance and support continuous improvement.
Planeja e monitora atividades de garantia da qualidade, assegurando a conformidade do SGQ e a segurança dos alimentos por meio de inspeções, auditorias, treinamentos e ações de melhoria.
Support client CMMC and NIST compliance engagements by reviewing evidence and technical configurations, maintaining audit-readiness documentation, identifying gaps, and communicating clear remediation guidance.
Develops and reviews safety plans for complex technical and operational environments, assessing hazards and risks while setting practical controls, training, incident-response, and occupational health guidance.
Serve as the local Regulatory Affairs and Pharmacovigilance representative, carrying out country-level safety and compliance activities, advising on regulatory requirements, and supporting product compliance throughout its lifecycle.
