Remote Jobs RockRemote Jobs Rock

Senior Technical Content Analytics Manager (Mexico)

📅 Aug 25
SQLLarge-scale Data AnalysisAI ToolsAI-agent Automation
Apply Now

📜 Description

  • Define content quality metrics and standards for technical interview content.
  • Build and maintain dashboards, metrics, and automated monitoring systems.
  • Monitor score distributions, content equivalence, cheating indicators, and score clustering.
  • Use AI tools and agentic automation to scale content monitoring, investigation, and improvement.
  • Investigate root causes, validate solutions, and own corrective actions through resolution.
  • Share content trends, risks, and recommendations with teams and executive stakeholders.

🛠️ Requirements

  • 6+ years of experience in analytics or strategy roles with demonstrated ownership of business outcomes
  • Professional experience using modern AI tools (Claude, GPT, etc.) for complex data analysis and AI-Agent based automation workflows
  • Fluency in data visualization and business intelligence tools (e.g., Metabase), with a strong sense for how to communicate insights to diverse stakeholders
  • Strong critical thinking and problem-solving abilities to independently create novel solutions to complex problems and drive solutions across multiple stakeholders
  • Executive-level communication skills, with the ability to influence cross-functional stakeholders and drive alignment across technical and non-technical teams
  • Native-level English proficiency with exceptional written and verbal communication skills
  • Python experience is nice to have
Full job description

We're Karat, the world's largest interviewing company.

Karat is transforming organizations around the world. We provide a powerful system for technical leaders at companies like PayPal, Atlassian, and Citi who want to take control of how they hire top engineers, elevate their teams and contractors, and stay ahead. At the core of Karat’s system are live, expert-led interviews, analytics designed to give leaders maximum visibility, and the most robust interview performance dataset in the world.

Interview Content at Karat

Karat's Interview Content team designs, writes, tests, and monitors the technical interview questions and scoring rubrics used in every Karat interview. From the questions candidates see to the rubrics interviewers score them against, our work spans technical domains from software engineering to data science and beyond.

What you will do

As a Senior Content Analytics Manager, you will be directly accountable for the health and performance of Karat's technical interview content. You'll define the metrics, set the bar for what "good" looks like, and own continuous improvement of the signals that determine whether our content produces fair, reliable, and consistent interview outcomes across the platform. You will leverage AI solutions to analyze, automate, and iterate on our interview content, while proactively identifying emerging issues, investigating root causes, and owning corrective actions from diagnosis to resolution — either directly or through cross-functional partners.

  • Design, build, and maintain dashboards, metrics, and automated monitoring systems that provide visibility into content health and performance.
  • Own the ongoing measurement and monitoring of content quality, including score distributions, content equivalence, cheating indicators, and score clustering.
  • Leverage AI solutions and agentic automation to scale content quality monitoring, investigation, and improvement efforts.
  • Independently develop theories, perform root-cause analyses, and validate solutions using data-driven processes.
  • Own the feedback loop with Content Development and Architect teams to ensure new designs don't repeat previous issues.
  • Monitor key business and content-performance indicators, including metrics that may not be directly owned by Content, and proactively escalate concerning trends to leadership.
  • Serve as the subject matter expert on content quality, communicating trends, risks, recommendations, and performance updates to Content leadership and executive stakeholders.

The experience you will bring

  • 6+ years of experience in analytics or strategy roles with demonstrated ownership of business outcomes
  • Professional experience using modern AI tools (Claude, GPT, etc.) for complex data analysis and AI-Agent based automation workflows
  • Proven success leading data-driven strategy at scale, with deep expertise in SQL and large-scale data analysis; Redshift experience is a plus
  • Fluency in data visualization and business intelligence tools (e.g., Metabase), with a strong sense for how to communicate insights to diverse stakeholders
  • Strong critical thinking and problem-solving abilities to independently create novel solutions to complex problems and drive solutions across multiple stakeholders
  • Executive-level communication skills, with the ability to influence cross-functional stakeholders and drive alignment across technical and non-technical teams
  • Native-level English proficiency with exceptional written and verbal communication skills
  • Comfort operating in ambiguous environments with significant autonomy and accountability; High-growth, quick-change startup experience a plus
  • Python experience is nice to have

This position is only available to candidates residing in Mexico City. While our team operates 100% remotely, we are currently limiting hiring to this specific location. Applications from other cities in Mexico will not be considered at this time.

This position is open to candidates authorized to work in Mexico only. No visa sponsorship provided.


Additional Information

By applying for a position, you consent to the processing of your personal data in accordance with Karat’s Employee and Contractor Privacy Notice found here.

Statement of Inclusivity

In keeping with our beliefs and goals, no employee or applicant will face discrimination or harassment based on: race, color, ancestry, national origin, religion, age, gender, marital/domestic partner status, sexual orientation, gender identity or expression, disability status, or veteran status. Above and beyond discrimination and harassment based on “protected categories,” we also strive to prevent other subtler forms of inappropriate behavior (i.e., stereotyping) from ever gaining a foothold in our office. Whether blatant or hidden, barriers to success have no place at Karat.

We value a diverse workforce: people of color, womxn, and LGBTQIA+ individuals are strongly encouraged to apply.

If you have a disability or special need that requires accommodation, please let us know at accommodation@karat.com.

1Password

Senior GTM Engineering Analyst

🕒 2 days ago
1Password👥 10,000+ employees🏢 Computer And Network Security🤝 B2B

Build AI agents, data products, and analysis workflows that connect go-to-market systems, automate repetitive work, and deliver reliable insights for Sales, Solutions, Customer Experience, and Channel teams.

AI AgentsLarge Language Models (llms)Power BIBusiness Intelligence
DeepSource Technologies

Business Intelligence Analyst & Data Engineer- Remote

🕒 3 days ago
DeepSource Technologies👥 11 - 50 employees🏢 IT Services

Own the end-to-end data lifecycle by building reliable pipelines, shaping governed data models, and delivering dashboards and AI-enabled analytics that help stakeholders make informed business decisions.

📍 🇮🇪 Ireland +5 - Remote?💼 Full-Time🎸 Senior🧵 Business Intelligence Analyst
SQLETL/ELT PipelinesData ModelingTableau
Ttecdigital

Senior Business Data Analyst (Contact Center Analyst)

🕒 9 days ago
Ttecdigital👥 1001 - 5000 employees🏢 Information Technology And Services

Analyzes contact center operations and sales data, develops measurement plans, and turns findings into strategic recommendations and clear client presentations that support business decisions.

Contact Center AnalyticsSQLExcelPivot Tables
Grupo Boticário

Analista Sênior de Inteligência Comercial [Vaga Temporária]

🕒 9 days ago
Grupo Boticário👥 10,000+ employees🏢 Cosmetics

Analisa dados comerciais e de estoque para apoiar decisões executivas, produzindo diagnósticos e relatórios e usando SQL, ferramentas de nuvem e IA para aprimorar a qualidade e a velocidade das entregas.

SQLAnálise ComercialAnálise De EstoqueDOH

Trusted by Remote Workers