Desenvolve e otimiza pipelines de dados escaláveis em Azure e Databricks, trabalhando com processamento distribuído, modelagem e armazenamento, automação de implantações e confiabilidade de rotinas em produção.
Master Data Developer - Data Ops, Colombia
📜 Description
- Provision environments and ensure platform readiness across lakehouse and cloud-warehouse layers.
- Build and operate CI/CD for metric definitions and transformation logic, including version control, environment promotion, and automated regression tests.
- Implement pipeline monitoring and alerts for replication, landing-zone health, warehouse refreshes, lag, and cost anomalies.
- Own platform cost attribution and consumption monitoring across warehouses and compute.
- Maintain architecture decision records and delivery artifacts with the Architect.
- Write operational runbooks and support ongoing knowledge transfer to the client operations team.
🛠️ Requirements
- Experience in DataOps or platform engineering supporting a production cloud data platform.
- Hands-on CI/CD experience for data pipelines, including Git workflows, automated testing, regression gates, and multi-environment promotion.
- Experience monitoring and alerting for CDC replication pipelines and cloud data warehouses; Snowflake experience is strongly preferred.
- Ability to own platform reliability and cost governance.
- Fluent English (B2+).
✨ Benefits
- Premium Healthcare
- Meal voucher
- Maternity and Parental leaves
- Mobile services subsidy
- Sick pay-Life insurance
- CI&T University
- Paid Vacations
Full job description
At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions.
With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy.
We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.
About Us:
At CI&T, our rapid growth is fueled by the innovative solutions we create for our global clients. We are seeking a Master DataOps Engineer to own the operational backbone — environments, CI/CD, and monitoring — for a large-scale Finance data platform modernization at a major US mortgage lender, so the platform being built is reliable and cost-governed from day one, not bolted on at the end.
Responsibilities:
• Own environment provisioning and platform readiness across the lakehouse and cloud-warehouse layers, ahead of and during the build.
• Build and operate the CI/CD pipeline for metric definitions and transformation logic: Git-based version control, promotion across dev/test/UAT/production, automated regression on reconciliation suites at every promotion.
• Implement monitoring and alerting across the pipeline: replication lag and failure alerts, lakehouse landing-zone health (including schema-change events), warehouse refresh state, lag breaches, and cost/consumption anomalies.
• Own platform cost attribution and consumption monitoring across warehouses and compute.
• Maintain architecture decision records and other living delivery artifacts alongside the Architect.
• Write and hand over the operational runbooks — replication failure/recovery, reconciliation triage, metric-definition change process, cost-anomaly response — the client's own operations team will run post-handoff.
• Support progressive knowledge transfer through the build via paired working sessions, rather than a single end-of-project handoff.
Requirements:
• Solid experience with DataOps/platform engineering roles supporting a production cloud data platform.
• Strong hands-on experience with CI/CD for data pipelines: Git-based workflows, automated testing/regression gates, promotion across multiple environments.
• Experience monitoring and alerting on a CDC replication pipeline and a cloud data warehouse (Snowflake experience strongly preferred).
• Comfortable owning platform reliability and cost governance as a named responsibility, not a shared or ambient one.
• Fluent English (B2+) — this is the named point of contact for platform operations across client and delivery teams.
Nice to Have:
• Experience with Microsoft Fabric/OneLake operational concerns (capacity, landing-zone health).
• Experience writing production runbooks and leading knowledge transfer to a client operations team.
• Experience with Qlik Replicate specifically.
• Experience in mortgage, lending, or financial-services environments with strict change-control discipline.
#LI-TO1
At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions. With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy. We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day. Our benefits include: - Premium Healthcare - Meal voucher - Maternity and Parental leaves - Mobile services subsidy - Sick pay-Life insurance - CI&T University - Colombian Holidays - Paid Vacations And many others. Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.Similar jobs
Search more Data Engineer jobsMid-Level Data Engineer (Ontologist)
Desenvolve pipelines de dados e modela ontologias, taxonomias e grafos de conhecimento, conectando engenharia de dados, recuperação de informação e IA generativa para viabilizar ingestão e inferência por máquinas.
Data Engineer (Azure, Fabric, Databricks)
Design and deliver client-facing data platforms with Microsoft Fabric and Databricks, building scalable lakehouse architectures, optimized pipelines, and semantic models that enable trusted reporting and self-service analytics.
Build and maintain scalable data pipelines, ETL/ELT processes, and orchestration systems that deliver reliable, usable data for business needs and support machine learning workflows.
Build and optimize ETL/ELT pipelines, data models, and cloud-based data platforms that support analytics and reporting, using Python, SQL, Spark, Databricks, Snowflake, and AWS.
