Drive Databricks adoption and technical standards while designing and optimizing scalable data pipelines, strengthening governance and observability, and guiding engineers across data engineering initiatives.
Senior Data Developer
📜 Description
- Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, SQL, and Python or Scala.
- Build solutions to process and transform large datasets efficiently.
- Monitor and optimize data pipelines and workflows for performance, scalability, throughput, and reliability.
- Collaborate with data scientists, analysts, engineers, and business stakeholders to translate data needs into technical solutions.
- Implement data quality checks and governance practices; troubleshoot pipeline issues and document engineering standards.
🛠️ Requirements
- Solid professional experience in Data Engineering, particularly designing and developing data pipelines.
- Hands-on experience with Databricks and Apache Spark.
- Strong knowledge of SQL and experience working with large datasets.
- Proficiency in Python or Scala for data engineering.
- Experience working with Microsoft Azure and cloud-based data solutions.
- Strong analytical and problem-solving skills, including the ability to troubleshoot complex data issues.
- Excellent communication skills in English and Portuguese, with confidence working in collaborative environments and interacting with clients and stakeholders.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
✨ Benefits
- Health and dental insurance
- Meal and food allowance
- Childcare assistance
- Extended paternity leave
- Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
- Profit Sharing and Results Participation (PLR);
- Life insurance
- Continuous learning platform (CI&T University);
Full job description
At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions.
With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy.
We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.
We are looking for a Data Engineer to join our team and help design, build, and optimize scalable data solutions.
In this role, you will work with modern data technologies such as Databricks, Apache Spark, SQL, Python, and Azure, collaborating with technical teams and business stakeholders to transform large volumes of data into reliable and efficient solutions.
Your responsibilities
- Design, develop, and maintain robust and scalable data pipelines using Databricks, Apache Spark, SQL, and Python or Scala.
- Build solutions to process and transform large datasets efficiently.
- Monitor and optimize existing data pipelines and workflows, improving performance, scalability, throughput, and reliability.
- Collaborate with data scientists, analysts, engineers, and business stakeholders to understand data needs and translate them into effective technical solutions.
- Implement data quality checks and governance practices to ensure data accuracy, consistency, and compliance.
- Troubleshoot complex data and pipeline issues, identifying root causes and proposing sustainable solutions.
- Maintain clear technical documentation and contribute to engineering standards and best practices across the team.
What we are looking for
- Solid professional experience in Data Engineering, particularly designing and developing data pipelines.
- Hands-on experience with Databricks and Apache Spark.
- Strong knowledge of SQL and experience working with large datasets.
- Proficiency in Python or Scala for data engineering.
- Experience working with Microsoft Azure and cloud-based data solutions.
- Strong analytical and problem-solving skills, including the ability to troubleshoot complex data issues.
- Excellent communication skills in English and Portuguese, with confidence working in collaborative environments and interacting with clients and stakeholders.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
Similar jobs
Search more Data Engineer jobsDesign and optimize scalable data pipelines and cloud-native architectures that support Data & AI initiatives, collaborating across teams to deliver secure, high-performing data solutions.
Leads the design and operation of data assets and pipelines, integrating complex healthcare datasets and building secure, reliable data foundations for products, analytics, and machine learning.
As a Senior Data Engineer, you will build, enhance, and maintain our data platform on Databricks, transforming large datasets into clean, usable data products.
Develops and maintains data systems, APIs, and user interfaces, optimizing data operations for performance, scalability, integrity, and security while delivering automated tests and supporting team success.
