Migrate Hadoop data infrastructure to cloud services and build reliable data pipelines, transformations, and CI/CD workflows using Scala, SQL, Spark, and Airflow.
Snowflake Data Engineer - R01568220
๐ Description
- Design and develop scalable Snowflake data pipelines and modern data architectures.
- Lead migrations from legacy databases and optimize transformed workloads for Snowflake.
- Build ELT frameworks with dbt and orchestrate workflows using Apache Airflow.
- Create data models, ingestion pipelines, and reusable validation, reconciliation, auditing, and monitoring frameworks.
- Optimize Snowflake objects and develop technical design documents and migration runbooks.
- Provide L3 production support, troubleshoot pipeline and performance issues, and implement permanent fixes.
๐ ๏ธ Requirements
- Snowflake, Airflow, DBT
- Python/PySpark
Full job description
As a Data Engineer at Brillio, you will be at the forefront of building robust, scalable data architectures that power complex business intelligence and AI initiatives. You will work closely with cross-functional teams, including AI/ML engineers and product stakeholders, to transform raw data into reliable, high-quality assets. Your day-to-day will involve architecting sophisticated data pipelines, implementing advanced modeling techniques, and ensuring the seamless flow of information across the enterprise, directly influencing the data-driven decision-making capabilities of our clients.
Primary Skills
Specialization
Job requirements
Key Responsibilities
Project Type: L3 Support
Flexibility to shift working is Mandatory.
Development Responsibilities
Migration Responsibilities
Good to have:
AMS / Production Support Responsibilities
Similar jobs
Search more Data Engineer jobsAs a Data Engineer II, you will build and maintain data pipelines, implement data models, and ensure data quality while collaborating with cross-functional teams.
Data Integration Developer (Informatica CDI)
Design, build, test, and maintain Informatica CDI data pipelines that integrate and transform data across cloud and on-premise platforms for enterprise analytics and reporting.
Data Engineer in FCP DVR team โ GCP migration project (temporary contract)
Lead part of the FCP Data Visualization and Reporting teamโs migration from on-premises to GCP, refactoring data pipelines and coordinating technical solutions, requirements, estimates, and project updates.
Engenheiro de dados
Engenheiro(a) de Dados responsรกvel por desenvolver e manter pipelines escalรกveis e seguros, integrar fontes de dados e traduzir necessidades de negรณcio em soluรงรตes de dados no ecossistema AWS.
