Remote Jobs RockRemote Jobs Rock

Snowflake Data Engineer - R01568220

๐Ÿ“… Jul 17
SnowflakeApache AirflowDbtSQL
Apply Now

๐Ÿ“œ Description

  • Design and develop scalable Snowflake data pipelines and modern data architectures.
  • Lead migrations from legacy databases and optimize transformed workloads for Snowflake.
  • Build ELT frameworks with dbt and orchestrate workflows using Apache Airflow.
  • Create data models, ingestion pipelines, and reusable validation, reconciliation, auditing, and monitoring frameworks.
  • Optimize Snowflake objects and develop technical design documents and migration runbooks.
  • Provide L3 production support, troubleshoot pipeline and performance issues, and implement permanent fixes.

๐Ÿ› ๏ธ Requirements

  • Snowflake, Airflow, DBT
  • Python/PySpark
Full job description

As a Data Engineer at Brillio, you will be at the forefront of building robust, scalable data architectures that power complex business intelligence and AI initiatives. You will work closely with cross-functional teams, including AI/ML engineers and product stakeholders, to transform raw data into reliable, high-quality assets. Your day-to-day will involve architecting sophisticated data pipelines, implementing advanced modeling techniques, and ensuring the seamless flow of information across the enterprise, directly influencing the data-driven decision-making capabilities of our clients.

Primary Skills

  • Snowflake, Airflow, DBT
  • SQL
  • Python/PySpark
  • ETL
  • CDC
  • Specialization

  • Snowflake
  • SnowPro
  • Job requirements

    Key Responsibilities

    Project Type: L3 Support

    Flexibility to shift working is Mandatory.

    Development Responsibilities

  • Design and develop scalable data pipelines and modern data architectures using Snowflake.
  • Lead migration initiatives from legacy databases to Snowflake.
  • Build and optimize ELT frameworks using DBT.
  • Develop and orchestrate workflows using Apache Airflow.
  • Design and implement data models, including Star Schema and Snowflake Schema.
  • Develop ingestion pipelines for structured and semi-structured data.
  • Create reusable frameworks for data validation, reconciliation, auditing, and monitoring.
  • Optimize Snowflake objects, including:
  • Virtual Warehouses
  • Clustering Keys
  • Materialized Views
  • Streams & Tasks
  • Dynamic Tables
  • Develop technical design documents and migration runbooks.
  • Perform code reviews and enforce engineering best practices.

  • Migration Responsibilities

  • Assess and migrate data from legacy platforms, including:
  • Oracle
  • SQL Server
  • Teradata
  • Netezza
  • DB2
  • SAP HANA
  • On-Prem Data Warehouses
  • Perform source system analysis and database rationalization.
  • Design migration strategies, including:
  • Full Data Loads
  • Incremental Loads
  • CDC (Change Data Capture)
  • Historical Data Migration
  • Conduct data reconciliation and validation during migration.
  • Optimize transformed workloads for Snowflake architecture.
  • Execute cutover planning and post-migration stabilization.

  • Good to have:

    AMS / Production Support Responsibilities

  • Provide L3 support for Snowflake data platforms and pipelines.
  • Monitor and manage production data workloads.
  • Troubleshoot data failures, performance issues, and pipeline disruptions.
  • Perform root cause analysis (RCA) and implement permanent fixes.
  • Support incident, problem, change, and release management activities.
  • Work closely with business users and stakeholders to resolve production issues.
  • Ensure adherence to SLA and operational support commitments.
  • Participate in production releases and deployment activities.
  • NucleusTeq

    Data Integration Developer (Informatica CDI)

    ๐Ÿ•’ 4 days ago
    NucleusTeq๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Information Technology And Services

    Design, build, test, and maintain Informatica CDI data pipelines that integrate and transform data across cloud and on-premise platforms for enterprise analytics and reporting.

    Informatica Cloud Data Integration (cdi/idmc)SQLData Pipeline DevelopmentData Integration

    Lead part of the FCP Data Visualization and Reporting teamโ€™s migration from on-premises to GCP, refactoring data pipelines and coordinating technical solutions, requirements, estimates, and project updates.

    GCPBigqueryIAMDataproc
    FCamara

    Engenheiro de dados

    ๐Ÿ•’ 8 days ago
    FCamara๐Ÿ‘ฅ 501 - 1000 employees๐Ÿข Information Technology And Services

    Engenheiro(a) de Dados responsรกvel por desenvolver e manter pipelines escalรกveis e seguros, integrar fontes de dados e traduzir necessidades de negรณcio em soluรงรตes de dados no ecossistema AWS.

    Engenharia De DadosPythonSQLPandas

    Trusted by Remote Workers