🕒 yesterday
As a Senior Data Engineer, you will design and implement scalable data pipelines, ensuring data governance and supporting Headway's mission to improve access to mental healthcare.
Senior Data Engineer - R01569889
📅 Aug 13
Cloud Data Integration (cdi)SnowflakeETL/ELTSQL
📜 Description
- Build and maintain ETL/ELT pipelines and IICS data integration workflows, including mappings, taskflows, scheduling, and error handling.
- Develop Snowflake warehouse structures and optimize SQL queries and stored procedures.
- Implement incremental and full loads, CDC, and SCD Type 1/Type 2 patterns.
- Transform, cleanse, validate, and reconcile data to maintain quality and integrity.
- Troubleshoot pipeline failures, data issues, and performance bottlenecks.
- Collaborate with analysts, architects, QA, and technical teams on end-to-end solutions and production deployments.
🛠️ Requirements
- 5 to 8 years of experience designing, developing, and maintaining data integration and data warehouse solutions using IICS and Snowflake.
- Hands-on experience with IICS Cloud Data Integration, mappings, mapping tasks, and taskflows.
- Expertise in Snowflake architecture and features, including warehouses, stages, streams, tasks, Time Travel, and zero-copy cloning.
- Advanced SQL development and query optimization; proficiency in ETL/ELT and data warehousing concepts.
- Experience with pipeline parameterization, error handling, workflow scheduling, and incremental/full loads using SCD and CDC patterns.
- Preferred: AWS or Azure, S3 or Azure Blob Storage, CI/CD, DevOps, Python or scripting, Git, Jenkins, or Azure DevOps.
- Preferred: Life Sciences or Pharmaceutical domain experience.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline; Snowflake, Informatica CDI, AWS, or Azure certification preferred.
Full job description
Senior Data Engineer
Primary Skills
Specialization
Job requirements
Similar jobs
Search more Data Engineer jobs
🕒 2 days ago
Build and maintain real-time, batch, and streaming data pipelines, warehouse infrastructure, and dbt models while supporting analytics and data quality across business teams.
🕒 2 days ago
Build and maintain real-time, batch, and streaming data pipelines and warehouse infrastructure, while supporting analytics and developing dbt models that improve data accessibility, quality, and decision-making.
🕒 2 days ago
Build and maintain real-time, batch, and streaming data pipelines and warehouse infrastructure, while supporting analytics and dbt modeling to improve data accessibility, quality, and decision-making.
🕒 2 days ago
Build and maintain real-time, batch, and streaming data pipelines, warehouse infrastructure, and dbt models while supporting analytics and data quality across business teams.