As a Data Engineer II, you will build and maintain data pipelines, implement data models, and ensure data quality while collaborating with cross-functional teams.
Data Integration Developer (Informatica CDI)
📜 Description
- Design, build, and optimize end-to-end pipelines using Informatica CDI mappings, tasks, taskflows, and synchronization tasks.
- Connect and ingest data from databases, cloud storage, APIs, and data warehouses.
- Implement business logic with standard and advanced transformations, including SQL ELT pushdown.
- Schedule and orchestrate workflows with CDI Taskflows and, where applicable, external schedulers or CI/CD pipelines.
- Unit test and debug pipelines, resolve bottlenecks, and troubleshoot runtime errors and session logs.
- Monitor production runs, optimize execution times, and support root-cause analysis of failed jobs.
🛠️ Requirements
- 3+ years of hands-on experience building, deploying, and troubleshooting mappings and taskflows in Informatica CDI (IDMC).
- Strong SQL skills, including complex joins, aggregations, window functions, and query performance tuning.
- Understanding of dimensional modeling, Star and Snowflake schemas, SCD Type 1/2, and incremental load strategies.
- Experience with at least one of Snowflake, Google BigQuery, or Amazon Redshift, and cloud object stores such as S3 or ADLS.
- Ability to interpret data mapping specifications, translate functional requirements into workflows, and debug mapping issues independently.
- Preferred: Informatica CAI, Unix/Linux shell scripting or basic Python, Secure Agent configuration, or an Informatica certification.
Full job description
Role Overview
We are looking for a proactive Data Integration Developer with practical, hands-on experience in
Informatica Cloud Data Integration (CDI). In this role, you will design, build, test, and maintain cloud-native data pipelines, ingesting and transforming data across diverse cloud and on-premise platforms to support our enterprise analytics and reporting ecosystems.
Key Responsibilities
● Pipeline Development: Design, build, and optimize end-to-end data pipelines using Informatica CDI (mappings, mapping tasks, taskflows, and synchronization tasks).
● Source/Target Integration: Establish connections and ingest data from heterogeneous sources, including relational databases, cloud storage (AWS S3, Azure Data Lake, GCP), APIs, and modern data warehouses (Snowflake, BigQuery, Databricks, or Amazon Redshift).
● Data Transformation: Implement business logic using standard and advanced transformations (e.g., Expression, Router, Aggregator, Joiner, Lookup, Normalizer, and SQL ELT pushdown).
● Scheduling & Automation: Schedule and orchestrate workflows via CDI Taskflows and integrate with external job schedulers or CI/CD deployment pipelines where applicable.
● Testing & Debugging: Perform unit testing, resolve pipeline bottlenecks, and debug run-time errors or session logs.
● Maintenance & Monitoring: Monitor production execution runs, optimize execution runtimes, and assist in root-cause analysis for failed jobs.
Required Qualifications & Skills
● Informatica Expertise: 3+ years of hands-on experience building, deploying, and troubleshooting mappings and taskflows in Informatica CDI (IDMC).
● SQL Proficiency: Strong practical knowledge of SQL (writing complex joins, aggregations, window functions, and query performance tuning).
● Data Warehousing Foundations: Solid understanding of dimensional modeling (Star and Snowflake schemas), slowly changing dimensions (SCD Type 1/2), and incremental load strategies.
● Cloud & Platform Experience: Working familiarity with at least one major cloud data
warehouse (Snowflake, Google BigQuery, or Amazon Redshift) and cloud object stores (S3, ADLS).
● Problem Solving: Ability to read data mapping specifications, translate functional requirements into technical workflows, and debug mapping issues independently.
Preferred / Nice-to-Have Skills
● Hands-on experience with Informatica CAI (Cloud Application Integration) for API-led or real-time workflows.
● Familiarity with Unix/Linux shell scripting or basic Python for pre/post-processing tasks.
● Experience configuring Informatica Secure Agents on Linux/Windows environments.
● Official Informatica certification (e.g., Informatica IDMC Cloud Data Integration Specialist).
Similar jobs
Search more Data Engineer jobsData Engineer in FCP DVR team – GCP migration project (temporary contract)
Lead part of the FCP Data Visualization and Reporting team’s migration from on-premises to GCP, refactoring data pipelines and coordinating technical solutions, requirements, estimates, and project updates.
Engenheiro(a) de Dados responsável por desenvolver e manter pipelines escaláveis e seguros, integrar fontes de dados e traduzir necessidades de negócio em soluções de dados no ecossistema AWS.
Pessoa Engenheiro de dados - Martech
Engenheiro(a) de Dados responsável por criar e otimizar pipelines, integrar fontes e garantir dados confiáveis para análises, produtos digitais, iniciativas de marketing e personalização da experiência do cliente.
Design and maintain secure, scalable data pipelines, models and automation for DK, enabling trusted data for reporting, analytics and operational workflows while improving governance, reliability and service quality.
