Engenheiro de Dados Pleno responsável por migrar tabelas e pipelines do Cloudera Hadoop para AWS, desde o levantamento do ambiente até a estabilização em produção.
Data Engineer - Remote, Latin America
📜 Description
- Develop and maintain data models for application and reporting databases, supporting documentation, custom development, and integrations.
- Monitor daily pipeline execution and performance; triage and escalate issues.
- Improve data models and pipelines with analytics and business teams to support BI tools and data accessibility.
- Implement monitoring processes to ensure production data quality and availability.
- Write unit and integration tests, document work, and contribute to the engineering wiki.
- Analyze and troubleshoot data issues in AWS/Linux environments while collaborating with engineers, product managers, and analysts.
🛠️ Requirements
- Experience with AWS services including but not limited to S3, Athena, EC2, EMR, and Glue.
- Ability to solve any ongoing issues with operating the cluster.
- Experience with the integration of data from multiple data sources.
- Experience with various database technologies such as SQLServer, Redshift, Postgres, and RDS.
- Experience with one or more of the following data integration platforms: Pentaho Kettle, SnapLogic, Talend OpenStudio, Jitterbit, Informatica PowerCenter, or similar.
- Knowledge of best practices and IT operations in an always-up, always-available service.
- Experience with or knowledge of Agile Software Development methodologies.
- Excellent problem-solving and troubleshooting skills.
- Excellent oral and written communication skills with a keen sense of customer service.
- Experience with collecting/managing/reporting on large data stores.
✨ Benefits
- Competitive salary and bonuses, including performance-based salary increases.
- Generous paid-time-off policy
- Flexible working hours
- Work remotely
- Continuing education, training, conferences
- Company-sponsored coursework, exams, and certifications
Full job description
What we are looking for
What you'll be doing
Company Benefits
Similar jobs
Search more Data Engineer jobsBuild and optimize ETL/ELT pipelines, data models, and cloud-based data platforms that support analytics and reporting, using Python, SQL, Spark, Databricks, Snowflake, and AWS.
Build the data models, pipelines, and automation that make cloud costs and margins trustworthy, while identifying and delivering savings across AWS and GCP in partnership with Engineering and Finance.
Engenheiro de Dados (GCP/Databricks) Pleno
Constrói e mantém pipelines de dados escaláveis em GCP e Databricks, projetando arquiteturas Lakehouse e garantindo qualidade, performance e governança para apoiar decisões estratégicas.
Desenvolve e otimiza pipelines de dados escaláveis em Azure e Databricks, trabalhando com processamento distribuído, modelagem e armazenamento, automação de implantações e confiabilidade de rotinas em produção.
