Data Engineer - Web Scraping (3 months contract)
Maintains Python-based web scraping configurations, monitors data collection for errors and blockages, and builds pipelines to ingest and transform data in the Datalake.
Estamos em busca de uma Pessoa Engenheira de Dados Júnior para impulsionar a evolução da nossa plataforma de dados, criando integrações e pipelines escaláveis que contribuam para um ambiente robusto, monitorado e orientado por boas práticas de governança.
🎯Quais serão suas principais atividades?
🔍Requisitos:
✨Diferenciais:
Maintains Python-based web scraping configurations, monitors data collection for errors and blockages, and builds pipelines to ingest and transform data in the Datalake.
Develop interactive Power BI dashboards and Python web applications, integrating data through REST APIs and AWS Lambda while building data-processing workflows and collaborating with technical and business teams.
Desarrolla, mantiene y optimiza pipelines ETL/ELT y modelos de datos con Python, SQL, Apache Airflow y Snowflake, asegurando datos confiables y disponibles para el análisis y la toma de decisiones.
Develops and supports Python and SQL Server data pipelines, integrating diverse sources and maintaining reliable, secure workflows on Azure for regulated environments.
Design and optimize scalable batch and streaming data pipelines, model data, and own reliability, quality, observability, lineage, and cost while translating client and business needs into dependable data products.