Remote Jobs RockRemote Jobs Rock

DATA ENGINEER

🕒 yesterday
ScalaSQLApache SparkApache Airflow
Apply Now

📜 Description

  • Migrate Hadoop infrastructure to cloud services, including Kubernetes Engine, COS, Spark, and Airflow.
  • Build data transformations and enrichment workflows with Scala, SQL, and Spark, ensuring data quality and consistency.
  • Automate deployments, unit testing, and development workflows with CI/CD pipelines.
  • Automate data ingestion and pipeline scheduling, primarily with Airflow.
  • Write and conduct unit and validation tests, and maintain technical specifications and operational documentation.
  • Collaborate with data squads and business teams to understand requirements and deliver solutions.

🛠️ Requirements

  • Good knowledge of Spark with Scala, SQL, Hadoop, HDFS, Apache Airflow, and structured and NoSQL databases.
  • Experience with CI/CD tools such as GitLab or Jenkins, and S3/COS storage and Parquet or ORC formats.
  • Understanding of Oozie, shell scripting, SDLC, and Agile principles and ceremonies.
  • Ability to design effective prompts for generative AI tools used in development, testing, data generation, and documentation.
  • Some knowledge of Kubernetes containerization and Dremio; Elasticsearch, Kibana, Kafka, and HVault are pluses.
  • English level C1; French is optional.
  • Problem-solving, decision-making, collaboration, and ability to support change and deliver results.
Full job description

Company Description

🚀 Join Inetum – We're Hiring a DATA ENGINEER! 🚀

At Inetum, a leading international digital consultancy, we empower 27,000 professionals across 27 countries to shape their careers, foster innovation, and achieve work-life balance. Proudly certified as a Top Employer Europe 2026, we’re passionate about creating positive and impactful digital solutions.

Job Description

Hybrid work mode in Madrid. This service could imply a willingness to travel occasionally within Italy.

The main responsibilities are:

  • Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service.
  • Implement data transformation and quality to ensure data consistency and accuracy. Utilize programming languages such as Scala and SQL and tools like Spark for data transformation and enrichment operations.
  • Set up CI/CD pipelines to automate deployments, unit testing and development management.
  • Write and conduct unit and validation tests to ensure accuracy and integrity of code developed.
  • Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly).
  • Writing technical documentation (specifications, operational documents) to ensure knowledge capitalization.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Foster a culture of continuous learning and improvement within the team.

Qualifications

Good knowledge of:

  • Spark on Scala
  • CI/CD tools (Gitlab, Jenkins…)
  • HDFS and structured databases (SQL)
  • Apache Airflow
  • S3 storage/COS and parquet (and ORC) format
  • Strong knowledge of SQL and NoSQL databases
  • Hadoop

Full understanding of:

  • Oozie
  • Shell script
  • Software Development Lifecycle (SDLC) awareness
  • Agile principles and ceremonies
  • Design effective prompts to leverage Gen AI tools across IT domains (e.g., development, testing, data generation, documentation) during the development stage.

Some knowledge of:

  • Kubernetes containerization
  • Dremio as tool to virtualize data

Optionally/ as a plus:

  • Elasticsearch and Kibana
  • Streaming process (Kafka, event steam…)
  • HVault

Additional Information

BUSINESS AND TRANSVERSAL SKILLS

  • Knowledge of banking industry and processes
  • Problem-Solving and Decision-Making person
  • Business / IT relationship (including IT OPS)
  • Ability to understand, explain and support change
  • Ability to Deliver / Results driven
  • Ability to collaborate / Teamwork with data squads and business teams


LANGUAGES

  • English level C1
  • Optionally Fench

Lead part of the FCP Data Visualization and Reporting team’s migration from on-premises to GCP, refactoring data pipelines and coordinating technical solutions, requirements, estimates, and project updates.

GCPBigqueryIAMDataproc
Vemprabip

Pessoa Engenheiro de dados - Martech

🕒 9 days ago
Vemprabip👥 501 - 1000 employees🏢 Management Consulting

Engenheiro(a) de Dados responsável por criar e otimizar pipelines, integrar fontes e garantir dados confiáveis para análises, produtos digitais, iniciativas de marketing e personalização da experiência do cliente.

Engenharia De DadosETL/ELTPythonSQL
MMDSmart

Middle Data Engineer

🕒 7 days ago
MMDSmart🤝 B2B

Build and maintain batch and streaming data pipelines, ETL workflows, and data warehouse solutions, improving data quality, reliability, and performance through Python, SQL, BigQuery, and Airflow.

📍 🇵🇱 Poland +5 - Remote?💼 Full-Time🎹 Mid-level🛢️ Data Engineer📢 🇬🇧 English Required
Data EngineeringData PipelinesBatch ProcessingStreaming Data Processing

Trusted by Remote Workers