Remote Jobs RockRemote Jobs Rock

DATA ENGINEER (Scala/Spark)

๐Ÿ•’ 4 days ago
ScalaApache SparkSQLNoSQL Databases
Apply Now

๐Ÿ“œ Description

  • Migrate Hadoop infrastructure to cloud services, including Kubernetes Engine, COS, Spark, and Airflow.
  • Build data transformations and enrichment workflows with Scala, SQL, and Spark, ensuring data quality and consistency.
  • Create CI/CD pipelines and write unit and validation tests for deployments and code quality.
  • Automate data ingestion and pipeline scheduling, primarily with Airflow.
  • Document technical specifications and operational processes, and collaborate with data and business teams.

๐Ÿ› ๏ธ Requirements

  • Good knowledge of Scala with Spark, SQL, Hadoop, HDFS, and structured databases.
  • Experience with CI/CD tools such as GitLab or Jenkins and Apache Airflow.
  • Knowledge of S3 storage or COS and Parquet or ORC formats, plus SQL and NoSQL databases.
  • Understanding of Oozie, shell scripting, SDLC, and Agile principles and ceremonies.
  • Some knowledge of Kubernetes containerization and Dremio; Elasticsearch, Kibana, Kafka, and HVault are a plus.
  • English level C1; French is optional.
  • Banking industry knowledge, problem-solving, collaboration, and ability to support change.
Full job description

Company Description

๐Ÿš€ Join Inetum โ€“ We're Hiring a DATA ENGINEER! ๐Ÿš€

At Inetum, a leading international digital consultancy, we empower 27,000 professionals across 27 countries to shape their careers, foster innovation, and achieve work-life balance. Proudly certified as aย Top Employer Europe 2026, weโ€™re passionate about creating positive and impactful digital solutions.

Job Description

Hybrid work mode in Madrid.ย This service could imply a willingness to travel occasionally within Italy.

The main responsibilities are:

  • Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service.
  • Implement data transformation and quality to ensure data consistency and accuracy. Utilize programming languages such as Scala and SQL and tools like Spark for data transformation and enrichment operations.
  • Set up CI/CD pipelines to automate deployments, unit testing and development management.
  • Write and conduct unit and validation tests to ensure accuracy and integrity of code developed.
  • Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly).
  • Writing technical documentation (specifications, operational documents) to ensure knowledge capitalization.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Foster a culture of continuous learning and improvement within the team.

Qualifications

Good knowledge of:

  • Spark on Scala
  • CI/CD tools (Gitlab, Jenkinsโ€ฆ)
  • HDFS and structured databases (SQL)
  • Apache Airflow
  • S3 storage/COS and parquet (and ORC) format
  • Strong knowledge of SQL and NoSQL databases
  • Hadoop

Full understanding of:

  • Oozie
  • Shell script
  • Software Development Lifecycle (SDLC) awareness
  • Agile principles and ceremonies
  • Design effective prompts to leverage Gen AI tools across IT domains (e.g., development, testing, data generation, documentation) during the development stage.

Some knowledge of:

  • Kubernetesย containerization
  • Dremio as tool to virtualize data

Optionally/ as a plus:

  • Elasticsearch and Kibana
  • Streaming process (Kafka, event steamโ€ฆ)
  • HVault

Additional Information

BUSINESS AND TRANSVERSAL SKILLS

  • Knowledge of banking industry and processes
  • Problem-Solving and Decision-Making person
  • Business / IT relationship (including IT OPS)
  • Ability to understand, explain and support change
  • Ability to Deliver / Results driven
  • Ability to collaborate / Teamwork with data squads and business teams


LANGUAGES

  • English level C1
  • Optionally Fench
PubMatic

Data Engineer โ€“ Mobile Monetization โ€“ Big Data, GenAI & Mobile AdTech

๐Ÿ•’ 5 days ago
PubMatic๐Ÿ‘ฅ 1001 - 5000 employees๐Ÿข Internet

Build and operate high-scale real-time and batch data platforms for mobile advertising, powering bidding, attribution, campaign optimization, fraud detection, analytics, and GenAI-enabled automation.

JavaGoRustApache Spark
Zifo

Data Engineer (Clinical)

๐Ÿ•’ 3 days ago
Zifo๐Ÿข Information Technology๐Ÿค B2B

Build clinical data pipelines and models that transform scientific documents into linked, queryable datasets, powering R&D analytics and AI-driven trial design recommendations with regulatory traceability.

PythonApache SparkJavaScala
OpenAI

Technical Operations Analyst, User Safety & Risk Operations

๐Ÿ•’ 2 days ago
OpenAI๐Ÿ‘ฅ 10,000+ employees๐Ÿข Research Services๐Ÿง  AI-native

Build and maintain production data pipelines, shared datasets, and operational reporting for User Safety & Risk Operations, helping teams turn data from multiple systems into reliable insights and automation.

SQLPythonData PipelinesApache Airflow
Wayve

Data Engineer, Security Analytics

๐Ÿ•’ 3 days ago
Wayve๐Ÿ‘ฅ 501 - 1000 employees๐Ÿข Computer Software๐Ÿง  AI-native

Build the data pipelines, models, integrations and automations that make security posture measurable, improve control monitoring and evidence collection, and turn security data into actionable insights.

Data EngineeringPythonSQLData Pipelines

Trusted by Remote Workers