Remote Jobs RockRemote Jobs Rock

Senior Data Engineer

🕒 2 days ago
PythonSQLApache SparkPyspark
Apply Now

📜 Description

  • Design and build scalable cloud-native data platforms from greenfield through production.
  • Implement near-real-time ingestion pipelines using event-driven patterns.
  • Set platform standards for data lakes, lakehouses, medallion architecture, and data contracts.
  • Optimize Spark and PySpark code and establish code quality, testing, and CI/CD practices.
  • Improve data quality, observability, scalability, and reliability; build self-service tools and microservices.
  • Drive AI tooling, agentic workflows, architecture decisions, and technical R&D with cross-functional teams.

🛠️ Requirements

  • 5+ years of professional experience in Data Engineering
  • Strong Python and SQL development skills
  • Hands-on experience with Apache Spark and PySpark including query optimization and performance tuning
  • Experience working with Databricks or Snowflake
  • Practical experience with at least one major cloud provider such as Azure, AWS, or GCP
  • Experience with stream processing technologies including Kafka or Spark Structured Streaming
  • Strong understanding of ETL/ELT patterns, data modelling, and data warehousing concepts
  • Experience with orchestration tools such as Apache Airflow or Azure Data Factory
  • Knowledge of Infrastructure as Code tools including Terraform
  • Understanding of production-grade systems including observability, scalability, reliability, and performance
Full job description

Company Description

We are looking for a Senior Data Engineer to join our Data Engineering Team and take ownership of high-impact, greenfield data initiatives. You will work on building modern cloud-native data platforms, migrating on-premises legacy systems to the cloud, and laying the architectural foundation for AI-ready data infrastructure. 

In this role, you will collaborate closely with Machine Learning, Data Science, and Product teams, serving as a key technical contributor and thought leader. You will also drive R&D efforts around agentic AI architectures, event-driven systems, and LLM-ready data pipelines – turning architectural concepts into production-grade solutions.

Job Description

  • Design and build scalable cloud-native data platforms from greenfield to production
  • Design and implement near-real-time ingestion pipelines using event-driven patterns
  • Define and enforce data platform standards including Data Lake and Lakehouse principles, medallion architecture, and data contracts
  • Refactor, optimize, and modernize Spark and PySpark scripts for performance and maintainability
  • Introduce best practices for code quality, testing, and CI/CD across data pipelines
  • Drive adoption of AI tooling and agentic workflows within the Data Engineering team
  • Ensure data quality, observability, scalability, and reliability across all platforms and pipelines
  • Design and deliver self-service tooling and microservices that simplify platform usage
  • Collaborate with cross-functional stakeholders including Product, Machine Learning, and Data Science teams
  • Contribute to architecture decisions and technical R&D initiatives

Qualifications

  • 5+ years of professional experience in Data Engineering
  • Strong Python and SQL development skills
  • Hands-on experience with Apache Spark and PySpark including query optimization and performance tuning
  • Experience working with Databricks or Snowflake
  • Practical experience with at least one major cloud provider such as Azure, AWS, or GCP
  • Experience with stream processing technologies including Kafka or Spark Structured Streaming
  • Strong understanding of ETL/ELT patterns, data modelling, and data warehousing concepts
  • Experience with orchestration tools such as Apache Airflow or Azure Data Factory
  • Knowledge of Infrastructure as Code tools including Terraform
  • Understanding of production-grade systems including observability, scalability, reliability, and performance
  • Ability to independently lead technical initiatives from concept to delivery
  • Strong communication and collaboration skills
  • Upper-Intermediate or higher English level

WILL BE A PLUS

  • Familiarity with RAG pipeline design and LLM integration patterns
  • Knowledge of data governance frameworks and tools such as Unity Catalog or Apache Atlas
  • Experience with dbt for data transformation and modelling
  • Familiarity with MLflow, Feature Stores, or ML platform integrations

Additional Information

PERSONAL PROFILE

  • Proactive and self-driven mindset
  • Strong analytical and architectural thinking
  • Ability to work independently and take ownership of technical decisions
  • Passion for innovation and modern engineering practices
  • Knowledge-sharing and team-oriented approach
  • Strong problem-solving skills
Aimpoint Digital

Senior Data Engineer 2026 - US

🕒 yesterday
Aimpoint Digital👥 51 - 200 employees🏢 Computer Software

Design and deliver AI-ready data platforms, pipelines, and semantic layers for client engagements, translating business needs into scalable analytics solutions and supporting AI-enabled workflows from design through production.

Data EngineeringSQLPythonApache Spark
Leega Consultoria

Engenheiro de Dados Sênior (AWS - PySpark - Kafka)

🕒 2 days ago
Leega Consultoria👥 201 - 500 employees🏢 Information Technology And Services

Projeta e opera plataformas de dados orientadas a eventos na AWS, desenvolvendo pipelines Kafka e PySpark, definindo arquitetura e garantindo performance, rastreabilidade e confiabilidade em ambiente financeiro regulado.

Engenharia De DadosApache KafkaPysparkSpark Structured Streaming
Leega Consultoria

Engenheiro de Dados GCP Sênior

🕒 yesterday
Leega Consultoria👥 201 - 500 employees🏢 Information Technology And Services

Construa e opere um hub de dados centralizado no Google Cloud, integrando fontes corporativas e entregando dados confiáveis e modelados para análises, painéis e soluções de IA e machine learning.

Google CloudBigqueryCloud StorageApache Airflow

Trusted by Remote Workers