Remote Jobs RockRemote Jobs Rock

Software Engineer - Data Infrastructure

๐Ÿ“… Aug 10
PythonDistributed ComputingRaySpark
Apply Now

๐Ÿ“œ Description

  • Build and maintain scalable data infrastructure for high-throughput machine learning workflows.
  • Develop and optimize large-scale data pipelines and batch processing jobs.
  • Partner with ML researchers, product teams, and engineering teams to meet evolving data needs and define best practices.
  • Contribute to reliable, high-performance data platform architecture and implementation.
  • Integrate open-source tools and improve infrastructure through monitoring, troubleshooting, and performance tuning.
  • Support evaluation and adoption of programming languages and frameworks for data infrastructure.

๐Ÿ› ๏ธ Requirements

  • Proficiency in Python (or similar languages with willingness to learn Python) and experience with large-scale, high-throughput data infrastructure
  • Familiarity with distributed computing frameworks (e.g., Ray, Spark, Beam)
  • Ability to design and optimize data pipelines for ML research and internal teams
  • Strong problem-solving skills and understanding of data engineering at scale
  • Collaborative, product-focused mindset; comfortable in fast-paced environments
  • Experience sourcing, integrating, and optimizing data from diverse and large datasets
  • Comfortable working in a fast-paced, product-focused environment with a strong execution mindset
  • Open to candidates across seniority levels, from mid-level individual contributors to senior engineers and managers.
  • Prior experience working with complex data infrastructure or AI/ML platforms highly desirable
  • Experience working in the robotics industry preferred
Full job description

About the Role

As a Data Infrastructure Engineer in Research at Luma, you will play a critical role in building and scaling the data infrastructure that supports our cutting-edge multimodal AI systems. Your work will focus on developing high-throughput, large-scale data processing pipelines tailored for machine learning research and internal ML platform needs. You will collaborate closely with ML researchers and product teams to create reliable, efficient, and easy-to-use data infrastructure that empowers innovation and accelerates development. This role requires a strong foundation in distributed systems and data engineering, with an emphasis on supporting complex machine learning workflows rather than traditional product data infrastructure.

ย 

Responsibilities

  • Build and maintain scalable data infrastructure for high-throughput machine learning workflows

  • Collaborate with ML researchers and product teams to ensure data systems meet evolving needs

  • Develop and optimize large-scale data pipelines and batch processing jobs

  • Contribute to the architecture and implementation of reliable, high-performance data platforms

  • Integrate open-source tools and continuously improve data infrastructure through monitoring and tuning

  • Participate in cross-functional projects to improve data reliability, scalability, and operational excellence

  • Support the evaluation and adoption of new programming languages and frameworks relevant to data infrastructure

  • Engage in continuous improvement of data infrastructure through monitoring, troubleshooting, and performance tuning

  • Collaborate with research & engineering teams to help define and refine best practices for data infrastructure development

ย 

Qualifications

  • Proficiency in Python (or similar languages with willingness to learn Python) and experience with large-scale, high-throughput data infrastructure

  • Familiarity with distributed computing frameworks (e.g., Ray, Spark, Beam)

  • Ability to design and optimize data pipelines for ML research and internal teams

  • Strong problem-solving skills and understanding of data engineering at scale

  • Collaborative, product-focused mindset; comfortable in fast-paced environments

  • Experience sourcing, integrating, and optimizing data from diverse and large datasets

  • Comfortable working in a fast-paced, product-focused environment with a strong execution mindset

  • Open to candidates across seniority levels, from mid-level individual contributors to senior engineers and managers.

ย 

Nice to have

  • Prior experience working with complex data infrastructure or AI/ML platforms highly desirable

  • Experience with open source data infrastructure projects is a plus

  • Experience working in the robotics industry preferred

Build and operate SEBโ€™s GCP data platform, owning data pipelines, infrastructure, CI/CD, monitoring and production support while improving workflows through automation and practical AI solutions.

PythonSQLGCPBigquery
Sopra Steria

Data Engineer Gรถteborg

๐Ÿ•’ 5 days ago
Sopra Steria๐Ÿ‘ฅ 10,000+ employees๐Ÿข Information Technology And Services

Bygg, optimera och framtidssรคkra moderna dataplattformar i Microsoft Fabric, Azure Synapse och Databricks, och hjรคlp kunder med nyutveckling och molnmigrering genom hela analyskedjan.

Data EngineeringMicrosoft FabricAzure SynapseAzure Databricks
Sopra Steria

Data Engineer Stockholm

๐Ÿ•’ 5 days ago
Sopra Steria๐Ÿ‘ฅ 10,000+ employees๐Ÿข Information Technology And Services

Build, optimize, and future-proof modern data platforms, supporting cloud migrations and shaping the analytics pipeline from data collection and modeling through visualization and decision support.

๐Ÿ“ ๐Ÿ‡ธ๐Ÿ‡ช Stockholm - Hybrid๐Ÿ’ผ Full-Time๐ŸŽน Mid-level๐Ÿ›ข๏ธ Data Engineer๐Ÿ“ข ๐Ÿ‡ธ๐Ÿ‡ช Swedish Required๐Ÿ“ข ๐Ÿ‡ฌ๐Ÿ‡ง English Required
Data EngineeringMicrosoft FabricAzure SynapseAzure Databricks
Grahamand-Brown

Data Engineer

๐Ÿ•’ 5 days ago
Grahamand-Brown

Designs and maintains data pipelines and integrations, unifying digital and business-system data to support global reporting, customer insights, manufacturing efficiency, and data-driven decisions.

Data EngineeringData ArchitectureSQLDatabase Management
Montreal

Engenheiro de Dados

๐Ÿ•’ 7 days ago
Montreal๐Ÿ‘ฅ 1001 - 5000 employees๐Ÿข Information Technology And Services

As a Data Engineer, you will design and develop robust data architectures, ensuring high-quality data flow from source systems to data warehouses while collaborating with teams.

Data ArchitectureSQLPythonPyspark

Trusted by Remote Workers