Remote Jobs RockRemote Jobs Rock

Data Loop Pipeline Engineer

📅 Sep 17
PythonSQLData EngineeringML Training Pipelines
Apply Now

📜 Description

  • Build ingestion pipelines for flight test, simulation, and operational data, including normalization, time alignment, and quality checks.
  • Curate and version datasets with end-to-end lineage across sources, processing steps, and tool versions.
  • Automate mining and triage of anomalies, system disagreements, and near-boundary events.
  • Own labeling workflows and tooling, including quality control and inter-annotator agreement.
  • Instrument deployed systems so operational signals reach subsequent training cycles.
  • Partner with Flight Test & Operations on logging, instrumentation, and data access; monitor pipeline health and dataset coverage for drift, gaps, and failures.

🛠️ Requirements

  • Degree in Computer Science, Artificial Intelligence, Data Science, Computer Engineering, Applied Math, or a related subject.
  • 3+ years in data engineering, with production ownership of pipelines feeding ML training.
  • Strong Python and SQL; solid grasp of data modeling, storage formats and processing frameworks.
  • Experience with dataset versioning and lineage tooling.
  • Comfort with high-volume time-series and multimodal sensor data — telemetry, video, audio, structured logs.
  • Care about correctness. In this role a quiet data bug becomes a model behavior nobody can explain.
  • Robotics, autonomous vehicle or aerospace data experience.
  • Familiarity with flight data formats and avionics bus data.
  • Experience building internal tools that engineers actually chose to use.
  • Data governance or provenance work in a regulated environment.

✨ Benefits

  • Health benefits
  • Dental benefits
  • Life insurance
  • Flexible paid time off
  • 401(k) with match
  • Work/life integration
Full job description
Merlin (NASDAQ: MRLN) is a publicly traded aerospace and defense company building a non-human pilot to deliver full-stack autonomy for any aircraft from takeoff to touchdown. The Merlin Pilot autonomy system powers a growing range of aircraft and mission profiles and has been proven through hundreds of autonomous flights from Merlin's global flight test facilities, including Kerikeri, New Zealand; Smithfield, Rhode Island; and soon, Bedford, Massachusetts. Headquartered in Boston, Merlin is expanding its organization to accelerate the development and deployment of its autonomy platform, helping customers solve some of aviation's most pressing challenges, from pilot shortages to improving flight safety. Backed by some of the world's leading investors prior to its public listing, Merlin continues to advance the certification and commercialization of autonomous flight across commercial and defense aviation.
Merlin (NASDAQ: MRLN) is a publicly traded aerospace and defense company building a non-human pilot to deliver full-stack autonomy for any aircraft from takeoff to touchdown. The Merlin Pilot autonomy system powers a growing range of aircraft and mission profiles and has been proven through hundreds of autonomous flights from Merlin's global flight test facilities, including Kerikeri, New Zealand; Smithfield, Rhode Island; and soon, Bedford, Massachusetts. Headquartered in Boston, Merlin is expanding its organization to accelerate the development and deployment of its autonomy platform, helping customers solve some of aviation's most pressing challenges, from pilot shortages to improving flight safety. Backed by some of the world's leading investors prior to its public listing, Merlin continues to advance the certification and commercialization of autonomous flight across commercial and defense aviation. Merlin Labs offers an innovative, entrepreneurial, and team-focused startup environment. We also offer a top-notch benefits package (health, dental, life, flexible paid time off, and 401k with match) and work/life integration. Being part of the Merlin team allows you to become part of a small team that supports professional development while working together to achieve our mission.   Merlin Labs is an equal opportunity employer and values diversity. We do not discriminate on the basis of race, religion, color, national origin, genetic information, sex (including pregnancy), gender, gender identity and expression, sexual orientation, age, marital status, military service or obligation or disability status, or any other characteristic protected by law. All job offers are contingent upon the candidate passing background and reference checks.   At this time, we are unable to provide visa sponsorship or consider candidates who require visa transfers. Applicants must be authorized to work in the United States without the need for visa sponsorship now or in the future.    In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.   If you require reasonable accommodation in completing an application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to: people@merlinlabs.com   Merlin Labs does not accept unsolicited resumes from any source other than directly from candidates.

About You:

You think data infrastructure is a craft. You have built pipelines that ran unattended for months and you have felt the specific satisfaction of a dataset that is exactly what it claims to be. You'd rather prevent a data problem than debug a model trained on one. You will own the machinery that turns flight and simulation output into trustworthy, versioned, traceable training data — and turns deployed behavior back into the next training set.

Responsibilities:

  • Build and operate ingestion pipelines for flight test, simulation and operational data, including format normalization, time alignment across sources, and quality validation at the gate.
  • Implement dataset curation and versioning with full lineage: what went into a dataset, from where, processed how, and by which version of which tool.
  • Build automated mining and triage for the rare and interesting — anomalies, disagreements between learned and rule-based systems, near-boundary events — so the flywheel prioritizes signal over volume.
  • Own labeling workflows and tooling, including quality control and inter-annotator agreement where human labeling is involved.
  • Close the loop: instrument deployed-system behavior so that operational signal reliably reaches the next training cycle without manual shepherding.
  • Work with Flight Test & Operations on logging and instrumentation requirements, and help resolve access constraints where data is captured by third-party systems.
  • Monitor pipeline health and dataset coverage; alert on drift, gaps and silent breakage.
  • Qualifications:

  • Degree in Computer Science, Artificial Intelligence, Data Science, Computer Engineering, Applied Math, or a related subject.
  • 3+ years in data engineering, with production ownership of pipelines feeding ML training.
  • Strong Python and SQL; solid grasp of data modeling, storage formats and processing frameworks.
  • Experience with dataset versioning and lineage tooling.
  • Comfort with high-volume time-series and multimodal sensor data — telemetry, video, audio, structured logs.
  • Care about correctness. In this role a quiet data bug becomes a model behavior nobody can explain.
  • Nice to Have:

  • Robotics, autonomous vehicle or aerospace data experience.
  • Familiarity with flight data formats and avionics bus data.
  • Experience building internal tools that engineers actually chose to use.
  • Data governance or provenance work in a regulated environment.
  • Logistics:

  • We welcome remote applicants for this role, with a preference for candidates based in or willing to relocate to Boston, MA for a hybrid work schedule at our HQ.
  • Leega Consultoria

    Engenheiro de Dados (GCP/Databricks) Pleno

    🕒 yesterday
    Leega Consultoria👥 201 - 500 employees🏢 Information Technology And Services

    Constrói e mantém pipelines de dados escaláveis em GCP e Databricks, projetando arquiteturas Lakehouse e garantindo qualidade, performance e governança para apoiar decisões estratégicas.

    Google Cloud Platform (gcp)DatabricksApache SparkPyspark

    Trusted by Remote Workers