Remote Jobs RockRemote Jobs Rock

Staff Backend Engineer, Datalake Platform

📅 Jun 30
Backend Software EngineeringDistributed SystemsData InfrastructureObject Storage
Apply Now

📜 Description

  • Design a unified Iceberg metastore and define APIs, authorization, credential vending, and integrations for Spark, Trino, Flink, and PyIceberg.
  • Lead multi-cloud architecture strategy and implement disaster recovery plans.
  • Build preventative compliance controls, including audit logging, access reviews, data segregation, and lifecycle enforcement.
  • Improve storage layout, snapshot retention, and data lifecycle through automated self-service tooling.
  • Lead design reviews, set reliability, security, and developer experience standards, and mentor senior engineers.

🛠️ Requirements

  • 10+ years of professional software engineering experience.
  • Track record designing, building, and operating large-scale distributed storage or data infrastructure systems.
  • Deep object storage experience, including S3, Azure Blob, IAM, access policies, lifecycle management, and petabyte-scale operations.
  • Experience leading complex, multi-quarter infrastructure projects and coordinating cross-team migrations.
  • Strong background in authorization and access control for distributed data systems.
  • 5+ years of Backend/Infrastructure Software Engineering experience preferred.
  • Experience with large-scale data migrations, including sequencing, blast-radius reduction, rollback, and data integrity validation.
  • Ability to build ergonomic, well-documented abstractions that reduce engineering toil.

✨ Benefits

  • Equity
  • Company bonus
  • Retirement plans
  • Health benefits
  • Wellness stipends
Full job description

Who We Are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies — from the world's largest enterprises to the most ambitious startups — use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important work of your career.

About the Team

The Datalake team builds and maintains Stripe's foundational data access and governance infrastructure — the paved path for safe, fast, and compliant access to Stripe's critical big data assets. We serve developers, data engineers, analysts, ML and AI teams, security teams, and business users across the company. The team is in the middle of a significant architectural transition as Stripe grows. We are making Stripe's data lake a first-class citizen of the modern data ecosystem to support our growing scale and diverse workloads.

What Makes This Role Compelling

  • Foundational infrastructure with broad reach: The Datalake team's systems sit in the critical path of nearly every data workload at Stripe. Decisions affect petabytes of data, hundreds of production pipelines, and every engineering team that builds on Stripe's data lake.
  • Multi-cloud architecture design and transition: You will lead the strategy to transition to a multi-cloud architecture and implement disaster recovery plans.
  • Active, high-stakes, OSS-aligned architectural transformation: You will lead a multi-year migration to modern, open-source solutions like the Apache Iceberg. This is a technically deep project involving critical architectural choices at each step, from API design and compute engine integration to authorization models, where your opinions and technical influence will directly shape how the platform engages with the broader data infrastructure ecosystem.
  • At Stripe you’ll have the scale of the large company and the agency to influence technical strategy and the roadmap

Responsibilities

  • Architect the unified Iceberg platform: Lead the technical design of a metastore service as it becomes the single source of truth for Iceberg table management across all compute engines — Spark, Trino, Flink, and PyIceberg. Define the API contracts, authorization model, per-table credential vending, and integration patterns that every data pipeline at the company will depend on.
  • Lead compliance architecture: Partner with security and compliance teams to translate regulatory requirements into durable preventative technical controls — audit logging, access review infrastructure, data segregation, and lifecycle enforcement — built into the platform rather than bolted on.
  • Drive cost and efficiency at petabyte scale: Identify systemic inefficiencies in storage layout, snapshot retention, and data lifecycle, and design automated, self-service tooling that scales without ongoing manual intervention from the team.
  • Set the technical bar: Own critical design reviews, establish standards for reliability, security, and developer experience, and mentor senior engineers through high-stakes architectural decisions. Provide the technical judgment that keeps the platform moving fast without accumulating structural debt.

Who You Are

Minimum requirements

  • 10+ years of professional software engineering experience
  • Demonstrated track record of designing, building, and operating large-scale distributed storage or data infrastructure systems.
  • Deep experience with object storage (S3, Azure Blob, or equivalent) — including IAM, access control policy design, lifecycle management, and operational practices at petabyte scale.
  • Proven ability to lead complex, multi-quarter infrastructure projects end-to-end, including cross-team dependency management and coordinating migrations across many consuming teams.
  • Strong background in authorization and access control design for distributed data systems.

Preferred requirements

  • 5+ years of Backend/Infrastructure Software Engineering experience.
  • Experience safely executing large-scale data migrations with a strong instinct for sequencing, blast radius reduction, rollback, and data integrity validation.
  • A strong developer experience sensibility: the ability to build abstractions that are ergonomic, well-documented, and actively reduce toil for the engineering teams that depend on your platform.

In-office expectations

Office-assigned Stripes in most of our locations are currently expected to spend at least 50% of the time in a given month in their local office or with users. This expectation may vary depending on role, team and location. For example, Stripes in Stripe Delivery Center roles in Mexico City, Mexico, Bengaluru, India, and Dublin, Ireland work 100% from the office. Also, some teams have greater in-office attendance requirements, to appropriately support our users and workflows, which the hiring manager will discuss. This approach helps strike a balance between bringing people together for in-person collaboration and learning from each other, while supporting flexibility when possible.

Pay and benefits Stripe does not yet include pay ranges in job postings in every country. Stripe strongly values pay transparency and is working toward pay transparency globally.

Harvey

Staff Software Engineer, Backend Platform

🕒 yesterday
Harvey👥 10,000+ employees🏢 Software Development🤝 B2B

Build and operate the shared backend platform, creating frameworks, APIs, and reliability capabilities that help product teams ship scalable, observable services and GenAI-native applications faster.

PythonBackend DevelopmentAPI DesignDistributed Systems

Own the architecture, reliability, and production operation of payment transaction systems, shaping APIs and transaction lifecycles while guiding AI-assisted implementation and building the team that will maintain the domain.

Payments OrchestrationPayment APIsTransaction ProcessingDistributed Systems
Airwallex

Staff Software Engineer, Growth

🕒 3 days ago
Airwallex👥 10,000+ employees🏢 Financial Services🤝 B2B

Defines the technical strategy and builds scalable backend and AI-native growth platforms, turning customer and product signals into personalized experiences, automated workflows, and measurable business outcomes.

Backend EngineeringPythonJavaKotlin
Airwallex

Staff Software Engineer, Growth

🕒 7 days ago
Airwallex👥 10,000+ employees🏢 Financial Services🤝 B2B

Define the technical architecture and build scalable backend and AI-native growth platforms that turn customer signals into personalized experiences, automated workflows, and measurable business outcomes.

Backend EngineeringPythonJavaKotlin
Radiant

Principal Backend Software Engineer

🕒 8 days ago
Radiant🏢 Artificial Intelligence Infrastructure

Lead the architecture and development of backend services powering AI infrastructure, GPU orchestration, inference, and model lifecycle management while setting technical standards and mentoring engineers across teams.

Go (golang)Cloud-native Backend DevelopmentDistributed SystemsGrpc

Trusted by Remote Workers