Remote Jobs RockRemote Jobs Rock

Senior Software Engineer - Infrastructure Storage

๐Ÿ“… Jul 16
Distributed SystemsStorage SystemsNFSSMB

๐Ÿ“œ Description

  • Design, develop, and maintain software for storage systems, focusing on performance, scalability, and reliability.
  • Implement and optimize storage protocol APIs for file (e.g., NFS, SMB), block (e.g., iSCSI, Fibre Channel), and object (e.g., S3) access.
  • Develop distributed systems for managing and orchestrating storage resources across multiple storage solutions and redundant arrays.
  • Collaborate with hardware and system architects to integrate software with various storage solutions, including NVMe and GPU-direct storage.
  • Troubleshoot and debug complex issues in a production data center environment.
  • Contribute to the full software development lifecycle, from requirements gathering and design to deployment and maintenance.

๐Ÿ› ๏ธ Requirements

  • gathering and design to deployment and maintenance.
  • You Have:
  • Bachelor's or Master's degree in Computer Science or a related field.
  • 5+ years of experience in software development for storage systems.
  • Proven experience with distributed systems programming and concepts such as load balancers, data-durability, consensus algorithms, fault tolerance, and data consistency.
  • Strong programming skills in languages such as C, C++, Go, or Python.

โœจ Benefits

  • Generous cash & equity compensation โ€ข Health
  • Vision coverage for you and your dependents โ€ข Wellness and commuter stipends for select roles โ€ข 401k Plan with 2% company match (USA
Full job description

Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers. Our customers range from AI researchers to enterprises and hyperscalers. Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence. One person, one GPU.

If you'd like to build the world's best AI cloud, join us.

*Note: This position requires presence in our San Francisco, San Jose, or Bellevue office location 4 days per week; Lambdaโ€™s designated work-from-home day is currently Tuesday.

In the world of distributed AI training and inference, raw GPU and CPU horsepower is just a part of the story. High-performance networking and storage are the critical components that enable and unite these systems, making groundbreaking AI training and inference possible.

The Lambda Infrastructure Engineering organization forges the foundation of high-performance AI clusters by welding together the latest in AI storage, networking, GPU and CPU hardware.

Our expertise lies at the intersection of:

  • High-Performance Distributed Storage Solutions and Protocols: We engineer the protocols and systems that serve massive datasets at the speeds demanded by modern clustered GPUs.

  • Dynamic Networking: We design advanced networks that provide multi-tenant security and intelligent routing without compromising performance, using the latest in AI networking hardware.

  • Compute Clustering and Virtualization: We enable cutting-edge virtualization and clustering that allows AI researchers and engineers to focus on AI workloads, not AI infrastructure, unleashing the full compute bandwidth of clustered GPUs.

AI training and inference relies on petabytes of data hosted on large, high-performance storage arrays. At Lambda, the Infrastructure Storage Teamโ€™s job is to ensure that the data powering AI is fast, performant, and available across a variety of access protocols (fit for purpose).

We're looking for an experienced Senior Software Engineer to join our storage team. You'll join a team responsible for developing and implementing storage software for our next-generation on-premise storage solutions. This role requires expertise in distributed systems, and an in-depth understanding of file, block, and object storage protocols. You'll work on building scalable and resilient storage services that power our AI and machine learning infrastructure.

What Youโ€™ll Do:

  • Design, develop, and maintain software for storage systems, focusing on performance, scalability, and reliability.

  • Implement and optimize storage protocol APIs for file (e.g., NFS, SMB), block (e.g., iSCSI, Fibre Channel), and object (e.g., S3) access.

  • Develop distributed systems for managing and orchestrating storage resources across multiple storage solutions and redundant arrays.

  • Collaborate with hardware and system architects to integrate software with various storage solutions, including NVMe and GPU-direct storage.

  • Troubleshoot and debug complex issues in a production data center environment.

  • Contribute to the full software development lifecycle, from requirements gathering and design to deployment and maintenance.

You Have:

  • Bachelor's or Master's degree in Computer Science or a related field.

  • 5+ years of experience in software development for storage systems.

  • Proven experience with distributed systems programming and concepts such as load balancers, data-durability, consensus algorithms, fault tolerance, and data consistency.

  • Strong programming skills in languages such as C, C++, Go, or Python.

  • Deep understanding of storage protocols, including:

    • File: NFS, SMB, Lustre

    • Block: iSCSI, Fibre Channel

    • Object: S3, Swift

  • Experience with Linux kernel internals and system-level programming.

  • Familiarity with containerization technologies like Docker and Kubernetes and running production workloads in these environments.

  • Familiarity with CI/CD and QA practices for distributed systems development environments.

Nice to Have

  • Experience with AI/ML workloads and the unique storage challenges they present.

  • Knowledge of data center networking and high-speed interconnects (e.g., InfiniBand, RoCE).

  • Experience with performance tuning and optimization of storage systems.

  • Familiarity with hardware acceleration technologies, specifically GPUs and DPUs.

Salary Range Information

Based on market data and other factors, the annual salary range for this position is. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

About Lambda

  • Founded in 2012, with 500+ employees, and growing fast

  • Our investors notably include TWG Global, US Innovative Technology Fund (USIT), Andra Capital, SGW, Andrej Karpathy, ARK Invest, Fincadia Advisors, G Squared, In-Q-Tel (IQT), KHK & Partners, NVIDIA, Pegatron, Supermicro, Wistron, Wiwynn, Gradient Ventures, Mercato Partners, SVB, 1517, and Crescent Cove

  • We have research papers accepted at top machine learning and graphics conferences, including NeurIPS, ICCV, SIGGRAPH, and TOG

  • Our values are publicly available: https://lambda.ai/careers

  • We offer generous cash & equity compensation

  • Health, dental, and vision coverage for you and your dependents

  • Wellness and commuter stipends for select roles

  • 401k Plan with 2% company match (USA employees)

  • Flexible paid time off plan that we all actually use

Equal Opportunity Employer

Lambda is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.

Cloudflare

Senior Software Engineer - Quicksilver - Distributed Key Value

Cloudflare๐Ÿ‘ฅ 10,000+ employees๐Ÿข Computer And Network Security๐Ÿค B2B
๐Ÿ•’ yesterday

As a Senior Software Engineer for Quicksilver, you will enhance a globally distributed key-value store, tackling complex challenges while ensuring high performance and reliability.

GoDistributed SystemsStorage SystemsPeer-to-peer Systems
Cloudflare

Senior Software Engineer, Security Rules

Cloudflare๐Ÿ‘ฅ 10,000+ employees๐Ÿข Computer And Network Security๐Ÿค B2B
๐Ÿ•’ yesterday

As a Senior Software Engineer on the Security Rules team, you will design and maintain software systems for Cloudflare's Application Security products, leading complex projects and mentoring fellow engineers.

RustGoC++Distributed Systems
Brevo

Senior Software Engineer - PRO

Brevo๐Ÿ‘ฅ 501 - 1000 employees๐Ÿข Internet
๐Ÿ•’ yesterday

As a Senior Software Engineer, you will leverage your expertise in Go and React to drive complex product initiatives, shape solutions, and enhance our high-throughput microservices ecosystem.

Go (golang)React.jsMicroservicesDistributed Systems
Harvey

Staff Software Engineer, Model Infrastructure

Harvey๐Ÿ‘ฅ 10,000+ employees๐Ÿข Software Development๐Ÿค B2B
๐Ÿ•’ yesterday

As a Staff Software Engineer on the Model Infrastructure team, you'll lead the design and development of systems that ensure high availability and operational excellence for AI inference at Harvey.

Software EngineeringDistributed SystemsCloud InfrastructureNetworking
Harvey

Senior Software Engineer, Model Infrastructure

Harvey๐Ÿ‘ฅ 10,000+ employees๐Ÿข Software Development๐Ÿค B2B
๐Ÿ•’ yesterday

As a Staff Software Engineer on the Model Infrastructure team, you'll design and develop systems that ensure high availability and operational excellence for AI requests at Harvey.

Software EngineeringDistributed SystemsCloud InfrastructureNetworking

Trusted by Remote Workers