Remote Jobs RockRemote Jobs Rock

Senior GPU Systems & Fabric Engineer

πŸ“… Aug 25
Linux Kernel InternalsGoNVIDIA GpusAMD Gpus
Apply Now

πŸ“œ Description

  • Integrate NVIDIA and AMD GPU device plugins and Kubernetes Operators to expose hardware capabilities.
  • Configure and optimize host networking with RDMA, SR-IOV, RoCEv2, and InfiniBand for distributed AI training.
  • Build telemetry-driven remediation pipelines to detect and recover degraded GPU and NIC components.
  • Implement GPU slicing with MIG and vGPU to support multi-tenant inference and improve cluster utilization.
  • Tune kernels, drivers, CUDA, and NCCL to resolve performance bottlenecks in containerized AI workloads.
  • Set bare-metal operating standards, investigate cross-stack performance issues, and mentor team members.

πŸ› οΈ Requirements

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or related field.
  • 5+ years of systems engineering experience, with strong proficiency in Linux kernel internals, C, or Go.
  • Hands-on experience with GPU architectures (NVIDIA H100/A100), CUDA runtimes, and distributed networking (RDMA, InfiniBand).
  • Deep understanding of containerized environments and Kubernetes device plugin architecture.
  • Proven track record of operating, debugging, and scaling bare-metal systems in large-scale production or HPC environments.
  • Familiarity with infrastructure automation (e.g., Terraform, Ansible, CI/CD pipelines) for managing hardware lifecycles.
  • Strong problem-solving skills, with the ability to navigate ambiguous performance challenges at the intersection of hardware and software.
  • Excellent communication skills, with a collaborative approach to working across infrastructure, scheduling, and reliability teams.
  • Experience working in high-velocity, high-growth engineering environments is strongly preferred
Full job description

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.

To learn more, visit https://ir.bitdeer.com/

Position Overview

We are seeking a Senior GPU Systems & Fabric Engineer to serve as the critical bridge between our physical GPU/network infrastructure and the Kubernetes abstraction layer. You will be responsible for creating the high-performance 'hardware foundation' that makes AI-native cloud computing possible. This role requires deep expertise in Linux kernel internals, GPU architectures, and high-speed interconnects, as you will be tasked with transforming raw, bare-metal compute resources into scalable, resilient, and multi-tenant cloud primitives. You will drive the design of our fabric layer, ensuring that our AI workloads have the low-latency, high-bandwidth environment they require to perform at industry-leading speeds.

Key Responsibilities

  • Architect and maintain integrations for NVIDIA/AMD GPU device plugins and Kubernetes Operators to expose hardware capabilities to the control plane.
  • Configure and optimize high-performance host networking stacks, including RDMA, SR-IOV, RoCEv2, and InfiniBand, ensuring line-rate throughput for distributed AI training.
  • Build and manage automated hardware remediation pipelines using DCGM telemetry to proactively identify, isolate, and reset degraded GPU/NIC components before they impact production jobs.
  • Implement and manage sophisticated GPU slicing technologies (MIG, vGPU) to enable efficient multi-tenant inference workloads and maximize cluster utilization.
  • Profile and tune kernel-level parameters, device drivers, and runtime libraries (CUDA, NCCL) to resolve bottlenecks and optimize containerized AI workloads.
  • Collaborate with the Scheduling and Storage engineering teams to ensure topology-aware placement and efficient data movement across the fabric.
  • Define and enforce operational standards for bare-metal provisioning, BIOS/firmware updates, and OS hardening within the containerized environment.
  • Lead technical investigations into complex performance issues spanning hardware, fabric, and software, providing actionable architectural insights.
  • Mentor team members and drive documentation standards for our evolving AI hardware stack.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or related field.
  • 5+ years of systems engineering experience, with strong proficiency in Linux kernel internals, C, or Go.
  • Hands-on experience with GPU architectures (NVIDIA H100/A100), CUDA runtimes, and distributed networking (RDMA, InfiniBand).
  • Deep understanding of containerized environments and Kubernetes device plugin architecture.
  • Proven track record of operating, debugging, and scaling bare-metal systems in large-scale production or HPC environments.
  • Familiarity with infrastructure automation (e.g., Terraform, Ansible, CI/CD pipelines) for managing hardware lifecycles.
  • Strong problem-solving skills, with the ability to navigate ambiguous performance challenges at the intersection of hardware and software.
  • Excellent communication skills, with a collaborative approach to working across infrastructure, scheduling, and reliability teams.
  • Experience working in high-velocity, high-growth engineering environments is strongly preferred

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

Hex

Software Engineer, Infrastructure

πŸ•’ 2 days ago
HexπŸ‘₯ 201 - 500 employees🏒 Computer Software

Own infrastructure projects that improve CI/CD, single-tenant stack lifecycle, database performance, cost visibility, security, and customer-facing platform capabilities across Hex’s production systems.

KubernetesAWSEKSRDS
Kit

Senior Infrastructure Engineer II

πŸ•’ 3 days ago
KitπŸ‘₯ 51 - 200 employees🏒 Consumer Goods

Own and improve core production infrastructure across AWS, databases, Kubernetes, and platform tooling, while building safe self-service paths and strengthening reliability, observability, and on-call operations.

AWSManaged Relational DatabasesNetworkingLoad Balancing
BlackSky

Senior Software Engineer, Infrastructure

πŸ•’ 3 days ago
BlackSkyπŸ‘₯ 201 - 500 employees🏒 Defense & Space

Own and improve build systems, CI/CD pipelines, cloud infrastructure, and developer tools for embedded software, while supporting testing and releases across mission-critical programs.

PythonBashC/C++Git
Axion

Senior Infrastructure Engineer

πŸ•’ 6 days ago
AxionπŸ‘₯ 201 - 500 employees🏒 Computer Software

Backed by leading investors, including Bessemer Venture Partners, Amplo, Boeing, and RTX Ventures, Axion is poised to lead the quality revolution in manufacturing.

GCPKubernetesTerraformCI/CD Pipelines
Emerging Travel Group

Senior Big Data Infrastructure Engineer

πŸ•’ 11 days ago
Emerging Travel GroupπŸ‘₯ 501 - 1000 employees🏒 Travel Technology

As a Big Data Infrastructure Engineer, you'll lead the big data infrastructure, deploying and operating core services while driving significant architectural changes.

πŸ“ πŸ‡°πŸ‡Ώ Kazakhstan +3 - Remote?πŸ’Ό Full-Time🎸 SeniorπŸ§‘β€πŸŽ¨ Infrastructure EngineerπŸ“’ πŸ‡¬πŸ‡§ English Required
Big DataHDFSApache OzoneIceberg

Trusted by Remote Workers