Remote Jobs RockRemote Jobs Rock

DevOps Engineer (AI Inference)

🕒 16 days ago
KubernetesLinuxNetworkingPython

📜 Description

  • Design, develop, and maintain infrastructure for AI inference workloads, including GPU scheduling and model deployment pipelines.
  • Build and manage monitoring and observability tools for AI inference platforms, including dashboards and alerts.
  • Collaborate with ML engineers and platform teams to design system architecture for AI workloads.
  • Integrate inference runtimes and test performance at scale.

🛠️ Requirements

  • Strong understanding of Kubernetes architecture, including CNI, CSI, and control plane components.
  • Hands-on experience operating and troubleshooting production Kubernetes clusters.
  • Strong Linux and networking troubleshooting skills, including DNS and routing.
  • Ability to develop automation and operational tooling using Python, Go, or Bash.
  • Experience with Terraform, Ansible, or similar IaC/configuration management tools.
  • Experience with monitoring tools like VictoriaMetrics/Grafana.

Benefits

  • Flexible working hours and hybrid or remote options, depending on your role
  • Private medical insurance for you and your family*
  • Extra paid vacation and sick leave days*

Trusted by Remote Workers