Remote Jobs RockRemote Jobs Rock

AWS Trainium / NKI Kernel Expert

📅 Sep 15
AWS TrainiumInferentia2Neuron Kernel Interface (nki)CUDA
Apply Now

📜 Description

  • Review NKI kernel correctness and Trainium-specific development patterns.
  • Evaluate CUDA-to-NKI kernel migrations and cross-platform numerical correctness.
  • Assess Trainium performance optimization, profiling, and benchmarking.
  • Review memory management across SBUF, PSUM, and HBM, plus tile-based computation and DMA scheduling.
  • Identify Trainium-specific performance bottlenecks and optimization opportunities.
  • Provide clear technical feedback on kernel implementations and their quality.

🛠️ Requirements

  • 2+ years of hands-on experience developing or optimizing kernels with the Neuron Kernel Interface (NKI)
  • Experience working with AWS Trainium and/or Inferentia2
  • Strong understanding of:Tile-based computationSBUF / PSUM / HBM memory hierarchyPartition dimension constraintsDMA orchestrationTrainium-specific optimization techniques
  • Ability to evaluate CUDA → NKI migrations
  • Experience profiling and optimizing workloads on Trainium
  • Understanding of numerical differences across GPU and Trainium backends
  • Strong ability to analyze complex technical implementations and provide clear written feedback
  • Experience with the AWS Neuron SDK or Neuron Compiler
  • CUDA or Triton kernel development experience
  • Knowledge of NeuronCore-v2 architecture
Full job description

Anyone AI is recruiting experienced AWS Trainium / Neuron Kernel Interface (NKI) engineers for a specialized project focused on evaluating and improving kernel development tasks for AI workloads.

We’re looking for engineers with hands-on experience building or optimizing NKI kernels on AWS Trainium or Inferentia2 hardware who understand how Trainium’s architecture differs from traditional GPU programming.

What You’ll Work On

You’ll review and evaluate technical tasks involving:

  • NKI kernel correctness and Trainium-specific development patterns

  • CUDA → NKI kernel migrations

  • Trainium performance optimization and benchmarking

  • Memory management across SBUF, PSUM, and HBM

  • Tile-based computation and DMA scheduling

  • Cross-platform numerical correctness between CUDA/Triton and NKI

  • Trainium-specific performance bottlenecks and optimization opportunities

  • Technical feedback and quality assessment of kernel implementations

The work involves determining whether implementations are not only technically correct, but also idiomatic and optimized for Trainium hardware rather than simply translated from GPU-based approaches.

What We’re Looking For

  • 2+ years of hands-on experience developing or optimizing kernels with the Neuron Kernel Interface (NKI)

  • Experience working with AWS Trainium and/or Inferentia2

  • Strong understanding of:

    • Tile-based computation

    • SBUF / PSUM / HBM memory hierarchy

    • Partition dimension constraints

    • DMA orchestration

    • Trainium-specific optimization techniques

  • Ability to evaluate CUDA → NKI migrations

  • Experience profiling and optimizing workloads on Trainium

  • Understanding of numerical differences across GPU and Trainium backends

  • Strong ability to analyze complex technical implementations and provide clear written feedback

Nice to Have

  • Experience with the AWS Neuron SDK or Neuron Compiler

  • CUDA or Triton kernel development experience

  • Knowledge of NeuronCore-v2 architecture

  • Experience with FP32, BF16, FP8, and INT8 workloads

  • Experience benchmarking workloads on Trn1 or Trn2 instances

  • Familiarity with nki.language, @nki.jit, or XLA custom calls

  • Experience with technical evaluation, AI/ML data projects, RLHF, or rubric-based assessment

Engagement

Work Type: Remote
Engagement: Part-time, project-based consulting
Focus: AWS Trainium / NKI kernel engineering and technical evaluation

This is a strong fit for engineers who have worked deeply with AWS Trainium infrastructure and low-level ML kernel optimization and are interested in applying that expertise to technically challenging AI projects.

Globalhitss

Hitss | Arquiteto de Soluções de IA Generativa

🕒 2 days ago
Globalhitss👥 1001 - 5000 employees🏢 Information Technology

Projeta e implementa uma solução conversacional de FinOps com IA generativa, integrando dados e ferramentas corporativas e garantindo respostas confiáveis por meio de RAG, governança, segurança e monitoramento.

Microsoft Copilot StudioAzure AI FoundryModelos De Linguagem (llms)Retrieval-augmented Generation (rag)
WeAssist

AI Automation Engineer (Voice AI & Middleware Integration) - Pod 4

🕒 2 days ago
WeAssist👥 11 - 50 employees🏢 Consumer Services

Build and maintain production voice agents, middleware, and automations that connect AI platforms with field-service systems, turning customer conversations into booked jobs while ensuring reliable, secure operations.

📍 🇵🇭 Philippines +2 - Remote?💼 Full-Time🎹 Mid-level🤖 AI Engineer📢 🇬🇧 English Required
JavaScriptTypeScriptVoice AI AgentsVapi
WeAssist

AI Automation Engineer (P3)

🕒 3 days ago
WeAssist👥 11 - 50 employees🏢 Consumer Services

Build and maintain production voice AI agents, middleware integrations, and automations that turn contractor calls into booked jobs, while owning reliability, client onboarding, security, and technical documentation.

Voice AI AgentsVapiRetellAssistable
Bask Health

Software Engineer, AI Platform

🕒 3 days ago
Bask Health👥 51 - 200 employees🏢 Internet

Build and operate shared backend infrastructure for AI applications, including model integrations, inference services, secure data access, observability, and reusable tools that help engineering teams ship reliable AI capabilities.

Backend EngineeringTypeScriptJavaScriptPython

Trusted by Remote Workers