Remote Jobs RockRemote Jobs Rock

AI Phone - On-device AI / ML Systems Engineer

πŸ•’ 10 days ago
ML SystemsInference EngineeringPythonC++
Apply Now

πŸ“œ Description

  • Evaluate open-weight and commercial models for on-device execution.
  • Benchmark model performance on target mobile hardware.
  • Integrate models into Android applications and system services.
  • Optimize inference latency, memory consumption, and power usage.
  • Assess quantization, compression, and distillation techniques, using CPU, GPU, and NPU acceleration.
  • Evaluate local model capabilities and build hybrid local/cloud routing with AI agent engineers.

πŸ› οΈ Requirements

  • Strong ML systems or inference engineering experience.
  • Experience deploying and optimizing models.
  • Strong Python and C++ skills.
  • Understanding of neural network inference.
  • Experience with model quantization and performance optimization.
  • Understanding of hardware constraints and inference benchmarks.
  • Experience with on-device LLMs.
  • Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.
  • ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.
  • Android NDK.
Full job description

About

We are reimagining the phone. AI phones need to be proactive, intuitive, intelligent and low cost. This is a mission critical for rest of the world to adopt intelligence.

There are over 5 billion people using everyday applications such as email, messaging, notes, tasks, and calendars, yet most are not AI-native. Our mission is to build proactive applications and devices that bring intelligence into daily conversations, coordination and workflows, with minimal prompting.

Responsibilities

  • Evaluate suitable open-weight and commercially available models for on-device execution.

  • Benchmark model performance on target mobile hardware.

  • Integrate models into Android applications and system services.

  • Optimize inference latency, memory consumption and power usage.

  • Evaluate quantization, compression and model distillation techniques.

  • Work with CPU, GPU and NPU acceleration.

  • Evaluate local model capabilities for different workflows.

  • Build hybrid local/cloud model routing mechanisms.

  • Identify which tasks can be handled locally and which require cloud inference.

  • Work with AI agent engineers to integrate local models into the agent runtime.

Requirements

  • Strong ML systems or inference engineering experience.

  • Experience deploying and optimizing models.

  • Strong Python and C++ skills.

  • Understanding of neural network inference.

  • Experience with model quantization and performance optimization.

  • Understanding of hardware constraints and inference benchmarks.

Nice to have

  • Experience with on-device LLMs.

  • Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.

  • ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.

  • Android NDK.

  • Mobile or edge AI deployment.

  • Multimodal model optimization.

Faculty

Machine Learning Engineer

πŸ•’ yesterday
FacultyπŸ‘₯ 501 - 1000 employees🏒 Internet

Build and deploy production-grade machine learning systems for retail and consumer clients, shaping scalable architecture and engineering standards while translating complex ML challenges into measurable business outcomes.

Machine LearningPythonScikit-learnTensorflow
Kaizen Labs

AI/ML Engineer

πŸ•’ 2 days ago
Kaizen LabsπŸ‘₯ 11 - 50 employees🏒 Computer Software

Fine-tune and deploy specialized open-weight language models for software engineering tasks, building training pipelines and evaluations that improve model performance, reduce inference costs, and support public-sector applications.

PythonPytorchLanguage Model Fine-tuningOpen-weight Models
Bjak

Machine Learning Engineer, Applied AI

πŸ•’ 4 days ago
BjakπŸ‘₯ 51 - 200 employees🏒 Computer Software

Develop and deploy production machine learning models for classification, ranking, retrieval, and personalisation, improving search relevance and model quality while balancing accuracy, latency, and inference cost.

PythonPytorchJAXMachine Learning
Designworkstalent

Inference Engineer - Member of Technical Staff

πŸ•’ 4 days ago
DesignworkstalentπŸ‘₯ 1 - 10 employees🏒 Staffing And Recruiting

Build and operate production inference systems for large AI models, optimizing throughput, latency, GPU utilization, scalability, and reliability as customer workloads grow.

Machine Learning InferenceModel ServingDistributed SystemsGPU Computing
Designworkstalent

AI Training Infrastructure - Member of Technical Staff

πŸ•’ 4 days ago
DesignworkstalentπŸ‘₯ 1 - 10 employees🏒 Staffing And Recruiting

Build and operate distributed training infrastructure for large AI models, improving GPU-cluster reliability, efficiency, and scale while enabling production training pipelines and researcher workflows.

Distributed TrainingMachine Learning InfrastructureGPU ClustersMulti-node GPU Training

Trusted by Remote Workers