Remote Jobs RockRemote Jobs Rock

AI Phone - On-device AI / ML Systems Engineer

πŸ•’ 10 days ago
ML SystemsInference EngineeringPythonC++
Apply Now

πŸ“œ Description

  • Evaluate open-weight and commercial models for on-device execution.
  • Benchmark model performance on target mobile hardware.
  • Integrate models into Android applications and system services.
  • Optimize inference latency, memory use, and power consumption.
  • Evaluate quantization, compression, and model distillation techniques; work with CPU, GPU, and NPU acceleration.
  • Build hybrid local/cloud model routing and integrate local models into the agent runtime.

πŸ› οΈ Requirements

  • Strong ML systems or inference engineering experience.
  • Experience deploying and optimizing models.
  • Strong Python and C++ skills.
  • Understanding of neural network inference.
  • Experience with model quantization and performance optimization.
  • Understanding of hardware constraints and inference benchmarks.
  • Experience with on-device LLMs.
  • Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.
  • ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.
  • Android NDK.
Full job description

About

We are reimagining the phone. AI phones need to be proactive, intuitive, intelligent and low cost. This is a mission critical for rest of the world to adopt intelligence.

There are over 5 billion people using everyday applications such as email, messaging, notes, tasks, and calendars, yet most are not AI-native. Our mission is to build proactive applications and devices that bring intelligence into daily conversations, coordination and workflows, with minimal prompting.

Responsibilities

  • Evaluate suitable open-weight and commercially available models for on-device execution.

  • Benchmark model performance on target mobile hardware.

  • Integrate models into Android applications and system services.

  • Optimize inference latency, memory consumption and power usage.

  • Evaluate quantization, compression and model distillation techniques.

  • Work with CPU, GPU and NPU acceleration.

  • Evaluate local model capabilities for different workflows.

  • Build hybrid local/cloud model routing mechanisms.

  • Identify which tasks can be handled locally and which require cloud inference.

  • Work with AI agent engineers to integrate local models into the agent runtime.

Requirements

  • Strong ML systems or inference engineering experience.

  • Experience deploying and optimizing models.

  • Strong Python and C++ skills.

  • Understanding of neural network inference.

  • Experience with model quantization and performance optimization.

  • Understanding of hardware constraints and inference benchmarks.

Nice to have

  • Experience with on-device LLMs.

  • Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.

  • ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.

  • Android NDK.

  • Mobile or edge AI deployment.

  • Multimodal model optimization.

Endava

Machine Learning Engineer

πŸ•’ 2 days ago
EndavaπŸ‘₯ 5001 - 10,000 employees🏒 Information Technology And Services

Deploy and operate production machine learning models for a mobile trading app, building reliable serving systems and data pipelines while establishing monitoring, retraining, and deployment practices.

PythonMachine Learning Model DeploymentREST APIsGrpc
Bask Health

Applied ML Engineer, Care Experience

πŸ•’ 3 days ago
Bask HealthπŸ‘₯ 51 - 200 employees🏒 Internet

Build and improve production machine learning features for patient support and care coordination, including request classification, communication tools, workflow routing, and model evaluation with privacy and human oversight.

PythonTypeScriptMachine LearningLarge Language Models
Bask Health

ML Platform Engineer, Evaluation Systems

πŸ•’ 3 days ago
Bask HealthπŸ‘₯ 51 - 200 employees🏒 Internet

Build and operate scalable ML evaluation infrastructure, including orchestration, data pipelines, experiment tracking, and monitoring, so engineering teams can compare models reliably and reproducibly.

PythonTypeScriptMachine Learning EvaluationDistributed Systems
Bask Health

Machine Learning Engineer, Search & Discovery

πŸ•’ 3 days ago
Bask HealthπŸ‘₯ 51 - 200 employees🏒 Internet

Build and improve machine learning-powered search across platform applications, developing retrieval services, semantic and hybrid search, ranking, evaluation, and secure access-aware discovery.

PythonTypeScriptInformation RetrievalSemantic Search
Bask Health

ML Systems Engineer

πŸ•’ 3 days ago
Bask HealthπŸ‘₯ 51 - 200 employees🏒 Internet

Build and operate production infrastructure for machine learning services, including model serving, deployment pipelines, inference workflows, monitoring, and reliability safeguards across healthcare-related applications.

PythonTypeScriptMachine Learning Operations (mlops)Model Serving

Trusted by Remote Workers