Remote Jobs RockRemote Jobs Rock

AI Phone - On-device AI / ML Systems Engineer

πŸ•’ 12 days ago
ML SystemsInference EngineeringPythonC++
Apply Now

πŸ“œ Description

  • Evaluate open-weight and commercial models for on-device execution.
  • Benchmark model performance on target mobile hardware.
  • Integrate models into Android applications and system services.
  • Optimize inference latency, memory consumption, and power usage.
  • Evaluate quantization, compression, and model distillation techniques across CPU, GPU, and NPU acceleration.
  • Build hybrid local/cloud model routing and integrate local models into agent runtimes.

πŸ› οΈ Requirements

  • Strong ML systems or inference engineering experience.
  • Experience deploying and optimizing models.
  • Strong Python and C++ skills.
  • Understanding of neural network inference.
  • Experience with model quantization and performance optimization.
  • Understanding of hardware constraints and inference benchmarks.
  • Experience with on-device LLMs.
  • Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.
  • ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.
  • Android NDK.
Full job description

About

We are reimagining the phone. AI phones need to be proactive, intuitive, intelligent and low cost. This is a mission critical for rest of the world to adopt intelligence.

There are over 5 billion people using everyday applications such as email, messaging, notes, tasks, and calendars, yet most are not AI-native. Our mission is to build proactive applications and devices that bring intelligence into daily conversations, coordination and workflows, with minimal prompting.

Responsibilities

  • Evaluate suitable open-weight and commercially available models for on-device execution.

  • Benchmark model performance on target mobile hardware.

  • Integrate models into Android applications and system services.

  • Optimize inference latency, memory consumption and power usage.

  • Evaluate quantization, compression and model distillation techniques.

  • Work with CPU, GPU and NPU acceleration.

  • Evaluate local model capabilities for different workflows.

  • Build hybrid local/cloud model routing mechanisms.

  • Identify which tasks can be handled locally and which require cloud inference.

  • Work with AI agent engineers to integrate local models into the agent runtime.

Requirements

  • Strong ML systems or inference engineering experience.

  • Experience deploying and optimizing models.

  • Strong Python and C++ skills.

  • Understanding of neural network inference.

  • Experience with model quantization and performance optimization.

  • Understanding of hardware constraints and inference benchmarks.

Nice to have

  • Experience with on-device LLMs.

  • Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.

  • ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.

  • Android NDK.

  • Mobile or edge AI deployment.

  • Multimodal model optimization.

Tensorwave

ML Engineer, Developer Ecosystem

πŸ•’ 3 days ago
TensorwaveπŸ‘₯ 51 - 200 employees🏒 Internet🀝 B2B

Build tutorials, reference solutions, and workshop content that help developers use TensorWave’s AI platform, while evaluating models and frameworks and contributing hands-on ML expertise to events and technical content.

Machine Learning SystemsPythonPytorchHugging Face
Endava

Machine Learning Engineer

πŸ•’ 4 days ago
EndavaπŸ‘₯ 5001 - 10,000 employees🏒 Information Technology And Services

Deploy and operate production machine learning models for a mobile trading app, building reliable serving systems and data pipelines while establishing monitoring, retraining, and deployment practices.

PythonMachine Learning Model DeploymentREST APIsGrpc
Bask Health

Applied ML Engineer, Care Experience

πŸ•’ 5 days ago
Bask HealthπŸ‘₯ 51 - 200 employees🏒 Internet

Build and improve production machine learning features for patient support and care coordination, including request classification, communication tools, workflow routing, and model evaluation with privacy and human oversight.

PythonTypeScriptMachine LearningLarge Language Models
Bask Health

ML Platform Engineer, Evaluation Systems

πŸ•’ 5 days ago
Bask HealthπŸ‘₯ 51 - 200 employees🏒 Internet

Build and operate scalable ML evaluation infrastructure, including orchestration, data pipelines, experiment tracking, and monitoring, so engineering teams can compare models reliably and reproducibly.

PythonTypeScriptMachine Learning EvaluationDistributed Systems
Bask Health

Machine Learning Engineer, Search & Discovery

πŸ•’ 5 days ago
Bask HealthπŸ‘₯ 51 - 200 employees🏒 Internet

Build and improve machine learning-powered search across platform applications, developing retrieval services, semantic and hybrid search, ranking, evaluation, and secure access-aware discovery.

PythonTypeScriptInformation RetrievalSemantic Search

Trusted by Remote Workers