Remote Jobs RockRemote Jobs Rock

Senior Machine Learning Engineer - Perception

๐Ÿ“… May 20, 2025
Machine LearningPerceptionFused Sensor DataDetection Models
Apply Now

๐Ÿ“œ Description

  • Design and implement detection models using fused sensor data, including joint detection and tracking approaches.
  • Train machine learning models and evaluate state-of-the-art methods, ablations, and model modifications.
  • Document experimental results and work toward deploying models into Zoox robots.
  • Visualize model inputs and outputs to identify and understand issues.
  • Collaborate with ML optimization, data labeling, metrics, and planner teams to support successful releases.

๐Ÿ› ๏ธ Requirements

  • MS/PhD in Computer Science or related field
  • Experience with PyTorch or related ML frameworks
  • Experience deploying learned models into production
  • Excellent collaboration and teamwork skills with proven track record of working on large-scale problems
  • Prior experience in the AV or related space with joint detection and tracking models
  • Deep understanding of how to setup end-to-end training and evaluation processes
Full job description
As a Perception Engineer, you will be instrumental in designing and implementing cutting-edge detection models, utilizing fused sensor data. In particular, the role will be on advanced projects that are aimed at the next generation of driving software, including looking at joint detection and tracking models as well as ways to send rich embeddings to downstream models to relay semantic meaning and capture uncertainty.
This role offers a unique opportunity to directly impact Zoox's expansion into new areas. By developing more generalizable and adaptable models, you will help us navigate diverse and challenging circumstances, accelerating our mission to deliver safe and reliable autonomous mobility. We are looking for a highly motivated individual passionate about pushing the boundaries of perception in the autonomous vehicle space.
About Zoox Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. Weโ€™re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team. Follow us on LinkedIn Accommodations If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter. A Final Note: You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

In this role, you will:

  • Train ML models, perform various studies into incorporating SOTA approaches as well as ablations/modifications of existing models
  • Document experimental outcomes and drive towards deploying these models into Zoox robots
  • Visualize your data at the input and output to understand the issues
  • Collaborate with teams such as ML optimization, data labeling, metrics and planner to ensure project is successful for Zoox releases
  • Qualifications

  • MS/PhD in Computer Science or related field
  • Experience with PyTorch or related ML frameworks
  • Experience deploying learned models into production
  • Excellent collaboration and teamwork skills with proven track record of working on large-scale problems
  • Bonus Qualifications

  • Prior experience in the AV or related space with joint detection and tracking models
  • Deep understanding of how to setup end-to-end training and evaluation processes
  • Faculty

    Senior Machine Learning Engineer

    ๐Ÿ•’ yesterday
    Faculty๐Ÿ‘ฅ 501 - 1000 employees๐Ÿข Internet

    Lead the development and deployment of production-grade machine learning systems, shaping architecture and engineering standards while advising clients and mentoring engineers.

    Machine LearningPythonTensorflowPytorch
    Scandit

    Senior Machine Learning Engineer - Video Understanding

    ๐Ÿ•’ 4 days ago
    Scandit๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Computer Software

    Lead technical discovery and development of video-based computer vision systems for retail, building end-to-end ML pipelines and action-recognition models while validating performance and production constraints.

    Computer VisionMachine LearningVideo UnderstandingAction Recognition
    Scandit

    Senior Machine Learning Engineer - Video Understanding

    ๐Ÿ•’ 4 days ago
    Scandit๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Computer Software

    Lead the 0-to-1 development of video-based computer vision systems for retail, owning technical experiments, data workflows, model development and deployment to deliver robust action recognition in live environments.

    Computer VisionMachine LearningVideo UnderstandingHuman Action Recognition
    Scandit

    Senior Machine Learning Engineer - Video Understanding

    ๐Ÿ•’ 4 days ago
    Scandit๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Computer Software

    Lead the technical discovery and development of video-based computer vision systems, building end-to-end ML pipelines and production-ready action recognition models for real-world retail environments.

    Computer VisionMachine LearningVideo UnderstandingAction Recognition
    Scandit

    Senior Machine Learning Engineer - Video Understanding

    ๐Ÿ•’ 4 days ago
    Scandit๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Computer Software

    Leads technical discovery and development of video-based computer vision systems, building end-to-end ML pipelines and production-ready action recognition models for real-world retail environments.

    Computer VisionMachine LearningVideo UnderstandingHuman Action Recognition

    Trusted by Remote Workers