Remote Jobs RockRemote Jobs Rock

Senior Staff Machine Learning Engineer - Perception

πŸ“… Nov 12, 2024
Machine LearningDeep LearningComputer VisionSensor Data
Apply Now

πŸ“œ Description

  • Develop algorithms to understand scenes around the robot and how they evolve over time.
  • Build multimodal foundation models for on-vehicle and offline applications.
  • Apply generative AI to simulation to improve offline validation realism.
  • Use large-scale machine learning infrastructure to explore and develop new solutions.
  • Mentor ML developers and collaborate with Prediction, Planning, and Simulation teams.
  • Prototype cross-team approaches that influence technical direction and autonomy milestones.

πŸ› οΈ Requirements

  • BS, MS, or PhD degree in computer science or related field
  • Experience with training and deploying Deep Learning models on sensor data-Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
  • Experience with modern computer vision techniques
  • Strong mathematical skills and understanding of probabilistic techniques
  • Fluency in C++ or Fluency in Python with a basic understanding of C++
  • Extensive experience with programming and algorithm design-Strong mathematics skills
  • Publications in your field (CVPR, ICCV, RSS, ICRA preferred)
  • Experience with autonomous robots
  • Experience with realtime sensor fusion (e.g. LiDAR, camera, radar)
  • Experience with novel pipelines and architectures for convolutional neural nets
Full job description
Our Perception team is responsible for using our sensor data to understand the complex and dynamic environments where we drive. In this role, you will have access to the best sensor data in the world and an incredible infrastructure for testing and validating your algorithms. We are creating new algorithms for segmentation, tracking, classification, and high-level scene understanding, and you could work on any (or all!) of these components.
As a Senior Staff ML Engineer, you will lead the development of machine learning algorithms that can range in influence from onboard autonomy to offboard autonomy and validation. You will collaborate closely with other teams specializing in Prediction, Planning, Simulation, and Safety Validation, influencing our overall technical stack. Your role will look at problems in a way that crosses team boundaries to prototype new approaches that influence the long term technical direction of multiple organizations within the company. The impact of the role can be in the form of impacting immediate company milestones to leading forward-looking exploratory projects.
About Zoox Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team. Follow us on LinkedIn Accommodations If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter. A Final Note: You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

Responsibilities

  • Develop new algorithms to understand the scene around the robot, and how that scene would evolve through time
  • Build multi-modal foundation models for on-vehicle and offline applications
  • Develop new algorithms to apply generative AI to simulation to improve the realism of our offline validation systems
  • Leverage our large-scale machine learning infrastructure to discover new solutions and push the boundaries of the field
  • Provide technical mentorship to the broader group of ML developers at Zoox
  • Collaborate with engineers on Prediction, Planning, and Simulation to solve the overall Autonomous Driving problem in complex urban environments
  • Qualifications

  • BS, MS, or PhD degree in computer science or related field
  • Experience with training and deploying Deep Learning models on sensor data-Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
  • Experience with modern computer vision techniques
  • Strong mathematical skills and understanding of probabilistic techniques
  • Fluency in C++ or Fluency in Python with a basic understanding of C++
  • Extensive experience with programming and algorithm design-Strong mathematics skills
  • Bonus Qualifications

  • Publications in your field (CVPR, ICCV, RSS, ICRA preferred)
  • Experience with autonomous robots
  • Experience with realtime sensor fusion (e.g. LiDAR, camera, radar)
  • Experience with novel pipelines and architectures for convolutional neural nets
  • Experience with 3D data and representations (pointclouds, meshes, etc.)
  • Chime

    Staff AI/ML Engineer

    πŸ•’ 8 days ago
    ChimeπŸ‘₯ 10,000+ employees🏒 Financial Services

    Lead end-to-end development of production machine learning systems for cash-flow underwriting, shaping technical direction and turning transaction data into fair, accurate credit decisions and measurable member outcomes.

    Machine LearningDeep LearningCredit UnderwritingCash-flow Modeling
    Wayve

    Machine Learning Engineer, Application Software

    πŸ•’ 21 days ago
    WayveπŸ‘₯ 501 - 1000 employees🏒 Computer Software

    Lead the development and production deployment of machine-learning driving behaviours, improving autonomous driving performance through model architecture, data pipelines, evaluation, and cross-team technical leadership.

    Machine LearningDeep LearningSequential ModelsControl
    Plaid

    Staff Machine Learning Engineer (Research Scientist) - DFAI

    πŸ•’ 2 days ago
    PlaidπŸ‘₯ 10,000+ employees🏒 Software Development

    Lead the technical strategy and end-to-end development of foundation models, from data curation and pretraining through production serving, evaluation, and monitoring, while guiding teams across Plaid.

    Machine LearningFoundation ModelsTransformersLLMs
    Faculty

    Lead Machine Learning Engineer (Safety)

    πŸ•’ 2 days ago
    FacultyπŸ‘₯ 501 - 1000 employees🏒 Internet

    Leads the strategy, architecture, and deployment of secure, scalable machine learning systems, advancing AI safety evaluations and multi-agent tooling while advising clients and mentoring engineering teams.

    Machine LearningLarge Language ModelsAI Safety EvaluationMulti-agent Systems
    Pinterest

    Staff Machine Learning Engineer, Ads Conversion Core Modeling

    πŸ•’ 7 days ago
    PinterestπŸ‘₯ 5001 - 10,000 employees🏒 Computer Software

    Leads technical direction for ads conversion machine learning, building low-latency, large-scale prediction models and using text, visual, and user signals to improve ad products.

    Machine LearningApplied Machine LearningDeep Neural Networks (dnns)Ads Conversion Modeling

    Trusted by Remote Workers