Design, build, and validate perception systems for autonomous vehicles, developing computer vision and autonomy software and integrating it into real-world platforms through hardware/software co-development.
Perception Engineer
📜 Description
- Design, train, and deploy models for person detection, tracking, pose and gesture recognition, emotion recognition, and scene understanding.
- Build data collection, labeling, evaluation, debugging, and monitoring tools and pipelines.
- Improve reliability across varied lighting, environments, and user behaviors through data-driven iteration.
- Optimize models for real-time edge inference, balancing latency, accuracy, and power use.
- Integrate multimodal inputs from RGB and depth cameras, IMUs, and audio with robot behavior, controls, and firmware.
- Develop the perception architecture and apply research advances to improve how the robot understands and interacts with people.
🛠️ Requirements
- Degree in Computer Engineering, Computer Science, Robotics, Electrical Engineering, or a related field, and 3+ years of hands-on experience.
- Proficiency in Python and comfort working in C++.
- Experience training and deploying machine learning models with PyTorch, TensorFlow, ONNX, or similar tools.
- Experience with computer vision tasks such as detection, tracking, pose estimation, segmentation, gesture recognition, or activity understanding.
- Experience deploying and optimizing models for edge devices and real-world systems.
- Understanding of dataset collection, labeling, and maintenance.
- Ability to document clearly, debug machine learning systems, and drive issues to resolution.
Full job description
Human Computer Lab is a research lab building character robots that feel alive and responsive. Our first robot, LeLamp, explores a new category of consumer robotics where everyday objects become interactive and help us reshape our attachment to technology.
Our goal is to push the frontier of human-robot interaction by making technology more legible, emotionally intuitive, and human-centered. We are building the foundation for a new generation of robots designed for everyday environments.
What to Expect
We are looking for a hands-on Perception Engineer who can build the system that allows our robot to understand people and the world around it. You will work on developing computer vision and machine learning system at the core of the robot’s awareness, enabling it to recognize people, understand gestures, track attention, and respond naturally in real time. The liveliness of our robot will truly convey the character interface that we are building that can learn and adapt as required.
This role sits at the intersection of robotics, machine learning, and software engineering. You will work closely with the CEO and the founding team to develop perception capabilities from prototype to deployment, collecting data, training models, optimizing performance, and integrating the stack directly into the robot's behavior.
In this Role, You Will:
Design, train, and deploy computer vision and perception models for person detection, tracking, pose estimation, gesture recognition, emotion recognition and scene understanding.
Develop data collection, labeling, and evaluation pipelines to improve model performance and reliability.
Build perception systems that operate robustly across varying lighting conditions, environments, and user behaviors.
Optimize models for real-time inference on edge hardware while balancing latency, accuracy, and power constraints.
Work with RGB cameras, depth sensors, IMUs, audio inputs, and other sensor modalities to create multi-modal perception systems.
Develop tools for dataset management, model evaluation, debugging, and monitoring.
Support integration between perception, behavior, controls, and firmware systems.
Stay updated with state-of-the-art research to develop architectures and techniques that can improve the robot’s ability to understand and interact with people.
Debug perception failures systematically and close the loop through data-driven improvements.
Help define and evolve the platform’s perception architecture as the robot grows in capability.
You May Be a Good Fit If You:
Have a degree in Computer Engineering, Computer Science, Robotics, Electrical Engineering, or a related field, and a minimum of 3+ years of hands-on experience.
Are proficient in Python and comfortable working in C++ when required.
Have experience training and deploying machine learning models using frameworks such as PyTorch, TensorFlow, ONNX, or similar tools.
Have worked on computer vision problems such as object detection, tracking, pose estimation, segmentation, gesture recognition, or activity understanding.
Have experience deploying models to edge devices and optimizing performance for real-world systems.
Understand the challenges of collecting, labeling, and maintaining high-quality datasets.
Are comfortable working in environments where architecture is still evolving and your input shapes direction.
Document clearly and drive issues to resolution.
You Will Be a Strong Fit If You:
Care deeply about building perception systems that work reliably outside ideal lab conditions.
Have strong intuition for debugging machine learning systems and can distinguish between data problems, model problems, and deployment problems.
Enjoy converting cutting-edge research into practical systems that ship.
Think critically about tradeoffs between accuracy, latency, robustness, power consumption, and cost.
Have the ability to quickly adapt through iteration cycles without waiting for perfect information to make progress.
Take ownership over systems end-to-end, from data collection and training through deployment and monitoring.
Work well in small, collaborative teams where software, hardware, controls, and AI are in constant conversation.
Care about what perception enables: awareness, responsiveness, and the feeling that the robot is alive.
The early team becomes the DNA of the company. We set ourselves and others to a high standard, and we respond with kindness when things get hard but keep everyone accountable. This requires us to be curious, creative, and diverse in our thinking and approach.
We’re proud to be an equal opportunity employer and consider all qualified applicants regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. Even if you don’t meet every single requirement, we encourage you to apply. Studies show that women and underrepresented groups often hold back unless they meet 100% of the criteria - we don’t want that to be the reason we miss out on great talent.
Similar jobs
Search more Computer Vision Engineer jobsDevelop 3D vision and robotics capabilities for UAV situational awareness, including visual odometry, 3D flight-path reconstruction, and depth estimation methods for navigation.
Set the technical direction for computer vision item identification, building and productionizing fine-grained models with calibrated confidence, reliable serving, and accuracy tailored to an online marketplace catalog.
Design and deploy efficient computer vision and robotics models for autonomous systems, building training pipelines and optimizing on-device inference for embedded accelerators under tight compute and memory constraints.
As an AI Computer Vision Engineer, you will design and develop scalable computer vision systems, applying machine learning to solve real-world challenges in healthcare.
