Own automated verification for autonomous-driving embedded software, building reusable tests, investigating failures across engineering teams, and improving coverage, reliability, and release traceability.
Software Verification & Validation Engineer
📜 Description
- Define objective safety and comfort metrics for autonomous vehicle software modules and translate operational domains and failure modes into automated criteria.
- Build and maintain open- and closed-loop simulation test suites to evaluate releases, edge cases, and system performance.
- Analyze simulation results, identify regressions and root causes, and provide diagnostic reports to development teams.
- Develop Python automation for test execution, data ingestion, and statistical reporting.
- Integrate regression suites into CI pipelines and establish reproducible testing and artifact-management practices.
🛠️ Requirements
- Standardized Map & Scenario Formats: Familiarity with lane-level maps (OpenDRIVE, Lanelet2, OSM) or scenario description standards (OpenSCENARIO); hands-on experience with spatial/geometry data pipelines.
- Computational Geometry: Foundations in applied geometry, including polyline sampling, curvature evaluation, offsets, and polygon intersection routines.
- Industry Simulators: Experience with open-source or commercial simulator tools (e.g., CARLA).
- Data Querying & Storage: Proficiency with SQL and relational databases for querying bulk test results.
- Safety Regulations & Benchmarks: Exposure to real-world crash databases (e.g., NHTSA CISS/CRSS, FARS) or standard safety testing protocols (e.g., Euro NCAP, ISO 26262/ISO 21448 SOTIF).
✨ Benefits
- Package, including 401(k) plan.
- Autonomous Vehicle Domain Knowledge: Deep understanding of AV stack architecture—including perception, prediction, motion planning
- Quantitative & Safety Metrics Analysis: Demonstrated experience defining and evaluating kinematic and spatial metrics (e.g.
- Python Development: Strong Python scripting skills for data processing, test automation, and test framework creation
- CI/CD & DevOps Tooling: Practical experience with automated build/test pipelines (e.g., Jenkins
Full job description
Key Responsibilities
-
Performance Metrics Definition: Design, formalize, and implement quantitative safety and comfort metrics for AV algorithm modules (Perception, Prediction, Motion Planning, and Control). Translate high-level operational design domains (ODDs) and potential failure modes into automatable, objective criteria.
-
Simulation Test Engineering: Build, execute, and maintain complex open-loop and closed-loop simulation test suites to stress-test software releases, evaluate edge cases, and benchmark module-level and system-level performance.
-
Failure Triage & Root Cause Analysis: Analyze large-scale simulation outputs to distinguish genuine software regressions from simulation artifact anomalies. Localize root causes to specific modules and deliver actionable diagnostic reports to development teams.
-
Test Framework Automation: Write production-grade Python scripts and extend core testing frameworks to automate test execution, data ingestion, and statistical reporting.
-
CI/CD Pipeline Integration: Integrate automated regression suites into continuous integration pipelines (e.g., Jenkins) for seamless, multi-stage testing across daily builds.
-
Data-Driven Quality Standards: Establish reproducible testing practices, enforcing strict artifact hygiene, dependency management, and quantitative validation over visual inspection.
Required Skills:
Autonomous Vehicle Domain Knowledge: Deep understanding of AV stack architecture—including perception, prediction, motion planning, and control—along with their associated failure modes and physical constraints.
Simulation & Test Design: 2+ years of hands-on experience authoring scenarios and executing test cases within Software-in-the-Loop (SIL) or Hardware-in-the-Loop (HIL) simulation platforms.
Quantitative & Safety Metrics Analysis: Demonstrated experience defining and evaluating kinematic and spatial metrics (e.g., Time-to-Collision [TTC], headway, jerk/acceleration profiles, lateral error) using statistical analysis across large datasets.
Python Development: Strong Python scripting skills for data processing, test automation, and test framework creation, with an emphasis on clean code structure and problem-solving.
CI/CD & DevOps Tooling: Practical experience with automated build/test pipelines (e.g., Jenkins, GitHub Actions) and visualization tools (e.g., Grafana, custom dashboards) to report test metrics.
Education: Bachelor’s or Master’s degree in Computer Science, Robotics, Electrical/Software Engineering, Mathematics, Statistics, or a related technical discipline.
Preferred Skills:
Standardized Map & Scenario Formats: Familiarity with lane-level maps (OpenDRIVE, Lanelet2, OSM) or scenario description standards (OpenSCENARIO); hands-on experience with spatial/geometry data pipelines.
Computational Geometry: Foundations in applied geometry, including polyline sampling, curvature evaluation, offsets, and polygon intersection routines.
Industry Simulators: Experience with open-source or commercial simulator tools (e.g., CARLA).
Data Querying & Storage: Proficiency with SQL and relational databases for querying bulk test results.
Safety Regulations & Benchmarks: Exposure to real-world crash databases (e.g., NHTSA CISS/CRSS, FARS) or standard safety testing protocols (e.g., Euro NCAP, ISO 26262/ISO 21448 SOTIF).
Similar jobs
Search more QA Engineer jobsIntegration and Test Engineering Specialist
Develop and maintain verification plans for a LEO satellite communications system, coordinate system-level testing, configure lab equipment, and verify that products meet technical and performance requirements.
As a QA Engineer II, you will ensure the stability and quality of the STMS Web and services, collaborating with engineers to develop innovative solutions in the auto transport industry.
As a QA Engineer, you'll lead test planning, functional and exploratory testing, and user acceptance testing (UAT) across zerohash's product stack, shaping quality standards as the team scales.
Build and maintain automated tests for critical desktop and mobile user flows, integrate reliable coverage into CI/CD, investigate failures, and perform hands-on functional, exploratory, and regression testing.
