Lead QA strategy and modernize testing across engineering teams by introducing AI-powered tools and agents, strengthening automation, and establishing quality standards, metrics, and AI-assisted workflows.
Principal Reliability and Systems Test Engineer
π Description
- Define reliability targets, prioritized test plans, and acceptance criteria based on intended use and product risks.
- Establish lab capabilities, including equipment, fixtures, instrumentation, and safe testing practices.
- Design and run component and integrated-system tests for durability, lifetime, and performance across hardware, software, and AI-enabled behavior.
- Build test automation, data collection, and reporting tools for repeatable testing.
- Investigate failures, identify root causes, and verify corrective actions with engineering and manufacturing teams.
- Assess release readiness and reliability risks using test results and field data; partner on qualification, production quality, and certification testing.
π οΈ Requirements
- 8 or more years in reliability, systems testing, product validation, or a related field
- Strong hands-on experience validating complex electromechanical products that combine hardware, embedded software, and integrated system behavior
- Knowledge of failure mechanisms, statistical methods for assessing product reliability, and accelerated-life, environmental, and durability testing
- Experience building test capabilities, including fixtures, instrumentation, and automation, using Python or comparable tools for test execution, data collection, and analysis
- Strong troubleshooting and root-cause analysis skills across mechanical, electrical, firmware, and software systems, including implementing and verifying corrective actions
- Experience translating intended use into measurable requirements, prioritized test plans, and acceptance criteria, and supporting products through development into production
- Recognized technical leadership in reliability testing: experience setting direction for a test program and guiding others through it, formally or informally
Full job description
About Us
Familiar Machines & Magic (FM&M) is building the Physical AI platform for human connection, beginning with Familiars β physically embodied AI systems designed to form long-term, emotionally intelligent relationships with people. Our mission is to create artificial life to build a more caring world.
Founded by industry leaders from iRobot, Outrider, and Amazon, our team has collectively deployed over 50 million consumer robots worldwide and led advances in navigation, machine learning, and human-robot interaction.
Familiar Machines & Magic is building a mission-driven team of high performers, anchored in our unique Culture Principles and Ways of Working.
Position Overview
We're looking for a hands-on Principal Reliability & System Test Engineer to join our growing team and build the test capabilities necessary for us to deliver Familiars that provide a dependable experience throughout their lifetimes.
As our first dedicated engineer in this function, you will combine technical leadership with direct execution: from clearly defining reliability requirements, to building test setups and automation, to investigating failures and guiding design improvements. You'll partner closely with Hardware, Robot Software, AI, Product, Design, and Manufacturing & Operations, with support from external labs and specialists as needed.
In this role, you will set the objectives and approach for reliability testing, drive the test method and lab decisions that give it direction, and be the technical leader FM&M looks to on reliability. You are highly collaborative, comfortable navigating ambiguity, and thrive in a fast-paced, dynamic, and culture-forward environment.
Location: Greater Boston Area office (Woburn/Burlington, MA), on-site 3+ days per week.
What Youβll Do | Responsibilities & Scope
Define measurable reliability targets, prioritized test plans, and acceptance criteria based on expected use and critical product risks
Establish lab capabilities, including equipment, fixtures, instrumentation, and safe testing practices
Design, build, and run component and integrated system tests covering durability, product lifetime, and performance across hardware, software, and AI-enabled behavior
Develop test automation, data collection, and reporting tools that make testing repeatable and support a growing team
Lead hands-on failure investigations, identify root causes, and partner with the engineering and manufacturing teams to implement and verify corrective actions
Assess product and release readiness using test results and field data, and advise engineering leadership on coverage gaps, reliability trends, and risks
Partner with Manufacturing & Operations and external labs on reliability qualification, production quality, and certification testing
What Youβll Bring | Experience, Expertise & Qualifications
8 or more years in reliability, systems testing, product validation, or a related field
Strong hands-on experience validating complex electromechanical products that combine hardware, embedded software, and integrated system behavior
Knowledge of failure mechanisms, statistical methods for assessing product reliability, and accelerated-life, environmental, and durability testing
Experience building test capabilities, including fixtures, instrumentation, and automation, using Python or comparable tools for test execution, data collection, and analysis
Strong troubleshooting and root-cause analysis skills across mechanical, electrical, firmware, and software systems, including implementing and verifying corrective actions
Experience translating intended use into measurable requirements, prioritized test plans, and acceptance criteria, and supporting products through development into production
Recognized technical leadership in reliability testing: experience setting direction for a test program and guiding others through it, formally or informally
How Youβll Succeed | Mindset, Judgment & Ways of Working
Build capabilities from scratch, and move between technical planning and lab work: building setups, running tests, debugging failures, and analyzing results
Connect physical reliability, software behavior, and AI performance to the experience of the person living with a Familiar
Prioritize critical risks, choose practical test methods, and balance rigor with resources as designs, schedules, and business needs evolve
Take initiative and follow issues through to resolution
Build trust across teams by welcoming feedback and clearly communicating evidence, uncertainties, and recommendations
Be energized by building dependable Familiars that create meaningful human connections
Please Note: We have often hired those that do not meet the exact requirements but that we found to be a great culture fit and have the relevant experience to be successful in the role. Please consider applying if this is you.
Familiar Machines & Magic is an Equal Opportunity Employer. We are committed to fostering a diverse, inclusive, and equitable workplace where all individuals are valued and respected. Employment decisions are based on qualifications, merit, and business needs, without regard to race, color, religion, gender, sexual orientation, national origin, disability, veteran status, or any other protected status.
Similar jobs
Search more QA Engineer jobsIT Quality Assurance Lead
Leads end-to-end User Acceptance Testing across IT projects and BAU releases, coordinating business testers, managing defects and governance, and ensuring solutions meet requirements and are ready for release.
Establish quality engineering for the firmware production lane, owning system-level test automation and customer acceptance evidence while setting cross-team standards for reliable releases.
Principal Software Development Engineer
Validates end-to-end Zero Trust Branch solutions for customer deployments by building realistic test environments, automating functional and scale testing, and resolving complex issues to improve release quality and readiness.
Lead QA for PowerWash Simulator 2, coordinating quality strategy across platforms and release cycles, supervising the QA team, and driving risk reduction and quality improvements with project stakeholders.
