Remote Jobs RockRemote Jobs Rock

Lead Quality Engineer - R01569777

๐Ÿ“… Aug 13
Test Data ManagementJenkinsPostmanSelenium
Apply Now

๐Ÿ“œ Description

  • Design test strategies for traditional and AI-powered platform features, prioritizing high-impact areas.
  • Create and execute test scenarios from business requirements and acceptance criteria across platform modules.
  • Perform functional, regression, integration, and system testing for web applications and microservices.
  • Validate chatbot conversations, AI-generated responses, RAG retrieval accuracy, prompts, and healthcare-specific guardrails.
  • Test APIs and integrations for provider directories, benefits, claims, cost estimation, AI gateway, and contact center services.
  • Collaborate with product, architecture, development, and business teams; improve quality practices and automate testing with Selenium and Jenkins.

๐Ÿ› ๏ธ Requirements

  • Behavior Driven Development (BDD)
  • System Integration Testing
  • Test Driven Development (TDD)
  • Accessibility Testing with JAWS
  • AI validation and conversational testing
  • Healthcare domain expertise
  • Advanced API automation
  • Experience with contact center integrations (Avaya)
  • RAG (Retrieval-Augmented Generation) testing
  • Bachelor's degree in Computer Science, Information Technology, or a closely related discipline
Full job description
Lead Quality Engineer

Primary Skills

  • Test Data Management, Jenkins, Postman, Selenium, BDD - Behavior Driven Development, SoapUI, System Integration testing, Zephyr, TDD - Test Driven Development, Accessibility Testing (JAWS), Cucumber
  • Job requirements

    Experience Range:
    With at least 4 years of experience in quality engineering for web applications and microservices, including hands-on testing of AI-enabled applications
    Key Responsibilities:
  • Design and implement comprehensive test strategies for traditional and AI-powered features within the Personal Health Concierge platform, prioritizing high-impact areas
  • Develop and execute detailed test scenarios based on business requirements and acceptance criteria across provider search, facility search, symptom guidance, benefits navigation, cost estimation, claims status, and contact center handoff modules
  • Perform functional, regression, integration, and system testing to ensure measurable quality and compliance of web applications and microservices
  • Validate chatbot conversations, AI-generated responses, and RAG-based retrieval accuracy, ensuring prompt behavior and guardrail compliance for healthcare-specific use cases
  • Conduct API and integration testing for provider directory APIs, benefits and eligibility APIs, claims APIs, cost estimation services, AI gateway services, and contact center integrations
  • Collaborate with Product Owners, AI Architects, Developers, and Business SMEs to establish robust quality engineering practices and drive continuous improvement
  • Leverage automation tools such as Selenium and Jenkins to streamline testing workflows and increase coverage
  • Perform accessibility testing using JAWS to ensure compliance with accessibility standards across the platform
  • Required Skills:
    1. Jenkins
    2. Postman
    3. Selenium
    4. Behavior Driven Development (BDD)
    5. SoapUI
    6. System Integration Testing
    7. Zephyr
    8. Test Driven Development (TDD)
    9. Accessibility Testing with JAWS
    Preferred Skills:
  • 1. Cucumber
  • 2. AI validation and conversational testing
  • 3. Healthcare domain expertise
  • 4. Advanced API automation
  • 5. Experience with contact center integrations (Avaya)
  • 6. RAG (Retrieval-Augmented Generation) testing
  • Desired Qualifications:
  • 1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline
  • 2. Certified Software Quality Engineer (CSQE) or ISTQB Advanced Level Test Analyst certification
  • 3. Certification in AI or Machine Learning testing methodologies (preferred for AI-enabled application testing)
  • Additional Information:
    This is a QA Engineer role focused on AI-enabled applications, not a typical QA position.
    BlackStone eIT

    Test Lead

    ๐Ÿ“… Mar 2
    BlackStone eIT๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Information Technology And Services

    Lead the development of UI, API, and mobile automation frameworks, guide QA team members through technical escalations, and strengthen release readiness through testing and CI/CD improvements.

    Test AutomationUI TestingAPI TestingMobile Testing
    Skylo

    Staff QA Engineer, Performance Testing

    ๐Ÿ•’ 26 days ago
    Skylo๐Ÿข Telecommunications

    Lead quality and performance validation for Skyloโ€™s cloud-based connectivity platforms by building automation, load and regression testing, and monitoring systems that support scalable, reliable network services.

    QA AutomationPerformance TestingLoad TestingRegression Testing
    Easyapplyrekluti

    QA MANUAL LEAD

    ๐Ÿ“… Jul 2
    Easyapplyrekluti๐Ÿ‘ฅ 1 - 10 employees๐Ÿข Internet

    As a QA Manual Lead, you will design and govern manual testing strategies, lead a QA team, and drive automation efforts to ensure high-quality software delivery.

    Aseguramiento De Calidad (qa)Metodologรญas รgilesScrumDiseรฑo De Planes De Prueba

    Trusted by Remote Workers