Remote Jobs RockRemote Jobs Rock

Senior Software Engineer in Test

🕒 4 days ago
Software TestingTest Automation FrameworksSDK TestingTypescript/javascript
Apply Now

📜 Description

  • Design reusable automation frameworks for SDKs in TypeScript/JavaScript, Python, Java, and Go.
  • Automate SDK functionality, compatibility, error handling, integration, and release validation.
  • Build MCP test frameworks covering clients, servers, tools, resources, prompts, transports, and protocol interactions.
  • Test prompts, AI workflows, tool calling, structured outputs, and LLM response quality.
  • Create automated test coverage for XAA and reusable test utilities, mocks, harnesses, and developer tools.
  • Integrate tests into CI/CD, troubleshoot failures and flaky tests, and use GenAI tools to support test development and debugging.

🛠️ Requirements

  • Bachelor's degree in Computer Science, Software Engineering, or a related field.
  • 5–8 years of experience in SDET, software testing, test infrastructure, or software engineering.
  • Strong programming skills in at least one language: TypeScript/JavaScript, Python, Java, or Go.
  • Experience building automation frameworks, reusable libraries, or developer tools.
  • Strong understanding of SDK testing, integration testing, regression testing, and compatibility testing.
  • Experience with Git, CI/CD, and debugging complex software systems.
  • Familiarity with AI-assisted development tools such as GitHub Copilot or Claude Code.
  • Strong problem-solving, ownership, and communication skills.
  • Experience with MCP clients/servers, protocol testing, or MCP SDKs.
  • Experience with prompt automation, LLM evaluation, AI agents, or AI-powered applications.

✨ Benefits

  • Well-being support
  • Social impact opportunities
  • Talent development and community connection
  • Immersive, in-person onboarding
Full job description

Secure Every Identity, from AI to Human

Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence.

This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk.

We are looking for a strong Senior Software Engineer in Test (SET) to build scalable automation frameworks for multi-language SDKs, Model Context Protocol (MCP), and AI-powered workflows. The role focuses on SDK testing, MCP protocol validation, prompt automation, and developer productivity tools. Strong programming and framework development skills are essential; UI and API automation are secondary.

Key Responsibilities

  • Design and develop reusable automation frameworks for SDKs across multiple languages, including TypeScript/JavaScript, Python, Java, and Go.
  • Automate SDK functionality, compatibility, error handling, integration, and release validation.
  • Build and maintain MCP test frameworks to validate clients, servers, tools, resources, prompts, transports, and protocol interactions.
  • Develop automated tests for prompts, AI workflows, tool calling, structured outputs, and LLM response quality.
  • Develop and maintain automated test coverage for XAA, validating functionality, integrations, error handling, and reliability across supported workflows.
  • Build reusable test utilities, mocks, test harnesses, and developer productivity tools.
  • Integrate automated tests into CI/CD pipelines and troubleshoot flaky tests, failures, and infrastructure issues.
  • Leverage GitHub Copilot, Claude Code, and other GenAI tools for test generation, debugging, and framework development.
  • Collaborate with developers, architects, and platform teams to improve quality, reliability, and release confidence.

Required Qualifications

  • Bachelor's degree in Computer Science, Software Engineering, or a related field.
  • 5–8 years of experience in SDET, software testing, test infrastructure, or software engineering.
  • Strong programming skills in at least one language: TypeScript/JavaScript, Python, Java, or Go.
  • Experience building automation frameworks, reusable libraries, or developer tools.
  • Strong understanding of SDK testing, integration testing, regression testing, and compatibility testing.
  • Experience with Git, CI/CD, and debugging complex software systems.
  • Familiarity with AI-assisted development tools such as GitHub Copilot or Claude Code.
  • Strong problem-solving, ownership, and communication skills.

Preferred Qualifications

  • Experience with MCP clients/servers, protocol testing, or MCP SDKs.
  • Experience with prompt automation, LLM evaluation, AI agents, or AI-powered applications.
  • Experience testing SDKs across multiple programming languages.
  • Familiarity with Docker, Kubernetes, cloud environments, and performance testing.
  • Working knowledge of API automation and UI frameworks such as Playwright or Cypress.

Key Technologies

Primary: SDK Automation | TypeScript/JavaScript | Python | Java | Go | MCP | Prompt Automation | LLM Evaluation | Test Frameworks | GenAI

Additional: Git | CI/CD | GitHub Actions | Jenkins | Docker | Kubernetes | REST APIs | Playwright | Cypress | JMeter

Expected Outcomes

  • Scalable automation coverage across multiple SDKs and programming languages.
  • Reliable MCP protocol and integration testing.
  • Automated prompt and AI workflow regression testing.
  • Improved developer productivity, defect detection, and release confidence.

#LI-Hybrid

P22395_3583173

The Okta Experience

We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.

If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation.

Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.

Export-Development-Canada

Sr. SQA Analyst - EN 707

🕒 5 days ago
Export-Development-Canada👥 1001 - 5000 employees🏢 Financial Services

Defines and executes manual and automated test strategies for enterprise software, building test frameworks and integrating testing into CI/CD to reduce regression risk and improve release quality.

Software Quality AssuranceTest AutomationManual TestingWeb Application Testing
Filevine

Senior Software Development Engineer in Test

🕒 6 days ago
Filevine👥 10,000+ employees🏢 Software Development🤝 B2B

Own end-to-end quality engineering as the first quality engineer, defining the QA strategy and building automation infrastructure while testing API, UI, and integration layers and embedding quality gates in CI/CD.

Software Development Engineering In TestQuality Assurance StrategyTest AutomationPlaywright
Wayve

Senior Embedded Software Test Engineer, Onboard Test Automation

🕒 14 days ago
Wayve👥 501 - 1000 employees🏢 Computer Software

Design and maintain automated tests for onboard embedded software, validating system behavior across hardware-in-the-loop platforms and helping teams detect, diagnose, and resolve issues before full-vehicle testing.

Embedded Software TestingAutomated TestingPythonC++
Wayve

Senior Embedded Software Test Engineer, Onboard Test Automation

🕒 14 days ago
Wayve👥 501 - 1000 employees🏢 Computer Software

Design and deliver automated tests for onboard embedded software, validating system behavior across hardware platforms and HIL environments while improving test coverage, diagnostics, and developer self-service.

Embedded Software TestingAutomated TestingPythonC++
Okta

Senior Software Engineer in Test, Federal Classified

📅 Jul 20
Okta👥 10,000+ employees🏢 Software Development

Own quality certification for weekly platform releases in a restricted environment, developing and maintaining system tests and automation to protect critical customer workflows, reliability, and compatibility.

Software QARelease TestingRelease ValidationSaaS

Trusted by Remote Workers