🕒 5 days ago
As a QA Automation Engineer focused on AI, you'll develop testing strategies and frameworks to ensure the reliability and accuracy of GenAI applications.
Automation Test Engineer
📅 Sep 17
📍 🇦🇷 Argentina +5 - Remote?🎸 Senior📥 QA Automation Engineer📢 🇬🇧 English Required⏳ Temporary/Contract
QA AutomationTest Automation ArchitectureAPI TestingWeb Testing
📜 Description
- Design, develop, and maintain scalable test automation architectures and frameworks.
- Define and execute automated testing strategies for web applications and REST APIs, including regression and performance testing.
- Implement BDD practices and integrate automated tests into CI/CD pipelines, particularly Azure DevOps.
- Develop automated tests using Playwright, Selenium, Karate, Gatling, or similar technologies.
- Collaborate with engineering teams to establish quality standards and continuously improve testing processes and coverage.
- Apply quality engineering practices to AI solutions and help evaluate AI-generated outputs and AI-assisted development workflows.
🛠️ Requirements
- 4+ years of experience in QA Automation, Software Testing, or a similar Quality Engineering role.
- Strong experience with test automation architecture, API and web testing, BDD, regression testing, and performance testing.
- Hands-on experience with CI/CD and Azure DevOps.
- Experience with Playwright, Selenium, Karate, Gatling, or similar automation technologies.
- Programming experience with Java, JavaScript/TypeScript, Python, or similar languages; strong understanding of REST APIs.
- Experience with Git and version-control workflows.
- English proficiency at B2 level or higher.
- Practical experience or working knowledge of LLMs, AI agents, prompt or context engineering, AI orchestration, specification-driven development, or AI-assisted code generation.
Full job description
Senior Automation Test Engineer
We are looking for a Senior Automation Test Engineer with strong experience in test automation, API and web testing, and modern quality engineering practices. This role will be responsible for designing and implementing robust automated testing strategies across web applications, APIs, and AI-powered solutions.
The ideal candidate combines a strong foundation in QA Automation and Software Engineering with practical knowledge of Large Language Models (LLMs), AI Agents, and AI-assisted development workflows.
Key Responsibilities
- Design, develop, and maintain scalable test automation architectures and frameworks.
- Define and execute automated testing strategies for web applications and REST APIs.
- Develop and maintain effective automated regression testing strategies.
- Implement BDD (Behavior-Driven Development) practices.
- Design and execute performance testing.
- Integrate automated testing into CI/CD pipelines, particularly within Azure DevOps environments.
- Develop automated tests using Playwright, Selenium, Karate, Gatling, or similar technologies.
- Collaborate with development and engineering teams to establish quality standards throughout the software development lifecycle.
- Apply quality engineering practices to solutions incorporating Large Language Models, AI Agents, and Agentic Workflows.
- Contribute to the evaluation and validation of AI-generated outputs and AI-assisted development processes.
- Continuously improve testing processes, automation coverage, and quality practices.
Required Qualifications
- 4+ years of experience in QA Automation, Software Testing, or a similar Quality Engineering role.
- Strong experience in test automation architecture and automation strategies.
- Solid experience with API and Web Testing.
- Experience with BDD and regression testing strategies.
- Experience with Performance Testing.
- Hands-on experience with CI/CD and Azure DevOps.
- Solid experience with one or more automation technologies such as Playwright, Selenium, Karate, Gatling, or similar tools.
- Programming experience with Java, JavaScript/TypeScript, Python, or similar languages.
- Strong understanding of REST APIs.
- Experience with Git and version-control workflows.
- English proficiency: B2 level or higher.
AI & Emerging Technology Experience
Practical experience or working knowledge in one or more of the following areas is highly valuable:
- Large Language Models (LLMs)
- AI Agents and Agentic Workflows
- Prompt Engineering and Context Engineering
- Tool Calling and AI Orchestration
- Specification-Driven Development
- AI-assisted code generation
- Evaluation and validation of AI-generated outputs
Experience in these areas may come from professional environments, hands-on projects, or practical implementation within software development and QA workflows.
Similar jobs
Search more QA Automation Engineer jobs
🕒 18 days ago
As a Senior QA Automation Engineer, you will build evaluation suites for LLM and ML features, define quality metrics, and design automated test suites for various client projects.
🕒 3 days ago
Own and improve end-to-end test automation infrastructure using Playwright and TypeScript, strengthening regression coverage, reducing flaky tests, and integrating reliable testing into CI/CD release workflows.
Senior Test Automation Engineer (Healthcare/Medical industry)
📅 Sep 10
Sigma Software👥 1001 - 5000 employees🏢 Computer Software
📅 Sep 10
Design and implement scalable test automation strategies to enhance the quality and reliability of healthcare software solutions.
📍 🇷🇴 Bucharest - Remote💼 Full-Time🎸 Senior📥 QA Automation Engineer📢 🇬🇧 English Required📢 🇩🇪 German Required
🕒 3 days ago
Design and lead automated quality testing for AI-powered platforms, covering application and API reliability, nondeterministic LLM behavior, security, asynchronous workflows, performance, and release readiness.