Senior Automation Quality Engineer
Avenga · Skopje
Job description
About the role
As a Senior Automation Quality Engineer you will lead the design and execution of test strategies for automation, low‑code applications and AI‑driven agent solutions. The role blends traditional functional and regression testing with the unique quality challenges of AI systems such as output consistency, accuracy, exception handling and edge‑case behavior.
Key responsibilities
- Design, implement and maintain automated test suites for UI, API and low‑code platforms using Python‑based frameworks.
- Validate AI agent outputs, monitor hallucinations, and ensure reliable performance across edge cases and exception scenarios.
Required profile
- 3+ years of hands‑on test automation experience with strong Python skills.
- Proficiency with Playwright for UI automation and PyTest (or equivalent) for API testing.
- Experience with BDD/Gherkin (Behave or similar) and ability to work with feature files.
- Solid SQL knowledge for data validation and Git/GitHub workflow expertise.
Required skills
- Python, Playwright, PyTest, Behave (BDD/Gherkin), SQL, Git, GitHub.
- Use of AI coding assistants such as GitHub Copilot, Claude or Cursor in a test‑automation workflow.
- Prompt engineering and understanding of LLM concepts (context windows, hallucination, RAG).
- Familiarity with agent frameworks like LangChain, LangGraph, AutoGen or Model Context Protocol.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in North Macedonia.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 10 hours ago
Expires 1 month from now
4 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Avenga
Skopje