QA Engineer

Role Purpose

We are looking for a technically strong QA Automation Engineer / SDET to build and maintain automated testing solutions for data-intensive applications and systems. The role requires a strong programming foundation in Python, hands-on experience with Pytest, PySpark and SQL, and the ability to understand application code, develop reliable automated tests, and leverage AI agents to improve testing efficiency.

This is an automation-first role, with approximately 85–90% of testing expected to be automated and minimal manual testing. The successful candidate will contribute to scalable test frameworks, data validation, automated regression coverage, and AI-enabled testing workflows.

Key Responsibilities

• Design, develop and maintain automated test suites, targeting approximately 85–90% automation coverage with minimal reliance on manual testing.
• Develop robust and reusable test automation frameworks using Python and Pytest.
• Write and maintain automated test cases covering functional, integration, API, regression and data-processing scenarios.
• Use PySpark to validate data transformations, processing logic, data quality and expected outputs across data-intensive workflows.
• Write SQL queries to validate application data, verify database states, identify
• inconsistencies and reconcile expected versus actual results.
• Integrate Python, Pytest, PySpark and SQL into automated validation workflows wherever appropriate.
• Understand application code, test existing implementations, investigate failures and identify defects through code-level analysis.
• Design reusable test utilities, fixtures, assertions, test-data management mechanisms and failure-reporting capabilities.
• Leverage AI agents to support test-case generation, test automation, code analysis, failure investigation and other relevant QA workflows.
• Create, maintain and improve
• SKILL.md files defining instructions, workflows, tools and reusable capabilities for AI agents.
• Evaluate AI-generated test cases and code for correctness, reliability, maintainability and adequate test coverage.
• Integrate automated test execution into CI/CD pipelines and support repeatable regression validation.
• Collaborate with developers, data engineers and other stakeholders to understand requirements, review code, investigate defects and improve overall software quality.
• Identify opportunities to reduce repetitive manual effort through automation, reusable components and AI-assisted workflows.

Skills and Experience

• Strong hands-on programming experience in Python, including writing maintainable code, reusable utilities, functions, modules and debugging logic.
• Practical experience with Pytest, including test design, fixtures, parametrisation, assertions, test organisation and failure handling.
• Hands-on experience with PySpark, including validating distributed data-processing logic, transformations and expected data outputs.
• Strong SQL skills, including joins, aggregations, filtering, subqueries and data validation across relational databases.
• Experience building and maintaining automated test frameworks rather than relying primarily on manual test execution.
• Ability to connect automated test execution with backend or database validation and assert expected results.
• Ability to read and understand application code, trace execution logic, investigate failures and distinguish application defects from test issues.
• Practical experience leveraging AI agents or AI-assisted development workflows for coding, testing, debugging or task automation.
• Ability to write and maintain Markdown-based SKILL.md files for defining reusable AI-agent skills, instructions or workflows.
• Experience with version control, preferably Git, and automated execution through CI/CD pipelines.

Must Have skills

• Experience with Selenium or Playwright for UI automation, where relevant to the application.
• API automation using Python libraries and tools.
• Experience testing data-intensive applications, distributed processing workflows or data platforms.
• Experience with automated data-quality checks, reconciliation and database integrity validation.
• Familiarity with Docker, Linux environments and CI/CD tooling.
• Experience evaluating AI/LLM outputs, validating generated code or building AI-assisted testing workflows.
• Experience working in Agile development environments.