Location
Cardiff

Hours
Full Time

Salary
£62,699 per annum

About the Role
Across government, the successful adoption of artificial intelligence depends not only on innovation, but on the ability to assure quality, reliability and ethical use at scale. As AI systems become embedded in critical services, robust testing and validation practices are essential to ensure that models perform as expected, outputs are trustworthy and risks are effectively managed. Ofgem plays a vital role in the UK’s energy system, protecting consumers and enabling a more secure, fair and sustainable energy future, and strong assurance of AI-enabled services is critical to delivering this mission.

Ofgem is on an ambitious transformation journey. Within the Digital, Data and Security Services (DDSS) directorate, we are building advanced data and AI capabilities to support innovation, improve efficiency and enhance decision-making. As part of this, we are embedding modern testing practices across digital, data and AI services, ensuring that quality is built into every stage of delivery.

As the Senior Test Engineer for AI, you will play a key role in ensuring the quality and reliability of AI and data-driven solutions. You will lead the design and implementation of testing strategies for complex systems, including AI models, data pipelines and digital services. You will work across multidisciplinary teams, embedding test-driven and behaviour-driven development practices and promoting a culture of quality and continuous improvement.

This is a senior, hands-on technical role requiring strong expertise in testing, automation and AI systems, alongside the ability to influence and mentor across delivery teams.

Experience
- Extensive experience managing testing across complex systems, including AI and data platforms
- Strong knowledge of automated testing frameworks and tools within Microsoft-based environments
- Experience with programming or scripting languages such as Python, Java, SQL or JavaScript
- Solid understanding of CI/CD, DevOps and cloud-based testing integration
- Experience working in agile delivery environments is desirable
- Exposure to AI model validation or data pipeline testing is beneficial

About you
- Technically strong and forward-thinking testing professional
- Ability to lead quality assurance for AI and data-driven systems
- Skilled in analysing risks, managing defects and driving continuous improvement in quality
- Able to influence and mentor delivery teams, promoting a culture of quality and continuous improvement

Qualifications
- ISTQB Advanced certification (or equivalent) is expected or willingness to obtain
- Proficiency in one or more coding languages (e.g. Python, Java, R, SQL, or JavaScript)
- Extensive expertise in managing quality across the AI solution development lifecycle in a Microsoft AI environment using testing platforms and tools, including Azure Test Plan, Co-pilot Studio, Co-pilot Studio CLI and PowerShell tools, AI Foundry and AI Foundry Agent evaluation SDK