AI testing

The speed of AI,
The certainty of people

For us, AI testing means three things: testing smarter with AI, assessing the quality of AI applications, and assuring software that was partly built by AI. Especially in healthcare, energy, infrastructure and government, where a single error has immediate consequences, human judgment makes the difference.

AI and software quality: three scenarios

AI supports testing, is increasingly part of applications itself, and helps write code. Three scenarios, each with its own quality approach. The bar stays the same, whoever or whatever built the software: a specialist signs off on the verdict.

AI AS A TOOL
Testing with AI
AI helps us analyze requirements, prepare test cases and automate tests. That lets us explore more scenarios and gives you feedback sooner. The test strategy and the risks determine where we use AI: what counts isn't the number of generated tests, but their relevance and coverage.
AI AS THE TEST SUBJECT
Testing AI applications
A chatbot can answer convincingly without being right, and an AI agent takes actions with real consequences. That's why we also test AI applications for accuracy, use of sources, consistency, safety and appropriate behavior. When the model, the prompt or a data source changes, we reassess whether the application still meets the criteria.
AI AS THE CODE AUTHOR
Testing software written with AI
More and more code is partly written by AI: it gets built faster, but nobody has read every line, and a model repeats its assumptions consistently. This discipline is also known as vibe testing. We review AI-generated code systematically, test more deeply where AI helped build, and grow an automated regression suite alongside it as a safety net.

AI tests, the specialist decides

Anyone can run a test with AI these days. The difference is in what happens next: understanding why a test fails, seeing the risk behind it and having the confidence to say whether something can go live. That's why every result passes a specialist who knows both your system and your sector before any conclusion is drawn.

What it delivers

The tangible results of AI testing are easiest to measure in our own testing work. Here's what clients see:

GDPR
EU AI Act
AI-certified specialists
100
x
faster test feedback
what took days now takes hours
80
%
lower costs
by cutting manual testing
3
x
higher test coverage
more tests in the same sprint
100
%
reviewed
by a specialist
GDPR
EU AI Act
AI-certified specialists

Wat het oplevert

Wat AI testen concreet oplevert, is in ons eigen testwerk het hardst te meten. Dit zien klanten terug:

AVG
EU AI Act
AI-gecertificeerde specialisten
100
x
snellere testfeedback
wat dagen kostte, kan in uren
70
%
minder onderhoud
aan je testautomatisering
100
%
beoordeeld
door een specialist
450
aanspreekpunt
voor alles rond kwaliteit
AVG
EU AI Act
AI-gecertificeerde specialisten

How we already use AI today

Three applications running at clients right now, in healthcare, energy and government.

Test automation in plain language with Spartaficial
Describe what you want tested and Spartaficial builds and maintains the tests. From specification to running test in hours instead of days.
Visual checks during migrations
After a migration, AI compares the before and after screens. An expert only reviews what differs. That cuts manual checking by more than half.
AI review of user stories
AI checks specifications for completeness and testability before the team starts building. Early feedback, at the point where fixing things is still cheap.

Beyond testing

The gains from AI are easiest to measure in our testing work, but the approach is the same everywhere: AI for the repetitive work, a specialist for the judgment. Here's how that carries through all our areas of expertise.

Software testing
Our most developed area: test automation in plain language, visual checks and smart test selection.
Business analysis
AI helps make sense of documentation and assess requirements for completeness, clarity and testability. That gets the right questions on the table sooner.
Functional management
Knowledge about systems and agreements is often scattered. AI assistants make it usable and help interpret tickets and track changes.
Acceleration
Adding an AI tool isn't an improvement in itself. We connect its capabilities to day-to-day work, with training and clear agreements on how it's used and reviewed.

No experiments on your production systems

Every AI application we use has followed the same path. Our specialists explore new technology in professional communities and share what works and what doesn't. In Cerios Labs, they turn promising ideas into working pilots, together with clients, on real cases. Only what proves itself there is made robust and scalable by our solutions teams. So you know that whatever runs in your environment has already proven itself.

Frequently asked questions about AI testing

What is AI testing?

AI testing is the use of artificial intelligence in the testing process: from generating automated tests based on a plain-language description to comparing screens during a migration. It's also known as AI quality assurance. The goal is faster, sharper testing, while a specialist remains responsible for the verdict.

How do you assure the quality of software partly built by AI?

With the same bar as for all software, but with adapted checks: reviews of the AI-generated code, extra testing depth in the parts AI helped build, and an automated regression suite as a safety net. A model's errors follow different patterns than human errors, and we design our testing around that.

Will AI replace the tester?

No. AI takes over the repetitive work and makes testing up to a hundred times faster, but deciding what needs testing, interpreting the results and deciding whether something can go live remain human work. At Cerios, every AI result is reviewed by a specialist.

Is testing with AI safe for confidential data?

Yes, if you set it up properly. Beforehand, we look at which data is needed, in which environment it's processed and who has access. Our specialists work within the frameworks of the GDPR and the EU AI Act: your data stays yours, models get no more access than necessary and every outcome is traceable.

What does AI testing deliver?

In our testing work: up to 100x faster test feedback, up to 70% less test automation maintenance and, in migrations, more than half less manual checking. The exact gains depend on your IT landscape, and an assessment makes them concrete in a short time.

Do you also test chatbots and LLM applications?

Yes. A chatbot or LLM application never gives exactly the same answer twice, so traditional testing falls short. We test these systems for relevance, safety and consistency, using real-world scenarios and review by specialists who know what an acceptable answer looks like.

What AI knowledge does our team need?

That depends on the application and the roles in the team. We tailor training and support accordingly: learning to work with AI in practice, recognizing its limitations and learning to assess the quality of its output.

Want to know what AI can do for your testing process?
Our AI testing assessment quickly shows where AI adds value, and where you're better off having a specialist take a look. Practical, independent and with no obligation.