ISTQB CT-AI Practice Exams
Last updated on Oct 21,2026- Exam Code: CT-AI
- Exam Name: Certified Tester AI Testing
- Certification Provider: ISTQB
- Latest update: Oct 21,2026
“BioSearch” is creating an Al model used for predicting cancer occurrence via examining X-Ray images. The accuracy of the model in isolation has been found to be good. However, the users of the model started complaining of the poor quality of results, especially inability to detect real cancer cases, when put to practice in the diagnosis lab, leading to stopping of the usage of the model.
A testing expert was called in to find the deficiencies in the test planning which led to the above scenario.
Which ONE of the following options would you expect to MOST likely be the reason to be discovered by the test expert? SELECT ONE OPTION
- A . A lack of similarity between the training and testing data.
- B . The input data has not been tested for quality prior to use for testing.
- C . A lack of focus on choosing the right functional-performance metrics.
- D . A lack of focus on non-functional requirements testing.
Which ONE of the following options represents a technology MOST TYPICALLY used to implement Al? SELECT ONE OPTION
- A . Search engines
- B . Procedural programming
- C . Case control structures
- D . Genetic algorithms
Which ONE of the following options describes the LEAST LIKELY usage of Al for detection of GUI changes due to changes in test objects? SELECT ONE OPTION
- A . Using a pixel comparison of the GUI before and after the change to check the differences.
- B . Using a computer vision to compare the GUI before and after the test object changes.
- C . Using a vision-based detection of the GUI layout changes before and after test object changes.
- D . Using a ML-based classifier to flag if changes in GUI are to be flagged for humans.
Which ONE of the following options is an example that BEST describes a system with Al-based autonomous functions? SELECT ONE OPTION
- A . A system that utilizes human beings for all important decisions.
- B . A fully automated manufacturing plant that uses no software.
- C . A system that utilizes a tool like Selenium.
- D . A system that is fully able to respond to its environment.
Upon testing a model used to detect rotten tomatoes, the following data was observed by the test engineer, based on certain number of tomato images.
For this confusion matrix which combinations of values of accuracy, recall, and specificity respectively is CORRECT? SELECT ONE OPTION
- A . 0.87.0.9. 0.84
- B . 1,0.87,0.84
- C . 1,0.9, 0.8
- D . 0.84.1,0.9
Max. Score: 2
Al-enabled medical devices are used nowadays for automating certain parts of the medical diagnostic processes. Since these are life-critical process the relevant authorities are considenng bringing about suitable certifications for these Al enabled medical devices. This certification may involve several facets of Al testing (I – V).
I. Autonomy
II. Maintainability
III. Safety
IV. Transparency
V. Side Effects
Which ONE of the following options contains the three MOST required aspects to be satisfied for the above scenario of certification of Al enabled medical devices? SELECT ONE OPTION
- A . Aspects II, III and IV
- B . Aspects I, II, and III
- C . Aspects III, IV, and V
- D . Aspects I, IV, and V
A company producing consumable goods wants to identify groups of people with similar tastes for the purpose of targeting different products for each group. You have to choose and apply an appropriate ML type for this problem.
Which ONE of the following options represents the BEST possible solution for this above-mentioned task? SELECT ONE OPTION
- A . Regression
- B . Association
- C . Clustering
- D . Classification
Which ONE of the following options does NOT describe an Al technology related characteristic which differentiates Al test environments from other test environments? SELECT ONE OPTION
- A . Challenges resulting from low accuracy of the models.
- B . The challenge of mimicking undefined scenarios generated due to self-learning
- C . The challenge of providing explainability to the decisions made by the system.
- D . Challenges in the creation of scenarios of human handover for autonomous systems.
A software component uses machine learning to recognize the digits from a scan of handwritten numbers.
In the scenario above, which type of Machine Learning (ML) is this an example of? SELECT ONE OPTION
- A . Reinforcement learning
- B . Regression
- C . Classification
- D . Clustering
Which ONE of the following tests is MOST likely to describe a useful test to help detect different kinds of biases in ML pipeline? SELECT ONE OPTION
- A . Testing the distribution shift in the training data for inappropriate bias.
- B . Test the model during model evaluation for data bias.
- C . Testing the data pipeline for any sources for algorithmic bias.
- D . Check the input test data for potential sample bias.