ISTQB CT-AI Practice Exams
Last updated on Oct 21,2026- Exam Code: CT-AI
- Exam Name: Certified Tester AI Testing
- Certification Provider: ISTQB
- Latest update: Oct 21,2026
Which ONE of the following options does NOT describe an Al technology related characteristic which differentiates Al test environments from other test environments? SELECT ONE OPTION
- A . Challenges resulting from low accuracy of the models.
- B . The challenge of mimicking undefined scenarios generated due to self-learning
- C . The challenge of providing explainability to the decisions made by the system.
- D . Challenges in the creation of scenarios of human handover for autonomous systems.
Which ONE of the following options describes the LEAST LIKELY usage of Al for detection of GUI changes due to changes in test objects? SELECT ONE OPTION
- A . Using a pixel comparison of the GUI before and after the change to check the differences.
- B . Using a computer vision to compare the GUI before and after the test object changes.
- C . Using a vision-based detection of the GUI layout changes before and after test object changes.
- D . Using a ML-based classifier to flag if changes in GUI are to be flagged for humans.
Which of the following best describes the use of natural language processing in AI testing?
- A . Generation of test data from structured databases
- B . Validation of software requirements from user feedback
- C . Conversion of textual requirements into test cases
- D . Assessment of user interfaces for usability issues
Which ONE of the following characteristics is the least likely to cause safety related issues for an Al system? SELECT ONE OPTION
- A . Non-determinism
- B . Robustness
- C . High complexity
- D . Self-learning
A system was developed for screening the X-rays of patients for potential malignancy detection (skin cancer). A workflow system has been developed to screen multiple cancers by using several individually trained ML models chained together in the workflow.
Testing the pipeline could involve multiple kind of tests (I – III):
I. Pairwise testing of combinations
II. Testing each individual model for accuracy
III. A/B testing of different sequences of models
Which ONE of the following options contains the kinds of tests that would be MOST APPROPRIATE to include in the strategy for optimal detection? SELECT ONE OPTION
- A . Only III
- B . I and II
- C . I and III
- D . Only II
In a certain coffee producing region of Colombia, there have been some severe weather storms, resulting in massive losses in production. This caused a massive drop in stock price of coffee.
Which ONE of the following types of testing SHOULD be performed for a machine learning model for stock-price prediction to detect influence of such phenomenon as above on price of coffee stock. SELECT ONE OPTION
- A . Testing for accuracy
- B . Testing for bias
- C . Testing for concept drift
- D . Testing for security
Upon testing a model used to detect rotten tomatoes, the following data was observed by the test engineer, based on certain number of tomato images.
For this confusion matrix which combinations of values of accuracy, recall, and specificity respectively is CORRECT? SELECT ONE OPTION
- A . 0.87.0.9. 0.84
- B . 1,0.87,0.84
- C . 1,0.9, 0.8
- D . 0.84.1,0.9
In a conference on artificial intelligence (Al), a speaker made the statement, "The current implementation of Al using models which do NOT change by themselves is NOT true Al*.
Based on your understanding of Al, is this above statement CORRECT or INCORRECT and why? SELECT ONE OPTION
- A . This statement is incorrect. Current Al is true Al and there is no reason to believe that this fact will change over time.
- B . This statement is correct. In general, what is considered Al today may change over time.
- C . This statement is incorrect.
What is considered Al today will continue to be Al even as technology evolves and changes. - D . This statement is correct. In general, today the term Al is utilized incorrectly.
ln the near future, technology will have evolved, and Al will be able to learn multiple tasks by itself without needing to be retrained, allowing it to operate even in new environments. The cognitive abilities of Al are similar to a child of 1-2 years.’
In the above quote, which ONE of the following options is the correct name of this type of Al? SELECT ONE OPTION
- A . Technological singularity
- B . Narrow Al
- C . Super Al
- D . General Al
Which ONE of the following options describes a scenario of A/B testing the LEAST? SELECT ONE OPTION
- A . A comparison of two different websites for the same company to observe from a user acceptance perspective.
- B . A comparison of two different offers in a recommendation system to decide on the more effective offer for same users.
- C . A comparison of the performance of an ML system on two different input datasets.
- D . A comparison of the performance of two different ML implementations on the same input data.