Appearance
Glossary (CT-AI Syllabus v2.0)
Source
Definitions from the ISTQB® Glossary (all 278 terms the Glossary tags for CT-AI v2.0, retrieved 2026-11-20), supplemented by the CT-AI v2.0 Syllabus, Chapter 9 (AI-Specific Terms). Each entry names its source; entries marked Unofficial were compiled by this guide from the syllabus text because no official definition exists. The syllabus wording is authoritative for the exam. Official source
A searchable reference of 283 terms.
A/B testing
A test approach in which two variants of a test object are statistically evaluated to determine which performs better for specified characteristics.
Source: ISTQB® Glossary (references: ISO 29119-11)
acceptance criteria
The criteria that a work product must satisfy to be accepted by the stakeholders.
Source: ISTQB® Glossary (references: IREB Glossary)
acceptance testing
A test level that focuses on determining whether to accept the system.
Source: ISTQB® Glossary
accountability
The degree to which the actions of an entity can be traced uniquely to that entity.
Source: ISTQB® Glossary (references: ISO 25010)
accuracy
The ML functional performance metric used to evaluate a classifier, which measures the proportion of predictions that were correct.
Source: ISTQB® Glossary (references: ISO 29119-11)
activation function
The formula associated with a neuron in a neural network that determines the output of the neuron from the inputs to the neuron.
Source: ISTQB® Glossary
activation value
The output of an activation function of a neuron in a neural network.
Source: ISTQB® Glossary
adaptability
The degree to which a component or system can be adapted to various or evolving hardware, software, or other operational or usage environments.
Source: ISTQB® Glossary (references: ISO 25010)
adaptive AI-based system
An AI-based system that adjusts its behavior in response to changes in its operational environment.
Source: ISTQB® Glossary
adversarial attack
The deliberate use of adversarial examples to cause an ML model to fail.
Source: ISTQB® Glossary
adversarial example
An input to an ML model created by applying small perturbations to a working example that results in the model outputting an incorrect result with high confidence.
Source: ISTQB® Glossary (references: ISO 29119-11)
adversarial testing
A test technique in which tests are designed based on adversarial examples.
Source: ISTQB® Glossary
AI as a Service (AIaaS)
A software licensing and delivery model in which AI and AI development services are centrally hosted.
Source: ISTQB® Glossary
AI component
A component that provides AI functionality.
Source: ISTQB® Glossary
AI functional correctness Unofficial
Functional correctness adjusted for AI-based systems: because a certain error rate is expected in AI outputs, it is evaluated by considering both correct and incorrect outputs and by defining acceptable thresholds for incorrect results. A modified sub-characteristic of functional suitability in ISO/IEC 25059 (product quality).
Source: Unofficial: compiled by this guide from syllabus section 2.1.1 (no ISTQB® Glossary or Chapter 9 entry)
AI model
A computer program that implements AI.
Source: ISTQB® Glossary
AI robustness Unofficial
The ability of an AI-based system to maintain its level of AI functional correctness regardless of circumstances, such as the presence of biased, adversarial, or invalid data inputs, external interference, adverse environmental conditions, and operator misuse. A new sub-characteristic of reliability in ISO/IEC 25059 (product quality).
Source: Unofficial: compiled by this guide from syllabus section 2.1.1 (no ISTQB® Glossary or Chapter 9 entry)
AI-based system
A system that incorporates one or more AI components.
Source: ISTQB® Glossary
algorithmic bias
A type of bias caused by the ML algorithm.
Source: ISTQB® Glossary
annotation
The activity of identifying objects in images with bounding boxes to provide labelled data for classification.
Source: ISTQB® Glossary
API testing
A test approach performed by submitting requests to a test object using its application programming interface.
Source: ISTQB® Glossary
application programming interface (API)
A type of interface in which the components or systems involved exchange information in a defined formal structure.
Source: ISTQB® Glossary
artificial intelligence (AI)
The capability of an engineered system to acquire, process, create and apply knowledge and skills.
Source: ISTQB® Glossary (references: ISO 29119-11)
association
An unsupervised ML learning technique that identifies relationships and dependencies between samples.
Source: ISTQB® Glossary
attack
A test approach in which a set of deliberate actions is used to reveal a particular defect type.
Source: ISTQB® Glossary
attack vector
A path or means by which an attacker can gain access to a system for malicious purposes.
Source: ISTQB® Glossary
audit
An independent examination performed by a third party on a work product or process to assess whether it complies with specified criteria.
Source: ISTQB® Glossary (references: ISO 24765)
augmentation
The activity of creating new data points based on an existing dataset.
Source: ISTQB® Glossary
automotive safety integrity level
One of four levels that specify the item's or element's necessary requirements of ISO 26262 and safety measures to avoid an unreasonable residual risk.
Source: ISTQB® Glossary (references: ISO 26262)
availability
The degree to which a component or system is operational and accessible when required for use.
Source: ISTQB® Glossary (references: ISO 25010)
back-to-back testing
A test approach in which a pseudo-oracle is used.
Source: ISTQB® Glossary (references: ISO 29119-1)
Bayesian model
A statistical model that uses probability to represent the uncertainty of both model inputs and outputs.
Source: ISTQB® Glossary
bias
The systematic difference in treatment of certain objects, people or groups in comparison to others. (After ISO/IEC TR 24027)
Source: CT-AI v2.0 Syllabus, Chapter 9 (no ISTQB® Glossary entry tagged for CT-AI v2.0)
big data
Extensive datasets whose characteristics in terms of volume, variety, velocity and/or variability require specialized technologies and techniques to process.
Source: ISTQB® Glossary
black-box testing
A test approach based on the specification of a component or system.
Source: ISTQB® Glossary
bootstrap technique
A resampling technique that repeatedly draws samples with replacement from a training dataset to estimate the ML functional performance criteria of an ML model.
Source: ISTQB® Glossary
boundary value analysis
A black-box test technique in which the test conditions are boundary values.
Source: ISTQB® Glossary
branch
A transfer of control between two consecutive nodes in the control flow graph of a test item.
Source: ISTQB® Glossary
certification
The process of confirming that a component, system or person complies with specified requirements.
Source: ISTQB® Glossary
chatbot
An application used to conduct a conversation via text or text-to speech.
Source: ISTQB® Glossary
classification
An ML function that predicts the output class for a given input.
Source: ISTQB® Glossary (references: ISO 29119-11)
classifier
An ML model used for classification. Synonyms: classification model.
Source: ISTQB® Glossary
clustering
An ML function that groups similar data points together.
Source: ISTQB® Glossary
clustering algorithm
A type of ML algorithm used to group similar objects into clusters.
Source: ISTQB® Glossary
compatibility
The degree to which a component or system can exchange information with other components or systems, and/or perform its required functions while sharing the same hardware or software environment.
Source: ISTQB® Glossary (references: ISO 25010)
compliance
Adherence of a work product to standards, conventions or regulations in laws and similar prescriptions.
Source: ISTQB® Glossary (references: IREB Glossary)
component
A part of a system that can be tested in isolation.
Source: ISTQB® Glossary
component integration testing
The integration testing of components.
Source: ISTQB® Glossary
component testing
A test level that focuses on individual hardware or software components.
Source: ISTQB® Glossary
concept drift
A change in user expectations, behavior or the operational environment over time that negatively impacts the ML functional performance of an operational ML model.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “A change in the perceived functional performance of an ML model over time caused by changes in user expectations, behavior and the operational environment.”
Source: ISTQB® Glossary
confidence interval
In managing project risks, the period of time within which a contingency action must be implemented in order to be effective in reducing the impact of the risk.
Source: ISTQB® Glossary
confirmation testing
A type of change-related testing performed after fixing a defect to confirm that a failure caused by that defect does not reoccur.
Source: ISTQB® Glossary
confusion matrix
A technique for summarizing the ML functional performance of a classification algorithm.
Source: ISTQB® Glossary
convolutional neural network (CNN)
A type of deep learning model designed to process grid-like data such as images, enabling it to recognize spatial patterns and features through layered operations.
Source: ISTQB® Glossary
coverage
The degree to which specified coverage items are exercised by a test suite, expressed as a percentage.
Source: ISTQB® Glossary
cross-device testing
A test type to determine whether a component or system performs correctly across its intended range of devices.
Source: ISTQB® Glossary
cross-prompt injection attack
An attack in which malicious instructions in one prompt or context segment disrupt an AI model’s behavior in a different prompt, turn, or context segment.
Source: ISTQB® Glossary
dashboard
A representation of dynamic measurements of operational performance for some organization or activity, using metrics represented via metaphors such as visual dials, counters, and other devices resembling those on the dashboard of an automobile, so that the effects of events or activities can be easily understood and related to operational goals.
Source: ISTQB® Glossary
data accuracy
The degree to which data correctly represents the real-world values it is intended to model.
Source: ISTQB® Glossary
data acquisition
The activity of acquiring data relevant to the business problem to be solved by an ML model.
Source: ISTQB® Glossary
data bias
A systematic error caused by inaccurate, incomplete, or unrepresentative training data that leads to unfair outcomes in ML models.
Source: ISTQB® Glossary
data drift
A change in the distribution of input data over time that negatively impacts the ML functional performance of an operational ML model.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “A change in the distribution of input data over time, which can negatively impact the functional performance of an operational ML model.”
Source: ISTQB® Glossary
data pipeline
The implementation of data preparation activities to provide input data to support training by an ML algorithm or prediction by an ML model.
Source: ISTQB® Glossary
data pipeline testing
A test type that covers the training and operational data pipelines of a machine learning system.
Source: ISTQB® Glossary
data point
A set of one or more measurements comprising a single observation used as part of a dataset.
Source: ISTQB® Glossary
data preparation
The activities of data acquisition, data preprocessing and feature engineering in the ML workflow.
Source: ISTQB® Glossary
data preprocessing
The activities of data cleaning, data transformation, data augmentation, and data sampling in the ML workflow.
Source: ISTQB® Glossary
data privacy
The protection of personally identifiable information or otherwise sensitive information from undesired disclosure.
Source: ISTQB® Glossary
data provenance testing
A test type to determine if data is sourced, managed, protected, and used in accordance with an organization's policies, standards, and regulatory obligations.
Source: ISTQB® Glossary
data representativeness testing
A test type to determine if the datasets used for training an AI model are fair representations of the data expected to be encountered by the operational model.
Source: ISTQB® Glossary
dataset
A collection of data used for training, evaluation, testing and prediction in ML.
Source: ISTQB® Glossary
dataset constraint testing
A type of static testing to determine if logical or specified constraints are followed on a dataset.
Source: ISTQB® Glossary
decision tree
A tree-like ML model whose nodes represent decisions, and whose branches represent possible outcomes.
Source: ISTQB® Glossary
deep learning (DL)
An ML approach that uses deep neural networks to automatically learn patterns from data.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “ML using deep neural networks to automatically learn complex features and representations from large datasets.”
Source: ISTQB® Glossary
deep neural network (DNN)
A neural network comprised of several layers of neurons. Synonyms: multi-layer perceptron.
Source: ISTQB® Glossary
deepfake
Synthetic media, such as video, audio, or images, created or edited using AI to convincingly mimic or impersonate real people or events.
Source: ISTQB® Glossary
defect
An imperfection or deficiency in a work product where it does not meet its requirements or specifications or impairs its intended use.
Source: ISTQB® Glossary (references: ISO 24765)
defect prediction
A technique to predict the areas within the test object in which defects will occur or the quantity of defects that are present
Source: ISTQB® Glossary
deterministic
Producing the same set of outputs and final state from a given set of inputs and starting state.
Source: ISTQB® Glossary
disparate impact analysis
A technique for detecting bias by comparing decisions on original scenarios with their counterfactual versions, where sensitive attributes are swapped.
Source: ISTQB® Glossary
drift testing
A type of maintenance testing that evaluates the degree to which data drift, concept drift or both occur.
Source: ISTQB® Glossary
driver
A component or tool that temporarily replaces another component and controls or calls a test item in isolation.
Source: ISTQB® Glossary
dynamic testing
A test approach that involves test execution of a test item.
Source: ISTQB® Glossary (references: ISO 29119-1)
edge AI
The deployment of AI models on local edge devices, enabling real-time processing near the source of data without relying on cloud-based systems.
Source: ISTQB® Glossary
edge case
A test condition which is within the defined operational limits of a component or system but is uncommon, extreme, or atypical.
Source: ISTQB® Glossary
edge computing
The part of a distributed architecture in which information processing is performed close to where that information is used.
Source: ISTQB® Glossary
effectiveness
The extent to which correct and complete goals are achieved.
Source: ISTQB® Glossary (references: ISO 9241-11)
efficiency
The degree to which resources are expended in relation to results achieved.
Source: ISTQB® Glossary (references: IREB Glossary)
epoch
An iteration of ML training on the whole training dataset.
Source: ISTQB® Glossary
error
A human action that results in a defect.
Source: ISTQB® Glossary (references: ISO 24765)
ethical system testing
A test type that evaluates a system's design, interface, and potential societal and legal impacts against established ethical principles.
Source: ISTQB® Glossary
expected result
The observable predicted behavior of a test item under specified conditions based on its test basis.
Source: ISTQB® Glossary (references: ISO 29119-1)
expert system
An AI-based system for solving problems in a particular domain or application area by drawing inferences from a knowledge base developed from human expertise.
Source: ISTQB® Glossary
explainability
The degree to which results from an AI-based system can be explained.
Source: ISTQB® Glossary
explainable AI
The field of study related to understanding the factors that influence AI system outputs.
Source: ISTQB® Glossary
exploratory data analysis (EDA)
An interactive, visual, and hypothesis-driven process to summarize, explore, and understand the main characteristics and patterns of data.
Source: ISTQB® Glossary
exploratory testing
A test approach in which tests are dynamically designed and executed based on tester's knowledge, exploration of a test item, and previous test results.
Source: ISTQB® Glossary (references: ISO 29119-1)
F1-Score
An ML functional performance metric used to evaluate a classifier which provides a balance between recall and precision.
Source: ISTQB® Glossary
failed
A test result if the actual result does not match the expected result.
Source: ISTQB® Glossary
failure
An event in which a component or system does not meet its requirements within specified limits during its execution.
Source: ISTQB® Glossary (references: ISO 24765)
false negative (FN)
An ML model prediction in which the model mistakenly predicts the negative class.
Source: ISTQB® Glossary
false positive (FP)
An ML model prediction in which the model mistakenly predicts the positive class.
Source: ISTQB® Glossary
fault attack
A test technique to evaluate a specific quality characteristic of a test object by attempting to trigger specific failures.
Source: ISTQB® Glossary
fault injection
A technique for creating adverse conditions to evaluate whether a component or system can detect them and show reliable behavior.
Source: ISTQB® Glossary
feature
An individual measurable attribute of the input data used for training by an ML algorithm and for prediction by an ML model.
Source: ISTQB® Glossary
feature engineering
The activity in which those attributes in the raw data that best represent the underlying relationships that should appear in the ML model are identified for use in the training data.
Source: ISTQB® Glossary (references: ISO 29119-11)
feature testing
A test type to determine if an AI model training dataset contains an appropriate set of features.
Source: ISTQB® Glossary
flexibility
The degree to which a component or system can be adapted to changes in its requirements, contexts of use, or system environment.
Source: ISTQB® Glossary (references: ISO 25010)
follow-up test case
A test case generated by applying a metamorphic relation to a source test case during metamorphic testing.
Source: ISTQB® Glossary
foundation model
A large-scale ML model trained on large datasets using self-supervised learning, designed as a versatile base that can be fine-tuned or adapted to a wide range of tasks across different domains.
Source: ISTQB® Glossary
frontier AI
A general-purpose AI-based system that exceeds the capabilities of today’s most advanced AI systems.
Source: ISTQB® Glossary
functional adaptability
The degree to which an AI-based system can acquire information from data or previous actions to make future predictions.
Source: ISTQB® Glossary (references: ISO 25059)
functional correctness
The degree to which a component or system provides the correct results with the needed degree of precision.
Source: ISTQB® Glossary
functional safety
The absence of unreasonable risk due to hazards caused by malfunctioning behavior of electric/electronic systems.
Source: ISTQB® Glossary (references: ISO 26262)
functional suitability
The degree to which a component or system provides functions that meet stated and implied needs when used under specified conditions.
Source: ISTQB® Glossary (references: ISO 25010)
functional testing
A test type to determine the functional suitability of a test object.
Source: ISTQB® Glossary (references: ISO 24765)
fuzz testing
A test technique in which high volumes of random data are used to generate test inputs.
Source: ISTQB® Glossary
fuzzy logic
A type of logic based on the concept of partial truth represented by certainty factors between 0 and 1.
Source: ISTQB® Glossary
general AI
A type of AI that can match human cognitive abilities across most intellectual tasks.
Source: ISTQB® Glossary
generative AI (GenAI)
A type of AI that uses ML to generate new content that resembles human-created content.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “A type of AI that creates new content by learning patterns from existing data.”
Source: ISTQB® Glossary
graphics processing unit (GPU)
An application-specific integrated circuit designed to manipulate and alter memory to accelerate the creation of images in a frame buffer intended for output to a display device.
Source: ISTQB® Glossary
ground truth
The information provided by direct observation and measurement that is known to be real or true.
Source: ISTQB® Glossary
hyperparameter
A parameter used to either control the training of an ML model or to set the configuration of an ML model.
Source: ISTQB® Glossary
hyperparameter tuning
The activity of determining the optimal hyperparameters based on particular goals.
Source: ISTQB® Glossary
hypothesis testing
The validation of a theory and its assumptions using sample data.
Source: ISTQB® Glossary
impact analysis
The identification of all work products affected by a change, including an estimate of the resources needed to accomplish the change.
Source: ISTQB® Glossary (references: ISO 24765)
independence of testing
The separation of testing responsibilities from development for a test object.
Source: ISTQB® Glossary (references: DO-178C)
input data testing
A test level that focuses on the quality of data used for training an ML model.
Source: ISTQB® Glossary
inspection
A type of formal review that uses defined team roles and measurement to identify defects in a work product, and improve the review process and the software development process.
Source: ISTQB® Glossary (references: ISO 20246)
installability
The degree to which a component or system can be successfully installed and/or uninstalled in a specified environment.
Source: ISTQB® Glossary (references: ISO 25010)
integrity
The degree to which only authorized access and modification is allowed to a component, a system or data.
Source: ISTQB® Glossary
intelligent agent
An autonomous program which directs its activity towards achieving goals using observations and actions.
Source: ISTQB® Glossary
inter-annotator agreement (IAA)
The degree of consensus or similarity among the annotations made by different annotators on the same data.
Source: ISTQB® Glossary (references: ISO 12791)
interaction capability
The degree to which a component or system can exchange information via the user interface with its specified users to complete an intended task.
Source: ISTQB® Glossary (references: ISO 25010)
intervenability
The degree to which an operator can intervene in a system’s functioning in a timely manner to prevent harm or hazard.
Source: ISTQB® Glossary
k-multisection neuron coverage (kMNC)
The coverage of sections of the output range of each neuron in a neural network, where the output range is divided into k sections.
Source: ISTQB® Glossary
keyword
A phrase that represents specific actions to be performed during test execution.
Source: ISTQB® Glossary (references: ISO 29119-1)
label correctness testing
A test type to determine the accuracy and consistency of labels assigned to examples in a dataset.
Source: ISTQB® Glossary
large language model (LLM)
A generative AI system trained on very large collections of language data.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “A text-to-text generative AI system trained on very large collections of language data.”
Source: ISTQB® Glossary
linear regression
A statistical technique that models the relationship between variables by fitting a linear equation to the observed data when the target variable is numeric.
Source: ISTQB® Glossary
locked AI-based system
A deterministic AI-based system with a fixed unchanging model which does not change its behavior once it is deployed.
Source: ISTQB® Glossary
machine learning (ML)
The process of using computational techniques to enable systems to learn from data or experience.
Source: ISTQB® Glossary
maintainability
The degree to which a component or system can be modified by the intended maintainers.
Source: ISTQB® Glossary (references: ISO 25010)
maintenance
The process of modifying a component or system after delivery to correct defects, improve quality characteristics, or adapt to a changed environment.
Source: ISTQB® Glossary (references: ISO 24765)
malware
Software that is intended to harm a system or its components.
Source: ISTQB® Glossary
maturity
(1) The capability of an organization with respect to the effectiveness and efficiency of its processes and work practices. (2) The degree to which a component or system meets needs for reliability under normal operation.
Source: ISTQB® Glossary
metamorphic relation
A description of how a change to an input for a test case affects an expected result based on the required behavior of a test item.
Source: ISTQB® Glossary (references: ISO 29119-1)
metamorphic testing
A test technique in which test conditions are metamorphic relations.
Source: ISTQB® Glossary
metric
A measurement scale and the method used for measurement.
Source: ISTQB® Glossary
ML algorithm
An algorithm used to create an ML model from a training dataset.
Source: ISTQB® Glossary
ML development framework
A software platform that provides tools and libraries to build, train, and deploy ML models.
Source: ISTQB® Glossary
ML development testing Unofficial
Testing that addresses the risks introduced by ML development tools, configuration choices, and deployment mechanisms, rather than by the ML model itself, using test approaches and test types such as API testing, ML functional performance testing, A/B testing, back-to-back testing and reviews.
Source: Unofficial: compiled by this guide from syllabus section 7.1 (no ISTQB® Glossary or Chapter 9 entry)
ML function
Functionality implemented by an ML model, such as classification, ML regression or clustering.
Source: ISTQB® Glossary
ML functional performance
The degree to which an ML model meets ML functional performance criteria.
Source: ISTQB® Glossary
ML functional performance criteria
Criteria based on ML functional performance metrics used as a basis for model evaluation, tuning and testing.
Source: ISTQB® Glossary
ML functional performance metric
A measure that relates to the functional correctness of an ML model.
Source: ISTQB® Glossary
ML model
An implementation of machine learning that generates a prediction, classification or recommendation based on input data.
Source: ISTQB® Glossary
ML model testing
A test level that focuses on the ability of an ML model to meet required ML functional performance criteria and non-functional criteria.
Source: ISTQB® Glossary
ML regression
A type of ML function that results in a numerical or continuous output value for a given input.
Source: ISTQB® Glossary (references: ISO 29119-11)
ML workflow
The set of activities used to develop, deploy and operate an ML model.
Source: ISTQB® Glossary
MLS
A system that integrates one or more ML models.
Source: ISTQB® Glossary
model confidence score analysis
A technique that identifies data points with low confidence scores from training, which are indicators for mislabeled data points.
Source: ISTQB® Glossary
model conversion testing
A test type to determine whether an ML model converted for deployment retains acceptable predictive accuracy, consistent behavior, and operational efficiency.
Source: ISTQB® Glossary
model loss analysis
A technique that identifies data points with high loss values during training, which are indicators for mislabeled data points.
Source: ISTQB® Glossary
monitoring tool
A software tool or hardware device that runs concurrently with a system under test and supervises, records and/or analyzes its behavior.
Source: ISTQB® Glossary (references: ISO 24765)
multimodal model
An ML model capable of processing text, images, audio, and video and other data modalities.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “An ML model designed to handle multiple types of data modalities, such as text, images, audio, and video.”
Source: ISTQB® Glossary
multiple annotation
An approach in which labelled data points from multiple annotators are compared.
Source: ISTQB® Glossary
narrow AI
AI focused on a single well-defined task to address a specific problem. Synonyms: weak AI.
Source: ISTQB® Glossary (references: ISO 29119-11)
natural language processing (NLP)
A field of computing that provides the ability to read, understand, and derive meaning from natural languages.
Source: CT-AI v2.0 Syllabus, Chapter 9 (no ISTQB® Glossary entry tagged for CT-AI v2.0)
neural network
A network of primitive processing elements connected by weighted links with adjustable weights, in which each element produces a value by applying a nonlinear function to its input values, and transmits it to other elements or presents it as an output value. Synonyms: artificial neural network.
Source: ISTQB® Glossary (references: ISO 2382)
neuromorphic processor
An integrated circuit designed to mimic the biological neurons of the human brain.
Source: ISTQB® Glossary
neuron
A node in a neural network, usually receiving multiple input values and generating an activation value.
Source: ISTQB® Glossary
neuron boundary coverage (NBC)
The coverage of neurons in a neural network where their output either exceeds the maximum achieved in training, or is less than the minimum achieved in training.
Source: ISTQB® Glossary
neuron coverage
The coverage of neurons in a neural network where their output exceeds a specified threshold.
Source: ISTQB® Glossary
noise
A distortion or corruption in data.
Source: ISTQB® Glossary
non-determinism
A property of a system or process in which an outcome is not uniquely determined by its initial conditions.
Source: ISTQB® Glossary
non-functional testing
A test type to evaluate that a component or system complies with non-functional requirements.
Source: ISTQB® Glossary
outlier
An observation that lies outside the overall pattern of the data distribution.
Source: ISTQB® Glossary
overfitting
The generation of an ML model that corresponds too closely to the training dataset, resulting in a model that finds it difficult to generalize to new data.
Source: ISTQB® Glossary (references: ISO 29119-11)
passed
A test result if the actual result matches the expected result.
Source: ISTQB® Glossary
perceptron
A neural network with just one layer and one neuron.
Source: ISTQB® Glossary
performance efficiency
The degree to which a component or system performs its functions with efficient use of resources under specified conditions, throughput, and time.
Source: ISTQB® Glossary (references: ISO 25010)
performance testing
A test type to determine the performance efficiency of a component or system.
Source: ISTQB® Glossary
phishing
An attempt to acquire personal or sensitive information by masquerading as a trustworthy entity in an electronic communication.
Source: ISTQB® Glossary
precision
An ML functional performance metric used to evaluate a classifier, which measures the proportion of predicted positives that were correct.
Source: ISTQB® Glossary (references: ISO 29119-11)
precondition
The required state of a test item and its test environment prior to test execution.
Source: ISTQB® Glossary
pretrained model
An ML model that has already been trained on a large, general purpose dataset and can be reused or fine-tuned for specific tasks.
Source: ISTQB® Glossary
probabilistic
Behavior described in terms of probabilities, where outcomes are uncertain and described by likelihoods rather than certainty.
Source: ISTQB® Glossary
product risk
A risk that impacts the quality of a product.
Source: ISTQB® Glossary
project risk
A risk that impacts project success.
Source: ISTQB® Glossary
pseudo-oracle
An independently derived variant of the test item used to generate results, which are compared with the results of the original test item based on the same test inputs.
Source: ISTQB® Glossary (references: ISO 29119-11)
quality
The degree to which a work product satisfies stated and implied requirements.
Source: ISTQB® Glossary (references: IREB Glossary)
quality assurance
Activities focused on providing confidence that quality requirements will be fulfilled.
Source: ISTQB® Glossary (references: ISO 24765)
quality characteristic
A category of quality attributes that bears on work product quality.
Source: ISTQB® Glossary (references: ISO 24765)
quality measure
A group of preventive, detective or corrective activities to achieve a required quality level.
Source: ISTQB® Glossary
random forest
Ensemble ML technology for classification, ML regression and other tasks that operate by constructing and running many decision trees and then either outputting the mode of the class or the mean prediction of the individual trees.
Source: ISTQB® Glossary
recall
An ML functional performance metric used to evaluate a classifier, which measures the proportion of actual positives that were predicted correctly. Synonyms: sensitivity.
Source: ISTQB® Glossary (references: ISO 29119-11)
recurrent neural network (RNN)
A type of deep learning model designed to process sequential data, enabling it to recognize patterns and dependencies over time.
Source: ISTQB® Glossary
red teaming (RT)
A test approach that involves attacking a system to deliberately cause it to produce harmful or undesirable results.
Source: ISTQB® Glossary
regression testing
A type of change-related testing to detect whether defects have been introduced or uncovered in unchanged areas of the software.
Source: ISTQB® Glossary
reinforcement learning
An approach in which an ML model, known as an agent, learns by using a trial-and-reward feedback loop with its environment to achieve specific objectives.
Source: ISTQB® Glossary
reliability
The degree to which a component or system performs specified functions under specified conditions for a specified period of time.
Source: ISTQB® Glossary (references: ISO 25010)
requirement
A provision that contains criteria to be fulfilled.
Source: ISTQB® Glossary (references: ISO 24765)
resource utilization
The degree to which a component or system uses no more than the specified amount of resources to perform its function under specified conditions.
Source: ISTQB® Glossary (references: ISO 25010)
retrieval-augmented generation (RAG)
An approach where a GenAI system retrieves relevant external information to supplement its internal knowledge and generate more accurate, contextually relevant responses.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “An ML technique where a GenAI system dynamically improves its output by retrieving relevant external information to supplement its internal knowledge.”
Source: ISTQB® Glossary
review
A type of static testing in which the quality of a work product or process is evaluated by individuals.
Source: ISTQB® Glossary
reward function
A function that defines the success of reinforcement learning.
Source: ISTQB® Glossary
reward hacking
The activity performed by an intelligent agent to maximize its reward function to the detriment of meeting the original objective.
Source: ISTQB® Glossary (references: ISO 29119-11)
risk
A factor that could result in future negative consequences.
Source: ISTQB® Glossary
risk mitigation
The process through which decisions are reached and protective measures are implemented for reducing or maintaining risks to specified levels.
Source: ISTQB® Glossary
risk-based testing
A test approach in which the management, selection, prioritization, and use of test activities and resources are based on corresponding risk types and risk levels.
Source: ISTQB® Glossary (references: ISO 29119-1)
robustness
The degree to which a component or system maintains its level of performance under any circumstances.
Source: ISTQB® Glossary
safety
The degree to which a component or system under defined conditions can avoid endangering human life, health, property, or the environment.
Source: ISTQB® Glossary (references: ISO 25010)
scalability
The degree to which a component or system can be adjusted for changing capacity.
Source: ISTQB® Glossary (references: Gerrard)
search algorithm
An algorithm that systematically visits a subset of all possible states or structures until the goal state or structure is reached.
Source: ISTQB® Glossary (references: ISO 29119-11)
security
The degree to which a component or system defends against security attacks and provides access appropriate to types and levels of authorization.
Source: ISTQB® Glossary (references: ISO 25010)
security testing
A test type to determine the security of a component or system.
Source: ISTQB® Glossary
self-learning system
An adaptive system that changes its behavior based on learning through trial and error.
Source: ISTQB® Glossary (references: ISO 29119-11)
sensitive attributes
Characteristics that define legally or ethically protected groups and individuals that must be controlled to prevent discrimination.
Source: ISTQB® Glossary
sentiment analysis
The use of natural language processing and machine learning to identify and classify the emotional tone expressed in text.
Source: ISTQB® Glossary
shadow testing
A test type used to compare a new version of a component or system with the current version by running the former in the background.
Source: ISTQB® Glossary
side-effects testing
A test type to determine if executing a test object leads to unforeseen consequences.
Source: ISTQB® Glossary
smoke testing
A test type to gain sufficient confidence that a test object is ready for planned testing.
Source: ISTQB® Glossary
societal and ethical risk mitigation
The degree to which an AI-based system avoids risks to society arising from its operation.
Source: ISTQB® Glossary (references: ISO 25059)
source test case
A test case that passed and is used as the basis of follow-up test cases in metamorphic testing.
Source: ISTQB® Glossary
static analysis
The automated process of evaluating a component or system without executing it, based on its form, structure, content, or documentation.
Source: ISTQB® Glossary (references: ISO 24765)
stratified sampling
A technique to confirm if a sample proportionally represents different sub-populations within the overall population.
Source: ISTQB® Glossary
structural coverage
Coverage measures based on the internal structure of a component or system.
Source: ISTQB® Glossary
super AI
A type of AI that far exceeds human capabilities.
Source: ISTQB® Glossary
supervised learning
An approach to training an ML model by using a labeled dataset.
Source: ISTQB® Glossary
support vector machine (SVM)
A supervised ML algorithm that finds the optimal hyperplane between data points for classification or ML regression tasks.
Source: ISTQB® Glossary
system integration testing
A test level that focuses on the integration of systems.
Source: ISTQB® Glossary
system testing
A test level that focuses on verifying that a system as a whole meets specified requirements.
Source: ISTQB® Glossary
system under test
A type of test object that is a system.
Source: ISTQB® Glossary
technological singularity
A point in the future when technological advances are no longer controllable by people.
Source: ISTQB® Glossary (references: ISO 29119-11)
temperature
A parameter that controls the randomness of GenAI outputs, with lower values generating more predictable results and higher values generating more creative results.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “A setting controlling the randomness of GenAI outputs, with lower values generating more predictable results and higher values generating more creative results.”
Source: ISTQB® Glossary
test
A set of one or more test cases.
Source: ISTQB® Glossary
test analyst
A person responsible for test analysis, test design, test implementation, and test execution, focusing on non-technical aspects of software.
Source: ISTQB® Glossary
test approach
The manner of implementing test tasks.
Source: ISTQB® Glossary
test automation
The conversion of test activities to automated operation.
Source: ISTQB® Glossary (references: ISO 2382)
test case
A set of preconditions, inputs, actions (where applicable), expected results and postconditions, developed based on test conditions.
Source: ISTQB® Glossary
test condition
A testable aspect of a component or system that is intended to be tested.
Source: ISTQB® Glossary (references: ISO 29119-1)
test data
Data needed for test execution.
Source: ISTQB® Glossary
test environment
An environment containing hardware, instrumentation, simulators, software tools, and other support elements needed to perform a test.
Source: ISTQB® Glossary (references: ISO 24765)
test level
A specific instantiation of a test process.
Source: ISTQB® Glossary
test management
The process of planning, scheduling, estimating, monitoring, reporting, controlling, and completing test activities.
Source: ISTQB® Glossary (references: ISO 29119-1)
test manager
The person responsible for managing test activities, test resources, and evaluating the test object.
Source: ISTQB® Glossary
test object
The work product to be tested.
Source: ISTQB® Glossary
test objective
The purpose for testing.
Source: ISTQB® Glossary
test oracle
A source to determine an expected result.
Source: ISTQB® Glossary (references: Adrion)
test oracle problem
The challenge of determining whether a test has passed or failed for a given set of test inputs and state.
Source: ISTQB® Glossary
test process
A set of test activities performed to achieve a test objective.
Source: ISTQB® Glossary (references: ISO 29119-1)
test report
Documentation summarizing testing and test results.
Source: ISTQB® Glossary
test result
The status of the execution of a test.
Source: ISTQB® Glossary (references: ISO 29119-1)
test run
The execution of a test suite on a specific version of the test object.
Source: ISTQB® Glossary
test strategy
A description of how to perform testing to reach test objectives under given circumstances.
Source: ISTQB® Glossary
test suite
A set of test scripts or test procedures to be executed in a specific test run.
Source: ISTQB® Glossary
test technique
A procedure used to define test conditions, design test cases, and specify test data.
Source: ISTQB® Glossary
test type
A group of test activities based on specific test objectives aimed at specific characteristics of a component or system.
Source: ISTQB® Glossary (references: TMap)
testability
The degree to which test conditions can be established for a component or system, and tests can be performed to determine whether those test conditions have been met.
Source: ISTQB® Glossary
tester
A person who performs testing.
Source: ISTQB® Glossary
testing
The process within the software development lifecycle that evaluates the quality of a component or system and related work products.
Source: ISTQB® Glossary
testing for bias
A test type to detect bias in input data, an AI model, or an AI-based system.
Source: ISTQB® Glossary
testing in production
A test level that focuses on validating a system in a production environment.
Source: ISTQB® Glossary
traceability
The ability to establish explicit relationships between related work products or items within work products.
Source: ISTQB® Glossary (references: IREB Glossary)
training dataset
A dataset used to train an ML model.
Source: ISTQB® Glossary
transformer
A neural network architecture that compares different parts of the input and assigns relative weights based on their relevance, capturing long-range dependencies.
Note: CT-AI v2.0 Syllabus, Chapter 9 wording: “A neural network architecture that processes sequential data to capture long-range dependencies, powering NLP tasks, computer vision and multimodal applications.”
Source: ISTQB® Glossary
transparency
The degree to which appropriate information about an AI-based system is communicated to relevant stakeholders.
Source: ISTQB® Glossary (references: ISO 25059)
true negative (TN)
A prediction in which the model correctly predicts the negative class.
Source: ISTQB® Glossary
true positive (TP)
A prediction in which the model correctly predicts the positive class.
Source: ISTQB® Glossary
underfitting
The generation of an ML model that does not reflect the underlying trend of the training dataset, resulting in a model that makes inaccurate predictions.
Source: ISTQB® Glossary (references: ISO 29119-11)
unsupervised learning
An approach to training an ML model by using an unlabeled dataset.
Source: ISTQB® Glossary
usability
The degree to which a component or system can be used by specified users to achieve specified goals in a specified context of use.
Source: ISTQB® Glossary
usability testing
Testing to evaluate the degree to which the system can be used by specified users with effectiveness, efficiency and satisfaction in a specified context of use.
Source: ISTQB® Glossary (references: ISO 25010)
user controllability
The degree to which a user can intervene in a system’s functioning in a timely manner.
Source: ISTQB® Glossary (references: ISO 25059)
user interface
All components of a system that provide information and controls for the user to accomplish specific tasks with the system.
Source: ISTQB® Glossary
validation
Confirmation by examination that a work product matches a stakeholder's needs.
Source: ISTQB® Glossary
validation dataset
A dataset used to evaluate a trained ML model with the purpose of tuning the model.
Source: ISTQB® Glossary
verification
The process of confirming that a work product fulfills its specification.
Source: ISTQB® Glossary
von Neumann architecture
A computer architecture which consists of five main components: memory, a central processing unit, a control unit, input, and output.
Source: ISTQB® Glossary
weakness
A condition that may lead to undesirable behavior.
Source: ISTQB® Glossary
weight
An internal variable of a connection between neurons in a neural network that affects how it computes its outputs and that changes as the neural network is trained.
Source: ISTQB® Glossary
white-box testing
A test approach based on the internal structure of a component or system.
Source: ISTQB® Glossary