Skip to content

Topic Drill 5.1.3: Data Pipeline Testing ​

About this drill

LO AI-5.1.3 (K2): Summarize the various forms of data pipeline testing.
Lesson: Ch 5, section 5.1.3

This drill covers every point in section 5.1.3:

  • The layered approach: design reviews, component, component integration, system (smoke, functional, non-functional, fault injection, back-to-back vs. the training pipeline), system integration, production (back-to-back vs. previous versions, A/B, continuous monitoring)
  • Configuration management reviews
  • Training vs. operational pipeline priorities

Topic Drill: 5.1.3

Q1. In the layered approach to data pipeline testing, what is the first activity, performed during the design phase?

AData-pipeline design reviews
BSmoke testing
CA/B testing
DFault injection

Q2. What do component tests of a data pipeline validate, according to the syllabus?

AOnly the performance of the complete pipeline under load
BThe comparison of the operational pipeline with the training pipeline
CTransformation logic, the implementation of data validation rules, robust error handling, and vulnerabilities that could be exploited to introduce malware or poisoned data
DThe interaction with external storage platforms

Q3. One pipeline component writes dates as DD/MM/YYYY, and the next component interprets them as MM/DD/YYYY. Which test level is aimed at this kind of defect?

AComponent testing
BSystem integration testing
CTesting in production
DComponent integration testing

Q4. A data pipeline has just been fully assembled. What does system testing of it begin with, according to the syllabus?

AA/B testing against the previous pipeline
BSmoke testing to confirm basic pipeline functionality
CConfiguration management reviews
DFault injection testing

Q5. In SYSTEM testing of a data pipeline, what does back-to-back testing compare?

AThe operational pipeline with the training pipeline, to verify consistent functionality
BThe pipeline with a previous version in production
CTwo ML models on live traffic
DThe pipeline design with the requirements

Q6. Which aspects does NON-functional system testing of a data pipeline evaluate, according to the syllabus?

AData transformations and data routing
BLabel accuracy
CPerformance under load, scalability to handle increasing data volumes, and security measures that protect data integrity
DRepresentativeness of the training data

Q7. Which test level verifies the correct interaction between the data pipeline and external systems such as data sources, storage platforms, monitoring tools and downstream ML models?

AComponent integration testing
BSystem integration testing
CComponent testing
DDesign review

Q8. A new version of the operational pipeline is run on part of the live data stream and its results are compared with the current baseline, to validate improvements and confirm there is no degradation. What is this?

ASmoke testing
BFault injection testing
CConfiguration management review
DA/B testing in production

Q9. An investigation shows that the model was trained with pipeline version 2.3, while production still runs version 2.1 with a different configuration. Which activity is designed to prevent this?

AConfiguration management reviews, which verify that the correct pipeline code versions, configurations and datasets are used across training, testing and production
BSmoke testing
CLabel correctness testing
DExploratory data analysis

Q10. Which TWO statements about testing training pipelines versus operational pipelines are CORRECT?

Select 2 options.

ATraining pipelines need no testing
BConfiguration management reviews are only relevant for operational pipelines
CTraining pipelines are often exploratory prototypes, and their testing may focus on data integrity
DOperational pipeline testing is limited to unit tests
EOperational pipeline testing prioritizes reliability, performance and maintainability

0 / 10 answered

← 5.1.2 Testing for Bias · Next drill: 5.1.4 Data Representativeness →

Unofficial study guide for the ISTQB® Certified Tester AI Testing (CT-AI) exam. Not affiliated with International Software Testing Qualifications Board (ISTQB®).