Skip to content

Topic Drill 2.1.1: AI-Specific Quality Characteristics ​

About this drill

LO AI-2.1.1 (K2): Classify behaviors of AI-based systems according to the quality characteristics defined in ISO/IEC 25059.
Lesson: Ch 2, section 2.1.1

This drill covers every point in section 2.1.1:

  • ISO/IEC 25059 extends ISO/IEC 25010; product quality and quality in use; why the characteristics matter for testing
  • AI functional correctness: accepted error rate, correct and incorrect outputs, thresholds
  • Functional adaptability (functional suitability), user controllability and transparency (interaction capability; transparency also under satisfaction), AI robustness (reliability), intervenability (security)
  • Interaction capability replacing usability
  • Societal and ethical risk mitigation (freedom from risk) and its areas
  • Classifying behaviors, including the user controllability vs. intervenability distinction

Topic Drill: 2.1.1

Q1. A navigation app retrains nightly. After a new bypass road opens, it starts routing drivers over it within days, without any developer involvement. Which ISO/IEC 25059 characteristic does this behavior BEST demonstrate?

AAI robustness
BFunctional adaptability
CUser controllability
DTransparency

Q2. A customer-service chatbot lets the user type "stop, connect me to a person" at any point, and it immediately hands the conversation over. Which characteristic does this BEST demonstrate?

AIntervenability
BTransparency
CUser controllability
DSocietal and ethical risk mitigation

Q3. A road-sign classifier keeps its 95% accuracy when the camera images contain rain, glare and sensor noise. Which characteristic is being demonstrated?

AFunctional adaptability
BIntervenability
CTransparency
DAI robustness

Q4. Which statement about AI functional correctness in ISO/IEC 25059 is CORRECT?

AIt considers both correct and incorrect outputs and defines acceptable thresholds for incorrect results
BIt requires an AI-based system to produce 100% correct outputs before release
CIt is a new sub-characteristic of reliability
DIt only applies to generative AI systems

Q5. Under which quality characteristic does ISO/IEC 25059 place intervenability?

AReliability
BSecurity
CInteraction capability
DFreedom from risk

Q6. Transparency is a new sub-characteristic of which TWO parent characteristics?

AReliability (product quality) and security (product quality)
BFunctional suitability (product quality) and freedom from risk (quality in use)
CInteraction capability (product quality) and satisfaction (quality in use)
DUsability (product quality) and maintainability (product quality)

Q7. What is "interaction capability" in the context of the syllabus?

AA new name for intervenability
BA sub-characteristic of security
CA quality-in-use characteristic for societal risk
DThe term that replaces usability in the 2023 version of ISO/IEC 25010

Q8. Which TWO of the following are listed as areas considered by societal and ethical risk mitigation?

Select 2 options.

ALabor practices
BTime-to-market
CEnvironmental sustainability
DCode coverage
EModel size

Q9. Which TWO circumstances does the syllabus list as conditions under which an AI-robust system should maintain its AI functional correctness?

Select 2 options.

AScheduled retraining
BAdversarial data inputs
CUpgrading to faster hardware
DOperator misuse
EAdding new product features

Q10. How does ISO/IEC 25059 relate to ISO/IEC 25010?

AIt extends the ISO/IEC 25010 quality model to address AI-specific considerations, from the perspectives of product quality and quality in use
BIt replaces ISO/IEC 25010 for all AI-based systems
CIt is a testing standard that defines test techniques for AI
DIt only covers quality in use, while ISO/IEC 25010 covers product quality

Q11. From a testing perspective, why do the ISO/IEC 25059 quality characteristics matter?

AThey replace the need for risk-based testing
BThey define the test levels to be used for ML systems
CThey prescribe which ML algorithm to use
DThey directly influence how test objectives are defined, how acceptance criteria are formulated, and how test results are interpreted

Q12. An audit finds that a credit-scoring model approves loans at noticeably different rates for equally qualified applicants from different ethnic groups. Which characteristic is MOST directly affected?

AAI robustness
BSocietal and ethical risk mitigation
CFunctional adaptability
DUser controllability

Q13. Which statement CORRECTLY distinguishes user controllability from intervenability?

AUser controllability is part of security; intervenability is part of interaction capability
BUser controllability is a quality-in-use characteristic; intervenability is product quality
CIntervenability is an operator intervening in a timely manner to prevent harm or hazard (security); user controllability is a human or external agent intervening in a timely manner (interaction capability)
DThey are synonyms in ISO/IEC 25059

0 / 13 answered

← 1.1.8 Regulations and Standards · Next drill: 2.1.2 AI and Safety →

Unofficial study guide for the ISTQB® Certified Tester AI Testing (CT-AI) exam. Not affiliated with International Software Testing Qualifications Board (ISTQB®).