Home / Resources / QA Glossary 1,075 terms · 21 categories · 111 agentic & AI
The QA & agentic testing glossary. From acceptance criteria to zoom testing, 1,075 testing terms defined by engineers, not marketers. Browse by letter, filter by category, or search for exactly what you need.
Trending: Agentic Testing Flaky Test Test Oracle Exploratory Testing Service Level Objective (SLO) Regression Testing
Last reviewed July 2026 · 21 categories
All A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
All terms 1075 Agentic & AI Testing 111 Test Design & Coverage 91 Accessibility Testing 80 Automation & Tooling 76 Performance & Scalability 59 Test Planning & Governance 59 Core Testing Concepts 57 Defect Management 57 Test Types & Levels 57 Observability & Diagnostics 54 Data & Database Testing 47 API & Service Testing 44 Web & Browser Testing 42 SEO & Web Quality 41 Reliability & Resilience 39 Metrics & Reporting 37 Test Data & Environments 36 Security Testing 35 CI/CD & Release Quality 22 Mobile & Device Testing 21 Quality Attributes & UX 10
A 91 terms 0001 Acceptance Criteria # Test Planning & Governance Clear, testable conditions that a product increment must satisfy before stakeholders consider it acceptable. 0002 Acceptance Test-Driven Development (ATDD) # Test Design & Coverage A collaborative practice in which examples and acceptance tests are defined before implementation to guide development and confirm business value. 0003 Acceptance Testing # Test Types & Levels Testing that determines whether a system is ready for acceptance by users, customers, operators, regulators, or another approving party. 0004 Access Control Testing # Security Testing Testing that users and services can perform only the actions allowed for their identity, role, ownership, and context. 0005 Accessibility Audit # Accessibility Testing A structured evaluation of digital content using automated checks, expert inspection, assistive technology, and documented conformance criteria. 0008 Accessibility Scanner # Accessibility Testing A tool that automatically checks digital content against a set of machine-testable accessibility rules. 0009 Accessibility Statement # Accessibility Testing A public description of a product's accessibility commitments, conformance status, known limitations, and support or feedback channels. 0010 Accessibility Testing # Accessibility Testing Testing that evaluates whether people with disabilities can perceive, operate, understand, and robustly use a product. 0011 Accessibility Tree # Accessibility Testing A browser or platform representation of interface semantics exposed to assistive technologies. 0012 Accessible Authentication # Accessibility Testing Authentication that does not impose unnecessary cognitive tests and supports accessible alternatives, assistance, and password managers. 0013 Accessible Description # Accessibility Testing Supplementary text that gives assistive-technology users additional information about an element beyond its accessible name. 0014 Accessible Name # Accessibility Testing The text alternative used by assistive technology to identify a control, landmark, image, or other interface element. 0015 Accessible PDF # Accessibility Testing A PDF with semantic tags, meaningful reading order, text alternatives, navigable structure, and usable form controls. 0016 ACID Properties # Data & Database Testing The database transaction properties of atomicity, consistency, isolation, and durability. 0017 Action Trace # Agentic & AI Testing A chronological record of an agent's actions, tool calls, observations, and outcomes during a test session. 0018 Actual Result # Core Testing Concepts The behavior or output observed when a test is executed, compared with the expected result to determine the outcome. 0019 Ad Hoc Testing # Test Design & Coverage Informal testing performed without detailed prewritten cases, relying on the tester's knowledge to explore likely problem areas. 0020 Affected Version # Defect Management The product version, build, commit, or release in which a defect has been observed. 0021 Agent Benchmark # Agentic & AI Testing A standardized collection of tasks, environments, scoring rules, and resource limits used to compare agent capabilities. 0022 Agent Evaluation # Agentic & AI Testing Systematic measurement of an AI agent's task success, safety, reliability, efficiency, and behavior under defined conditions. 0023 Agent Test Session # Agentic & AI Testing A bounded autonomous testing run with a goal, environment, permissions, budget, evidence, and stop condition. 0024 Agent Trajectory # Agentic & AI Testing The complete sequence of states, observations, decisions, actions, tool calls, and outputs produced while an agent attempts a task. 0025 Agentic AI Testing # Agentic & AI Testing Testing of agentic AI systems for task success, safety, tool use, permissions, robustness, and long-horizon behavior. 0026 Agentic Application Testing # Agentic & AI Testing Testing software that contains autonomous agents, including orchestration, memory, tools, guardrails, and user-impacting actions. 0027 Agentic QA # Agentic & AI Testing Quality engineering performed or augmented by autonomous agents that can plan, explore, verify, and report across workflows. 0029 Agentic Testing # Agentic & AI Testing Goal-directed software testing in which AI agents plan, act, observe, adapt, and report findings across multi-step workflows. 0030 AI Agent Testing # Agentic & AI Testing Evaluation of an AI agent's goals, plans, actions, tool calls, outcomes, safety boundaries, and recovery behavior. 0031 AI Browser Testing # Agentic & AI Testing Use of AI to understand and exercise browser interfaces, adapt to state, and evaluate web behavior. 0032 AI Bug Detection # Agentic & AI Testing Use of AI models or agents to identify, classify, and explain potential software defects from execution and product evidence. 0033 AI Quality Assurance # Agentic & AI Testing Application of AI across quality planning, prevention, testing, diagnosis, defect management, and release decisions. 0034 AI Software Testing # Agentic & AI Testing A broad term covering both AI-assisted software testing and testing of software that contains AI capabilities. 0035 AI Test Agent # Agentic & AI Testing An AI-powered agent designed to investigate software, execute interactions, evaluate outcomes, and produce actionable quality evidence. 0036 AI Test Automation # Agentic & AI Testing Test automation that uses AI for generation, adaptation, exploration, visual understanding, diagnosis, or maintenance.0037 AI Testing # Agentic & AI Testing A broad term that can mean testing AI systems or using AI to improve software testing, so scope should be stated explicitly. 0038 AI Website Testing # Agentic & AI Testing Use of AI to explore and evaluate website functionality, usability, visuals, accessibility, performance, and errors. 0039 AI-Assisted Testing # Agentic & AI Testing Testing in which AI helps people design, execute, analyze, maintain, or prioritize tests while humans retain key decisions. 0040 Alert # Observability & Diagnostics A notification triggered when observed conditions indicate a failure, risk, or threshold requiring attention. 0041 Alert Fatigue # Observability & Diagnostics Reduced ability to respond effectively because alerts are too frequent, noisy, duplicated, or low-value. 0042 Alpha Testing # Test Types & Levels Pre-release acceptance testing performed in a controlled setting, typically by internal staff or selected users before broader beta testing. 0043 Alt Text Quality Testing # Accessibility Testing Human or AI-assisted evaluation of whether image alternatives are accurate, concise, contextual, and equivalent to the image's purpose. 0044 Alternative Text # Accessibility Testing Text that communicates the purpose or content of a meaningful non-text element, such as an image or icon. 0045 Anomaly # Core Testing Concepts Any observed condition that differs from expectations, requirements, prior behavior, or a relevant reference and may require investigation. 0046 Anonymization # Test Data & Environments Transformation of personal data so individuals can no longer be identified by reasonably available means. 0048 API Contract # API & Service Testing A machine-readable or documented agreement describing an API's operations, inputs, outputs, schemas, errors, and behavioral expectations. 0049 API Contract Testing # API & Service Testing Testing that verifies an API implementation and its consumers conform to an agreed interface and behavior contract. 0050 API Error Response # API & Service Testing A structured response that communicates why a request could not be processed, ideally with a stable code and actionable detail. 0051 API Functional Testing # API & Service Testing Testing API operations, business rules, validation, state changes, and responses against expected behavior. 0052 API Fuzz Testing # API & Service Testing Supplying generated, malformed, unexpected, or extreme requests to an API to expose robustness and security defects. 0053 API Load Testing # API & Service Testing Applying concurrent API traffic to measure latency, throughput, errors, saturation, and behavior under expected workload. 0054 API Mocking # API & Service Testing Replacing a real API with a controlled implementation that returns predefined or programmable responses for testing. 0055 API Observability # API & Service Testing The ability to understand API behavior through correlated requests, errors, logs, metrics, traces, and dependency information. 0056 API Security Testing # API & Service Testing Testing API authentication, authorization, validation, data exposure, abuse resistance, and other security controls. 0057 API Testing # API & Service Testing Testing an application's service interfaces directly, without depending on the graphical user interface. 0058 API Virtualization # API & Service Testing Simulation of API behavior, state, timing, and faults when real services are unavailable, costly, unstable, or unsafe to use. 0059 App Lifecycle Testing # Mobile & Device Testing Testing mobile behavior across launch, resume, pause, background, termination, restoration, update, and reinstall events. 0060 Application Link # Mobile & Device Testing A verified HTTP link that opens a specific screen in an Android app when the app is installed. 0062 Application Security Testing (AST) # Security Testing The combined practices used to discover, validate, and manage security weaknesses in software across its lifecycle. 0063 Approval Testing # Test Design & Coverage Testing that compares current output with a human-approved reference and highlights differences for review. 0064 ARIA (Accessible Rich Internet Applications) # Accessibility Testing A W3C specification that adds accessibility semantics to web content when native HTML alone is insufficient. 0065 ARIA Role # Accessibility Testing A semantic role that communicates an element's purpose or interaction pattern to assistive technology. 0066 Arrival Rate # Performance & Scalability The number of new requests, transactions, or users entering a system per unit of time. 0067 Assertion # Automation & Tooling A machine-evaluated statement that compares an observed value or state with an expected condition. 0068 Assertion Library # Automation & Tooling A reusable collection of assertions and matchers for expressing expected outcomes in automated tests. 0069 Assistive Technology # Accessibility Testing Hardware or software that helps people with disabilities interact with digital content, such as screen readers or switch controls. 0070 Asynchronous API Testing # API & Service Testing Testing operations whose completion, events, or responses occur later than the initiating request. 0071 Atomicity # Data & Database Testing The transaction property that all operations complete as one unit or none of them take effect. 0072 Attribute # Observability & Diagnostics A key-value property attached to telemetry to describe the operation, resource, user, environment, or result. 0073 Audio Description # Accessibility Testing Narration that communicates important visual information in video for people who cannot see it. 0074 Audit Trail # Agentic & AI Testing A durable record of inputs, decisions, actions, evidence, and outcomes that allows an agent run or test conclusion to be reviewed. 0075 Authentication Testing # Security Testing Testing login, identity verification, recovery, lockout, multi-factor authentication, and session establishment. 0076 Authorization Testing # Security Testing Testing whether authenticated identities are correctly permitted or denied actions on each resource and function. 0077 Auto-Waiting # Automation & Tooling Automation behavior that waits for relevant readiness conditions, such as visibility or stability, before performing an action or assertion. 0078 Automated Accessibility Testing # Accessibility Testing Tool-based evaluation of machine-testable accessibility rules in markup, styles, content, and interactive states. 0079 Automated Bug Discovery # Agentic & AI Testing Machine-driven exploration and checking that finds previously unknown failures without requiring every test path to be scripted in advance. 0080 Automated Bug Reproduction # Agentic & AI Testing Automatic creation and verification of a reliable sequence of steps that triggers an observed defect again. 0081 Automated Oracle Synthesis # Agentic & AI Testing The creation of expected-result logic from requirements, examples, models, invariants, or observed behavior when no oracle is already available. 0082 Automated Testing # Test Types & Levels Testing in which software controls test setup, execution, comparison, and reporting with limited human intervention. 0083 Automated Website Testing # Web & Browser Testing Use of software to repeatedly evaluate website behavior, compatibility, accessibility, performance, security, or visual correctness. 0084 Autonomous Exploratory Testing # Agentic & AI Testing Exploratory testing performed by an agent that continuously chooses new actions based on observed states, risks, and prior findings.0085 Autonomous QA # Agentic & AI Testing A quality approach in which agents independently perform bounded testing, evidence collection, diagnosis, and triage. 0086 Autonomous Root Cause Analysis # Agentic & AI Testing Agent-assisted investigation that correlates failures, changes, traces, logs, and dependencies to propose evidence-backed causes. 0087 Autonomous Test Execution # Agentic & AI Testing Execution in which an agent controls navigation, data, checks, recovery, and evidence collection within defined boundaries. 0088 Autonomous Test Generation # Agentic & AI Testing Automatic creation of test scenarios, inputs, actions, and checks from goals, requirements, models, application state, or learned patterns. 0089 Autonomous Testing # Agentic & AI Testing Testing in which software independently selects, performs, and adapts test activities within a defined objective and control framework. 0090 Autonomous Triage # Agentic & AI Testing Automatic classification, deduplication, severity estimation, routing, and evidence enrichment of discovered issues. 0091 Autonomous Website Testing # Agentic & AI Testing Goal-driven website testing in which an agent chooses interactions and checks dynamically from observed page state. B 50 terms 0092 Back Navigation Testing # Web & Browser Testing Testing that browser or app back actions restore the correct page, state, focus, scroll position, and data. 0093 Back-to-Back Testing # Test Design & Coverage Testing that runs equivalent inputs through two implementations and compares their outputs to detect behavioral differences. 0094 Background Execution Testing # Mobile & Device Testing Testing how a mobile app behaves when backgrounded, suspended, limited by the operating system, or performing allowed background work. 0095 Backlog Trend # Metrics & Reporting The change in open work or defects over time, showing whether arrivals are outpacing resolution. 0096 Backup and Restore Testing # Test Types & Levels Testing that verifies backups are complete, protected, usable, and capable of restoring the required data and service state. 0097 Backward Compatibility # API & Service Testing The ability of a changed service or product to continue supporting existing consumers, data, workflows, and integrations. 0098 Baggage # Observability & Diagnostics Contextual key-value data propagated across service boundaries alongside distributed traces. 0099 Bandwidth # Performance & Scalability The maximum rate at which data can be transferred through a network path or interface. 0101 Basis Path Testing # Test Design & Coverage A white-box technique that derives tests from linearly independent control-flow paths, often using cyclomatic complexity. 0102 Behavior-Driven Development (BDD) # Test Design & Coverage A collaborative approach that expresses expected behavior through concrete examples, often written in Given-When-Then form and automated as tests. 0103 Benchmark Contamination # Agentic & AI Testing Evaluation distortion caused when benchmark tasks, answers, or close variants were present in training data or otherwise known to the model. 0104 Benchmark Saturation # Agentic & AI Testing The point at which a benchmark no longer separates capabilities well because most systems achieve similarly high scores. 0105 Beta Testing # Test Types & Levels Pre-release testing by representative external users in realistic environments to uncover issues and gather product feedback. 0106 Bias Testing # Agentic & AI Testing Evaluation of whether an AI system produces systematically unfair or unbalanced outcomes across relevant groups or contexts. 0107 Bidirectional Traceability # Test Planning & Governance Traceability that connects requirements to tests and test results, and also connects each test back to its originating requirement. 0108 Binary Payload Testing # API & Service Testing Testing upload, download, metadata, size, integrity, and error handling for non-text API content such as images or archives. 0109 Biometric Authentication Testing # Mobile & Device Testing Testing mobile authentication using fingerprint, face, or other biometrics, including enrollment changes, fallback, lockout, and cancellation. 0110 Black-Box Testing # Test Design & Coverage Testing based on externally visible behavior and specifications without relying on knowledge of the internal implementation. 0111 Blast Radius # Reliability & Resilience The users, services, data, regions, or operations that could be affected by a failure or experiment. 0112 Blocked Test # Defect Management A test that cannot execute or complete because a prerequisite, environment, dependency, data item, or earlier step is unavailable. 0113 Blocker Defect # Defect Management A defect severe enough to prevent critical use, testing, delivery, or operation with no acceptable workaround. 0114 Bottleneck # Performance & Scalability The resource, dependency, lock, or processing stage that most limits overall system capacity or throughput. 0115 Bottleneck Analysis # Performance & Scalability Investigation that correlates workload, timing, queues, dependencies, and resource saturation to identify the primary performance constraint. 0116 Braille Display Testing # Accessibility Testing Testing interface semantics and navigation with hardware that renders screen-reader output as refreshable braille. 0117 Branch Coverage # Test Design & Coverage The percentage of control-flow branches, such as true and false decision outcomes, exercised by a test suite. 0118 Broken Link # SEO & Web Quality A hyperlink that leads to an unavailable, invalid, or unintended destination. 0119 Broken Link Testing # SEO & Web Quality Automated or manual checking of internal and external links for invalid targets, errors, redirects, and incorrect destinations. 0120 Browser Automation # Automation & Tooling Programmatic control of a web browser to navigate pages, interact with elements, inspect state, and verify outcomes. 0121 Browser Compatibility Matrix # Web & Browser Testing The defined combinations of browsers, versions, operating systems, and devices a product commits to support and test. 0122 Browser Console # Web & Browser Testing A browser diagnostic interface that records JavaScript errors, warnings, security messages, and application logging. 0123 Browser Context # Automation & Tooling An isolated browser session with its own cookies, storage, permissions, and pages, used to keep tests independent. 0125 Browser History Testing # Web & Browser Testing Testing navigation history, back and forward behavior, route restoration, and state preservation. 0126 Browser Testing # Web & Browser Testing Testing web behavior in a browser, including rendering, interaction, navigation, storage, network, compatibility, and diagnostics. 0127 Bug # Core Testing Concepts A commonly used term for a defect in software, documentation, data, configuration, or another product artifact. 0128 Bug Aging # Metrics & Reporting The elapsed time a defect remains open, often analyzed by severity, owner, status, or release. 0129 Bug Backlog # Defect Management The collection of reported defects that remain unresolved, deferred, or awaiting triage. 0130 Bug Cluster # Defect Management A group of findings that share a likely symptom, component, cause, or remediation and may represent one underlying defect. 0131 Bug Deduplication # Defect Management Identifying reports that describe the same underlying defect and linking or merging them into one canonical issue. 0132 Bug Detection Precision # Metrics & Reporting The proportion of reported bug findings that are confirmed as real defects rather than false positives. 0133 Bug Detection Recall # Metrics & Reporting The proportion of all relevant defects in an evaluated set that a testing system successfully discovers. 0134 Bug Report # Defect Management A structured record of a suspected defect with summary, context, steps, expected and actual behavior, impact, and evidence. 0135 Bug Report Generation # Defect Management Automatic creation of a clear, structured defect report from captured test actions, observations, and evidence. 0136 Build Pipeline # CI/CD & Release Quality An automated sequence that converts source changes into tested, packaged, and traceable artifacts. 0137 Build Verification Testing (BVT) # Test Types & Levels A short automated test set that checks whether a new build is stable enough for deeper testing. 0138 Burn Rate # Reliability & Resilience The speed at which a service consumes its error budget relative to the rate allowed by its SLO. 0139 Business Impact # Defect Management The effect of a defect or failure on revenue, cost, operations, obligations, reputation, or strategic objectives. 0140 Business Logic Testing # Security Testing Security testing of workflows, limits, sequencing, trust assumptions, economic rules, and abuse-resistant behavior. 0141 Bypass Blocks # Accessibility Testing Providing a mechanism, such as a skip link or landmark navigation, to move past repeated content to the main page area. C 104 terms 0142 Calibration # Agentic & AI Testing The degree to which an agent's confidence scores correspond to the observed frequency of correct conclusions. 0143 Call Coverage # Test Design & Coverage The proportion of defined function or method calls exercised by tests, including relevant caller-to-callee relationships. 0144 Canary Evaluation # Agentic & AI Testing Running a new model, prompt, or agent configuration on a limited evaluation slice before wider adoption. 0145 Canonical URL # SEO & Web Quality The preferred URL declared for a page when the same or similar content is reachable through multiple addresses. 0146 Canonicalization Testing # SEO & Web Quality Testing that canonical tags, redirects, and URL rules consistently identify the intended preferred version of content. 0147 Capability Evaluation # Agentic & AI Testing Testing designed to measure what tasks or behaviors an AI system can perform under specified conditions. 0148 Capacity # Performance & Scalability The maximum workload a system can support while meeting defined performance and reliability objectives. 0149 Capacity Model # Performance & Scalability A quantitative relationship among workload, resources, throughput, latency, and service targets used for planning and testing. 0150 Capacity Testing # Test Types & Levels Testing that identifies the maximum workload or resource demand a system can handle while meeting defined service objectives. 0151 CAPTCHA Accessibility # Accessibility Testing Evaluation of whether bot-detection challenges provide usable, equivalent alternatives for people with disabilities. 0152 Caption Testing # Accessibility Testing Testing that video captions are accurate, synchronized, complete, correctly identified, and available for relevant audio. 0153 Capture-and-Replay # Automation & Tooling Automation that records user interactions and generates a script that can replay the captured sequence. 0154 Cardinality # Observability & Diagnostics The number of distinct values for a telemetry attribute, which can strongly affect observability cost and query performance. 0155 Cascading Failure # Reliability & Resilience A failure that spreads through dependencies or shared resources and causes additional services to degrade or fail. 0156 Causal Analysis # Observability & Diagnostics Investigation of evidence and dependencies to distinguish contributing causes from correlated symptoms. 0157 Cause-Effect Graphing # Test Design & Coverage A black-box technique that models logical relationships between input conditions and outcomes, then derives tests from the graph. 0158 Certificate Validation Testing # Security Testing Testing hostname, trust chain, validity dates, revocation behavior, algorithms, and failure handling for digital certificates. 0159 Change Data Capture (CDC) # Data & Database Testing A mechanism that records database changes and propagates them to downstream systems, streams, or replicas. 0160 Change Failure Rate # Metrics & Reporting The percentage of production changes that cause degraded service and require remediation such as rollback, fix, or intervention. 0161 Chaos Engineering # Reliability & Resilience The discipline of building confidence in resilience through controlled experiments that introduce adverse conditions and test hypotheses. 0162 Chaos Experiment # Reliability & Resilience A bounded, observable intervention that introduces a fault or disruption to evaluate a resilience hypothesis. 0163 Chaos Testing # Reliability & Resilience The execution of controlled failure scenarios to reveal weaknesses in detection, isolation, recovery, and operational response. 0164 Characterization Testing # Test Design & Coverage Testing that captures the current behavior of existing software, especially before refactoring code that lacks reliable specifications. 0165 Checklist-Based Testing # Test Design & Coverage An experience-based technique that uses a curated checklist of risks, rules, and past defects to guide testing. 0166 Checksum Validation # Data & Database Testing Comparing computed digests to verify that data or files remain complete and unchanged across transfer or transformation. 0167 CI Matrix # CI/CD & Release Quality A pipeline configuration that runs jobs across combinations of operating systems, runtimes, browsers, versions, or settings. 0168 CI Runner # CI/CD & Release Quality A machine, container, or process that executes continuous-integration workflow jobs. 0169 CI/CD Pipeline # CI/CD & Release Quality An automated delivery workflow that builds, tests, packages, and deploys software changes through controlled stages. 0170 Classification Tree Method # Test Design & Coverage A systematic technique that partitions input conditions into classes and combines representative values to design test cases. 0171 Client Error Response # API & Service Testing An HTTP 4xx response indicating that the server cannot fulfill the request because of client-side input, identity, permission, or state. 0173 Client-Side Security Testing # Security Testing Testing whether browser-executed code, storage, DOM interactions, and web APIs enforce defined security requirements. 0174 Client-Side Validation # Web & Browser Testing Validation performed in the browser to give fast feedback before data is submitted, but not a substitute for server-side validation. 0175 Closed Defect # Defect Management A defect whose resolution and required verification are complete according to the team's workflow. 0176 Closed Workload Model # Performance & Scalability A performance model with a fixed user population in which each user starts new work after completing and pausing from prior work. 0177 Closed-Loop Testing # Agentic & AI Testing Testing in which each observation feeds back into the next decision, allowing the system to adapt its actions during execution. 0178 Code Coverage # Test Design & Coverage A family of measures showing how much executable code structure, such as statements or branches, was exercised by tests. 0179 Code Review # Test Design & Coverage A structured examination of source code to identify defects, security weaknesses, maintainability issues, and standards violations before execution. 0180 Codeless Testing # Automation & Tooling Test automation created primarily through visual flows, recorded interactions, or natural language instead of hand-written code.0181 Cognitive Accessibility Testing # Accessibility Testing Testing whether content and interactions support users with cognitive, language, learning, attention, and memory differences. 0182 Cold Start # Performance & Scalability The latency and resource cost of starting a process, function, container, cache, or service from an inactive state. 0183 Collation Testing # Data & Database Testing Testing database rules for text comparison, ordering, case sensitivity, accents, and locale-specific behavior. 0184 Color Contrast Testing # Accessibility Testing Testing whether text, controls, icons, focus indicators, and meaningful graphics have sufficient visual contrast against adjacent colors. 0185 Color Independence # Accessibility Testing The requirement that color is not the only visual means used to convey information, status, prompts, or distinctions. 0186 Combinatorial Testing # Test Design & Coverage Testing that covers selected combinations of input values or configuration factors to expose interaction faults efficiently. 0187 Commit-Stage Testing # CI/CD & Release Quality Fast tests and checks run soon after a source change to provide early delivery feedback. 0188 Compatibility # Quality Attributes & UX The ability of a product to exchange information or share an environment with other products without unacceptable interference. 0189 Compatibility Testing # Test Types & Levels Testing that checks behavior across supported browsers, devices, operating systems, hardware, networks, versions, or interacting products. 0190 Compliance Testing # Test Types & Levels Testing that evaluates conformance to laws, regulations, contractual obligations, policies, or technical standards. 0191 Component Integration Testing # Test Types & Levels Testing focused on interfaces and interactions between integrated components within a larger system. 0192 Component Testing # Test Types & Levels Testing of an individual software or hardware component in isolation from most of the surrounding system. 0193 Concolic Testing # Test Design & Coverage A technique that combines concrete execution with symbolic reasoning to generate inputs that explore additional program paths. 0194 Concurrency Testing # Test Types & Levels Testing that exposes faults caused by simultaneous operations, shared resources, race conditions, locks, or timing dependencies. 0195 Condition Coverage # Test Design & Coverage The percentage of individual Boolean conditions evaluated as both true and false during testing. 0196 Confidence Interval # Metrics & Reporting A statistical range that expresses uncertainty around an estimated metric such as failure rate, latency, precision, or recall. 0197 Confidence Score # Agentic & AI Testing A numeric estimate of how strongly a model or agent supports a prediction, finding, classification, or action. 0198 Configuration Drift # Test Data & Environments Unplanned difference between the intended configuration and the actual state of an environment or system. 0199 Configuration Testing # Test Types & Levels Testing that checks behavior under different supported settings, feature flags, dependencies, hardware profiles, or deployment configurations. 0200 Confirmation Testing # Core Testing Concepts Testing performed after a fix to confirm that the specific defect has been corrected. 0201 Connection Pool # Performance & Scalability A managed set of reusable network or database connections that can improve performance but also become a capacity bottleneck. 0202 Console Log # Observability & Diagnostics Diagnostic output emitted by browser or application code to a runtime console during execution. 0203 Constraint-Based Testing # Test Design & Coverage Testing that uses formal constraints to generate or select inputs satisfying valid, invalid, boundary, or high-risk combinations. 0204 Consumer-Driven Contract Testing # API & Service Testing Contract testing in which API expectations are captured from consumer needs and verified against the provider. 0205 Container Security Testing # Security Testing Testing container images and runtime configuration for unsafe privileges, isolation defects, dependency problems, secret exposure, and unintended services. 0206 Containerized Test Runner # Automation & Tooling A test runner packaged in a container to provide portable, repeatable dependencies and execution conditions. 0207 Context Propagation # Observability & Diagnostics Transfer of trace and related context across process, service, thread, and network boundaries so telemetry can be correlated. 0208 Continuous Evaluation # Agentic & AI Testing Automated, repeated evaluation of models or agents as prompts, tools, data, dependencies, and behavior change. 0209 Continuous Integration (CI) # CI/CD & Release Quality Frequent integration of source changes with automated builds and tests that provide rapid feedback. 0210 Continuous Quality # Test Planning & Governance A delivery practice that treats quality evidence and improvement as an ongoing responsibility across planning, development, release, and operation. 0211 Continuous Testing # Test Planning & Governance Automated and manual quality activities embedded throughout delivery so teams receive timely evidence about every meaningful change. 0212 Continuous Verification # CI/CD & Release Quality Ongoing evaluation of release health using tests, telemetry, policies, and user-impact signals during and after deployment. 0213 Contractual Acceptance Testing # Test Types & Levels Acceptance testing that checks whether a system fulfills criteria defined in a customer or supplier contract.0214 Control Flow Testing # Test Design & Coverage White-box testing based on the order in which statements, decisions, and branches can execute through a program. 0215 Controllability # Core Testing Concepts The ease with which tests can place a system in a required state, provide inputs, and isolate relevant behaviors. 0216 Cookie Security Testing # Security Testing Testing cookie attributes, scope, lifetime, confidentiality, integrity, cross-site behavior, and invalidation. 0217 Coordinated Omission # Performance & Scalability A load-testing measurement error that under-reports latency because the generator stops sending work while the system is slow. 0218 Core Web Vitals # SEO & Web Quality Google's user-experience metrics for loading performance, interaction responsiveness, and visual stability: LCP, INP, and CLS. 0219 Corner Case # Core Testing Concepts A test situation created by the interaction of multiple extreme or unusual conditions at the same time. 0220 Correlation ID # API & Service Testing An identifier carried across related requests, messages, and services so one transaction can be traced end to end. 0221 Cost per Test # Metrics & Reporting The total compute, infrastructure, tool, maintenance, and human effort attributable to executing or sustaining a test. 0222 Counter Metric # Observability & Diagnostics A cumulative metric that generally increases over time, such as requests, errors, or processed bytes. 0223 Coverage Analysis # Test Design & Coverage The examination of achieved coverage against goals to identify untested requirements, risks, code, data, platforms, or user journeys. 0224 Coverage Criterion # Test Design & Coverage A rule that defines what elements or combinations must be exercised for a stated level of test coverage . 0225 Coverage Gap # Test Design & Coverage A requirement, risk, path, platform, or behavior that is not adequately exercised by the current tests. 0226 Coverage Goal # Test Planning & Governance A planned target for the requirements, risks, code structures, platforms, data combinations, or journeys that tests should exercise. 0227 Coverage-Guided Agent # Agentic & AI Testing An agent that uses measured coverage or unexplored application state to choose actions likely to reveal new behavior. 0228 CPU Profile # Observability & Diagnostics A sampled or instrumented view showing where a process spends processor time. 0229 CPU Saturation # Performance & Scalability A condition in which processor demand approaches or exceeds available capacity, causing queues and latency to grow. 0230 CPU Utilization # Performance & Scalability The proportion of processor capacity consumed during a measured interval. 0231 Crash Report # Observability & Diagnostics A diagnostic artifact describing an unexpected process termination, often including stack, signal, thread, device, and version information. 0232 Crawl Budget # SEO & Web Quality The practical amount of crawling a search engine is willing and able to spend on a site within a period. 0233 Crawlability # SEO & Web Quality The degree to which search engine crawlers can discover and access a site's important URLs and resources. 0234 Critical Defect # Defect Management A defect that causes severe user, business, security, safety, or operational impact and demands urgent response. 0235 Critical User Journey Monitoring # Observability & Diagnostics Continuous checks of high-value end-to-end user flows to detect functional or performance failure. 0236 Cross-Browser Testing # Web & Browser Testing Testing that a website works acceptably across its supported browsers, engines, versions, and device contexts. 0237 Cross-Device Testing # Mobile & Device Testing Testing consistent behavior across device categories, models, screen sizes, input methods, capabilities, and operating systems. 0238 Cross-Modal Testing # Agentic & AI Testing Testing that validates consistency and correctness across text, visual, audio, document, and structured-data representations. 0240 Crowdsourced Testing # Test Types & Levels Testing performed by a distributed external community to obtain broad device, location, language, and user-perspective coverage. 0241 CRUD Testing # API & Service Testing Testing create, read, update, and delete operations, including permissions, validation, state, and persistence. 0242 Cryptographic Testing # Security Testing Testing algorithms, protocols, key management, randomness, storage, transport, and failure behavior for cryptographic controls. 0243 CSS Selector # Automation & Tooling A pattern used by browser automation to locate elements through HTML tags, attributes, classes, identifiers, or relationships. 0244 Cumulative Layout Shift (CLS) # SEO & Web Quality A Core Web Vital that measures unexpected movement of visible page content during a user's visit. 0245 Cyclomatic Complexity # Test Design & Coverage A code metric based on independent control-flow paths that can help estimate structural complexity and minimum basis-path tests. D 95 terms 0246 Data Accuracy # Data & Database Testing The degree to which data correctly represents the real-world object, event, or source it is intended to describe. 0247 Data Completeness # Data & Database Testing The degree to which all required records, fields, relationships, and time periods are present. 0248 Data Consistency # Data & Database Testing The degree to which data does not conflict across fields, records, systems, replicas, or time. 0249 Data Corruption # Reliability & Resilience Unintended alteration of data that makes it inaccurate, inconsistent, unreadable, or unsafe to use. 0250 Data Currentness # Data & Database Testing The degree to which data is sufficiently up to date for its intended use. 0251 Data Durability # Reliability & Resilience The ability of committed data to remain intact and retrievable despite failures, restarts, or storage events. 0252 Data Factory # Test Data & Environments Reusable code or configuration that creates test objects and records with controlled defaults and variations. 0253 Data Flow Testing # Test Design & Coverage White-box testing that designs cases around where variables are defined, used, changed, and potentially misused. 0254 Data Integrity Testing # Data & Database Testing Testing that data remains accurate, complete, consistent, and correctly related across operations and system boundaries. 0255 Data Lineage # Data & Database Testing Recorded information about where data originated, how it moved, and which transformations or systems changed it. 0256 Data Loss # Reliability & Resilience Permanent or unacceptable absence of data that should have been retained or recoverable. 0257 Data Masking # Test Data & Environments Replacing sensitive values with realistic but protected substitutes while preserving characteristics needed for testing. 0258 Data Migration Testing # Data & Database Testing Testing that data moved between systems or versions remains complete, accurate, consistent, secure, and usable. 0259 Data Minimization # Test Data & Environments Limiting collected, copied, retained, and exposed data to what is necessary for a defined purpose. 0260 Data Observability # Data & Database Testing Monitoring data pipelines and products for freshness, volume, distribution, schema, lineage, and quality anomalies. 0261 Data Pipeline Testing # Data & Database Testing Testing ingestion, transformation, movement, storage, scheduling, retries, quality, and downstream delivery of data. 0262 Data Precision Testing # Data & Database Testing Testing that numeric values retain the required significant digits and scale through storage, calculation, and transfer. 0263 Data Quality Testing # Data & Database Testing Testing data against defined expectations for accuracy, completeness, consistency, validity, uniqueness, timeliness, and integrity. 0264 Data Reconciliation # Data & Database Testing Comparing data between sources, stages, or systems to identify missing, duplicated, transformed, or inconsistent records. 0265 Data Reset # Test Data & Environments Restoring test data and state to a known baseline between executions. 0266 Data Seed # Test Data & Environments A repeatable set of initial records or generation instructions used to populate a test environment . 0267 Data Type Validation # Data & Database Testing Testing that stored and exchanged values conform to expected types, formats, ranges, precision, and nullability. 0268 Data Uniqueness # Data & Database Testing The degree to which records or identifiers that should be unique are not duplicated. 0269 Data Validity # Data & Database Testing The degree to which data follows defined syntax, domain, range, relationship, and business rules. 0270 Data-Driven Testing # Automation & Tooling Automation that runs the same test logic with multiple input and expected-result datasets. 0271 Database Backup Testing # Data & Database Testing Testing that database backups are created consistently, contain required objects and logs, and can support the intended recovery. 0272 Database Snapshot # Test Data & Environments A point-in-time representation of database state used for restore, cloning, comparison, or repeatable testing. 0273 Database Testing # Data & Database Testing Testing schemas, queries, procedures, transactions, constraints, migrations, security, performance, and stored data quality. 0274 Dataset Versioning # Agentic & AI Testing Tracking evaluation or test datasets as immutable, named versions so results can be reproduced and compared fairly. 0275 Daylight Saving Time Testing # Test Data & Environments Testing date, time, schedules, expiry, billing, and duration behavior across daylight-saving transitions. 0276 Deadlock # Data & Database Testing A state in which transactions or threads wait indefinitely for resources held by one another. 0277 Debugging # Core Testing Concepts The activity of locating, understanding, and correcting the cause of a failure; testing supplies evidence but does not itself fix the fault. 0278 Decision Coverage # Test Design & Coverage The percentage of decision outcomes exercised by tests, usually requiring every decision to evaluate both true and false. 0279 Decision Table Testing # Test Design & Coverage A black-box technique that represents combinations of conditions and resulting actions in a table, then derives tests from meaningful rules. 0280 Decision Trace # Agentic & AI Testing A structured record of the information and rules that led an agent to select an action or conclusion. 0281 Deep Link Testing # Mobile & Device Testing Testing that a URL or app link opens the correct screen, route, parameters, authentication flow, and fallback behavior. 0282 Defect # Core Testing Concepts A flaw in a work product that may cause the software to fail or produce an unacceptable outcome. 0283 Defect Arrival Rate # Metrics & Reporting The number of new defects reported per unit of time, often tracked by release, area, or severity. 0284 Defect Classification # Defect Management Assigning structured attributes such as type, component, cause, severity, source, and detection phase to a defect. 0285 Defect Closure # Defect Management Formal completion of a defect after resolution, verification, documentation, and any required release action. 0286 Defect Containment # Defect Management Controls that prevent a defect or failure from spreading to additional components, users, data, or environments. 0287 Defect Density # Metrics & Reporting The number of confirmed defects relative to a chosen product size measure, such as code, function points, stories, or components. 0288 Defect Detection # Defect Management The discovery and recognition of a flaw through reviews, analysis, tests, monitoring, or user evidence. 0289 Defect Detection Percentage (DDP) # Metrics & Reporting The proportion of defects found before release compared with the total found before and after release for the same scope. 0290 Defect Escape # Defect Management A defect not detected in an earlier test stage that is found later, especially after release. 0291 Defect Escape Rate # Metrics & Reporting The proportion or rate of relevant defects first discovered after the intended detection stage or release. 0292 Defect Fingerprint # Defect Management A normalized signature derived from symptoms, stack, route, environment, component, and evidence to group recurring defects. 0293 Defect Leakage # Defect Management The movement of undetected defects from one test level, phase, or control point into a later one. 0294 Defect Lifecycle # Defect Management The states and transitions a defect follows from discovery through triage, resolution, verification, closure, or deferral. 0295 Defect Prevention # Defect Management Process, design, tooling, and learning activities intended to stop defects from being introduced or repeated. 0296 Defect Priority # Defect Management The business and delivery urgency assigned to resolving a defect. 0297 Defect Removal Efficiency (DRE) # Metrics & Reporting The proportion of relevant defects removed before a defined release or phase boundary. 0298 Defect Reopen Rate # Metrics & Reporting The proportion of closed or resolved defects that are reopened because the issue persists, recurs, or was incompletely addressed. 0299 Defect Reproduction # Defect Management The act of triggering a reported defect again under known conditions to validate and investigate it. 0300 Defect Severity # Defect Management The degree of technical, user, business, security, or operational impact caused by a defect. 0301 Defect Similarity Matching # Defect Management Comparison of text, traces, screenshots, components, environments, and behavior to estimate whether findings describe the same defect. 0302 Defect Status # Defect Management The current workflow state of a defect, such as new, triaged, in progress, resolved, verified, deferred, or closed. 0303 Defect Taxonomy # Defect Management A consistent classification system for organizing defects by type, source, cause, component, impact, or detection method. 0304 Defect Trend # Metrics & Reporting Change in defect arrivals, closures, backlog, severity, age, or escapes over time. 0305 Defect Triage # Defect Management Review and decision-making that validates a finding, assesses impact and urgency, checks duplication, assigns ownership, and selects next action. 0306 Defect-Based Testing # Test Design & Coverage Testing designed from known defect categories, historical failures, fault models, or recurring implementation mistakes. 0307 Deferred Defect # Defect Management A confirmed defect intentionally postponed to a later release or decision point. 0308 Definition of Done (DoD) # Test Planning & Governance A shared checklist of quality conditions that a product increment must meet before the team considers it complete. 0309 Delivery Pipeline # CI/CD & Release Quality The automated path through which a change is built, tested, packaged, promoted, deployed, and observed. 0310 Dependency Contract # API & Service Testing The behavioral and data expectations between a service and an upstream or downstream dependency. 0311 Dependency Scanning # Security Testing Automated analysis of third-party libraries and packages for known security defects, integrity issues, obsolete versions, and policy violations. 0312 Deployment Frequency # Metrics & Reporting How often an organization successfully deploys changes to a production environment. 0313 Deployment Verification # CI/CD & Release Quality Checks performed during or immediately after deployment to confirm the correct version, configuration, dependencies, and critical behavior. 0314 Desk Checking # Test Design & Coverage A manual review in which an author or peer steps through logic, calculations, or code without executing the software. 0315 Desktop Application Testing # Test Types & Levels Testing software installed on desktop operating systems, including installation, permissions, updates, local resources, and platform integration. 0316 Determinism # Core Testing Concepts The property that the same initial state and inputs produce the same observable outcome, improving repeatability and diagnosis. 0317 Development Environment # Test Data & Environments An environment used by engineers to build, run, and debug changes before shared validation. 0318 Device Farm # Automation & Tooling A managed pool of real or virtual devices used to run tests across device models, operating systems, and configurations. 0319 Device Fragmentation # Mobile & Device Testing Variation across device models, screen sizes, hardware, operating systems, vendors, and capabilities that expands mobile test risk. 0320 Device Pixel Ratio (DPR) # Web & Browser Testing The ratio between physical screen pixels and CSS pixels, which can affect rendering, screenshots, and responsive behavior. 0321 Differential Testing # Test Design & Coverage Testing that compares outputs from multiple implementations, versions, models, or configurations for the same inputs to reveal inconsistencies. 0322 Dirty Read # Data & Database Testing A transaction anomaly in which one transaction reads changes another transaction has not committed. 0323 Disaster Recovery (DR) # Reliability & Resilience Plans, systems, and procedures for restoring critical services and data after a major disruptive event. 0324 Disaster Recovery Testing # Reliability & Resilience Exercises that verify recovery sites, backups, dependencies, communications, roles, RTOs, and RPOs under realistic disruption. 0325 Disk I/O # Performance & Scalability Read and write activity involving storage devices, often measured for rate, latency, queue depth, and saturation. 0326 Distributed Load Testing # Performance & Scalability Performance testing that coordinates multiple load generators to create traffic beyond one generator's capacity or from several locations.0327 Distributed Tracing # Observability & Diagnostics Following a request across services by linking spans that represent its component operations. 0328 DOM Mutation # Web & Browser Testing A change to document nodes, attributes, text, or structure after the page has loaded. 0329 DOM Snapshot # Web & Browser Testing A captured representation of document structure and state at a specific time for diagnosis, comparison, or evidence. 0330 Domain Testing # Test Design & Coverage Testing that partitions an input or output domain and concentrates cases on boundaries, interactions, and representative values. 0331 Downtime # Reliability & Resilience A period when a service is unavailable or fails to provide an acceptable result to users. 0332 Drag-and-Drop Testing # Web & Browser Testing Testing pointer or touch interactions that move an item, including valid targets, cancellation, keyboard alternatives, and edge boundaries. 0333 Dragging Movements # Accessibility Testing A WCAG 2.2 concept requiring a simple pointer alternative when functionality depends on dragging, unless dragging is essential. 0334 Dummy # Automation & Tooling A test double passed to satisfy an interface but not used meaningfully by the code under test. 0335 Duplicate Content # SEO & Web Quality Substantially similar content available at multiple URLs, which can confuse indexing and ranking signals if not handled intentionally. 0336 Duplicate Defect # Defect Management A report that refers to the same underlying problem as an existing canonical defect. 0337 Duplicate Rate # Metrics & Reporting The proportion of submitted findings identified as duplicates of existing or simultaneously reported defects. 0338 Duplicate Record Testing # Data & Database Testing Testing detection, prevention, merging, and downstream handling of records that should not appear more than once. 0339 Dynamic Application Security Testing (DAST) # Security Testing Testing a running application through its exposed interfaces to detect security defects in observed behavior. 0340 Dynamic Testing # Core Testing Concepts Testing that evaluates software behavior by executing the test object with selected inputs and conditions. E 46 terms 0341 Edge Case # Core Testing Concepts A valid or invalid situation near the limit of expected operation where defects are more likely to appear. 0342 ELT Testing # Data & Database Testing Testing pipelines that extract and load data before transforming it in the target system. 0343 Embedded Software Testing # Test Types & Levels Testing software integrated into dedicated hardware, often involving real-time behavior, resource constraints, safety, and hardware interfaces. 0344 Emulator # Automation & Tooling Software that reproduces another device or system closely enough to run its software and test platform-specific behavior. 0345 End-State Evaluation # Agentic & AI Testing Scoring an agent primarily by the final application or environment state it produces, regardless of the exact path taken. 0346 End-to-End Testing # Test Types & Levels Testing a complete user or business flow across the integrated components and external dependencies that support it. 0347 Endpoint Discovery # API & Service Testing Identifying available API paths, operations, versions, parameters, and exposed interfaces for testing or security review. 0348 Endurance Testing # Test Types & Levels Performance testing that applies a sustained workload to reveal degradation, leaks, accumulation, or stability problems over time.0349 Entity Integrity # Data & Database Testing Database rules ensuring that each row has a valid, unique primary identity. 0350 Entry Criteria # Test Planning & Governance Conditions that should be satisfied before a test activity, level, phase, or release evaluation begins. 0351 Environment Drift # Test Data & Environments Change over time that makes a test environment differ from its documented or intended baseline. 0352 Environment Fingerprint # Defect Management A compact record of build, configuration, platform, dependencies, data, browser, device, region, and other conditions relevant to a result. 0353 Environment Parity # Test Data & Environments The degree to which test and production environments match in behaviorally important configuration, topology, dependencies, and data shape. 0354 Environment Reset # Agentic & AI Testing Restoring a test environment to a known baseline so an agent run can start independently and be reproduced. 0355 Environment Variable # Test Data & Environments A named value supplied by the operating environment to configure application or test behavior. 0356 Ephemeral Environment # Test Data & Environments A short-lived environment created on demand for a branch, change, test run, or review and removed afterward. 0357 Equivalence Partitioning # Test Design & Coverage A black-box technique that divides a data domain into classes expected to behave similarly and tests representative values from each class. 0358 Error # Core Testing Concepts A human action or decision that produces an incorrect result and may introduce a defect into a work product. 0359 Error Budget # Reliability & Resilience The permitted amount of unreliability over a period, commonly calculated as one minus the service-level objective. 0360 Error Fingerprint # Observability & Diagnostics A normalized signature derived from exception type, message, stack, location, or context to identify recurring failures. 0361 Error Guessing # Test Design & Coverage An experience-based technique that targets likely failures using tester knowledge, intuition, defect history, and common mistake patterns. 0362 Error Identification # Accessibility Testing Accessibility support that clearly identifies an input error and describes it in text for the user. 0363 Error Prevention # Quality Attributes & UX Product design or process measures that reduce the chance of users or systems making mistakes. 0364 Error Rate # Performance & Scalability The proportion or rate of operations that fail according to defined success criteria. 0365 Error Recovery # Quality Attributes & UX The ability of an interface or system to help users recognize, correct, and recover from mistakes without losing necessary work. 0366 Error Suggestion # Accessibility Testing Accessibility support that offers a known correction when input is invalid and the suggestion does not create security or purpose conflicts. 0367 Escaped Defect # Defect Management A defect discovered after the phase or release in which it was expected to be detected. 0368 ETL Testing # Data & Database Testing Testing pipelines that extract data, transform it according to rules, and load it into a target system. 0369 Evals # Agentic & AI Testing Repeatable tests and measurements used to assess AI system behavior against defined tasks, datasets, graders, and success criteria. 0370 Evaluation Awareness # Agentic & AI Testing Behavior change caused when a model or agent recognizes or infers that it is being evaluated. 0371 Evaluation Dataset # Agentic & AI Testing A controlled set of tasks, inputs, expected properties, and labels used to measure a model or agent. 0372 Evaluation Harness # Agentic & AI Testing The software and configuration that supplies tasks, tools, prompts, budgets, environments, and scoring for an AI evaluation. 0373 Evaluation Probe # Agentic & AI Testing An automated measurement component that inspects an agent output, action, claim, or trace against a defined rubric or trusted evidence. 0374 Evaluation Versioning # Agentic & AI Testing Tracking changes to tasks, harnesses, rubrics, graders, budgets, and datasets so evaluation results remain interpretable. 0375 Event # Observability & Diagnostics A timestamped record that something meaningful happened in a system. 0376 Event-Driven Testing # API & Service Testing Testing systems that communicate through events, with attention to ordering, duplication, loss, retries, schemas, and eventual outcomes. 0377 Eventual Consistency Testing # API & Service Testing Testing that replicated or asynchronous state converges correctly within the allowed time and handles intermediate states safely. 0378 Evidence Chain # Agentic & AI Testing A connected sequence from observed behavior through captured artifacts to the finding and its supporting conclusion. 0379 Evidence Completeness # Metrics & Reporting The degree to which a result includes enough context, steps, artifacts, versions, and environment detail for review and reproduction. 0380 Evidence-Grounded Finding # Agentic & AI Testing A reported issue whose claims are directly supported by reproducible steps, captured state, logs, screenshots, traces, or other artifacts. 0381 Exception # Observability & Diagnostics A runtime event indicating an error or unusual condition that interrupts normal control flow or requires special handling. 0382 Exit Criteria # Test Planning & Governance Measurable conditions used to decide whether a test activity, test level, or release evaluation can be concluded. 0383 Expected Result # Core Testing Concepts The predicted observable behavior or output derived from requirements, models, business rules, or another trusted oracle. 0384 Experience-Based Testing # Test Design & Coverage Testing in which design and execution rely strongly on the tester's skills, domain knowledge, intuition, and defect history. 0385 Explicit Wait # Automation & Tooling A test command that waits until a defined condition is true or a timeout expires before continuing. 0386 Exploratory Testing # Test Design & Coverage Testing in which learning, test design, and execution occur together as the tester investigates the product and adapts to findings. F 51 terms 0387 Factuality Evaluation # Agentic & AI Testing Assessment of whether AI-generated claims are accurate according to trusted evidence. 0388 Fail # Core Testing Concepts A test outcome indicating that observed behavior did not satisfy one or more expected results or acceptance conditions. 0389 Failback # Reliability & Resilience The controlled return of workload from a failover resource to the original or preferred resource after recovery. 0390 Failover Testing # Test Types & Levels Testing that verifies service continuity and state handling when processing moves from a failed component to a standby or alternate resource. 0391 Failure # Core Testing Concepts An event in which a system or component does not perform a required function within specified limits. 0392 Failure Clustering # Automation & Tooling Automatic grouping of failed tests or agent findings that appear to share the same symptom or underlying cause. 0393 Failure Explanation # Agentic & AI Testing A concise, evidence-based account of what failed, under which conditions, and why the behavior matters. 0394 Failure Mode # Reliability & Resilience A specific way in which a component, service, process, or user journey can fail. 0395 Failure Mode and Effects Analysis (FMEA) # Reliability & Resilience A structured method for identifying potential failure modes, their effects, causes, controls, and priorities. 0396 Failure Rate # Metrics & Reporting The proportion or frequency of executed tests, requests, transactions, or user journeys that do not meet success criteria. 0397 Failure Trend # Metrics & Reporting The change in failed executions or failure categories across builds, time, components, or environments. 0398 Fairness Testing # Agentic & AI Testing Evaluation of outcome quality and error rates across relevant people, groups, languages, regions, or usage contexts. 0399 Fake # Automation & Tooling A working but simplified test implementation, such as an in-memory repository, used instead of a production dependency. 0400 False Fail # Defect Management A test result reported as failed even though the product behavior is acceptable. 0401 False Negative # Defect Management A result that incorrectly indicates no defect or risk when one is actually present. 0402 False Pass # Defect Management A test result reported as passed even though the product contains behavior that should have failed the check. 0403 False Positive # Defect Management A result that reports a defect or risk that is not actually present. 0404 Fault # Core Testing Concepts The underlying incorrect code, data, configuration, design, or documentation that can cause a failure when activated. 0405 Fault Injection Testing # Test Design & Coverage Testing that deliberately introduces failures or adverse conditions to evaluate detection, containment, recovery, and resilience. 0406 Feature Coverage # Test Design & Coverage The proportion of planned product features or behaviors exercised by a defined test set. 0407 Feature Flag # Test Data & Environments A runtime control that enables or changes functionality without requiring a new code deployment. 0408 Feedback Time # Metrics & Reporting Elapsed time from a change or test trigger until useful quality results are available to the people who need them. 0409 File Download Testing # Web & Browser Testing Testing downloaded content, filename, type, size, integrity, authorization, error handling, and browser behavior. 0410 File Upload Testing # Web & Browser Testing Testing file selection, type and size validation, transfer, progress, cancellation, storage, scanning, and error handling. 0411 First Contentful Paint (FCP) # SEO & Web Quality A web performance metric measuring when the browser first renders text, an image, or another content element. 0413 Fix Verification # Defect Management Testing that confirms a defect's corrective change resolves the reported behavior in the intended build and conditions. 0414 Fixed Defect # Defect Management A defect for which a corrective change has been implemented and is awaiting or has passed verification. 0415 Fixed Version # Defect Management The product version, build, commit, or release expected to contain the verified correction for a defect. 0416 Fixture # Automation & Tooling A known set of objects, data, files, services, or state prepared for a test. 0417 Flake Rate # Metrics & Reporting The proportion of test executions that produce inconsistent outcomes without a relevant product change. 0418 Flaky Test # CI/CD & Release Quality A test that sometimes passes and sometimes fails under equivalent conditions because of instability in the test, environment, or system. 0419 Flame Graph # Observability & Diagnostics A visualization of aggregated stack samples that shows which call paths consume CPU time or other profiled resources. 0420 Flashing Content Testing # Accessibility Testing Testing visual content for flashes that could trigger photosensitive seizures or create other accessibility barriers. 0421 Focus Appearance # Accessibility Testing The visual size, contrast, and persistence of a keyboard focus indicator. 0422 Focus Indicator # Accessibility Testing A visible cue showing which interactive element currently receives keyboard input. 0423 Focus Management # Accessibility Testing Programmatic and visual handling of keyboard focus during navigation, dynamic updates, dialogs, and errors. 0424 Focus Not Obscured # Accessibility Testing A WCAG 2.2 requirement that the focused component is not entirely hidden by author-created content. 0425 Focus Order # Accessibility Testing The sequence in which interactive elements receive focus, expected to preserve meaning and operability. 0426 Focus Trap # Accessibility Testing A defect in which keyboard focus cannot leave a component, except when containment is intentional and an accessible exit is provided. 0427 Foreign Key Testing # Data & Database Testing Testing referential constraints and behavior when related records are inserted, updated, deleted, migrated, or missing. 0431 Framework # Automation & Tooling A reusable structure of conventions, libraries, configuration, and utilities that supports consistent test development and execution. 0432 Front-End Testing # Web & Browser Testing Testing browser-delivered user interfaces, client logic, rendering, interactions, accessibility, and integration with services. 0433 Function Coverage # Test Design & Coverage The percentage of defined functions, methods, procedures, or operations invoked at least once by a test suite. 0434 Functional Correctness # Quality Attributes & UX The degree to which a product produces correct results with the required precision for specified inputs and conditions. 0435 Functional Testing # Test Types & Levels Testing that evaluates what a system does by checking functions, business rules, inputs, outputs, and user-visible behavior. 0436 Functional Website Testing # Web & Browser Testing Testing website features, forms, navigation, business rules, data, and integrations against expected behavior. 0437 Fuzz Testing # Test Design & Coverage Testing that supplies malformed, unexpected, or generated inputs to expose crashes, hangs, security weaknesses, and robustness defects. G 18 terms 0438 Game Day # Reliability & Resilience A planned operational exercise that rehearses failure scenarios, incident response, communication, and recovery in a controlled setting. 0439 Garbage Collection Pause # Performance & Scalability A period in which automatic memory management delays application work while reclaiming or reorganizing memory. 0440 Gauge Metric # Observability & Diagnostics A metric representing a value that can rise or fall, such as current memory use, queue depth, or active sessions. 0441 Gesture Testing # Mobile & Device Testing Testing taps, swipes, pinches, rotations, long presses, and multi-touch behavior across supported devices. 0442 Goal-Driven Testing # Agentic & AI Testing Testing organized around an outcome an agent should achieve, allowing it to choose the path and checks dynamically. 0443 Golden Dataset # Agentic & AI Testing A carefully reviewed dataset of inputs and trusted labels or outcomes used as a high-confidence evaluation reference. 0444 Golden Master Testing # Test Design & Coverage Testing that stores trusted output from existing behavior and compares future output against that reference to detect change. 0445 Golden Signals # Observability & Diagnostics A common service-monitoring set covering latency, traffic, errors, and saturation. 0446 Graceful Degradation # Reliability & Resilience The ability to preserve essential service with reduced functionality or quality when dependencies or resources fail. 0447 Grader Agreement # Agentic & AI Testing The extent to which multiple human or model graders assign the same result to identical evaluation items. 0448 GraphQL Authorization Testing # Security Testing Testing access control at operation, object, field, relationship, and tenant boundaries in a GraphQL API. 0449 GraphQL Query Validation # API & Service Testing Checking whether a GraphQL operation is syntactically correct and valid against the service schema before execution. 0450 GraphQL Testing # API & Service Testing Testing GraphQL queries, mutations, subscriptions, schema rules, authorization, errors, and performance. 0451 Gray-Box Testing # Test Design & Coverage Testing informed by partial knowledge of internal design, data, or architecture while still validating behavior through external interfaces. 0452 Ground Truth # Agentic & AI Testing A trusted reference label, state, measurement, or outcome used to judge the correctness of a prediction or test result. 0453 Groundedness Evaluation # Agentic & AI Testing Assessment of whether an AI output is supported by the context, sources, or application evidence available for the task. 0454 gRPC Testing # API & Service Testing Testing RPC methods, protobuf contracts, metadata, streaming, status codes, deadlines, and service compatibility. 0455 GUI Testing # Test Types & Levels Testing graphical user interface elements, interactions, states, layout, and visible feedback. H 20 terms 0456 Hallucination Testing # Agentic & AI Testing Evaluation designed to reveal unsupported or fabricated model claims, observations, citations, or actions. 0457 Happy Path # Core Testing Concepts The primary flow in which valid inputs and expected conditions allow a user to complete a goal successfully. 0458 Hardware Utilization # Performance & Scalability The measured consumption of CPU, memory, storage, network, accelerator, or other physical resources. 0459 Headed Browser # Automation & Tooling A browser automation mode that displays the graphical interface during test execution. 0460 Heading Hierarchy # SEO & Web Quality The semantic nesting of page headings that communicates content structure to users, assistive technology, and search engines. 0461 Heading Structure Testing # Accessibility Testing Testing whether headings accurately label sections and form a logical hierarchy for navigation and comprehension. 0462 Headless Browser # Automation & Tooling A browser that runs without a visible graphical window, commonly used for fast automated testing in CI. 0463 Health Check # Reliability & Resilience A diagnostic check reporting whether a component is functioning sufficiently for a defined purpose. 0464 High Availability # Reliability & Resilience A design and operating objective that minimizes service interruption through redundancy, failover, maintenance practices, and rapid recovery. 0465 Histogram Metric # Observability & Diagnostics A metric that groups observations into value ranges, supporting distribution and percentile analysis. 0466 Holdout Set # Agentic & AI Testing Evaluation data kept separate from development and tuning so it provides a less biased estimate of real performance. 0467 Hook # Automation & Tooling Automation code that runs at a defined lifecycle point, such as before each test, after failure, or after a suite. 0468 hreflang Testing # SEO & Web Quality Testing language and regional annotations so search engines serve the correct localized URL and reciprocal links are valid. 0469 HTTP Archive (HAR) # Observability & Diagnostics A structured file containing browser network requests, responses, headers, timing, and related metadata for diagnosis. 0471 HTTP Redirect # SEO & Web Quality A response that instructs a client to retrieve or use a different URL. 0472 HTTP Status Code # API & Service Testing A three-digit HTTP response code that communicates the general result of processing a request. 0473 Human Grader # Agentic & AI Testing A person who applies a defined rubric to judge model or agent outputs and provide trusted labels. 0474 Hybrid Mobile App # Mobile & Device Testing A mobile application that combines web technologies with a native container and device integrations. 0475 Hydration Mismatch # Web & Browser Testing A difference between server-rendered HTML and the client application's expected render, which may cause warnings or incorrect UI. I 31 terms 0476 Idempotency # API & Service Testing The property that repeating an operation has the same intended effect as performing it once. 0477 Idempotent Test # Automation & Tooling A test that can be repeated without unintended cumulative effects and produces the same valid state from the same starting conditions. 0478 Identity Management Testing # Security Testing Testing account creation, lifecycle, identifiers, roles, provisioning, deprovisioning, and identity-related privacy controls. 0479 Iframe Testing # Web & Browser Testing Testing content embedded in an inline frame, including loading, sizing, focus, origin boundaries, messaging, and security restrictions. 0480 Implicit Wait # Automation & Tooling A global browser automation setting that repeatedly searches for an element for a limited time before failing. 0481 In Scope # Test Planning & Governance Features, risks, platforms, interfaces, and quality attributes explicitly included in a testing effort. 0482 Incident # Defect Management An unplanned interruption, degradation, or harmful event that requires operational response and may originate from one or more defects. 0483 Inconclusive Result # Core Testing Concepts A test outcome that cannot be classified as pass or fail because evidence is missing, execution was blocked, or the environment was invalid. 0484 Incremental Testing # Automation & Tooling Testing focused on the newly changed or newly integrated parts of a system while retaining enough regression protection. 0485 Independent Testing # Test Planning & Governance Testing performed with organizational, technical, or cognitive separation from the people who created the test object. 0486 Indexability # SEO & Web Quality The degree to which a search engine is permitted and able to include a page in its index. 0487 Infrastructure as Code Testing # CI/CD & Release Quality Testing infrastructure definitions for syntax, policy, security, dependencies, drift risk, and deployable behavior. 0488 Infrastructure Security Testing # Security Testing Testing cloud, network, identity, host, container, and infrastructure configuration against defined security requirements and expected controls. 0489 Inspection # Test Design & Coverage A formal peer review with defined roles, preparation, criteria, defect logging, and follow-up. 0490 Installation Testing # Test Types & Levels Testing installers, packages, prerequisites, permissions, defaults, upgrades, rollback, and uninstallation across supported environments. 0491 Instrumentation # Observability & Diagnostics Code or configuration that makes a system emit telemetry such as traces, metrics, logs, or profiles. 0492 Integration Testing # Test Types & Levels Testing interactions, interfaces, and data flow between combined components, services, systems, or external dependencies. 0493 Intelligent Test Automation # Agentic & AI Testing Automation that uses models, heuristics, or adaptive algorithms to improve test design, execution, selection, or maintenance. 0494 Intent Coverage # Agentic & AI Testing The degree to which tests exercise the distinct user goals, business intents, and requested outcomes a product is expected to support. 0495 Intent-Based Testing # Agentic & AI Testing Testing specified through user or business intent while an agent determines concrete actions, data, and checks. 0496 Inter-Rater Reliability # Agentic & AI Testing A statistical measure of how consistently independent graders evaluate the same items. 0497 Interaction to Next Paint (INP) # SEO & Web Quality A Core Web Vital that measures page responsiveness across user interactions by observing interaction latency. 0498 Interactive Application Security Testing (IAST) # Security Testing Security analysis that observes a running application from inside the process while tests exercise it. 0499 Interface Testing # Test Types & Levels Testing the exchange of data, control, errors, and timing across a defined interface between components or systems. 0500 Intermittent Defect # Defect Management A defect that produces a failure only under certain timing, load, state, data, hardware, or environmental conditions. 0501 Internal Link Testing # SEO & Web Quality Testing internal links for valid targets, useful anchor context, crawlable paths, redirects, and correct navigation. 0502 Internationalization Testing # Test Types & Levels Testing whether a product can support multiple languages, scripts, regions, calendars, currencies, and cultural conventions without redesign. 0503 Interruption Testing # Mobile & Device Testing Testing mobile behavior during calls, alarms, notifications, lock and unlock, connectivity changes, and app switching. 0504 Invalid Defect # Defect Management A reported issue determined not to represent a product defect, such as expected behavior, user error, or an invalid environment. 0505 IoT Testing # Test Types & Levels Testing connected devices and their firmware, networks, cloud services, mobile apps, protocols, power behavior, and physical-world interactions. 0506 Isolation Level # Data & Database Testing A database setting that controls which concurrent transaction changes can be observed and which anomalies are prevented. J 6 terms 0507 JavaScript Error # Web & Browser Testing A runtime exception or unhandled rejection in browser code that may break functionality or degrade the experience. 0508 JavaScript SEO Testing # SEO & Web Quality Testing whether client-rendered content, links, metadata, and structured data are available to search-engine rendering and indexing. 0509 Jitter # Performance & Scalability Variation in latency, timing, or packet arrival that can affect real-time systems and tail performance. 0510 JSON Schema Validation # API & Service Testing Checking JSON instances against defined types, required properties, formats, ranges, and structural constraints. 0511 JSON Web Token Testing # Security Testing Testing token signatures, algorithms, claims, expiry, audience, issuer, key handling, replay resistance, and authorization use. 0512 JUnit XML # Metrics & Reporting A widely supported XML format for publishing automated test cases, durations, failures, errors, and skipped outcomes. K 5 terms 0513 Keyboard Accessibility # Accessibility Testing The ability to operate all relevant functionality through a keyboard or keyboard-equivalent input. 0514 Keyboard Navigation Testing # Accessibility Testing Testing tab order, focus visibility, activation, shortcuts, dialogs, menus, and complete task flows without a pointing device. 0515 Keyboard Trap # Accessibility Testing A defect that prevents keyboard users from moving focus away from a component using standard navigation methods. 0516 Keyword-Driven Testing # Automation & Tooling Automation in which tests are assembled from reusable action keywords and data rather than direct low-level code. 0517 Known Issue # Defect Management A confirmed product limitation or defect that is documented and not yet fully resolved. L 31 terms 0518 Label # Observability & Diagnostics A key-value dimension used to filter, group, and aggregate metrics, logs, or traces. 0519 Landmark # Accessibility Testing A semantic page region, such as main, navigation, or search, that helps assistive-technology users navigate efficiently. 0520 Language of Page # Accessibility Testing Programmatic identification of a page's primary human language so assistive technology can pronounce and process content correctly. 0521 Largest Contentful Paint (LCP) # SEO & Web Quality A Core Web Vital measuring when the largest visible content element is rendered, as an indicator of loading experience. 0522 Latency # Performance & Scalability The elapsed delay between initiating an operation and observing a defined response or completion point. 0523 Latent Defect # Defect Management A defect present in the product that has not yet caused an observed failure because its triggering conditions have not occurred. 0524 Layout Testing # Web & Browser Testing Testing alignment, spacing, sizing, overflow, overlap, clipping, and responsive arrangement across viewports and content variations. 0525 Lead Time for Changes # Metrics & Reporting Elapsed time from a code change being committed until it is successfully running in production. 0526 Link Accessibility Testing # Accessibility Testing Testing link text, purpose, focus, target behavior, visited state, and distinction from surrounding content. 0527 Link Purpose # Accessibility Testing The ability to understand a link's destination or function from its accessible text and relevant context. 0528 Linting # Test Design & Coverage Automated static checking that flags suspicious code, style violations, likely errors, or unsafe constructs without executing the program. 0529 Live Region # Accessibility Testing An ARIA mechanism that informs assistive technology about important dynamic content changes without moving focus. 0530 Liveness Probe # Reliability & Resilience A check that determines whether a running process is healthy enough to continue or should be restarted. 0531 LLM Evaluation # Agentic & AI Testing Systematic measurement of a language model's capabilities, quality, robustness, safety, latency, and cost on defined tasks. 0532 LLM Testing # Agentic & AI Testing Testing language-model outputs and applications for correctness, grounding, safety, consistency, robustness, and integration behavior. 0533 Load Generator # Performance & Scalability Software that creates controlled requests, users, messages, or transactions for performance testing . 0534 Load Profile # Performance & Scalability The planned shape of workload over time, including rates, concurrency, ramps, peaks, pauses, and traffic mix. 0535 Load Testing # Test Types & Levels Performance testing that evaluates behavior under expected and peak concurrent workload levels.0536 Locale Testing # Test Data & Environments Testing language, formatting, sorting, collation, calendars, currencies, addresses, names, and cultural conventions for a selected locale. 0537 Localization Testing # Test Types & Levels Testing the linguistic and regional adaptation of a product, including translations, formats, layout, sorting, and culturally appropriate content. 0538 Locator # Automation & Tooling A query that identifies one or more user interface elements for automation and assertions. 0539 Locator Strategy # Automation & Tooling The ordered approach used to identify UI elements reliably, favoring stable user-facing semantics over fragile implementation details. 0540 Lock Contention # Data & Database Testing Performance or concurrency degradation caused when multiple operations compete for the same database or application locks. 0541 Log # Observability & Diagnostics A timestamped record of an event or state emitted by software or infrastructure. 0542 Log Correlation # Observability & Diagnostics Linking log records to the same request, user journey, trace, service, deployment, or failure. 0543 Log Level # Observability & Diagnostics A severity or verbosity classification such as debug, info, warning, error, or fatal. 0544 Log Sampling # Observability & Diagnostics Retaining only a controlled subset of log events to manage volume and cost while preserving useful signal. 0545 Logout Testing # Security Testing Testing whether logout invalidates relevant sessions and tokens, clears sensitive state, and prevents unauthorized reuse. 0546 Loop Coverage # Test Design & Coverage The degree to which tests exercise relevant loop behaviors, such as zero, one, typical, boundary, and excessive iterations. 0547 Lost Update # Data & Database Testing A concurrency anomaly in which one write unintentionally overwrites another committed change. 0548 Low-Code Testing # Automation & Tooling Automation built with a mixture of visual configuration, reusable components, and limited custom code. M 44 terms 0549 Machine Learning Testing # Agentic & AI Testing Testing ML data, pipelines, models, interfaces, metrics, drift, robustness, fairness, and production behavior. 0550 Maintainability Testing # Test Types & Levels Testing or analysis that evaluates how easily software can be understood, diagnosed, modified, and safely verified after change. 0551 Major Defect # Defect Management A defect with significant impact on an important function but with less urgency or breadth than a critical defect. 0552 Manual Accessibility Testing # Accessibility Testing Human evaluation of accessibility behavior that automated rules cannot fully determine, including keyboard and assistive-technology use. 0553 Manual Testing # Test Types & Levels Testing in which a person performs or directly controls test activities rather than relying entirely on automated execution. 0554 Matcher # Automation & Tooling A reusable comparison that determines whether an observed value satisfies an expected pattern, range, state, or predicate. 0555 Materialized View Testing # Data & Database Testing Testing refreshed query results for correctness, freshness, consistency, permissions, and update behavior. 0556 Mean Time Between Failures (MTBF) # Reliability & Resilience Average operating time between repairable system failures over an observed period. 0557 Mean Time to Detect (MTTD) # Reliability & Resilience Average time from the start of a failure until the organization or system detects it. 0558 Mean Time to Failure (MTTF) # Reliability & Resilience Average operating time before a non-repairable component or instance fails. 0559 Mean Time to Recover (MTTR) # Reliability & Resilience Average time required to restore acceptable service after a failure begins. 0560 Mean Time to Resolve # Metrics & Reporting Average elapsed time from defect or issue creation until an accepted resolution is completed. 0561 Memory Leak # Performance & Scalability Unintended retention of memory that causes usage to grow over time and may eventually degrade or crash the system. 0562 Memory Pressure # Performance & Scalability A condition in which available memory is low enough to trigger reclaim, paging, throttling, termination, or degraded performance. 0563 Memory Profile # Observability & Diagnostics A diagnostic view of allocation, retention, object growth, and memory use within a process. 0564 Memory Safety Testing # Security Testing Testing and analysis for out-of-bounds access, use-after-free, uninitialized memory, leaks, and related memory defects. 0565 Message Queue Testing # API & Service Testing Testing queued communication for ordering, duplication, loss, delay, retries, dead letters, scaling, and consumer behavior. 0568 Metric # Observability & Diagnostics A numeric measurement recorded over time to describe behavior, performance, capacity, or reliability. 0569 Microservices Testing # API & Service Testing Testing independently deployable services and their contracts, dependencies, data boundaries, resilience, and end-to-end interactions. 0570 Migration Testing # Test Types & Levels Testing that verifies data, configuration, integrations, and behavior when moving between platforms, versions, schemas, or providers. 0571 Minidump # Observability & Diagnostics A compact process snapshot captured at a crash or failure for later debugging and symbolication. 0572 Minimal Reproducible Example (MRE) # Defect Management The smallest self-contained setup, data, and action sequence that reliably demonstrates a problem. 0573 Minor Defect # Defect Management A defect with limited impact that does not materially block a primary user or business outcome. 0575 Mobile Accessibility Testing # Mobile & Device Testing Testing a mobile experience with platform accessibility APIs, screen readers, switch controls, magnification, and alternative input. 0576 Mobile App Testing # Test Types & Levels Testing native, hybrid, or mobile web applications across devices, operating systems, networks, sensors, permissions, and interaction modes. 0578 Mobile Web App # Mobile & Device Testing A website designed to run in mobile browsers without being installed as a native application. 0579 Mock # Automation & Tooling A programmable test double that returns controlled behavior and can verify how it was called. 0580 Mock Service # Test Data & Environments A controlled service implementation that imitates a dependency's interface and selected behavior for testing. 0581 Modal Dialog Accessibility # Accessibility Testing Accessible dialog behavior with a clear name, managed focus, keyboard operation, appropriate modality, and a reliable close action. 0582 Model Checking # Test Design & Coverage Automated analysis of a formal system model to determine whether specified properties hold across reachable states. 0583 Model Evals # Agentic & AI Testing Structured evaluations used to compare model versions, prompts, safeguards, or configurations on defined behavior and quality dimensions. 0584 Model Grader # Agentic & AI Testing An AI model configured to apply evaluation criteria and produce structured scores, labels, or critiques. 0585 Model-Based Testing # Test Design & Coverage Testing in which cases are generated from a model of states, workflows, decisions, data, or expected system behavior. 0586 Modified Condition/Decision Coverage (MC/DC) # Test Design & Coverage Coverage requiring each atomic condition to independently affect its decision outcome while all decision outcomes are exercised. 0587 Multi-Agent Testing # Agentic & AI Testing Testing performed by multiple coordinated agents with specialized roles such as exploration, execution, verification, or triage. 0588 Multi-Factor Authentication (MFA) Testing # Security Testing Testing enrollment, challenges, recovery, fallback, trusted devices, lockout, and factor independence. 0589 Multi-Tenancy Testing # Test Data & Environments Testing isolation, configuration, identity, data, limits, performance, and administration across multiple tenants sharing a system. 0590 Multimodal Evidence # Agentic & AI Testing Combined evidence from screenshots, video, text, DOM state, logs, audio, network data, or structured records. 0591 Multiple Condition Coverage # Test Design & Coverage Coverage requiring every feasible combination of Boolean condition outcomes within each decision to be exercised. 0592 Mutation Testing # Test Design & Coverage Testing that makes small artificial code changes and measures whether the existing tests detect those changes. N 20 terms 0593 Name, Role, Value # Accessibility Testing Core accessibility semantics that identify a control, communicate what it is, and expose its current state or value. 0594 Native Mobile App # Mobile & Device Testing An application built for and installed on a specific mobile operating system using its platform APIs. 0595 Natural-Language Test Generation # Agentic & AI Testing Creation of structured or executable tests from goals, requirements, examples, or instructions written in ordinary language. 0596 Navigation Testing # Web & Browser Testing Testing menus, links, routes, breadcrumbs, browser history, redirects, and recovery from invalid or unauthorized destinations. 0597 Negative API Testing # API & Service Testing Testing APIs with invalid, missing, conflicting, unauthorized, malformed, or out-of-sequence requests. 0598 Negative Testing # Core Testing Concepts Testing with invalid inputs, missing data, forbidden actions, or adverse conditions to verify safe and informative behavior. 0599 Network Condition Testing # Mobile & Device Testing Testing behavior under different bandwidth, latency, packet loss, offline, roaming, and connectivity transitions. 0600 Network Interception # Automation & Tooling Automation that observes, blocks, modifies, or fulfills network requests and responses during a test. 0601 Network Log # Observability & Diagnostics A record of network connections, requests, responses, protocols, timing, errors, and transfer details. 0602 Network Throttling # Web & Browser Testing Artificially limiting network speed or adding latency to evaluate behavior under constrained connections. 0603 Network Throughput # Performance & Scalability The amount of data successfully transferred through a network per unit of time. 0604 Nofollow Attribute # SEO & Web Quality A link annotation indicating that a crawler should not treat the link as a normal endorsement or ranking signal. 0605 Noindex Directive # SEO & Web Quality A robots instruction requesting that a search engine not include a page in its index. 0606 Non-determinism # Core Testing Concepts Variation in outcomes despite apparently identical inputs and starting conditions, often caused by timing, concurrency, randomness, or external dependencies. 0607 Non-Deterministic Evaluation # Agentic & AI Testing An evaluation whose score can vary across equivalent runs because of model sampling, graders, environment state, or timing. 0608 Non-Functional Testing # Test Types & Levels Testing that evaluates quality attributes such as performance, security, accessibility, reliability, usability, and compatibility. 0609 Non-Repeatable Read # Data & Database Testing A transaction anomaly in which reading the same row twice returns different committed values within one transaction. 0610 Non-Text Contrast # Accessibility Testing Visual contrast for controls, states, focus indicators, and meaningful graphics that users need to perceive. 0611 Not Reproducible # Defect Management A defect status indicating that the reported behavior could not be triggered again with the available information and conditions. 0612 Null Handling Testing # Data & Database Testing Testing missing, unknown, empty, optional, and null values through validation, storage, calculations, display, and interfaces. O 16 terms 0613 OAuth Testing # Security Testing Testing clients, redirect URIs, scopes, state, PKCE, tokens, consent, refresh, revocation, and authorization-server interactions. 0614 Observability # Observability & Diagnostics The ability to understand a system's internal state and behavior by examining its external outputs and telemetry. 0615 Offline Evaluation # Agentic & AI Testing Evaluation performed on a controlled dataset or recorded interactions without exposing the candidate system to live users. 0616 Offline Testing # Web & Browser Testing Testing browser or app behavior when network connectivity is absent, intermittent, or restored. 0617 Online Evaluation # Agentic & AI Testing Evaluation performed on live or newly arriving interactions, often with safeguards, monitoring, and limited exposure. 0618 Open Workload Model # Performance & Scalability A performance model in which new work arrives independently of how quickly prior work completes. 0619 Open-Loop Testing # Agentic & AI Testing Testing in which actions are fixed in advance and do not adapt to observations made during execution. 0620 OpenTelemetry # Observability & Diagnostics An open-source observability framework and standard set of APIs, SDKs, protocols, and tools for telemetry. 0621 Operable # Accessibility Testing The WCAG principle that user-interface components and navigation must be usable through supported input methods and without inaccessible timing or motion demands. 0622 Operational Acceptance Testing (OAT) # Test Types & Levels Acceptance testing that evaluates operational readiness, including monitoring, backup, recovery, support, security, and deployment procedures.0623 Optimistic Locking # Data & Database Testing A concurrency strategy that detects conflicting updates at write time, commonly using a version value. 0624 Oracle Model # Agentic & AI Testing A model used to predict or judge the expected outcome of a test when deterministic rules are incomplete or expensive. 0625 Orientation Testing # Mobile & Device Testing Testing mobile layout, state, media, and interactions when switching between portrait and landscape. 0626 Orphan Page # SEO & Web Quality A page with no discoverable internal links pointing to it, making it difficult for users and crawlers to find. 0627 Orthogonal Array Testing # Test Design & Coverage A combinatorial technique that uses balanced experimental arrays to cover factor interactions with relatively few tests. 0628 Out of Scope # Test Planning & Governance Features, platforms, risks, or quality attributes explicitly excluded from a testing effort and documented as such. P 57 terms 0629 p50 Latency # Performance & Scalability The median latency, at or below which half of measured operations complete. 0630 p95 Latency # Performance & Scalability The latency at or below which 95 percent of measured operations complete, highlighting slower user experiences. 0631 p99 Latency # Performance & Scalability The latency at or below which 99 percent of measured operations complete, commonly used to inspect tail behavior. 0632 Page Experience # SEO & Web Quality The overall quality of using a web page, including responsiveness, stability, accessibility, security, usability, and content presentation. 0633 Page Load Testing # Web & Browser Testing Testing the correctness and timing of navigation, resource loading, rendering, interactivity, errors, and fallback behavior. 0634 Page Object Model (POM) # Automation & Tooling An automation pattern that represents pages or components as reusable objects containing locators and user-facing actions. 0635 Page Weight # Performance & Scalability The total transferred size of documents, scripts, styles, images, fonts, and other resources needed for a page. 0636 Pairwise Testing # Test Design & Coverage Combinatorial testing that covers every relevant pair of input values or configuration factors at least once. 0637 Parallel Testing # Automation & Tooling Running multiple tests at the same time to shorten feedback time or broaden environment coverage. 0638 Parameterized Test # Automation & Tooling A test definition executed repeatedly with different argument sets while reusing the same test logic. 0639 Pass # Core Testing Concepts A test outcome indicating that observed behavior satisfied all evaluated expected results and acceptance conditions. 0640 Pass Rate # Metrics & Reporting The proportion of completed test executions classified as passed under the defined rules. 0641 Pass@k # Agentic & AI Testing An evaluation metric measuring whether at least one of k independent attempts successfully completes a task. 0642 Password Policy Testing # Security Testing Testing password creation, storage, reset, reuse, length, compromised-password handling, and user guidance. 0643 Path Coverage # Test Design & Coverage The proportion of selected execution paths through a component that a test suite exercises. 0644 Pause, Stop, Hide # Accessibility Testing An accessibility requirement to let users control certain moving, blinking, scrolling, or auto-updating content. 0645 PDF Accessibility Testing # Accessibility Testing Testing PDF tags, reading order, headings, language, alternatives, tables, links, forms, and keyboard behavior. 0646 Peer Review # Test Design & Coverage An examination of a work product by colleagues to identify defects, improve clarity, and assess conformance before or without execution. 0647 Perceivable # Accessibility Testing The WCAG principle that information and user-interface components must be presented in ways users can perceive. 0648 Percentile # Performance & Scalability A value below which a stated percentage of observations falls, useful for describing latency distributions. 0654 Permission Testing # Mobile & Device Testing Testing app behavior when permissions are granted, denied, limited, revoked, or changed while the app is running. 0655 Pessimistic Locking # Data & Database Testing A concurrency strategy that locks data before change to prevent conflicting operations. 0656 Phantom Read # Data & Database Testing A transaction anomaly in which repeating a query returns a changed set of rows because another transaction inserted or deleted matching data. 0657 Pipeline Stage # CI/CD & Release Quality A logical phase in a pipeline, such as build, test, security, package, deploy, or verify. 0658 Pixel Comparison # Web & Browser Testing Visual testing that compares corresponding pixels in current and baseline images using a configured tolerance. 0659 Pointer Cancellation # Accessibility Testing Accessible interaction behavior that allows users to avoid or undo accidental pointer activation where practical. 0660 Pointer Gesture Testing # Accessibility Testing Testing that functionality requiring complex or multipoint gestures also has a simple, accessible alternative when required. 0661 Policy Compliance Evaluation # Agentic & AI Testing Testing that checks whether an AI system's outputs and actions follow defined organizational, legal, safety, and usage policies. 0662 Polling # Automation & Tooling Repeatedly checking a condition at intervals until it becomes true or a timeout is reached. 0663 Portability Testing # Test Types & Levels Testing how effectively a product can be transferred, installed, adapted, or replaced across supported environments. 0664 Positive Testing # Core Testing Concepts Testing with valid inputs and expected conditions to confirm that intended behavior succeeds. 0665 Post-Deployment Testing # CI/CD & Release Quality Testing after a deployment to verify critical behavior, integrations, configuration, data, and user impact. 0666 Postcondition # Core Testing Concepts A required or expected system state after a test case or test step has completed. 0667 Pre-Commit Testing # CI/CD & Release Quality Fast local checks run before a change is committed, such as unit tests, linting, formatting, or secret detection. 0668 Precondition # Core Testing Concepts A state, dependency, permission, or data condition that must exist before a test can be executed meaningfully. 0669 Preproduction Environment # Test Data & Environments A shared environment intended to approximate production closely enough for final technical and operational validation. 0670 Preview Environment # Test Data & Environments An on-demand deployable environment that lets stakeholders review and test a specific branch or change before merge. 0671 Primary Key Testing # Data & Database Testing Testing uniqueness, non-null behavior, generation, migration, and use of database primary identifiers. 0672 Product Risk # Test Planning & Governance The possibility that a product may fail to meet quality expectations and cause harm to users, operations, finances, security, or reputation. 0673 Production Environment # Test Data & Environments The live environment that serves real users or business operations. 0674 Production Evaluation # Agentic & AI Testing Measurement of model or agent behavior using controlled evidence from real operating conditions and user workflows. 0675 Production Monitoring # Observability & Diagnostics Continuous observation of live service health, behavior, errors, performance, security, and user impact. 0676 Production Testing # Test Types & Levels Controlled testing performed in a live environment using safeguards that limit user, data, and service risk. 0677 Production Verification Testing (PVT) # CI/CD & Release Quality A small, controlled test set run in production to confirm critical behavior after deployment. 0678 Programmatically Determined # Accessibility Testing Information encoded so software and assistive technology can identify it from markup, properties, or relationships. 0679 Project Risk # Test Planning & Governance The possibility that planning, staffing, tools, environments, dependencies, or schedule problems will hinder testing or delivery. 0680 Property-Based Testing # Test Design & Coverage Testing that generates many inputs and checks general properties or invariants instead of relying only on hand-written examples. 0681 Protocol Testing # API & Service Testing Testing conformance, sequencing, framing, errors, timing, and interoperability for a communication protocol. 0682 Provider Verification # API & Service Testing Execution of consumer expectations against an API provider to confirm that the provider still satisfies its contracts. 0683 Pseudo-Oracle # Test Design & Coverage An independent implementation, model, or heuristic used to approximate expected results when a definitive oracle is unavailable. 0684 Pseudonymization # Test Data & Environments Replacing direct identifiers with controlled substitutes while retaining a separately protected means of re-identification. 0685 Push Notification Testing # Mobile & Device Testing Testing notification registration, delivery, permission, content, actions, routing, foreground and background behavior, and expiry. Q 8 terms 0686 QA Automation # Automation & Tooling Automation of testing and other quality-assurance activities to increase repeatability, speed, coverage, and feedback. 0687 Quality Assurance (QA) # Core Testing Concepts Planned, systematic activities that build confidence that processes and products will satisfy quality requirements. 0688 Quality Control (QC) # Core Testing Concepts Product-focused activities that evaluate outputs, detect defects, and determine whether defined quality criteria are met. 0689 Quality Dashboard # Metrics & Reporting A concise view of testing, defects, risk, coverage, reliability, and release signals used for decisions. 0690 Quality Engineering # Core Testing Concepts An engineering discipline that integrates prevention, testability, automation, observability, and feedback to build quality throughout delivery. 0691 Quality Gate # Test Planning & Governance A decision checkpoint that blocks or permits progression based on defined evidence, thresholds, approvals, and unresolved risks. 0692 Queue Depth # Performance & Scalability The number of requests, messages, or tasks waiting for processing at a point in time. 0693 Queue Time # Performance & Scalability Time spent waiting for a resource, worker, connection, lock, or processing slot before service begins. R 76 terms 0694 Ramp-Down # Performance & Scalability The controlled reduction of workload near the end of a performance test or scenario phase. 0695 Ramp-Up # Performance & Scalability The controlled increase of workload over time until a target rate or concurrency is reached. 0696 Random Testing # Test Design & Coverage Testing that selects inputs or action sequences using a random or statistically controlled process. 0697 Rate Limiting # API & Service Testing A control that restricts the number or cost of requests allowed for a client, identity, resource, or time window. 0698 Readiness Probe # Reliability & Resilience A check that determines whether a service instance is prepared to receive traffic. 0699 Reading Order # Accessibility Testing The meaningful sequence in which content is presented to assistive technology and keyboard users. 0700 Real Device Testing # Mobile & Device Testing Testing on physical hardware to observe actual sensors, graphics, radios, power behavior, performance, and platform differences. 0701 Real User Monitoring (RUM) # Observability & Diagnostics Collection of performance and experience measurements from actual user sessions in production. 0702 Recorded Test Trace # Automation & Tooling A replayable record of test actions, browser state, network activity, timing, logs, and captured evidence. 0703 Recovery Point Objective (RPO) # Reliability & Resilience The maximum acceptable amount of data loss expressed as time before a disruption. 0704 Recovery Testing # Test Types & Levels Testing that verifies restoration of service, data, transactions, and dependencies after failures or interruptions. 0705 Recovery Time Objective (RTO) # Reliability & Resilience The target maximum time for restoring a service or business capability after disruption. 0706 RED Method # Observability & Diagnostics A service-monitoring approach focused on request rate, errors, and duration. 0707 Redirect Chain # SEO & Web Quality A sequence in which one URL redirects to another redirect before reaching the final destination. 0708 Redirect Loop # SEO & Web Quality A cycle of redirects that prevents the client from reaching a final resource. 0709 Redirect Testing # SEO & Web Quality Testing redirect status, destination, method handling, query preservation, loops, chains, security, and canonical intent. 0710 Reduced Motion Testing # Accessibility Testing Testing that motion and animation respect user preferences and do not create avoidable vestibular or cognitive barriers. 0711 Reflow Testing # Accessibility Testing Testing that content remains readable and operable without two-dimensional scrolling at required viewport and zoom conditions. 0712 Refusal Testing # Agentic & AI Testing Evaluation of whether an AI system appropriately refuses prohibited requests without rejecting allowed, benign tasks unnecessarily. 0713 Regression Eval # Agentic & AI Testing A repeatable evaluation used to detect behavior or quality regressions after changes to a model, prompt, tool, or agent workflow. 0714 Regression Testing # Test Types & Levels Testing after change to detect unintended impact on behavior that previously worked. 0715 Regulatory Acceptance Testing # Test Types & Levels Acceptance testing that demonstrates compliance with laws, regulations, or mandatory industry rules before approval or release.0716 Release Candidate # CI/CD & Release Quality A build considered potentially ready for release pending final validation and approval. 0717 Release Criteria # Test Planning & Governance The measurable quality, risk, coverage, operational, and approval conditions required before a product can be released. 0718 Release Observability # CI/CD & Release Quality Telemetry and analysis focused on comparing behavior, errors, performance, and user impact before, during, and after a release. 0719 Release Readiness # CI/CD & Release Quality The evidence-based assessment that quality, risk, operations, compliance, support, and rollback conditions are sufficient for release. 0720 Release Testing # CI/CD & Release Quality Testing focused on whether a specific build and its complete release package are suitable for deployment. 0721 Reliability # Quality Attributes & UX The degree to which a system performs specified functions under stated conditions for the required period. 0722 Reliability Testing # Test Types & Levels Testing that evaluates consistent operation, failure behavior, fault tolerance, availability, and recovery over time. 0723 Remote Browser # Automation & Tooling A browser running on another machine or managed service and controlled through a network automation protocol. 0724 Rendered HTML # SEO & Web Quality The document content and structure available after server rendering and any client-side JavaScript execution. 0725 Reopened Defect # Defect Management A previously resolved or closed defect returned to active work because the issue remains, recurs, or was not fully addressed. 0726 Replication Lag # Data & Database Testing The delay between a change on a source database and its appearance on a replica. 0727 Reproducibility Rate # Metrics & Reporting The proportion of reported findings that can be triggered again using their documented steps and conditions. 0728 Reproduction Rate # Defect Management How often a defect occurs across repeated attempts under defined conditions. 0729 Reproduction Steps # Defect Management The ordered actions, data, and setup required to trigger an observed defect. 0730 Request Rate # Performance & Scalability The number of requests arriving at or completed by a service per unit of time. 0731 Request Validation # API & Service Testing Checking an incoming request's structure, types, required fields, ranges, permissions, and business rules before processing it. 0732 Requests per Second (RPS) # Performance & Scalability A throughput measure counting how many requests a system handles each second. 0733 Requirements Coverage # Test Design & Coverage The proportion of requirements linked to one or more tests, often refined by execution status and risk. 0734 Requirements Traceability Matrix (RTM) # Test Planning & Governance A table connecting requirements with test conditions, test cases, execution results, defects, and other verification evidence. 0735 Requirements-Based Testing # Test Design & Coverage Testing in which conditions, cases, coverage, and expected results are derived from documented requirements. 0736 Residual Risk # Test Planning & Governance Risk that remains after planned controls, tests, fixes, and mitigations have been applied. 0737 Resilience # Reliability & Resilience The ability of a system to withstand disruption, limit impact, adapt, and recover while preserving critical outcomes. 0738 Resilience Testing # Reliability & Resilience Testing under faults, dependency failures, overload, network disruption, and recovery to evaluate continued service and containment. 0739 Resolved Defect # Defect Management A defect for which a disposition or corrective action is complete and ready for verification or closure. 0740 Resource Saturation # Performance & Scalability A state in which demand approaches or exceeds a resource's effective capacity and additional work queues or fails. 0741 Resource Timing # Web & Browser Testing Browser measurements for network and loading phases of individual resources such as scripts, images, fonts, and API calls. 0742 Resource Utilization # Performance & Scalability The proportion of available compute, memory, storage, connection, or network capacity consumed. 0743 Response Time # Performance & Scalability Elapsed time from sending a request or action until the defined response is received or rendered. 0744 Response Validation # API & Service Testing Checking an API response's status, headers, schema, values, business rules, timing, and side effects. 0745 Responsive Design Testing # Web & Browser Testing Testing that layout, content, interaction, and usability adapt correctly across screen sizes, orientations, zoom levels, and input types. 0746 REST API Testing # API & Service Testing Testing resource-oriented HTTP APIs for methods, status codes, representations, state changes, errors, and compatibility. 0747 Resumption Criteria # Test Planning & Governance Conditions that must be met before testing can restart after it has been suspended. 0748 Retesting # Core Testing Concepts Another execution of a test, commonly to confirm a fix or obtain a result after an earlier blocked or invalid run. 0749 Retry # Automation & Tooling Automatic re-execution of a failed action or test, usually with limits and evidence that preserves the original failure. 0750 Retry Analysis # Automation & Tooling Investigation of whether retries are masking flaky tests, unstable environments, real product defects, or insufficient synchronization. 0751 Retry Storm # Reliability & Resilience A feedback loop in which many clients retry a failing service and make overload or recovery worse. 0752 Review Checklist # Test Design & Coverage A list of questions, risks, standards, and common defects used to guide a consistent review. 0753 Rich Result Testing # SEO & Web Quality Testing structured data eligibility and rendering for enhanced search results such as products, events, or breadcrumbs. 0754 Risk Appetite # Test Planning & Governance The amount and type of quality risk an organization is willing to accept in pursuit of its objectives. 0755 Risk Coverage # Test Design & Coverage The degree to which identified product risks are addressed by designed and executed tests. 0756 Risk Exposure # Test Planning & Governance An estimate of risk magnitude, commonly based on the likelihood of a failure and the impact if it occurs. 0757 Risk Mitigation # Test Planning & Governance An action that reduces the likelihood, impact, or detectability of a quality risk. 0758 Risk-Based Testing # Test Planning & Governance Testing that prioritizes and tailors effort according to the likelihood and impact of product risks. 0759 robots.txt Testing # SEO & Web Quality Testing crawler directives for valid syntax, intended allow and disallow rules, sitemap references, and accidental blocking. 0760 Robust # Accessibility Testing The WCAG principle that content must be interpretable by a wide range of current and future user agents, including assistive technologies. 0761 Role-Based Access Control (RBAC) Testing # Security Testing Testing that permissions assigned through roles are correct, complete, minimal, and enforced across every interface. 0762 Root Cause Analysis (RCA) # Observability & Diagnostics A structured investigation that identifies the underlying and contributing causes of an incident or failure. 0763 Root Cause Hypothesis # Agentic & AI Testing A proposed explanation for a failure that is explicitly marked as uncertain and linked to supporting and contradicting evidence. 0764 Rounding Testing # Data & Database Testing Testing numeric rounding mode, precision, presentation, aggregation, boundaries, and consistency across components. 0765 Route Testing # Web & Browser Testing Testing client or server routes, parameters, guards, redirects, not-found states, and navigation between routes. 0766 Row Count Validation # Data & Database Testing Comparing expected and actual record counts across data sources, pipeline stages, partitions, or filters. 0767 Rubric-Based Evaluation # Agentic & AI Testing Evaluation that applies explicit criteria, levels, and scoring guidance to judge outputs or behavior consistently. 0768 Rule-Based Grader # Agentic & AI Testing A deterministic evaluator that scores output using explicit checks, formulas, schemas, or business rules. 0769 Runner # Automation & Tooling Software or infrastructure that discovers tests, schedules execution, manages workers, and reports outcomes. S 107 terms 0770 Safety Evaluation # Agentic & AI Testing Testing that measures whether an AI system avoids harmful, prohibited, deceptive, or unauthorized behavior. 0771 Safety Guardrail Testing # Agentic & AI Testing Testing whether AI guardrails reliably block prohibited behavior and allow valid tasks across representative scenarios. 0772 Sample Size # Metrics & Reporting The number of observations included in a metric or evaluation, which affects uncertainty and representativeness. 0773 Sanity Testing # Test Types & Levels A focused check that a specific change or narrow area behaves plausibly before broader testing continues. 0774 Scalability Curve # Performance & Scalability A graph showing how throughput, latency, errors, or cost changes as workload or resources increase. 0775 Scalability Testing # Test Types & Levels Testing that evaluates how performance and resource use change as workload, data, users, or system capacity grows. 0776 Scenario Generation # Agentic & AI Testing Automatic creation of realistic users, goals, conditions, data, and event sequences for testing or evaluation. 0777 Scenario Testing # Test Design & Coverage Testing realistic sequences of events, roles, data, and conditions that represent how a product is used. 0778 Schema Drift # API & Service Testing Unplanned divergence between the data or API schema expected by consumers and the schema actually produced. 0779 Schema Evolution # Data & Database Testing Managed change to a data schema while preserving compatibility, migration safety, and consumer expectations. 0780 Schema Markup Validation # SEO & Web Quality Checking structured data markup for valid syntax, required properties, supported types, and consistency with visible content. 0781 Schema Migration Testing # Data & Database Testing Testing database structure changes, data conversion, constraints, indexes, rollback, compatibility, and deployment safety. 0782 Schema Validation # API & Service Testing Checking a request, response, event, or document against its formal structural and type definition. 0783 Screen Magnifier Testing # Accessibility Testing Testing at high zoom and with magnification tools for reflow, focus visibility, overlap, and discoverability. 0784 Screen Reader Testing # Accessibility Testing Testing content and interactions with assistive software that converts accessibility semantics into speech or braille. 0785 Screenplay Pattern # Automation & Tooling An automation pattern that models actors, tasks, questions, and abilities to express tests around user goals. 0786 Scripted Testing # Test Types & Levels Testing guided by prewritten cases or procedures with defined steps, data, and expected results. 0787 Search Engine Crawler # SEO & Web Quality Automated software that discovers and retrieves web pages and resources for search-engine processing. 0788 Search-Based Software Testing (SBST) # Test Design & Coverage Testing that applies optimization algorithms to generate or select tests that maximize goals such as coverage or fault detection. 0789 Secure Code Review # Security Testing Manual or tool-assisted examination of code for security weaknesses, dangerous assumptions, and missing controls. 0791 Security Regression Testing # Security Testing Repeatable testing that detects the return of known security defects or weakening of previously verified controls. 0792 Security Requirement # Security Testing A testable statement of protection, trust, identity, privacy, resilience, or compliance that a system must satisfy. 0793 Security Test Case # Security Testing A defined procedure that evaluates a security requirement, control, or expected protective behavior. 0794 Selector # Automation & Tooling A query used to target elements in a UI document, such as a CSS selector, XPath expression, role, label, or test identifier. 0795 Self-Healing Test Automation # Automation & Tooling Automation that adapts selected locators, waits, data, or flows after application changes while preserving intent and auditability. 0796 Semantic HTML # SEO & Web Quality HTML that uses elements according to their meaning, improving structure, accessibility, maintainability, and search understanding. 0797 Semantic Locator # Automation & Tooling A locator based on user-facing meaning, such as accessible role, label, name, text, or relationship. 0798 Semantic Test Coverage # Agentic & AI Testing Coverage measured against meanings such as user intents, business rules, behaviors, and risks rather than only code structure. 0799 Server Error Response # API & Service Testing An HTTP 5xx response indicating that the server failed to fulfill an otherwise valid request. 0801 Server-Side Security Testing # Security Testing Testing authentication, authorization, validation, data access, business logic, dependencies, and infrastructure behind the client interface. 0802 Server-Side Validation # Web & Browser Testing Authoritative validation performed by a server regardless of what checks the client interface performs. 0803 Service Level Agreement (SLA) # Reliability & Resilience A formal commitment between parties defining service expectations and consequences, often including availability or performance targets. 0804 Service Level Indicator (SLI) # Reliability & Resilience A measured signal representing a user-relevant aspect of service behavior, such as successful-request proportion or latency. 0805 Service Level Objective (SLO) # Reliability & Resilience A target value or range for an SLI over a defined measurement window. 0806 Service Map # Observability & Diagnostics A visual or queryable representation of services and dependencies derived from configuration or telemetry. 0807 Service Time # Performance & Scalability The time a system actively spends processing an operation, excluding time waiting in queues. 0808 Session Management Testing # Security Testing Testing session creation, identifiers, rotation, storage, scope, expiry, logout, revocation, concurrency, and fixation resistance. 0809 Session Replay # Observability & Diagnostics A reconstruction of a user's interface interactions from captured events, used to diagnose experience and functional issues. 0810 Session Timeout Testing # Security Testing Testing idle and absolute session expiry, warnings, state preservation, reauthentication, and token invalidation. 0811 Session-Based Test Management (SBTM) # Test Design & Coverage A structured exploratory approach that organizes testing into time-boxed sessions with charters, notes, coverage, and debriefs. 0812 Severity Distribution # Metrics & Reporting The count or proportion of confirmed defects grouped by severity level. 0813 Shadow Evaluation # Agentic & AI Testing Running a candidate model or agent on real inputs without allowing its outputs to affect users or production decisions. 0814 Shadow Testing # CI/CD & Release Quality Running a candidate implementation or test system alongside the current one and comparing results without affecting the live outcome. 0815 Sharding # Automation & Tooling Dividing a test suite into independent partitions that can execute concurrently on separate workers. 0816 Shift-Left Testing # Test Planning & Governance Moving testing, reviews, risk analysis, and feedback earlier in the development lifecycle. 0817 Shift-Right Testing # Test Planning & Governance Using production-like or live-system evidence, monitoring, experiments, and controlled tests to evaluate quality after deployment. 0818 Simulation Environment # Agentic & AI Testing A controlled representation of a real application or system used to test agent behavior without production risk. 0819 Simulator # Automation & Tooling A system that imitates selected behavior of a device, dependency, network, or environment without reproducing its complete implementation. 0820 Single Point of Failure (SPOF) # Reliability & Resilience A component or dependency whose failure can remove an entire required service because no effective alternative exists. 0821 Sitemap Validation # SEO & Web Quality Testing an XML sitemap for accessible, canonical, indexable URLs, valid format, freshness, and correct segmentation. 0822 Skip Link # Accessibility Testing A keyboard-accessible link that lets users bypass repeated navigation and move directly to main content or another region. 0823 Skipped Test # Defect Management A test intentionally not executed because of a condition, configuration, selection rule, or temporary exclusion. 0824 Smart Test Selection # Automation & Tooling Automated choice of the tests most relevant to a change, risk, failure history, or limited execution budget. 0825 Smoke Testing # Test Types & Levels A broad, shallow check of critical functions used to determine whether a build is stable enough for further testing. 0826 Snapshot Testing # Test Design & Coverage Testing that serializes an output representation and compares it with a stored snapshot to detect unexpected change. 0827 Soak Testing # Test Types & Levels Long-running performance or reliability testing used to uncover leaks, degradation, resource exhaustion, and time-dependent failures. 0828 SOAP API Testing # API & Service Testing Testing SOAP operations, XML envelopes, WSDL contracts, schemas, faults, headers, and security behavior. 0829 Soft 404 # SEO & Web Quality A page that appears missing or empty but returns a successful status instead of an appropriate not-found response. 0830 Software Composition Analysis (SCA) # Security Testing Automated analysis of third-party and open-source components for known security defects, licenses, provenance, and version risk. 0831 Software Quality # Core Testing Concepts The degree to which software satisfies stated and implied needs, delivers value, and avoids unacceptable harm or failure. 0832 Software Quality Assurance (SQA) # Core Testing Concepts Systematic activities that provide confidence software processes and products will meet defined quality requirements. 0833 Software Testing # Core Testing Concepts The lifecycle process of evaluating software and related work products to reveal defects, measure quality, and reduce decision risk. 0834 Source Code Security Analysis # Security Testing Automated or manual examination of source code for security defects, unsafe data flow, unsafe APIs, and missing controls. 0835 Source Map # Web & Browser Testing A mapping from transformed or minified browser code back to original source, enabling readable stack traces and debugging. 0836 Source Revision # Defect Management The exact commit, tag, branch state, or source identifier used to create the tested build. 0837 Source-to-Target Testing # Data & Database Testing Testing that source data is mapped, transformed, loaded, and represented correctly in its target system. 0838 Span # Observability & Diagnostics A timed record of one operation within a distributed trace, including context, attributes, events, and status. 0839 Span ID # Observability & Diagnostics An identifier for one span within a trace. 0840 Specification by Example (SBE) # Test Design & Coverage A collaborative practice that uses concrete examples to clarify requirements and create shared, testable specifications. 0841 Specification-Based Testing # Test Design & Coverage Testing that derives cases from requirements, rules, models, interfaces, or other descriptions of expected behavior. 0842 Spike Testing # Test Types & Levels Performance testing that applies sudden, extreme workload changes to evaluate elasticity, stability, and recovery.0843 Split-Brain # Reliability & Resilience A distributed-system failure in which separated nodes both act as the authoritative leader, risking conflicting operations or data. 0844 Spy # Automation & Tooling A test double that records calls and interactions while optionally delegating to real behavior. 0845 Stack Trace # Observability & Diagnostics A record of active calls leading to a particular point, exception, or crash in a program. 0846 Staging Environment # Test Data & Environments A shared environment used to validate integrated software before production release. 0847 Startup Probe # Reliability & Resilience A check that gives a slow-starting application time to initialize before liveness or readiness rules apply. 0848 State Pollution # Test Data & Environments Unintended residual data or configuration from one test that changes the behavior of another test. 0849 State Transition Testing # Test Design & Coverage A black-box technique that derives tests from system states, triggering events, valid transitions, and invalid transitions. 0850 State-Space Exploration # Agentic & AI Testing Systematic or heuristic traversal of reachable application states and transitions to discover untested behavior. 0851 Statement Coverage # Test Design & Coverage The percentage of executable statements run at least once by a test suite. 0852 Static Analysis # Test Design & Coverage Tool-assisted examination of code or other artifacts without executing the software to find defects and maintainability issues. 0853 Static Application Security Testing (SAST) # Security Testing Analysis of source code, bytecode, or binaries for security weaknesses without executing the application. 0854 Static Testing # Core Testing Concepts Evaluation of work products without running the software, including reviews, inspections, static analysis , and model checking. 0855 Status Message # Accessibility Testing Dynamic information about success, errors, progress, or results that can be announced to assistive technology without moving focus. 0856 Steady State # Performance & Scalability A period in which workload and system behavior are sufficiently stable for meaningful comparison and measurement. 0857 Steady-State Hypothesis # Reliability & Resilience A measurable expectation of normal system behavior that a chaos experiment attempts to preserve despite introduced faults. 0858 Step-Level Evaluation # Agentic & AI Testing Scoring individual decisions, actions, tool calls, or intermediate states within an agent trajectory . 0859 Stress Testing # Test Types & Levels Performance testing beyond expected capacity to identify breaking points, failure modes, and recovery behavior.0860 Structure-Based Testing # Test Design & Coverage Testing derived from internal structure such as control flow, data flow, code, architecture, or call relationships. 0861 Structured Data Testing # SEO & Web Quality Testing machine-readable page annotations for validity, eligibility, accuracy, and agreement with visible content. 0862 Structured Logging # Observability & Diagnostics Logging that records events in consistent fields and types so machines can reliably search, correlate, and analyze them. 0863 Stub # Automation & Tooling A test double that returns predefined responses to calls made by the code under test. 0864 Success Criterion # Agentic & AI Testing A measurable condition that defines when an agent task or evaluation item has been completed successfully. 0865 Suspension Criteria # Test Planning & Governance Conditions serious enough to pause a test activity, such as an unusable build, invalid environment, or unacceptable safety risk. 0866 Switch Control Testing # Accessibility Testing Testing an interface with assistive switch input that navigates and activates controls sequentially or through scanning. 0867 Symbolic Execution # Test Design & Coverage Program analysis that represents inputs as symbols and solves path constraints to identify reachable behaviors and generate tests. 0868 Symbolication # Observability & Diagnostics Converting machine addresses or minified stack frames into readable function names and source locations. 0869 Symptom # Defect Management The observable failure, error, or abnormal behavior that indicates a possible underlying defect. 0870 Syntax Testing # Test Design & Coverage Testing that generates valid and invalid inputs from a formal grammar or syntax definition. 0871 Synthetic Monitoring # Observability & Diagnostics Scheduled automated checks that simulate users or requests from controlled locations to detect availability, correctness, or performance problems. 0872 Synthetic Test Data # Test Data & Environments Artificially generated data designed to represent required patterns and edge cases without copying real sensitive records. 0873 Synthetic User # Agentic & AI Testing A simulated persona or agent that behaves according to defined goals, context, abilities, and constraints during testing. 0874 System Integration Testing (SIT) # Test Types & Levels Testing interfaces and interactions between complete systems, external services, platforms, or organizational domains. 0875 System Testing # Test Types & Levels Testing an integrated system as a whole against specified functional and non-functional requirements. 0876 System Testing Agent # Agentic & AI Testing An AI agent configured to evaluate an integrated system across workflows, interfaces, states, and quality attributes. T 140 terms 0877 Tail Latency # Performance & Scalability Latency experienced by the slowest portion of operations, commonly examined with high percentiles such as p95 or p99. 0878 Target Size # Accessibility Testing The visible or interactive area available for activating a control, which should be large and sufficiently separated for reliable use. 0879 Task Replay # Agentic & AI Testing Re-execution of a recorded task, state, and interaction sequence to reproduce or compare agent behavior. 0880 Task Success # Quality Attributes & UX A usability measure indicating whether users can complete a defined goal accurately and completely. 0881 Task Success Rate # Agentic & AI Testing The percentage of evaluation tasks completed according to their defined success criteria. 0882 Technical Review # Test Design & Coverage A peer review by qualified specialists that assesses technical correctness, feasibility, consistency, and compliance with standards. 0883 Technical SEO Testing # SEO & Web Quality Testing technical conditions that affect crawling, rendering, indexing, canonicalization, structured data, performance, and mobile usability. 0884 Telemetry # Observability & Diagnostics Data emitted by systems to describe behavior and state, including traces, metrics, logs, events, and profiles. 0885 Test Account # Test Data & Environments A controlled identity created for testing roles, permissions, data access, and user journeys. 0886 Test Adaptation # Agentic & AI Testing Automatic modification of a test plan, path, data, or check in response to observed application state or change. 0887 Test Approach # Test Planning & Governance The tailored implementation of a test strategy for a specific product, project, release, risk profile, and context. 0888 Test Artifact # Metrics & Reporting A file or record produced or consumed by testing, such as a script, report, log, screenshot, trace, dataset, or coverage file. 0889 Test Audit # Test Planning & Governance An independent examination of testing processes, evidence, and controls to assess compliance, completeness, and effectiveness. 0890 Test Automation # Automation & Tooling Use of software to prepare, execute, evaluate, and report tests or supporting activities. 0891 Test Automation Architecture # Automation & Tooling The structural design of automation components, interfaces, layers, data, services, runners, and reporting. 0892 Test Automation Coverage # Automation & Tooling The proportion of selected testing scope executed or supported by automation, interpreted alongside risk and effectiveness. 0893 Test Automation Framework # Automation & Tooling A reusable implementation of automation architecture that provides conventions, libraries, fixtures, execution, and reporting. 0894 Test Automation Pyramid # Automation & Tooling A heuristic favoring many fast, isolated low-level tests, fewer service tests, and a smaller number of broad UI tests. 0895 Test Automation Strategy # Automation & Tooling A plan for where, why, and how automation will provide sustainable value across risks, levels, environments, and delivery workflows. 0896 Test Basis # Core Testing Concepts The requirements, risks, models, standards, contracts, code, or other information used to design and evaluate tests. 0897 Test Bed # Test Data & Environments An integrated set of hardware, software, tools, services, data, and instrumentation used for testing. 0898 Test Budget # Test Planning & Governance The approved time, cost, tooling, infrastructure, and staffing allocation for testing activities. 0899 Test Cache # CI/CD & Release Quality Stored results or built dependencies reused to avoid rerunning work that is proven unaffected by a change. 0900 Test Case # Core Testing Concepts A defined set of preconditions, inputs, actions, and expected results created to evaluate a test condition. 0901 Test Case Design # Test Design & Coverage The activity of converting test conditions, risks, and coverage goals into executable test cases. 0902 Test Case Generation # Test Design & Coverage The manual or automated creation of test cases from requirements, models, code, data, examples, or observed behavior. 0903 Test Case Prioritization # Test Design & Coverage Ordering test cases so the most valuable, risky, failure-prone, or change-relevant tests run earlier. 0904 Test Case Selection # Test Design & Coverage Choosing a subset of available tests for a particular build, risk, platform, change, or time budget. 0905 Test Charter # Test Design & Coverage A concise mission for an exploratory session that identifies its target, purpose, risks, constraints, and useful starting ideas. 0906 Test Completion # Core Testing Concepts The point at which agreed exit criteria are evaluated, remaining risks are reported, and testing is formally concluded. 0907 Test Completion Report # Test Planning & Governance A final summary of executed scope, results, coverage, defects, deviations, residual risk, and recommendations. 0908 Test Compliance # Test Planning & Governance The degree to which testing activities and evidence satisfy applicable process, policy, contractual, regulatory, or standard requirements. 0909 Test Condition # Core Testing Concepts A feature, rule, transaction, quality attribute, risk, or other aspect of a test basis that can be evaluated by tests. 0910 Test Condition Design # Test Design & Coverage The activity of identifying what must be tested from requirements, risks, models, interfaces, and other test-basis information. 0911 Test Control # Test Planning & Governance Corrective decisions and actions taken when monitoring shows that testing is deviating from plan, goals, or acceptable risk. 0912 Test Coverage # Test Design & Coverage The degree to which a test suite exercises a defined set of requirements, risks, structures, data, platforms, or behaviors. 0913 Test Cycle # Test Planning & Governance A planned iteration of preparation, execution, defect handling, and reporting for a build, release, or objective. 0914 Test Data # Core Testing Concepts Values, files, accounts, records, messages, and system states used as inputs or context during testing. 0915 Test Data Design # Test Design & Coverage The activity of selecting or generating data that exercises required partitions, boundaries, rules, states, risks, and privacy constraints. 0916 Test Data Management (TDM) # Test Data & Environments The policies, processes, and tools used to create, protect, provision, refresh, find, and retire test data . 0917 Test Data Provisioning # Test Data & Environments Supplying the required test data to an environment in a timely, repeatable, authorized, and protected way. 0918 Test Deliverable # Test Planning & Governance Any planned output of testing, such as a strategy, case set, script, dataset, report, log, defect, or sign-off record. 0919 Test Design Technique # Test Design & Coverage A systematic method for deriving test conditions, test cases, or test data from a defined source. 0920 Test Double # Automation & Tooling A substitute for a real dependency used to control or observe interactions during testing. 0921 Test Duration # Metrics & Reporting Elapsed time required for a test, suite, stage, or complete test run. 0922 Test Effectiveness # Metrics & Reporting The degree to which testing detects important defects and provides useful risk information for its cost and time. 0923 Test Effort Estimate # Test Planning & Governance A forecast of the people, time, infrastructure, and cost required to meet defined testing objectives. 0924 Test Engineering # Core Testing Concepts The design and implementation of testability, automation, environments, data, tooling, and measurement as engineering systems. 0925 Test Environment # Test Data & Environments The hardware, software, services, network, data, configuration, and tools in which tests are performed. 0926 Test Environment Management # Test Data & Environments Planning, provisioning, configuring, monitoring, scheduling, refreshing, and retiring environments used for testing. 0927 Test Evidence # Core Testing Concepts Artifacts that support a test conclusion, including results, logs, screenshots, traces, data, environment details, and reproduction steps . 0928 Test Execution # Core Testing Concepts The activity of running tests, recording observations, comparing outcomes, and capturing evidence. 0929 Test Execution Progress # Metrics & Reporting The proportion and status of planned tests that are completed, running, blocked, skipped, passed, or failed. 0930 Test Fixture # Automation & Tooling The reusable setup, data, objects, or environment state required by one or more automated tests. 0931 Test Generation with AI # Agentic & AI Testing Use of AI to derive test ideas, scenarios, data, steps, assertions, or executable scripts from available context. 0932 Test Governance # Test Planning & Governance The decision rights, policies, accountability, oversight, and controls used to direct testing across an organization. 0933 Test Harness # Automation & Tooling The tools, drivers, stubs, data, configuration, and infrastructure used to execute and observe tests. 0934 Test Hook # Automation & Tooling A lifecycle extension point where custom setup, cleanup, logging, screenshots, retries, or reporting can run. 0935 Test Impact Analysis # Automation & Tooling Analysis that maps a change to affected components, requirements, risks, and tests to focus regression effort. 0936 Test Independence # Test Planning & Governance The degree of separation between testing and the people, assumptions, tools, or organizational pressures involved in development. 0937 Test Isolation # Automation & Tooling The property that a test does not depend on or unintentionally alter the outcome of other tests. 0938 Test Item # Core Testing Concepts A specific part of a test object selected for testing, such as a component, document, model, or build. 0939 Test Lab # Test Data & Environments A controlled physical or virtual collection of devices, systems, networks, and tools maintained for testing. 0940 Test Level # Test Planning & Governance A group of testing activities managed together and associated with a development level, such as component, integration, system, or acceptance testing . 0941 Test Management # Test Planning & Governance Planning, estimating, monitoring, controlling, and reporting testing while coordinating people, risks, environments, data, tools, and defects. 0942 Test Maturity # Test Planning & Governance The capability and consistency of an organization's testing practices, governance, automation, measurement, and continuous improvement. 0943 Test Milestone # Test Planning & Governance A significant planned checkpoint in testing, such as environment readiness, execution start, exit review, or release recommendation. 0944 Test Minimization # Test Design & Coverage Reducing a test set while preserving selected coverage, risk, or fault-detection goals. 0945 Test Monitoring # Test Planning & Governance Ongoing collection and comparison of testing progress, results, coverage, resources, and risks against the plan. 0946 Test Object # Core Testing Concepts The work product being tested, which may be software, hardware, data, documentation, a model, configuration, or an integrated system. 0947 Test Objective # Test Planning & Governance A specific purpose for testing, such as detecting failures, measuring a quality attribute, demonstrating compliance, or reducing a product risk. 0948 Test Oracle # Core Testing Concepts A source or mechanism used to determine the expected result and decide whether observed behavior is acceptable. 0949 Test Oracle Problem # Test Design & Coverage The difficulty or cost of knowing the correct expected result for every input and system state. 0950 Test Outcome # Core Testing Concepts The classified conclusion from a test, such as passed, failed, blocked, skipped, or inconclusive. 0951 Test Phase # Test Planning & Governance A time-bounded stage of testing organized around a particular purpose, build, environment, or release milestone. 0952 Test Plan # Test Planning & Governance A document or maintained artifact describing test scope, objectives, approach, resources, schedule, environments, risks, and completion criteria. 0953 Test Policy # Test Planning & Governance A high-level organizational statement of testing principles, objectives, responsibilities, and expectations. 0954 Test Prioritization # Test Planning & Governance Allocating and ordering testing based on risk, value, change, dependencies, failure history, and available time. 0955 Test Procedure # Core Testing Concepts A sequence of actions for setting up, executing, evaluating, and cleaning up one or more tests. 0956 Test Process Improvement # Test Planning & Governance Systematic measurement and change intended to make testing more effective, efficient, predictable, and aligned with product risk. 0957 Test Progress # Test Planning & Governance The current state of planned testing expressed through execution, coverage, defects, blockers, effort, and remaining work. 0958 Test Quarantine # Automation & Tooling Temporary separation of an unreliable test from release decisions while its underlying cause is investigated and corrected. 0959 Test Report # Metrics & Reporting A structured summary of test scope, environment, execution, outcomes, coverage, defects, evidence, risks, and conclusions. 0960 Test Report Publishing # CI/CD & Release Quality Automated collection and presentation of test results and evidence from a pipeline or test platform. 0961 Test Repository # Test Planning & Governance A managed store for test cases, suites, data, results, evidence, configurations, and traceability information. 0962 Test Resource # Test Planning & Governance A person, tool, environment, service, device, dataset, or budget required to perform testing. 0963 Test Result # Core Testing Concepts Recorded information from a test execution, including outcome, observations, timing, evidence, and relevant environment details. 0964 Test Return on Investment (ROI) # Metrics & Reporting A comparison of testing benefits, such as avoided loss and faster feedback, with the cost of creating and operating the testing capability. 0965 Test Risk # Test Planning & Governance Uncertainty that could prevent testing from providing sufficient, timely, or trustworthy evidence. 0966 Test Run # Core Testing Concepts One execution of a selected test set against a defined build, environment, configuration, and dataset. 0967 Test Runner # Automation & Tooling Software that discovers, schedules, executes, and reports automated tests. 0968 Test Scenario # Core Testing Concepts A high-level description of a user goal, business flow, interaction, or condition to be evaluated. 0969 Test Schedule # Test Planning & Governance The planned sequence and timing of testing activities, dependencies, milestones, environments, and deliverables. 0970 Test Scope # Test Planning & Governance The boundaries of testing, defining included and excluded features, risks, quality attributes, platforms, interfaces, and data. 0971 Test Script # Core Testing Concepts Executable instructions, usually automated, that set up conditions, perform actions, make checks, and record results. 0972 Test Script Maintenance # Automation & Tooling Work required to keep automated tests aligned with product behavior, interfaces, data, dependencies, and environments. 0973 Test Selection # Test Planning & Governance Choosing the tests that best address a specific objective, change, risk, platform, or execution budget. 0974 Test Setup # Automation & Tooling Actions that establish the required data, configuration, services, sessions, and state before a test. 0975 Test Stability # Metrics & Reporting The consistency of test outcomes and execution behavior across equivalent runs. 0976 Test Status Report # Test Planning & Governance A periodic view of progress, results, coverage, defects, blockers, risks, forecast, and decisions needed. 0977 Test Step # Core Testing Concepts One action or check within a test procedure, with any required input and expected result. 0978 Test Strategy # Test Planning & Governance A durable, high-level approach explaining how testing will support quality objectives and manage product risk. 0979 Test Suite # Core Testing Concepts An organized collection of test cases or scripts grouped for a purpose, feature, level, risk, or execution schedule. 0980 Test Suite Optimization # Automation & Tooling Improving a test suite's speed, coverage, stability, diagnostic value, and maintenance cost by removing or reshaping low-value tests. 0981 Test Teardown # Automation & Tooling Actions that clean up data, sessions, resources, and state after a test. 0982 Test Tenant # Test Data & Environments A dedicated logical customer or organizational space used to test multi-tenant behavior without affecting real tenants. 0983 Test Type # Test Planning & Governance A group of testing activities aimed at a particular quality characteristic or objective, such as security or usability. 0984 Test-Driven Development (TDD) # Test Design & Coverage A development practice that cycles through writing a failing test, implementing the minimum code to pass, and refactoring safely. 0985 Testability # Core Testing Concepts The ease with which effective test conditions can be established, tests executed, and results observed and interpreted. 0986 Testing Agent # Agentic & AI Testing An autonomous or semi-autonomous software actor that performs defined testing activities using observations, tools, and feedback. 0987 Testing vs. Debugging # Core Testing Concepts Testing reveals failures and provides quality evidence, while debugging locates and corrects the faults responsible for those failures. 0988 Testware # Core Testing Concepts Artifacts created or used for testing, including plans, cases, scripts, data, environments, models, tools, results, and reports. 0989 Text Resize Testing # Accessibility Testing Testing that text can be enlarged without loss of content, controls, readability, or functionality. 0990 Text Spacing Testing # Accessibility Testing Testing that user-adjusted line, paragraph, letter, and word spacing does not cause loss of content or functionality. 0991 Think Time # Performance & Scalability A pause representing how long a simulated user waits between actions in a workload model. 0992 Thread Pool # Performance & Scalability A managed set of worker threads used to process tasks, which can become exhausted under load. 0993 Throughput # Performance & Scalability The amount of successful work completed per unit of time. 0994 Time Series # Observability & Diagnostics A sequence of measurements indexed by time, often grouped by a consistent set of attributes. 0995 Time to First Byte (TTFB) # SEO & Web Quality A web performance metric measuring the time from navigation or request start until the first response byte arrives. 0996 Time Travel Testing # Test Data & Environments Testing time-dependent behavior by controlling the system clock or advancing virtual time deterministically. 0997 Time Zone Testing # Test Data & Environments Testing storage, conversion, display, scheduling, expiry, and comparison across geographic time zones and offsets. 0998 Timeout # Automation & Tooling A maximum waiting or execution period after which an action, assertion, test, or run is treated as unsuccessful or interrupted. 0999 Timing Adjustable # Accessibility Testing An accessibility requirement that users can turn off, extend, or adjust certain time limits unless a documented exception applies. 1000 Title Tag # SEO & Web Quality The HTML title that identifies a page in browser tabs and commonly appears as the main search-result title. 1001 TLS Testing # Security Testing Testing protocol versions, cipher suites, certificates, hostname validation, downgrade resistance, and secure transport configuration. 1002 Tokenization # Test Data & Environments Replacing sensitive data with a non-sensitive token whose original value is held separately in a protected system. 1003 Touch Target Testing # Mobile & Device Testing Testing whether interactive controls are large enough, separated, visible, and operable with touch and alternative input. 1004 Tour-Based Testing # Test Design & Coverage Exploratory testing guided by a themed route through the product, such as features, data, configuration, or error handling.1005 Toxicity Testing # Agentic & AI Testing Evaluation of whether an AI system generates abusive, hateful, harassing, or otherwise harmful content under relevant conditions. 1006 Trace # Observability & Diagnostics A representation of an end-to-end operation composed of related spans across components or services. 1007 Trace Context # Observability & Diagnostics Identifiers and metadata that let spans from different components be connected into one distributed trace. 1008 Trace ID # Observability & Diagnostics An identifier shared by all spans belonging to one distributed trace. 1009 Trace Recording # Automation & Tooling Automated capture of actions, timing, application state, network activity, console output, and other diagnostic events during a test. 1010 Trace Sampling # Observability & Diagnostics Selecting which traces to record or retain in order to control volume while preserving diagnostic value. 1011 Traceability # Test Planning & Governance The ability to follow relationships among requirements, risks, code, tests, results, defects, and releases. 1012 Trajectory Evaluation # Agentic & AI Testing Assessment of both the final result and the sequence of actions an agent took to reach it. 1013 Transactions per Second (TPS) # Performance & Scalability A throughput measure counting completed business or technical transactions each second. 1014 Transcript Testing # Accessibility Testing Testing that an accurate, complete, and usable text alternative is available for relevant audio or audiovisual content. 1016 Trivial Defect # Defect Management A cosmetic or very low-impact defect that does not meaningfully impede use or operation. U 20 terms 1017 UI Test Automation # Automation & Tooling Automated interaction with user-interface controls and states to verify visible behavior and user workflows. 1018 Understandable # Accessibility Testing The WCAG principle that information and interface operation must be clear, predictable, and comprehensible. 1019 Unhappy Path # Core Testing Concepts A flow involving invalid input, missing prerequisites, rejected actions, failures, or recovery instead of straightforward success. 1020 Unicode Testing # Data & Database Testing Testing storage, input, display, search, comparison, normalization, and transfer of characters from relevant writing systems and symbols. 1021 Unique Defect Rate # Metrics & Reporting The proportion of reported findings that remain distinct confirmed defects after validation and deduplication. 1022 Unit Testing # Test Types & Levels Component-level testing of a small unit of code, usually in isolation and commonly performed by developers. 1023 Universal Link # Mobile & Device Testing A verified HTTPS link that opens a specific screen in an iOS app when the app is installed. 1024 Unscripted Testing # Test Types & Levels Testing that is not constrained by detailed prewritten steps and adapts as the tester learns. 1025 Upgrade Testing # Test Types & Levels Testing that verifies behavior, data, compatibility, rollback, and user impact when moving to a newer product version. 1026 Uptime # Reliability & Resilience The period or proportion of time during which a service provides an acceptable result. 1027 URL Normalization # SEO & Web Quality Consistent transformation of equivalent URL forms so routing, caching, analytics, canonicalization, and indexing behave predictably. 1028 Usability # Quality Attributes & UX The degree to which intended users can achieve goals effectively, efficiently, safely, and satisfactorily in a specified context. 1029 Usability Testing # Test Types & Levels Evaluation with representative users or expert methods to identify obstacles in learning, navigation, comprehension, efficiency, and satisfaction. 1030 Use Case Testing # Test Design & Coverage A black-box technique that derives end-to-end tests from interactions between actors and a system to achieve goals. 1031 USE Method # Observability & Diagnostics A resource-monitoring approach focused on utilization, saturation, and errors. 1032 User Acceptance Testing (UAT) # Test Types & Levels Acceptance testing performed by intended users or business representatives to confirm that the system supports real operational needs.1033 User Error Protection # Quality Attributes & UX The degree to which a product prevents likely mistakes or limits their negative consequences. 1034 User Experience (UX) # Quality Attributes & UX A person's perceptions, emotions, and responses before, during, and after using a product or service. 1035 User Impact # Defect Management The number and types of users affected by a defect and the degree to which their goals, safety, trust, or access are harmed. 1036 User Journey # Quality Attributes & UX The sequence of interactions and touchpoints through which a user pursues a goal across a product or service. V 12 terms 1037 Validation # Core Testing Concepts Evaluation of whether the completed or evolving product fulfills intended use and stakeholder needs in its real context. 1038 Verification # Core Testing Concepts Evaluation of whether a work product conforms to specified requirements, design, rules, or other defined criteria. 1039 Verifier Agent # Agentic & AI Testing A specialized agent that independently checks whether evidence, outcomes, and reported findings satisfy defined criteria. 1040 Video Recording # Automation & Tooling Capture of the visible test session as video to support diagnosis, review, and defect evidence. 1041 Virtual Private Accessibility Template (VPAT) # Accessibility Testing A standardized template vendors use to document how a product supports accessibility criteria. 1042 Virtual User # Performance & Scalability A software-simulated user that follows a defined behavior and timing model during performance testing . 1043 Visible Focus # Accessibility Testing A clear visual indication of which interactive element currently has keyboard focus. 1044 Visual Baseline # Web & Browser Testing An approved reference image or rendered state used to evaluate later visual changes. 1045 Visual Regression Testing # Web & Browser Testing Testing that compares current rendered interfaces with approved baselines to detect unintended visual changes. 1046 Visual Testing # Web & Browser Testing Testing rendered appearance for unintended changes, clipping, overlap, styling, content, and responsive layout defects. 1047 Voice Control Testing # Accessibility Testing Testing whether controls have discoverable spoken names and can be operated accurately through speech input. 1048 Volume Testing # Test Types & Levels Testing system behavior with large amounts of data, records, files, messages, or storage consumption. W 24 terms 1049 Wait Strategy # Automation & Tooling A consistent approach for synchronizing automation with application state while avoiding brittle fixed delays. 1050 Walkthrough # Test Design & Coverage A review led by the author, who guides participants through a work product to build understanding and find issues. 1051 Warm Start # Performance & Scalability Startup when some process, container, code, cache, or connection state is already initialized and reusable. 1052 WCAG 2.2 # Accessibility Testing The W3C recommendation defining testable success criteria for making web content more accessible to people with disabilities. 1056 WCAG Success Criterion # Accessibility Testing A testable, technology-neutral requirement used to assess conformance to a version and level of WCAG. 1057 Web Application Testing # Web & Browser Testing Testing a browser-based application across functionality, interfaces, security, accessibility, performance, compatibility, and usability. 1059 Web Manifest Testing # Web & Browser Testing Testing a web app manifest for valid metadata, icons, display mode, start URL, scope, and install behavior. 1060 WebDriver # Automation & Tooling A standards-based remote-control interface for automating and inspecting web browsers. 1061 WebDriver BiDi # Automation & Tooling A bidirectional browser automation protocol that supports event-driven communication between automation clients and browsers. 1062 Webhook Testing # API & Service Testing Testing outbound event callbacks for signatures, retries, ordering, duplication, payload contracts, errors, and idempotent handling. 1063 Website Bug Detection # Web & Browser Testing Discovery of functional, visual, accessibility, performance, security, content, or integration defects on a website. 1064 Website Monitoring # Observability & Diagnostics Repeated automated checking of website availability, transactions, content, performance, certificates, and errors over time. 1065 Website Quality Assurance # Web & Browser Testing The practices used to prevent, detect, and manage website defects across design, development, release, and operation. 1066 Website Regression Testing # Web & Browser Testing Testing a website after changes to detect unintended impact on existing pages, flows, integrations, or presentation. 1067 Website Testing # Web & Browser Testing Systematic evaluation of a website's functionality, usability, compatibility, accessibility, performance, security, SEO, and reliability. 1068 WebSocket Testing # API & Service Testing Testing connection setup, authentication, messages, ordering, reconnection, errors, timeouts, limits, and concurrent clients. 1069 White-Box Testing # Test Design & Coverage Testing based on knowledge of internal code, logic, data flow, architecture, or implementation structure. 1070 Whole-Team Approach # Test Planning & Governance An agile quality practice in which everyone contributes to prevention, testing, feedback, and shared responsibility for product quality. 1071 Won't Fix # Defect Management A defect disposition indicating that the team has decided not to implement a correction, usually with documented rationale and risk ownership. 1072 Workload Model # Performance & Scalability A quantitative description of users, operations, data, arrival patterns, concurrency, timing, and traffic mix used in performance testing . X 2 terms 1073 XML Sitemap # SEO & Web Quality A machine-readable list of site URLs and optional metadata intended to help search engines discover canonical content. 1074 XPath # Automation & Tooling A query language used by browser automation to locate nodes through paths, attributes, text, and relationships in XML or HTML documents. Z 1 term 1075 Zoom Testing # Accessibility Testing Testing content and controls at increased browser or platform zoom for reflow, clipping, overlap, and operability. What this glossary covers This is a curated reference of 1,075 English testing terms spanning 21 categories: test planning, design and coverage techniques, test types and levels, automation and tooling, API, web, mobile, data, security, accessibility, performance, reliability, observability, defect management, metrics, and 111 terms specific to agentic and AI testing. Definitions are original editorial syntheses informed by ISTQB, ISO/IEC 25010, W3C, OWASP, NIST, OpenTelemetry, and other primary sources listed at the bottom of this page — they are not copied normative text.
Every term has a stable anchor link. Deep-link any definition as byebugs.ai/glossary#term-slug — for example #agentic-testing .
Put the vocabulary to work
Stop reading about agentic testing. Run it on your app. ByeBugs is the world’s first agentic AI QA platform. It tests your web app, mobile app, and AI features on every pull request, explores unscripted paths, and reports only the bugs that are real — each one backed by reproduction steps and captured evidence.
Book a call Frequently asked questions What is agentic testing? Agentic testing is goal-directed software testing in which AI agents plan, act, observe, adapt, and report findings across multi-step workflows. Instead of replaying a fixed script, the agent is given an objective and chooses its own navigation, data, and checks based on what it observes, then collects evidence for every finding it reports.
How is agentic testing different from traditional test automation? Traditional test automation is open-loop: the actions are fixed in advance and do not adapt to what happens during execution. Agentic testing is closed-loop: each observation feeds back into the next decision, so the agent can explore unscripted paths, recover from unexpected states, and discover defects that were never written into a test case.
What is the difference between an error, a fault, a defect, and a failure? An error is the human action or decision that produces an incorrect result. A fault is the resulting incorrect code, data, or configuration. A defect is the flaw in the work product that may cause unacceptable behavior. A failure is the observable event in which the system does not perform a required function within specified limits.
What is the difference between verification and validation? Verification asks whether a work product conforms to its specified requirements, design, rules, or other defined criteria — building the thing right. Validation asks whether the completed or evolving product fulfills its intended use and stakeholder needs in the real context — building the right thing.
What makes a bug report evidence-grounded? An evidence-grounded finding is one whose claims are directly supported by reproducible steps, captured state, logs, screenshots, traces, or other artifacts. The evidence chain connects observed behavior through captured artifacts to the reported conclusion, so a reviewer can confirm the defect without re-running the investigation.
How is an AI test agent evaluated? Agent evaluation measures task success, safety, reliability, efficiency, and behavior under defined conditions. Common approaches include end-state evaluation (scoring the final system state), trajectory evaluation (scoring the sequence of actions taken), step-level evaluation of individual tool calls, and metrics such as task success rate, pass@k, bug detection precision, and reproducibility rate.
Sources & editorial notes Scope: 1,075 English terms that directly support test planning, execution, automated bug discovery, diagnosis, reporting, and triage. Excluded: named attacks, exploits, vulnerability patterns, offensive-security concepts, and generic technology terms with no direct testing or bug-workflow purpose. Definitions are original, concise editorial syntheses informed by the references below; they are not copied normative definitions.
ISTQB Core software-testing terminology and established QA vocabulary ISO/IEC 25010:2023 Product-quality model and quality characteristics OWASP Web Security Testing Guide methodology and web-application security test areas W3C WAI WCAG 2.2 principles, success criteria, glossary, and conformance model W3C WebDriver Browser automation interface and the bidirectional WebDriver protocol OpenAPI Initiative OpenAPI Specification for HTTP API descriptions and contracts NIST AI test, evaluation, validation, and verification guidance, and evaluation probes for agentic AI Google web.dev Web Vitals and Core Web Vitals terminology Google SRE Service-level objectives, indicators, and error budgets OpenTelemetry Observability, traces, metrics, logs, and telemetry glossary MDN Web Docs Cross-browser and web testing concepts Playwright Retries, trace-based diagnosis, browser automation, and visual comparisons Google Cloud DORA Software-delivery performance metrics Last reviewed July 2026.