Chapter 10: Quality & Acceptance

Quality benchmarks, acceptance criteria, performance KPIs, compliance validation, and the contrast between poor and best-practice segmentation deployments.


Quality assurance in a segmentation project is not a single event at the end of the implementation — it is a continuous process that begins with design review and continues through the operational life of the system. This chapter defines the quality benchmarks and acceptance criteria that must be met at each stage, provides a visual comparison between poor and best-practice deployments, and establishes the performance KPIs that should be monitored on an ongoing basis to detect quality degradation over time.

10.1 Quality Comparison: Poor vs. Best Practice

The visual comparison below illustrates the most common quality failures in segmentation deployments and contrasts them with the expected best-practice state. The differences are not merely cosmetic — each quality failure on the left side of the comparison represents a specific security risk or operational liability. The quality score reflects the aggregate risk posture of the deployment.

Quality Comparison: Poor vs Best Practice Segmentation

Figure 10.1: Quality Comparison — Left: Poor segmentation showing flat network topology, tangled cables, password sticky notes, and security alerts (Score: 2/10, Risk: Critical). Right: Best practice segmentation showing clean zone topology, organized cable management, professional documentation, and green security dashboard (Score: 9/10, Risk: Low).

Table 10-1: Quality Failure Modes and Remediation

Quality Failure Mode Security Risk Detection Method Remediation Priority
Flat network (no segmentation) Any compromised device can reach all others Network scan — all hosts reachable from any source Implement zone design from Chapter 2; deploy NGFW/ISFW Critical
Overly permissive firewall rules Lateral movement paths remain open Firewall rule review; penetration test Rule cleanup; implement default-deny; remove "any/any" rules Critical
Direct admin access (no bastion) Admin credentials exposed to lateral movement Attempt direct SSH/RDP from Office zone Deploy bastion/PAM; block direct admin paths Critical
No log forwarding to SIEM Incidents go undetected; no forensic evidence Check SIEM for missing log sources Configure syslog/API forwarding from all devices High
Unlabeled cables Incorrect cable removal during maintenance Physical inspection Label all cables at both ends per standard Medium
No HA for critical appliances Single point of failure for security boundary HA status check; failover test Deploy HA pair; test failover High
Hardcoded/shared credentials Credential compromise affects all systems Credential audit; PAM coverage check Rotate all shared credentials; integrate with PAM Critical
No certificate management Expired certs cause outages; TLS inspection fails Certificate expiry scan Deploy PKI; configure auto-renewal; set expiry alerts High

10.2 Acceptance Criteria

The following acceptance criteria define the minimum requirements for a segmentation deployment to be formally accepted. All criteria in the Critical tier must pass with 100% compliance. High-tier criteria must achieve at least 95% compliance, with a documented remediation plan for any gaps. Medium-tier criteria must achieve at least 80% compliance at acceptance, with full compliance within 90 days.

Acceptance Criterion Measurement Method Pass Threshold Tier
All denied zone-pair flows are blockedNegative penetration test from each zone100% block rateCritical
All permitted zone-pair flows are functionalPositive connectivity test for each permitted flow100% success rateCritical
All admin access routes through bastion/PAMAttempt direct SSH/RDP from Office; verify bastion path works100% via bastionCritical
All devices forward logs to SIEMSIEM log source inventory vs. device inventory100% coverageCritical
HA failover within RTO targetFailover test with traffic generatorRTO met; no session lossHigh
NAC authenticates all managed endpoints802.1X test with managed and unmanaged devices100% managed auth; guest isolatedHigh
All cables labeled at both endsPhysical inspection of 10% random sample≥95% labeled correctlyMedium
As-built documentation completeDocumentation review against actual topology100% accurateHigh
All accounts use approved authenticationAccount audit; no shared/default credentials100% compliantCritical
NTP synchronization within toleranceCheck time drift on all devices<100ms driftHigh

10.3 Ongoing Performance KPIs

After acceptance, the following KPIs must be tracked on a monthly basis and reviewed at the quarterly security review meeting. A KPI that falls below the target threshold for two consecutive months triggers a mandatory remediation review. KPIs that consistently exceed targets may indicate that the monitoring thresholds need to be recalibrated.

KPI Definition Target Warning Threshold Critical Threshold Review Frequency
Policy Violation RateBlocked inter-zone flows per day / total flows<0.1%0.1–0.5%>0.5%Monthly
Rule Compliance RateRules with valid ticket ID and review date / total rules≥98%95–98%<95%Quarterly
Log CoverageDevices forwarding logs to SIEM / total devices100%95–99%<95%Monthly
HA AvailabilityUptime of HA pair / total time≥99.9%99.5–99.9%<99.5%Monthly
Certificate Expiry ComplianceCerts renewed before expiry / total certs100%N/AAny expired certMonthly
Patch CurrencyDevices within 30 days of latest security patch / total≥95%85–95%<85%Monthly
Mean Time to Detect (MTTD)Avg. time from incident start to SIEM alert<15 min15–60 min>60 minMonthly
Rule Review CompletionRules reviewed on schedule / total rules due100%90–99%<90%Quarterly

10.4 Compliance Validation

For organizations subject to regulatory compliance requirements, the segmentation design must be validated against the applicable framework's specific controls. The table below maps the key segmentation controls to the most common compliance frameworks. Organizations subject to multiple frameworks should use the most stringent requirement where frameworks overlap.

Control Domain MLPS 2.0 Level 3 ISO 27001:2022 PCI DSS v4.0 NIST CSF 2.0
Network segmentationRequired (8.1.3.1)A.8.22Req. 1.3PR.AC-5
Access controlRequired (8.1.1.1)A.8.3Req. 7PR.AC-1
Privileged access managementRequired (8.1.1.3)A.8.2Req. 8.2PR.AC-4
Log managementRequired (8.1.6.1)A.8.15Req. 10DE.CM-1
Vulnerability managementRequired (8.1.5.1)A.8.8Req. 11.3ID.RA-1
Incident responseRequired (8.1.9.1)A.5.26Req. 12.10RS.RP-1
Change managementRequired (8.1.7.1)A.8.32Req. 6.5PR.IP-3
Encryption in transitRequired (8.1.3.4)A.8.24Req. 4.2PR.DS-2