Production defects
A checkout change goes live on Friday. By Saturday, customers on one payment method cannot complete orders, and the team learns about it from social media.
- Why it happens
- The change was tested on the main path only, and the affected combination was not in anyone's checklist.
- What it costs
- Lost revenue, emergency patches and damaged trust.
- How we approach it
- We analyse risk by feature and change, build coverage for critical flows and combinations, and add production checks so defects that escape are detected quickly.
- What to measure
- Escaped defects per release, defect detection percentage and time to detect production issues.