Automation Features
The PW-Tests framework includes several automated and semi-automated capabilities that extend beyond basic test execution.
Unified Healer
Analyzes test failures, identifies fixable patterns (selector changes, timeouts, consent dialog updates), and proposes fixes automatically. Runs as npm run heal or creates GitLab MRs via npm run heal:mr.
Interactive Healer
Claude-in-the-loop healing for complex failures. No API tokens needed — runs locally with npm run heal:claude. Best for cases where automated pattern matching isn't enough.
Humanized Failure Alerts
Per-failure Slack alerts with calm headlines, colored verdict labels, and clustered thread style. Not noisy — designed to inform without alarm.
Thread Recovery Replies
When a failed test starts passing again, the system posts a recovery reply to the original failure thread. Includes root cause, fix details, and time to resolution.
Weekly Reports
Automated weekly summary with pass rates, failure trends, and notable changes. Posted to #qa-reports as PDF + Slack message.
Screenshot verification using Claude Vision. Takes screenshots of test pages and verifies visual correctness, layout integrity, and content presence. Runs as npm run factcheck with budget controls.
Site Crawler
Crawls all CNC sites to discover pages, build URL maps, and maintain coverage. npm run crawl for all sites or npm run crawl:site blesk for one.
Selector Discovery
Discovers and validates selectors across sites. Identifies new elements for testing and flags broken selectors. npm run discover:all.
Intelligence Service
Classifies failures automatically: TEST_OUTDATED, TEST_FLAKY, PRODUCT_BUG, INFRASTRUCTURE. Assigns owners and priority levels.
Incident Management
Query and template tools for failure retrospectives. npm run incidents:query shows recent unclassified failures.
Registry Validation
120 content type entries across 231 site slots. Each entry tested for existence, structure, and behavior. Orchestrator groups tests by navigation context for efficiency.
Regression Detection
Tracks content test results over time. Detects when previously passing content types start failing.
Broken Link Detection
Crawls CNC sites at three depth levels (basic ~65 pages, nav ~300 pages, full ~600+ pages). Detects broken links, reports to Slack with deduplication.
Robots.txt & Sitemap
Daily monitoring of robots.txt and sitemap.xml for 16 CNC sites. Detects changes and validates nested sitemap health.
Weekly Reports
Automated PDF + Slack reports with pass rates, failure analysis, and trend charts. npm run report:weekly.
Monthly Reports
Comprehensive monthly analysis with feature summaries and failure retrospectives. npm run report:monthly.