FlakeProof connects to your CI pipeline and tells you which tests are actually flaky vs. actually broken โ using statistics, not AI.
A test fails. You rerun CI. It passes. Was it flaky or was it a real bug? You never know, so you waste hours rerunning builds hoping for green.
When tests fail 4 out of 10 runs, the entire test suite loses credibility. Developers start ignoring failures. Real bugs slip through.
Someone maintains a "flaky tests" spreadsheet. It's stale within a week. Nobody updates it. It's a coping mechanism, not a solution.
One webhook step in your GitHub Actions workflow. Works with GitLab, CircleCI, and any CI that can POST JSON.
curl -X POST .../webhook/github
FlakeProof ingests JUnit XML, tracks every test result, and computes flakiness scores using statistical analysis.
Get Slack alerts when flakiness spikes. Quarantine recommendations. Cross-branch analysis. README badge for your repo.
10-run sliding window with recency weighting. 0.0 = stable, 1.0 = completely flaky. Auto-quarantine at 70%.
Get notified the moment flakiness crosses your threshold. Never discover a broken test suite from a customer.
Detect tests that flake on main but pass on feature branches. The classic "it works on my machine" solved.
Show your team's test reliability publicly. A shield badge that updates automatically: "FlakeProof: 94% reliable".
Track flakiness over days, weeks, months. See if your test suite is improving or degrading over time.
Pure statistical analysis. No ML models, no hallucinations, no vendor lock-in. Deterministic and auditable.
Zero AI runtime. Zero regulatory exposure. Zero sales calls.
Just a CLI away from reliable tests.
pip install flakeproof-cli