AB Test Analysis skill: what it does and how to install it
Analyses A/B test results with significance tests, confidence intervals, sample-size checks and ship, extend or stop recommendations.
Summary generated from the skill's documentation.
Install
$ npx skills add phuryn/pm-skills --skill ab-test-analysisRun it in a terminal. If your agent is already running, start a new session so it picks the skill up.
About this skill
What it does. Evaluates an experiment's hypothesis, setup, sample size, duration, randomisation and guardrail metrics, then calculates conversion rates, relative lift, p-values and confidence intervals. It can read CSV, Excel or analytics exports and generate Python calculations for raw data, saving a structured markdown summary.
When to use it. For checking whether an A/B test reached statistical and practical significance and deciding whether to ship a variant, extend the test, stop it or investigate trade-offs.
History
Repo stars
27.4k+670 since 1 Oct 2026
Stars are counted for the whole repository, which holds 64 skills.
Show as a table
| Date | Repo stars |
|---|---|
| 26 Oct 2026 | 27,385 |
| 25 Oct 2026 | 27,358 |
| 24 Oct 2026 | 27,335 |
| 23 Oct 2026 | 27,321 |
| 22 Oct 2026 | 27,293 |
| 21 Oct 2026 | 27,257 |
| 20 Oct 2026 | 27,243 |
| 19 Oct 2026 | 27,201 |
| 18 Oct 2026 | 27,156 |
| 17 Oct 2026 | 27,131 |
| 16 Oct 2026 | 27,108 |
| 15 Oct 2026 | 27,069 |
| 14 Oct 2026 | 26,995 |
| 13 Oct 2026 | 26,953 |
| 12 Oct 2026 | 26,914 |
| 11 Oct 2026 | 26,880 |
| 10 Oct 2026 | 26,866 |
| 9 Oct 2026 | 26,852 |
| 8 Oct 2026 | 26,833 |
| 7 Oct 2026 | 26,815 |
| 6 Oct 2026 | 26,807 |
| 5 Oct 2026 | 26,778 |
| 4 Oct 2026 | 26,757 |
| 3 Oct 2026 | 26,736 |
| 2 Oct 2026 | 26,728 |
| 1 Oct 2026 | 26,715 |
Installs
2.9k+72 since 19 Oct 2026
Installs via skills.sh
Show as a table
| Date | Installs |
|---|---|
| 26 Oct 2026 | 2,891 |
| 25 Oct 2026 | 2,883 |
| 24 Oct 2026 | 2,875 |
| 23 Oct 2026 | 2,866 |
| 22 Oct 2026 | 2,854 |
| 21 Oct 2026 | 2,842 |
| 20 Oct 2026 | 2,832 |
| 19 Oct 2026 | 2,819 |
Similar skills
- Statistical AnalysisGuides statistical analysis of research data: test selection, assumption checks, effect sizes and APA-formatted reporting.
- Exploratory Data AnalysisRuns exploratory analysis on scientific data files: profiles, missing-data audits and outlier checks.
- GKE Cost AnalysisAnalyses Google Kubernetes Engine costs across clusters, namespaces and workloads using BigQuery billing exports and live utilisation metrics.