Testing updated title tag format across product pages
45
Unchanged title tags
42
Updated title tags
31 days
Started Jan 15, 2025
94.2%
Above 90% threshold
Aggregate metrics for control and treatment groups
| Group | Pages | Total Clicks | Total Impressions | Avg CTR | Avg Position | Click Change % |
|---|---|---|---|---|---|---|
|
Control
|
45 | 3,240 | 89,500 | 3.62% | 8.4 | Baseline |
|
Treatment
|
42 | 3,890 | 91,200 | 4.27% | 7.1 | +20.1% |
Visual comparison between control and treatment groups
95% confidence intervals for each metric difference (Treatment - Control)
Detailed output from the statistical significance analysis
Test Method
Mann-Whitney U Test
Non-parametric rank-based test
p-value
0.023
Below 0.05 significance level
Effect Size (Cohen's d)
0.34 Medium
Practical significance of the difference
Result: Statistically Significant
The treatment group (updated title tags) shows a statistically significant improvement in click-through rate compared to the control group (p = 0.023). With a medium effect size of 0.34 and 94.2% confidence, the title tag optimization is producing a meaningful positive impact on organic performance.
Individual page performance within each group
Connect your Search Console and measure the real impact of your SEO changes with statistical confidence.
A digital marketer, developer and above all, a SEO / GEO enthusiast from the Netherlands. I built GSC Wizard to make Google Search Console insights faster, clearer and more actionable for everyone.
Be the first to know when GSC Wizard launches. Get early access and exclusive updates.