THIS IS A DEMO EXPERIMENT USED FOR DEMONSTRATION PURPOSES ONLY
Experiment to test impact of checkout cart design. Both variations move the "Proceed to checkout" button to a single table, but with different spacing and headings.
| 0Current | 1Dev-Compact | 2Dev |
|---|---|---|
Split: 33% | Split: 33% | Split: 33% |
| Variation | Actual Units | Expected Units | Actual % | Expected % |
|---|---|---|---|---|
0 Current | 5,820 | 5,678.1 | 34.17% | 33.34% |
1 Dev-Compact | 5,564 | 5,676.4 | 32.67% | 33.33% |
2 Dev | 5,647 | 5,676.4 | 33.16% | 33.33% |
| p-value = 0.052 | ||||
Goal Metrics | Baseline | Variation | Chance to Win | % Change | |
|---|---|---|---|---|---|
| Purchases (FT) - Any Order (72 hour window) | |||||
1Dev-Compact | 63.9% 3,718 / 5.8K | 55.3% 3,078 / 5.6K | 0% | -13.4% | |
2Dev | 63.9% 3,718 / 5.8K | 67.8% 3,831 / 5.6K | 100% | 6.2% | |
| Purchases (FT) - Number of Orders (72 hour window) | |||||
1Dev-Compact | 0.66 3,844 / 5.8K | 0.568 3,162 / 5.6K | 0% | -14% | |
2Dev | 0.66 3,844 / 5.8K | 0.702 3,965 / 5.6K | 100% | 6.31% | |
| Purchases (FT) - Total Revenue (72 hour window) | |||||
1Dev-Compact | $5.96 $34,666 / 5.8K | $5.20 $28,946 / 5.6K | 0% | -12.7% | |
2Dev | $5.96 $34,666 / 5.8K | $6.51 $36,769 / 5.6K | 100% | 9.32% | |
| Retention (FT) - [1, 14] Days | |||||
1Dev-Compact | 45.6% 2,654 / 5.8K | 43.7% 2,430 / 5.6K | 1.7% | -4.23% | |
2Dev | 45.6% 2,654 / 5.8K | 44.9% 2,536 / 5.6K | 22.6% | -1.52% | |
| Purchases (FT) - Average Order Value (ratio) | |||||
1Dev-Compact | $9.02 $34,666 / 3,844 | $9.15 $28,946 / 3,162 | 80.5% | 1.51% | |
2Dev | $9.02 $34,666 / 3,844 | $9.27 $36,769 / 3,965 | 95.2% | 2.83% | |
| Days Active in Next 7 Days (FT) | |||||
1Dev-Compact | 0.317 1,847 / 5.8K | 0.311 1,730 / 5.6K | 25.9% | -2.03% | |
2Dev | 0.317 1,847 / 5.8K | 0.319 1,799 / 5.6K | 54.8% | 0.385% | |