A/B testing in Churn.io lets you run between 2 and 5 cancel flows simultaneously and compare their save rates. Instead of guessing which offer, survey phrasing, or design converts better, you let your real customers tell you with data.
⚠️ Pro plan required. A/B testing requires the Pro plan. Upgrade from Settings > Billing to unlock this feature.
How to set up an A/B test
Create the flows you want to test. See Managing Multiple Flows if you need help managing them.
Go to Flows > A/B Tests and click Create test
Enter a test name and set the end condition: a fixed number of days, or a target session count
Select between 2 and 5 flows to include in the test
Set the traffic split. 50/50 is standard for two variants; you can assign custom percentages for more
Click Start test
What to test first
Offer type: discount vs. pause for price-sensitive customers
Discount amount: 20% off vs. 30% off
Offer copy: different headlines on the same offer
Survey reasons: different phrasing to see if it affects selection distribution
Reading your test results
Results appear in real time on the A/B Tests dashboard. For each variant you will see session count, save rate, offer acceptance rate, and revenue saved. A winner is highlighted when the data is clear.
Declare a winner when:
At least 100 sessions have been recorded per variant
Statistical confidence is at 90% or above
✅ Change one thing at a time. Testing multiple variables simultaneously makes it impossible to know what caused the difference in performance. Always isolate one change per test to get clean, actionable data.
💬 Questions or concerns? Get help from our support specialists at Churn.io.