CustomFit.ai — Website personalization, A/B testing and CRO for Shopify and D2C
Product
Features
✱
Website Personalization
Adapt to each visitor's behavior & intent
⧖
A/B & Multivariate Testing
Rigorous experimentation
✨
AI CopilotNEW
Personalize with a prompt
🤖
AI WingmanNEW
Auto-optimize toward winners
🎯
AI Conversion OptimizerNEW
GPT-grade test ideas
✎
No-Code Visual Editor
Drag-and-drop edit any element
▦
Product Recommendations
Personalized recs that lift AOV
⚑
Feature Flags
Ship safely with kill-switches
◧
Chrome Extension
Edit your store in the browser
⧉
Shopify, WooCommerce & more
All platform integrations
View all features →
Use Cases
$
Price A/B Testing
Test price points to maximize revenue
▦
Theme A/B Testing
Compare whole layouts & designs
🗂
Template A/B Testing
Test whole PDP/PLP templates
🏷
Discount A/B Testing
Find the offer that converts
🚚
Shipping A/B Testing
Thresholds, speed & copy
✍
Content A/B Testing
Copy, images & reviews
💳
Checkout Gateway A/B
Payments & one-click
⌖
Geo-Based Personalization
Per-location content & offers
⚡
Buyer-Intent Nudges
Exit-intent & retargeting
↔
Split-URL / Redirection
Full-page redirect tests
View all use cases →
Solutions & Guides
⤢
Conversion Rate Optimization
The complete CRO guide
⧖
A/B Testing Software
Buyer's guide for D2C
🛒
Cart Abandonment Recovery
Win back lost carts
📰
Landing Page Optimization
Convert more paid traffic
S
Shopify A/B Testing
Test your store, no code
S
Shopify Personalization
Tailor the store per shopper
◔
First-Time Visitor Offers
Convert new shoppers with trust & offers
★
Repeat-Customer Experiences
Reward and re-engage loyal buyers
◎
Campaign-Matched Pages
Match the landing page to the ad
⌖
Location-Based Experiences
Currency, language & regional offers
Explore CRO →
Customer stories
GIVA
+32%
conversion via personalized recs
GIVA
Mamaearth
+18%
revenue lift from PDP A/B tests
ME
The Sleep Company
+24%
AOV from product recommendations
TSC
Read customer stories →
Integrations
SWsfGA+15
✦
Not sure where to start?
Let AI Copilot pick your first tests

“We wake up to evidence-backed tests ready to deploy — not a backlog of maybe ideas.”

AN
Anirudh S.
Growth · Chargebee
★★★★★4.8on G2 · 2,400+ brands
Talk to our team →
Widgets
Integrations
Ecommerce & Checkout
Shopify
Shopline
Shoplazza
GoKwik
ShopFlo
Razorpay Magic Checkout
Breeze
Shiprocket
View all integrations →
Analytics & Behavior
Google Analytics 4
Microsoft Clarity
Hotjar
Mixpanel
Amplitude
Heap
Adobe Analytics
Segment (CDP)
View all integrations →
Engagement, CRM & More
Klaviyo
MoEngage
CleverTap
WebEngage
HubSpot
Salesforce
Slack
Meta Ads
View all integrations →
CustomersPricing
Resources
CRO
▤
Playbooks
Proven strategies to boost conversions
🎙
Interviews
D2C leaders & marketing experts
▶
Webinars
Live deep dives & product sessions
Learn
✎
Blog
Tips, experiments & best practices
📕
Free E-Books
Mastering personalization
📖
Conversion Glossary
Every CRO term, defined
✦AI CopilotNEWLog inBook a demo
Start free trial
Select your platform — Install in 2 minsWe'll tailor the setup
⚡ Risk-free 14-day trial · No credit card · Cancel anytime
S
Shopify
Install from Shopify App Store
›
W
WooCommerce
Install the WooCommerce plugin
›
B
BigCommerce
Install from BigCommerce App Marketplace
›
SL
Shopline
Install from Shopline App Store
›
M
Salesforce / Magento
Install from the marketplace
›
SZ
Shoplazza
Install from Shoplazza App Store
›
WP
WordPress / Webflow
Install plugin or paste the script
›
◧
Others
Custom-built on React, Next.js, etc.
›
Tip: pick your platform — we handle the restBook a demo →
Product
Website PersonalizationA/B & Multivariate TestingAI CopilotAI WingmanAI Conversion OptimizerNo-Code Visual EditorProduct RecommendationsFeature FlagsView all features →
Use Cases
Price A/B TestingTheme A/B TestingTemplate A/B TestingDiscount A/B TestingShipping A/B TestingContent A/B TestingCheckout Gateway A/BGeo-Based PersonalizationBuyer-Intent NudgesSplit-URL / Redirection
Solutions & Guides
Conversion Rate OptimizationA/B Testing SoftwareCart Abandonment RecoveryLanding Page OptimizationShopify A/B TestingShopify Personalization
Explore
WidgetsIntegrationsCustomersPricing
Resources
BlogPlaybooksWebinarsInterviewsE-BooksConversion Glossary
Platforms
ShopifyShoplineShoplazzaChrome ExtensionAll integrations
Start free trialBook a demo
Home›Glossary›What Is Treatment Group? Definition & Guide
Definition

What Is Treatment Group? Definition & Guide

Put this into practice

Run A/B tests and personalize your store without code. 14-day free trial, no credit card.

Start free trial →

Articles about What Is Treatment Group? Definition & Guide

In-depth guides and case studies where this concept is put to work.

  • Incrementality Testing for Ecommerce
← Back to Conversion Glossary

Built for every D2C category

🧴
Skincare
💄
Beauty
🌿
Wellness
☕
F&B
👟
Apparel
💍
Jewelry
🛋️
Home
🍼
Baby
Live · Right now
Mamaearth — free-shipping band +12.4% AOVGIVA — festive collection page +34% revenueBellavita — PDP CTA test +27.4% CVRKapiva — Quiz-driven recs +9.48% CTRThe Sleep Co — landing personalized 2× capturesPlum — Returning shopper swap +18.2% CVRMamaearth — free-shipping band +12.4% AOVGIVA — festive collection page +34% revenueBellavita — PDP CTA test +27.4% CVRKapiva — Quiz-driven recs +9.48% CTRThe Sleep Co — landing personalized 2× capturesPlum — Returning shopper swap +18.2% CVR
Get in touch

Tell us about your store.

We reply within an hour during business hours. No sales pitch, no spam — just answers from someone who's seen 2,400+ D2C stores.

✓ Reply within 1 hour✓ No spam, ever✓ Free demo & setup help
✓ Thanks! We'll be in touch shortly.
CustomFit.ai

The all-in-one website personalization, A/B testing & CRO platform for high-growth D2C brands. Made by marketers, fueled by coffee.

in𝕏◎▶f
Product
  • Features
  • A/B Testing
  • Personalization
  • AI Copilot
  • AI Wingman
  • AI Conversion Optimizer
  • Feature Flags
  • Widgets
  • Integrations
  • ROI Calculator
Platforms
  • Shopify
  • Shopline
  • Shoplazza
  • Salesforce
  • Chrome Extension
  • All Integrations
Resources
  • Blog
  • Playbooks
  • Webinars
  • GrowthFit Interviews
  • Free E-Books
  • Conversion Glossary
  • Case Studies
Compare
  • vs VWO
  • vs Optimizely
  • vs Google Optimize
  • vs Mutiny
  • vs Intelligems
  • vs Shoplift
  • vs AB Tasty
  • vs Convert
  • vs Kameleoon
Company
  • About Us
  • Partners
  • CustomFit Awards
  • Recognition
  • Contact
  • Privacy Policy
  • Terms & Conditions
© 2026 CustomFit.ai · Valley Monks Pvt Ltd · Made by marketers, fueled by coffee, and obsessed with conversions.
SOC 2 Type II · GDPR · CCPA · ISO 27001

The treatment group (also called the variant, Variant B, or the challenger) is the segment of visitors in an A/B test who experience the modified version of a page, element, or experience. This is the group that sees your hypothesis in action — the new CTA button color, the redesigned product page, the updated pricing layout. By comparing the treatment group's behavior against the control group, you can measure whether your change had a positive, negative, or neutral effect on your target metric.

Formula / How to Calculate Treatment Group Impact

The lift generated by the treatment group is calculated as:

Lift = ((Treatment CR − Control CR) / Control CR) × 100

Where CR = conversion rate. For example, if the control group converts at 3.0% and the treatment group converts at 3.6%:

Lift = ((3.6 − 3.0) / 3.0) × 100 = +20% relative improvement

This lift becomes actionable only when it crosses the threshold of statistical significance.

Why Treatment Group Matters for Ecommerce

The treatment group is where your CRO hypothesis meets reality. Every change you test — whether it's a new trust badge, a different image, or a simplified checkout form — gets its first real-world validation through the treatment group. For D2C brands, the treatment group gives you evidence-based answers to questions you'd otherwise argue about in product meetings: Does urgency messaging actually increase purchases, or does it annoy customers? Does showing EMI options increase AOV? Does an exit-intent popup hurt or help conversion? The treatment group data answers these questions with your actual customers, not assumptions.

Real-World Example

Bellavita ran an A/B test where the treatment group saw a product page with a "Try Before You Buy" messaging banner (highlighting their return policy) added above the fold. The control group saw the standard page without this banner. After 12 days and 9,400 sessions per group, the treatment group showed a statistically significant 14% improvement in add-to-cart rate. The treatment group result was specific: the banner improved purchases for new visitors but had no effect on returning customers — a segmentation insight that shaped how the winning change was implemented.

How to Improve / Optimize Treatment Group Design

  • Test one meaningful change per treatment: If your treatment group sees a new headline AND new hero image AND a new CTA, you can't know which change drove the result. Keep treatments focused.
  • Make sure the change is substantive: Trivial changes (like button color) rarely produce meaningful lifts on their own. Treatment groups are most valuable when testing changes grounded in behavioral psychology or user research.
  • Randomly assign visitors to treatment: Non-random assignment (for example, assigning mobile users to treatment and desktop users to control) creates selection bias and invalidates results. Random assignment is the foundation of valid comparison.
  • Avoid novelty effects: Sometimes a treatment group performs better simply because the change is new and attracts attention — not because it's genuinely better. Running tests for multiple weeks catches this because novelty effects fade.
  • Analyze treatment group behavior beyond the primary metric: Don't just look at conversion rate. Check scroll depth, time on page, and exit rate in the treatment group to understand the full behavioral picture.

Treatment Group in A/B Testing

The treatment group is the engine of your experimentation program — it's where learning happens. A well-designed treatment tests a specific, hypothesis-driven change, runs against a clean control group, and generates insights that inform future tests regardless of whether it wins or loses. A losing treatment is still a valuable signal: it tells you what your customers don't respond to, which is equally important for building a better store.

Related Terms

  • Control Group
  • A/B Testing
  • Statistical Significance
  • Conversion Rate
  • Sample Size
  • Multivariate Testing

Run smarter A/B tests with CustomFit.ai — 14-day free trial, no credit card required.