Email is the highest-ROI channel for most D2C brands β but the difference between a well-optimised email programme and a mediocre one is often not the email volume or the creative budget. It is systematic A/B testing. Brands that consistently test subject lines, CTA placement, offer framing, and personalisation see measurably higher revenue per email over time. This guide covers what to test, how to set it up correctly, and how to interpret results for ongoing improvement.
Why Email A/B Testing Compounds Over Time
Unlike paid acquisition, where A/B test learnings improve a single ad or landing page, email A/B testing learnings compound across your entire subscriber base for every future send.
If you discover that emails with the customer's city in the subject line (e.g., "Your Mumbai-exclusive offer inside") get 8% higher open rates, that insight applies to every promotional email you send to that segment for the next year. Over 50 email sends to 20,000 subscribers, an 8% open rate improvement translates to hundreds of thousands of additional opens and the resulting revenue.
The investment in A/B testing is small (most email platforms support it natively). The compounding return is large.
What to Test in Ecommerce Emails
Subject Line Testing
Subject lines are the highest-leverage test because open rate is the first multiplier in the email revenue equation:
Revenue per email = Send volume Γ Open rate Γ Click rate Γ Purchase rate Γ AOV
Improving open rate lifts every downstream metric. Test these subject line variables:
Personalisation:
- Without: "Our Diwali sale is live β 30% off everything"
- With: "Priya, your Diwali offer expires at midnight"
Curiosity vs. directness:
- Direct: "30% off all protein powders this weekend only"
- Curiosity: "We're doing something we've never done before this Diwali"
Emoji vs. no emoji:
- Without: "Your exclusive order is ready"
- With: "π Your exclusive order is ready"
Question format:
- Statement: "Your wishlist items are on sale"
- Question: "Did you know your wishlist items are 30% off right now?"
Length:
- Short (under 40 characters): "Your order is waiting"
- Long (60+ characters): "The protein powder you saved is on sale β but only until Sunday"
A practical approach: test subject lines on 20% of your list (10% to each variant), wait 4 hours, then send the winning subject line to the remaining 80%. Most email platforms (Klaviyo, Mailchimp, Omnisend) have this built in.
The preview text is the line that appears after the subject line in the inbox. It is effectively a second subject line and has almost as much impact on open rate.
Test preview text that complements vs. contradicts the subject:
- Subject: "Your exclusive offer expires tonight"
- Preview A (complement): "Flat 25% off β no code needed, just tap to claim"
- Preview B (reveal): "We've been holding this back just for you"
Email Body: Above the Fold
The content visible without scrolling in the email preview pane on mobile. Test:
Hero image vs. text-only:
- Image-heavy hero with promotional banner
- Text-heavy personalised message from the "founder" (lower production value, but often higher trust perception)
Offer placement:
- Offer at the top of the email (for high-intent promo emails)
- Narrative first, offer later (for welcome sequences and relationship-building emails)
CTA position:
- One CTA above the fold, one repeated at the bottom
- First CTA appears after product description (no CTA before content)
Offer Framing
The same discount can be framed different ways. Test which framing gets more clicks and revenue:
| Framing A | Framing B |
|---|
| "25% off" | "Save βΉ350 on your order" |
| "Buy 2 Get 1 Free" | "Effectively 33% off when you buy 3" |
| "Free delivery above βΉ499" | "Your βΉ89 delivery charge is waived today only" |
The framing that wins varies by category, product price point, and customer segment. Testing reveals which mental model your customers use to evaluate value.
Send Time
Test the same email at different send times to different segments:
- 8:00 AM vs. 12:00 PM
- Weekday vs. weekend
- Tuesday vs. Thursday
For Indian D2C audiences, common high-performance windows are 8β10 AM (commute check), 12β1 PM (lunch break), and 9β10 PM (after-dinner scroll). The best send time varies significantly by list demographics and product category. Test it rather than assuming.
Automated Flow Tests
Automated flows (welcome series, abandoned cart, post-purchase, re-engagement) are especially worth testing because they send to every qualifying subscriber indefinitely. An improvement in an abandoned cart subject line affects every abandoned cart email for the next year.
For abandoned cart specifically:
- Test: urgency ("Your cart expires in 24 hours") vs. helpfulness ("We saved your cart β want to continue?")
- Test: email 1 timing (1 hour after abandonment vs. 3 hours)
- Test: discount in email 2 vs. no discount (does offering a discount in email 2 cannibalise full-price recoveries from email 1?)
How to Set Up an Email A/B Test
Choose One Variable
Test one thing at a time. Changing the subject line and the hero image in the same test means you cannot attribute the result to either change.
Split the Audience Fairly
Most email platforms split the test audience randomly from the same list segment. Ensure:
- Both variants go to similar-sized sub-segments
- Both variants are sent at the same time (no sequential sends where the second variant goes to a later-opening audience)
- The test segment is drawn from the same list with the same quality (same engagement level, same acquisition source)
Determine Sample Size Before Testing
Decide in advance:
- How big does each variant need to be to get reliable results? (Use an A/B test calculator β most require ~1,000 per variant for open rate, ~2,500 per variant for click rate)
- What is the minimum lift you care about? (A 0.5% open rate improvement on a 5,000-person list is 25 extra opens β probably not worth optimising for. A 3% lift is 150 extra opens β meaningful.)
The Right Metrics
| Metric | What it measures | Use for |
|---|
| Open rate | Subject line + preview text | Subject line tests only |
| Click rate | Email body effectiveness | Body copy, CTA, offer framing tests |
| Click-to-open rate (CTOR) | Body effectiveness independent of subject | Isolating body changes from subject influence |
| Revenue per email | Ultimate business outcome | Offer and full-email tests |
Revenue per email is the metric that matters most. An email with a higher open rate but lower revenue per email is not actually a better email.
Interpreting Results
Wait for statistical significance. Most email A/B test tools show whether results are statistically significant. Do not call a winner based on early data β open rates stabilise after 4β6 hours; click and purchase data needs 24β48 hours.
Look for patterns, not one-time wins. A subject line format that wins once might win again β or might have been a fluke. Run variations of the winning format in future tests to confirm the insight.
Build a learning log. Document every test: what you tested, what the variants were, the result, and the insight. A log of 20 tests becomes a content strategy guide for your email programme.
Tips and Best Practices
Test during different campaigns. A subject line that wins during Diwali might not outperform the control during a January clearance campaign. Subject lines are context-sensitive β validate learnings across contexts.
Maintain a holdout group. For major automated flow tests, send 10% of subscribers the existing flow (control) while 90% get the new version. This protects against the test variant being significantly worse.
Use the 80/20 winner approach for promotional emails. Test on 20% of your list, wait 4 hours, send the winner to the remaining 80%. This maximises the impact of the winning variant while still generating test data.
Do not just optimise for open rate. It is possible to game open rates with misleading subject lines. Always track click rate and revenue per email alongside open rate.
Key Takeaways
- Subject line testing has the biggest impact on email revenue because open rate is the first multiplier.
- Test one variable at a time. Subject line tests are the easiest to run and compound most over time.
- Revenue per email is the ultimate metric β open rate improvements that do not lead to click rate improvements are hollow wins.
- Automated flow tests (welcome series, abandoned cart) are the highest-ROI tests because improvements affect every qualifying subscriber indefinitely.
- Document learnings and use them to build a systematic understanding of what resonates with your list.
For more on email and retention strategy, see the Email & Retention pillar guide and the A/B testing pillar guide.
email retention
email retention
email retention