Last Updated: May 16, 2026 | Reviewed by Devon Cox, President, ConversionTeam
Across a multi-year A/B testing engagement, ConversionTeam delivered a 76% win rate with $14MM+ in incremental site revenue for this jewelry eCommerce retailer. The program produced a 24% measured test lift and a 13% estimated real-world conversion lift, anchored by wins across product detail pages, category portals, the mini cart, and checkout.
βΉ
Client Background
Our client is a leading e-commerce retailer in the jewelry sector, offering a diverse catalog that ranges from intricately designed necklaces to high-quality loose gemstones. Catering to a varied consumer base with different preferences and spending capacities, the platform attracts over 100,000 daily users and is based in the United States.
?
The Challenge
The client wanted to foster a culture of testing and brought us on to run their A/B testing program. Their objectives were to improve user experience, validate upcoming site changes, and test new conversion-increasing concepts across the full funnel.
π―
Objectives
With a long list of site enhancements in flight, the client wanted to make sure each one was net positive from a conversion perspective before shipping. The overarching goal was to lift revenue per user across the entire catalog.
π‘
Our Solution
The engagement started with a comprehensive Hitlist CRO Audit, a 60-90 page document offering specific, actionable recommendations for conversion rate optimization. The audit followed a structured methodology that encompassed an analytics audit, user testing, heatmaps, and session recordings. The user testing phase was instrumental in understanding user behavior and preferences, with scenario-based tasks run on both the client's and a competitor's site.
After the audit, the engagement transitioned into the Iterate A/B Testing Program. This ongoing initiative involved continuous testing of website elements to determine which versions converted better and to build a backlog of validated wins.
π
A/B Testing Program Highlights
Across the engagement, we ran A/B tests in the following areas:
- Product detail pages
- Mini cart and cart page
- Category portal pages
- Site navigation
- Checkout flow
- Airing now (live shopping) experience
- Mobile navigation
- Homepage messaging and layout
The three featured tests below illustrate the range and depth of the program. The program's full results, including all winning and losing tests, are summarized at the end.
Product Highlights on Category Portal Pages
βΉ
Background
Top-level category 'portal' pages are common destinations for both paid and organic traffic but often suffer from lower conversion rates for users already on the site.
π§ͺ
Hypothesis
Featuring top products for each section on the portal page would enhance conversion rates for both internal and entry users.
β
Methodology
The test involved adding top products for each section on the portal page.
π
Results
The test was successful, resulting in a 36% increase in revenue per user and a 5.2% increase in transaction conversion rate at a 97% confidence level. It was particularly strong for organic users, up 34.8% at 99% confidence.
After
Top products added to category portal
π
5.2%
Increase in Conversion Rate
π―
36%
Increase in Revenue per User
π°
34%
CR Increase for Organic Users
Product Warranty Upsell in Mini Cart
βΉ
Background
Warranty upsells are commonly tested in add-to-cart modals, carts, and sometimes checkout flows to increase average order value (AOV).
π§ͺ
Hypothesis
Adding a warranty upsell would increase both revenue per user and conversion rate.
β
Methodology
The test involved adding a warranty upsell option in the mini cart.
π
Results
The test was successful, resulting in an 8% increase in revenue per user, which was the primary KPI for this type of upsell test. We also observed a 2.6% increase in conversion rate at a 97% confidence level and an 11% increase in revenue per user for returning users.
After
Warranty upsell added to mini cart
π
8%
Increase in Revenue per User
π―
2.6%
Increase in Conversion Rate
π°
11%
Increase in Revenue per User for Returning Users
Price Box Redesign
βΉ
Background
Based on user testing, competitive analysis, and best practices, a redesign of the pricing area was deemed necessary to highlight potential savings and buy-over-time options.
π§ͺ
Hypothesis
A redesigned pricing area highlighting savings would improve the conversion rate.
β
Methodology
The test involved redesigning the pricing area to emphasize savings and buy-over-time availability.
π
Results
The test was successful, resulting in a 4.8% increase in conversion at a 99% confidence level. It was particularly strong for new users, up 7.2% for conversion and 12% for revenue per user.
After
Price area redesigned
π
4.8%
Increase in Conversion Rate
π―
12%
Increase in Revenue per New User
π°
7.2%
CR Increase for New Users
π
Program Results
This was a multi-year CRO engagement. The audit identified the priority opportunities; the ongoing Iterate A/B Testing Program then validated and shipped wins across every part of the funnel.
The program ran tests continuously and achieved a 76% win rate. According to the program tracking document, we delivered a 24% measured test conversion rate lift, a 7% conservative lift, and an estimated 13% real-world lift, which translates to over $14 million in incremental site revenue.
The partnership lasted over 4 years and ended when the client took their AB testing program internal β a typical outcome for larger enterprises once they see the program's effectiveness and want to build the capability in-house.
Our work with this client is a great example of how to jump-start a testing culture inside an organization and shift UX and UI decision-making from aesthetic preference to data-driven, ROI-focused practice.
π
76%
Program Win Rate
π°
$14MM+
Incremental Site Revenue
π
4+ yr
Engagement Duration
Client Testimonial
"ConversionTeam has been a great long-term partner. They have brought new insights, helped validate our own ideas, and provided turnkey A/B testing resources. ConversionTeam's mix of technical proficiency and dedication to client service makes them the perfect complement to our UI/UX practice."
Drew Bowman
Director, UI/UX
Frequently Asked Questions
What is an engagement-level CRO case study?
An engagement-level case study documents the cumulative outcome of a multi-test CRO program rather than a single A/B test. It reports on the program's win rate, total revenue impact, and breadth of tests run. This format reflects how CRO actually delivers value over time: through repeated testing across different parts of the conversion funnel, with wins compounding.
What was tested in this jewelry eCommerce CRO engagement?
A/B tests across the highest-leverage parts of the conversion funnel: category portal pages, product detail pages, the mini cart and cart, checkout flow, navigation (desktop and mobile), the airing-now live shopping experience, and homepage messaging. The program produced wins across most of these areas.
Which test had the biggest impact?
The category portal page test, which added top products to top-level 'portal' pages, drove a 36% lift in revenue per user and 5.2% lift in transaction conversion rate at 97% confidence. Organic users responded even more strongly, up 34.8% at 99% confidence β a meaningful signal that the portal pattern works for entry traffic.
How long did this CRO engagement run?
Over 4 years. The engagement ended when the client built an internal CRO team and took the testing program in-house, which is a typical outcome for larger enterprises once they see consistent program-level value.
What's the difference between measured, conservative, and real-world lift?
Measured lift is the direct lift observed in each test. Conservative lift uses the lower bound of statistical confidence intervals across the program portfolio. Real-world lift is our best estimate of site-wide impact after accounting for participation rates and overlap. For this program: 24% measured, 7% conservative, 13% real-world.
How does ConversionTeam decide what to test?
Every engagement starts with a comprehensive Hitlist CRO Audit that combines analytics review, user testing, heatmaps, session recordings, and competitive analysis to identify the highest-leverage opportunities. The audit produces a prioritized backlog. The testing program then validates the top opportunities with A/B tests before client engineering invests in native implementation.
Luxury retailers often ask me if our tactics work on luxury, or if they're just low-consideration purchases. My response is always the same: the psychological principles that make users convert, like social proof and scarcity, work regardless of the cost of the item.
Devon Cox
President, ConversionTeam