Challenge

Sephora, a multi-national chain owned by luxury conglomerate LVMH, depends on the loyalty of its highly-engaged customer base to drive revenue, customer lifetime value (CLV), and new business through word-of-mouth and product ratings.  As a brand with a large responsibility to cater to its family of customers, the desire for a personalized experience is a critical focus with a direct impact on the bottom line.

Sephora turned to Evolytics for additional hands on deck to progress their personalization practice, as well as an outside view into the structural solidity of its testing culture. 

Solution

Through a Team Augmentation partnership, Evolytics was able to increase speed and efficiency of test analysis, freeing up site areas for future tests and ensuring prompt implementation of the highest monetization opportunities. 

In order to progress beyond executional A/B Testing, the corporate testing culture must be inherently understood, practiced, and documented. Delivering a world-class personalization experience in a test and learn culture means leveraging a wide variety of tools such as Adobe Target, Certona, Braze, and APT. It also means cross-channel experimentation to ensure consistent personalization across the user journey. By embedding ourselves as members of the Testing and Personalization team, examining current practices with a fine-toothed comb, bringing to light areas of opportunity, and building upon systemic knowledge, Evolytics was able to create a thorough training curriculum, equipping teams with the confidence and resources needed in order to scale testing and personalization efforts.

Results

In partnership with Sephora, Evolytics maximized the Testing and Personalization team’s potential while bringing added value in the form of documentation and streamlined processes. 

Examples include:

  • Implementation of Adobe Workspace as primary tool for performance analysis and evaluation, inclusive of tracking requirements documentation, project brief access, and results
  • Streamlining of Testing & Personalization  process
  • Development of scalable cross-functional test read templates
  • Construction of statistical analysis metrics within Adobe Analytics
  • Introduced methodologies to track customer behavior prior to and following test live dates

Related A/B Testing Blog Posts

A/B testing and experimentation insights and best practices.

How to Optimize Testing Programs Using the Shared Control Group Method
How to Optimize Testing Programs Using the Shared Control Group Method

Another Approach to Supplementing Universal Holdout Experiments What is a Shared Control Group and Why Do I Need One? In…

Celebrating Pi Day with Data Science & Pie
Celebrating Pi Day with Data Science & Pie

I Designed an experiment to determine if I’m Evolytics’ best chef On March 14, 2022, Evolytics team members brought their…

Building the Perfect A/B Test Read
Building the Perfect A/B Test Read

Ask the author about a free A/B Test Read Template Components of an A/B Test Read It’s important to not…

Three Questions You Should Be Asking About Your A/B Testing Results
Three Questions You Should Be Asking About Your A/B Testing Results

Is your A/B Testing program failing to translate into business impact? Have you ever had two analysts pull data in…