Case with Yandex.Plus

August–October 2023

Boosting the upsell conversion for Yandex.Plus

Boosting the upsell conversion rate for Yandex.Plus

Yandex.Plus is a subscription management service for users within the Yandex ecosystem in Europe, who value the convenience of keeping subscriptions all in one place, saving money, and getting cash-backs.

Yandex.Plus is a subscription management service for users within the Yandex ecosystem in Europe, who value the convenience of keeping it all in one place, saving money, and getting cash-backs.

Problem

The upsell conversion rate within the “Checkout with Plus” scenario was 14%, lower than anticipated. Leadership recognized the potential for revenue growth and decided to focus on improving upsell conversion rate.

The reasoning behind the initiative

The reasoning behind

The upsell screen was integrated into the “Checkout with Plus” scenario, which was experienced by more than 800k users each month. If our team had increased the upsell conversion rate by just 1%, the monthly revenue could have increased by over 2.3 million rubles.

The upsold subscriptions

Success count (June–July 2023)

Success (June, 23)

Amediateka

48,000

X5

29,00

Match Soccer Ball TV

900

More.tv

600

Match Premier

300

Plus Multi

300

Plus Kids

0

The business goal

To increase the upsell conversion rate by 3%, aiming to raise the Average Revenue Per Paying User (ARPPU).

My role ⌘ + ...

As a Product Designer at Yandex.Plus, I took the lead in this project 💪, owning all design initiatives and working closely with the Yandex.Plus Checkout Team 🏗, which consisted of a Product Manager, one Data Analyst, one QA Analysts, and two full-stack engineers. Art director gave me feedback on my designs.

As a Product Designer at Yandex.Plus, I took the lead in this project 💪, owning all design initiatives and working closely with the 🏗 Yandex.Plus Checkout Team. Art director gave me feedback.

Context

Target audience

People across a broad income range, 18–82 y.o., living in cities of Azerbaijan, Armenia, Belarus, Israel, Kazakhstan, Ukraine, Russia.

People across a broad income range, 18–82 y.o., living in cities of Azerbaijan, Armenia, Belarus, Israel, Kazakhstan, Ukraine, Russia.

Business strategy

Addressing subscription management user needs while leveraging Yandex’s user base and a wide selection of services.

Addressing subscription management user needs while leveraging Yandex’s user base and a wide selection of services.

Key metrics

Average Revenue Per Paying User (ARPPU), Costs.

Average Revenue Per Paying User (ARPPU), Costs.

Monetization

Subscription fee.

Subscription fee.

“Plus” as a product

“Plus” is an al-in-one subscription to Yandex services that enables access to movies, music, e-books, and bonuses from taxi rides and tickets purchases.

“Plus” is an al-in-one subscription to Yandex services that enables access to movies, music, e-books, and bonuses from taxi rides and tickets purchases.

Users may upgrade for more services for additional price.

Types of upsell offerings in Plus

The type of offering depends on team's decision and context (e.g. users who had been subscribed to the service don't need the Trial):
— Intro


— Trial


— Full-price

Advantages of current solution

The existing solution streamlined creating upsell proposals be means of templates — the team crafted upsell offerings manually through the Admin website, defined the target audience, visuals and prices.

Checkout scenario As-is

Research & investigation

The product team hypothesized (H1) that the low conversion rate was due to users perceived the Upsell offer as a banner and closed it without reading.

The product team hypothesized (H1) — the low conversion rate was due to users perceived the Upsell offer as a banner and closed it without reading.

We also aimed to:

  1. Understand how users behaved within the scenario and to uncover users' needs regarding the upsell screen;

  2. Find out the best practices and upsell mechanics.

The hypotheses & objectives

Methods of research

How I did it

H1 — users perceive the Upsell offer as a banner and close it without reading.

Unmoderated perception testing with a survey

400+ people from the target audience took part.

To understand how users behaved within the scenario and to uncover users' needs regarding the upsell screen

Moderated UX testing with User Interview

7 users who have recently experienced “Checkout with Plus” scenario.

To find out the best practices and upsell mechanics

Competitors analysis

Direct competitors: VK Combo, SberPrime+, Tinkoff Pro. Indirect competitors: YouTube Music Premium, Spotify.

Summary of the findings

Problem framed

We needed to ensure that the Upsell screen:

  1. Did not interrupt the “Checkout with Plus” scenario.

  2. Had a concise headline with less text as users didn’t read.

  3. Addressed the worries of missing the cancellation date.

Ideation & scoring

During brainstorming sessions, our team set on agreement about scoring our solutions — easy & impactful win.

The key constraints to consider:



  1. We could not decrease prices or enlarge trial periods.

  2. Upsell terms (prices and N-days of trial) should stay the product team’s decision.

Iteration#1—showing the Upsell screen with a better layout when checking-out is finished.

How can we: 



  1. Upsell without interrupting user during check-outing with Plus?

  2. Help user understand the offer without cognitive load?

Hypothesis

We can show the Upsell screen on checkout finish.

Why might this work?

Users won't perceive the Upsell screen as an obstacle because the check-outing with Plus scenario is finished.

1

The screen title is concise and direct, and cancellation period concerns are addressed.

2

Why might this work?

Why I left the solution behind?

User Testing and side-by-side results were not good enough.

User Testing results:
— only 2 people out of 7 subscribed to Amediateka
— 2 people said they expected to see Settings screen
— 2 people didn’t read the offer and automatically tapped [Not now]
— 1 person was disappointed to see an add

Unmoderated side-by-side testing (50/50):
— 42 votes for “before” Upsell screen
— 67 votes for “after” Upsell screen

Why I left the solution behind?

Iteration#2—upselling within the checkout scenario only on user’s demand.

How can we: 



  1. Upsell without interrupting user during check-outing with Plus?



  2. Help user understand the offer without cognitive load?

Hypothesis

We can introduce a mascot bot to offer extra benefits and show the Upsell screen only if the user requests it.

Why might this work?

Users are in control to decide if they want to see the offer or not.

1

Animated mascot messages may draw user’s attention.

2

The screen title is concise and direct, and concerns about the cancellation period are addressed.

3

Why might this work?

Why I left the solution behind?

User Testing and side-by-side results were not good enough.

User Testing results: 


— 5 people out of 7 agreed to see the offer


— those 5 people asked what other services available with Plus?”


— 2 people subscribed to Amediateka after looking at the offer

Unmoderated side-by-side testing (50/50): 


— 42 votes for “before” Upsell screen


— 55 votes for “after” Upsell screen

Why I left the solution behind?

New input

During UX testing people asked —

During UX testing people asked:

“what other services available with Plus?”

New input

Iteration#3—upselling multiple services on the subscription success screen.

How can we:

  1. Upsell without interrupting userэы check-outing?



  2. Help user understand the offer without cognitive load?



  3. Help user to understand what services available?

Hypothesis

We can offer multiple extra services right on the “Subscription success” screen and show details about distinct option on user’s demand.

We can offer multiple extra services right on the “Subscription success” screen and show details on user’s demand.

Why might this work?

User may be relaxed and ready to perceive new information once subscribing to Plus is finished.

1

Each user may find a useful service. This increases the chance to upsell.

2

The title explicitly with CTA describe the purpose of the screen. Screen is not overloaded with text, and more info shown on user’s demand.

3

Why might this work?

Prototyping and solution verification

After corridor testing I performed UX tests with prototype:


4 people out of 7 upgraded their Plus with one or two additional services


— nobody skipped the screen without reading the offer


— all users noted that they would connect services that are useful to them

I also conducted unmoderated side-by-side test: 


— 6 votes for “before” Upsell screen 


— 68 votes for “after” Upsell screen

Final prototype

The final prototype

Feedback from Art Director

During the design review session, our Art Director suggested one correction to my design — to tone down the price text fill.

Error and edge cases

There was only one new error case to consider during implementation.

Screen_06

Plus subscription is success (enabled)

Screen_06

Nothing is selected (error case)

Screen_06

Plus subscription is success (nothing selected)

Delivery

It took us around three weeks of design iterations, prototype testing, close collaboration with PM and the team to get to a solid design proposal.

A gradual AB rollout (starting with 5% of the audience and then increasing) helped us verify and confirm that we increased the conversion to upsell rate.

Results and outcomes

The conversion to upsell rate increased by 5% (Q4, 2023)! 🥳

Learnings

Despite the amazing result, there are some things I should’ve done better, which are:

  1. Avoid getting too attached to your initial ideas.

  2. Get to prototyping rapidly. It helped me uncover user needs and gain a better understanding of the problem.

I defined the problem

We needed to ensure that the Upsell screen:

  1. Did not interrupt the “Checkout with Plus” scenario.

  2. Had a concise headline with less text as users didn’t read.

  3. Addressed the worries of missing the cancellation date.

Thank you for visiting.
I wish you a fantastic day!

Thank you for visiting.
I wish you a fantastic day!