Business challenges
Piano learners quit the app before taking any lessons, leaving the team's effort to improve learning content in vain.
When I joined Simpia’s product team in summer 2023, developers voiced their frustrations that the app’s retention rate is low and the team is expecting solutions in the next updates.
- 9% R1 retention rate
- 5% premium subscription rate
- Over 180s to reach app' core learning feature
then i found out the user problems :
Learners failed to learn how to effectively use Simpia with key features at the beginning, hindering their ability to fully using app's functionalities!
I have taken steps guided by the "Double Diamond" framework to discover the problems of users and how to solve them. Do you want to know the details? Let's find out below!
New onboarding experience
Simpia - Piano learning is simple
Communicate core value
- Play your favorite song
- Personalized feedback with AI
- Easy & Fun learning experience
Personalized for you
Utilized brief surveys for every first onboarding to provide accurate segments.
overview
I have successfully achieved:
At the end of the internship, I have successfully completed assigned task by the PO and helped the product achieve improvements in metrics set when I first joined!
- 35% shortened time to reach the app's core learning feature.
- 19% increase in R1 retention rate.
- Improved conversion rate of completing first song learning.
guided by Double Diamond Framework
Discover stage
Before jumping into finding solutions, I discussed with the PO and CEO to connect business goals with piano leaners' problems. Then to understand the problem context, I used existing data of piano learners to contextualize the potential problems. In this stage, I have:
- Planned with PO
- Collected existing user behavior data
- Conducted usability sessions
- Held interviews on UserTesting
Target learners
Simpia was designed for beginner & intermediate learners
Since 2021, among other competitors app has been designed for beginner & intermediate piano learners with 0 to 3 years of experience in piano learning. We target self-taught piano learners with YouTube videos, traditional learners who quit, and inspired short-term learners.
Success Mertrics
Why did I pick these success metrics?
I have sat down and discussed with the PO and CEO to clarify business goals with piano learners' problems. After understanding the context of what we want to achieve, I have suggested the following metrics:
User reviews analysis
I decided to take a look at reviews on the store to make sure the voices of product's end learners are heard, understand their need, and highlight areas for improvement.
- Most users are overwhelmed - At the beginning, users find menu navigation between song practice, course, and game mode, confusing and not clear.
- Onboarding screens are not helpful- Through event tracking, multiple new users don’t make it till the app’s core values are introduced in songs learning - “aha” moments”.
Define stage - confirm hypothesis
Usability testings with 5 users, 3 interviews on UserTesting
- Lack of onboarding guidelines - At the beginning, users find it hard to learn how to interact with piano, how to interact with the app, and catch up with songs pace.
- Extended time to AHA moments - Through event tracking, multiple new users don’t make it till the app’s core values introduction in songs learning- “aha” moments”.
Develop Stage
I learned about retention framework as I go!
After collecting and analyzing all the data, I tried to define the main challenge and brainstorm solutions with the help of the retention framework.
Leadership
I create task flows to prioritize tasks for engineers
During the development stage, with so many tasks on our hands, I collaborated with the product owner and engineers to select task implementation timelines based on planned updates and technical limitations.
Then, I revised new onboarding journey
With the data collected on UserTesting, we draw the user journey map of current app version and predict the new journey with the
pain points identified. The map enabled me to visualize the sequence of actions taken by the user as they interact with the app. It provided insights into the moments of high user satisfaction and pinpoints potential areas where frustration might arise.
1st focus point
How might we trigger learners' initial curiosity?
Curiosity of the app should start at the very beginning! I have decided to redesign the onboarding values introductory screens to trigger learners' interest. I evaluated old screens UX's problems & visual design to guide and ideate new ideas for new screens.
(Credit: Most of the graphic designs are done by our Graphic Designer: Rio Tran)
2nd focus point
How might we guide learners through main features?
After screens introduce core values and what's inside, we strive to guide learners through the main features to confirm the hypothesis and maintain learners interest through first song practice.
DEliver Stage
Personalized Onboarding Flow
Following the user journey, as users are confused with where to begin, we focused on delivering a straightforward and simple start to better prepare for future piano learning journeys with the app according to the categorized types of users!
( For mobile users viewing this, please rotate your phone to landscape to view the optimal final results! Thanks 💜 )
Learn WITH prior experience
Learn WITHOUT prior experience
Categorize home menu
result
We received positive feedback!
19% increase in R1 retention rate, 35% shortened amount of time to reach AHA moment
learning
Metrics alone are not enough for UX
UX focuses on "observational inference"
In the beginning, I assumed that learners didn't know how to navigate through the app based on low retention rate and long onboarding time, and I ended up solving a pain point that didn't exist! Fortunately, I have a chance to be in charge of usability testing and user interviewing. Looking at I got to learn this valuable lesson that a high bounce rate could not only mean they found the app "boring" but also because they have happily achieved their goal so fast.
Opposite opinions are valuable!
Fighting the urge to design solutions with my assumptions rather than looking at real data, which yielded opinions opposite to mine, really helps with being more empathetic to users' needs and solving the right problem. It triggers many thought-provoking questions for evaluating all aspects of an app.
How did i grow as a designer:
I have learned to:
Ask the good questions!
Being a lead in user interviews and testing an existing product on the market brought me a valuable skillset as a UX designer, which is “How to ask the correct questions in interviews”. Because it was the first time I interacted with the product’s users, I fell into the pitfall of inadvertently introducing bias during user interviews, potentially skewing the responses and influencing the outcomes of the research. Fortunately, the problem was quickly noted by the PO, and we had a discussion to resolve my problem.
Collaborate with engineers, product owners, and other collegues
The 4 months of working closely with engineers and the product owner were completely different from collaboration at the university. The project's challenges have brought me insights into considering technical constraints while prioritizing tasks and aligning our efforts toward achieving a common goal.