Meeting Key Engagement Metrics

Results indicate that, on average, 71.3% of learners (averaged across all 12 questions) feel engaged after experiencing their first VR lesson in the Immerse app.

Results indicate that, on average, 78.9% of learners (averaged across all 12 questions) feel engaged after experiencing their last VR lesson in the Immerse app.

The results paired-sample t-tests show from the pre-test (M = 42.1, SD = 3.91) and post-test (M = 45.6, SD = 4.18) on users’ level of engagement indicate that their was a statistically significant increase in user engagement after four weeks, t(10) = 12.1, p < 0.001.

In summary, we found an 8.1% mean increase in users’ engagement after using the Immerse app to learn Spanish for four weeks. This finding was statistically significant and indicates that users feel engaged while learning Spanish on the VR platform. 

After analyzing the open-ended questions and focus group data, we coded each of the user responses and categorized each code into overarching themes. After sorting our data, we took a deductive approach when looking at the qualitative results to explain potential reasonings for our quantitative findings. Below is an excerpt of the user commentaries.

From these commentaries, we see that users were raving about their engagement, interactions, and learning. The overarching trend gleaned from student responses was the instructor’s lesson facilitation skills. Users found her teaching to be charismatic, encouraging, supportive, and balanced. She was personable and conversational which I suspect lowered students’ pressure/ affect and found it easy to relate. Additionally, the alignment of the lesson with the activities really boosted students engagement. Specifically, the self-exploration, partnering, matching, and the pictionary at the end. The game at the end seemed to be a big highlight because it felt like it was real-life and students were synthesizing all they learned from the lesson. 

The data revealed an NPS Score of 88%, where 88% of users “would likely recommend this VR learning experience to a friend or colleague.”

 To better understand this NPS score, we looked at what users were saying:

“I think I would recommend this. The possibilities are endless with VR learning and I think Immerse is a great example of the great things VR can be used for.”

“I absolutely would share this with my friends and I personally want to continue using VR. I think there is a real market in the retirement community for language learning and many other activities. Friends posted on facebook that they were trying to use it for travel experiences and desperately wanted some help. They want to get together soon to talk about how we can use it.”

“I probably will recommend my friends to try VR for learning in the future. but maybe after I have some basic knowledge of VR. I think being completely immersed in a virtual environment is terrifying for a beginner.”

Based on user responses, a majority of users would highly recommend the Immerse app. We found that users resonated with the app for language learning, but also identified other potential markets and use cases where the platform might thrive. From language learners to travel enthusiasts or even a retirement community, our users are feeling excited about the potential of the Immerse app. Capturing the customer experience through an NPS measure allowed us to benchmark where the Immerse app is currently situated with our users and provides a metric for how we might continue future iterations.

The data revealed an CSAT Score of 91.2%, where 91.2% of users “felt satisfied with the Immerse VR app.”

To better understand this CSAT score, we looked at what users were saying:

“Overall, I am very satisfied with the learning interface because the activities are fun and are well-designed for integrating the VR functions with the learning content.”

“Overall I like the VR learning interface. It feels welcoming. Everything so far as felt very simple and easy to navigate once you play around with it and I enjoy the variety of immersive activities in the settings and the different layouts we are able to interact with.”

“The design is very simple and straight forward and is not distracting while learning. Some of it can be a bit overstimulating, but you get used to it as you use it. Some of the controls were hard to grasp at first but become more natural as more time is spent in the platform and in VR in general.”

Upon analyzing CSAT score, we discovered that a majority of users were quite satisfied with the Immerse app after four weeks. We infer that one of the primary reasons for such a high rating was the content/activities and 3D interactions alignment. Gleaning user responses, we can see that users felt very satisfied with the interactive activities they were engaged in and how the design of these activities sustained their interest. Capturing a CSAT provided us with a snapshot of what our users currently think about our product and analyzing the open-ended responses and focus group transcript validated our product for launch.