TutoriVR

By: Daniel He, Debbie Yuen, Buyu Zhang

GitHubPaperBehance

Problem and Motivation

Professor Hartmann testing TutoriVR

It is not easy since VR design is a creative process that requires mastery of certain skills. Users may want to learn from tutorials, which are typically 2D screencast videos made from members of the community. However, there are inherent limitations of using these 2D screencast videos as tutorials in VR. 

  • If one wants to learn to VR paint using a video tutorial, they need to stop their painting, and take off their VR headset, to view the tutorial video on their desktop monitor. This makes the user experience inconvenient.
  • It is not clear to what extent users can interpret the spatial nature of 3D VR tasks from a 2D video. 


Currently, there exists only limited solutions for VR users to access a video tutorial directly in VR, making it difficult to learn 3d-painting. 2D videos fall flat in trying to deliver crucial details that are required for the user to understand actions in a VR space.

Design Goals

Based on previous research from the original TutoriVR research paper by Bala Kumaravel, Cuong Nguyen, Stephen DiVerdi, and Bjoern Hartmann, a successful tutorial system may have demands such as the following: 

  • an accessible video player
  • spatio-temporal exploration
  • relative depth perception
  • user awareness of the tutorial instructions

Implementation Details

Recording

We provide a record button for the tutorial authors. When it is activated, it will record/log:

  • The monoscopic view of the VR headset and the app audio.
  • The stereoscopic view which is left-right split that will look like a 3d video when played back in the HMD.
  • Microphone audio.
  • Alert button presses.
  • Controller data - controller poses and controller button interaction - and certain app events for reconstruction of the stroke during viewer mode.

Viewing

Menu Buttons
Menu Buttons include the following: Awareness Widget, Video Player, Perspective Thumbnail.

Awareness Widget
A fixed widget that shows upcoming and past alerts in the timeline so that the user can know if something important is coming up or has passed.

Video Player

  • Basic navigation controls of playing, pausing, volume control, and timeline navigation.
  • Fast forward/backward (+5s/-5s)
  • Alert navigation (skip to previous/next alert)
  • Monoscopic (2D) and left-right stereoscopic (3D) mode

Perspective Thumbnail Widget

Allowing users to better understand stroke structure and controller interactions. Can be rotated 360 degrees around the stroke and zoom in and out.