How to use the application?
- 2 computers on same network
- The VR Computer (the server):
- one computer with VR headset Equipment (HTC Vive or Vive pro recommended) - see https://www.vive.com/eu/support/vive-pro-hmd/category_howto/what-are-the-system-requirements.html and https://wiki.unrealengine.com/Recommended_Hardware
- role: immerse the teacher in the virtual classroom
- The Desktop Computer (the client): -one computer with normal keyboard and screen (see Unreal Engine Minimum requirement https://wiki.unrealengine.com/Recommended_Hardware) -role: let the instructor controlling in the virtual classroom (i.e. behaviour of the virtual pupils=
- The VR Computer (the server):
- Clone/Download the repository
- Unzip on the two machines
- Start the application on two computers
- Computer with HMD: Teacher - start the program: BBB8project.exe
- Computer without HMD: Instructor start the program: BBB8project.exe
Within the main menu you should start the Teacher-Computer by clicking the button: "Start as Teacher (VR)". After creating the game, the second computer could join this session by clicking "Start as Instructor".
If the connection is not possible and you got the message "Couldn't find any session", you should check your firewall settings. For example the Windows Firewall. Search for "Allow an app through Windows Firewall" in your Windows Search bar. Open this application and permit your application for at least domain network. If this is still not working, open the "Advanced Settings" and click on "Inbound Rules". Remove all entries for your application and try again.
This picture shows the Main Menu of Breaking Bad Behaviours. The user on the figure select "Start as Teacher (VR)" for starting up the application server.
Lobby Menu (Instructor)
After a successful connection, the "Instructor Lobby Menu" is shown on the Instructor-Computer. Within this menu, the Instructor defines the target configuration. As the last step, the instructor clicks on the button "Ready?" and the application will start the selected classroom map.
The teacher is using a Head-Mounted display (e.g. HTC Vive) with the according HTC Vive MotionControllers. The controller is visualized by an abstract hand, which is able to execute the following interactions:
- Both Controllers: Grab objects (Trigger Button, Figure: Button 1)
- Right Controller: Activate Laser pointer and point forward with your forefinger (Thumb Button, Figure: Button 2)
- Left Controller: Point forward with your forefinger (Thumb Button, Figure: Button 2)
The instructor is sitting in front of the desktop and controls the application by an user-interface. The interface consists of several functionalities, which are numbered on the figure.
Number 1: Calibrates the forward direction and position of the teacher. As described by the hover menu, please put the HMD to the ground pointing in the target looking direction. Afterwards, press the "Calibrate Teacher" button to run the calibration process.
Number 2: By clicking with the left mouse button on a student, a radial menu will be opened. This menu contains several interactions for the student, which could be triggered by the Instructor. It is separated in the degree of bad behaviours (Low, Medium, High) and available dialogues, which could be played.
Number 3: This button gives the Instructor the ability to play a positive rewarding sound or a negative sound, which should indicate a bad reaction of the current Teacher within the simulation
Number 4: This configuration menu offers the functionality to switch the current Instructor camera view, shows the current level of behaviour), resets all interactions of the student, force students to write down notes and to control the overall bad behaviours by the slider.
Number 5: This menu controls the audio volume of the Teacher. The additional button "T" plays a demo sound on the teacher sound device.