Project Immersive Recordings for Game Design in Social Virtual Reality

Project Immersive Recordings for Game Design in Social Virtual Reality

Prof. Dr. Bernd Fröhlich
M.Sc. Anton Lammert
M.Sc. Gareth Rendle
M.Sc. Adrian Kreskowski

DegreeStudy ProgrammeExamination RegulationsECTS
M.Sc.Computer Science for 
Digital Media
PV18 and lower15
M.Sc.Computer Science for
Digital Media
PV2012
M.Sc.Computer Science and Mediaall15
M.Sc.Human-Computer InteractionPV17 and lower15
M.Sc.Human-Computer InteractionPV1912/18

Motivation

Traditional 2D video content is widely used for purposes such as entertainment, knowledge transfer, and communication. Despite the broad range of applications and numerous advantages offered by 2D video recordings, there is a limitation that recorded scenes cannot be viewed from arbitrary perspectives. In contrast, immersive recordings, which capture events and interactions in virtual environments, provide the viewer with the opportunity to explore recorded interactions both temporally and spatially and change the actual scenario and events in the recording. For the creation and playback of immersive recordings within immersive VR, we have developed a recording studio.

The goal of this project is to identify the most suitable tools for using immersive recordings for game design in social virtual reality. 
Our project will include the design of a recording-based VR game, an analysis of existing techniques for editing 2D videos as well as the development and implementation of novel tools that address the following research questions among others:

  • How can immersive recordings be altered e.g. to change the path of an object or the position of avatars?
  • How to remove a part of the recording and insert a cut instead?
  • Which techniques are necessary to manage such transitions in immersive recordings and ensure comprehensibility for the viewer? 

Your project work contributes to the evolution of our immersive recording studio and helps to increase the relevance of immersive analytics tools for the virtual reality research and content creation community. 

Hardware

You will gain 24/7 access to our well-equipped lab at Schwanseestraße 143. Should pandemic counter measures limit the accessibility of our infrastructure, we will in all cases supply you with state-of-the-art hardware and boost your journey into immersive virtual worlds.

For the duration of the project, each participant will be supplied with an Oculus Quest 2 HMD. If necessary, we will also hand out desktop workstations to meet any additional hardware requirements, which your own machine cannot handle.

Apart from deploying your applications using this hardware, we strongly encourage you to explore related VR applications in the wild!

Requirements

As well as willingness to work in a team, and enthusiasm for learning about multi-user VR application development, you should have the following competencies:

  • solid programming / scripting skills (C#, C++, Python or similar)
  • affinity for VR and games

Additional advantages are experience in:

  • Unity3D development
  • 3D modelling
  • social VR development

If you are in doubt as to whether you fulfil the requirements, or if you have any further questions regarding the project, we are happy to have a discussion with you at the project fair on 3rd of April.

Assessment

The final assessment of your work will be conducted based on the project contributions of every team member, including:

  • Quality and innovation of your practical results
  • Active participation in the project during and in between weekly meetings
  • Intermediate and final project presentations
  • Documentation

If you are interested in social virtual reality and want to dive deeper into the design and development of a game based on immersive recordings - join us!