Infrastructure

The VR Centre (IT Service Centre Virtual Reality) as part of the newly built computer centre has two experimental laboratories that are connected to each other by broadband network technology.

The larger of the two rooms is soon to be equipped with a multi-user VR environment such as the so-called CAVEs (cave automatic virtual environment). This is to feature a modular, reconfigurable, high-resolution, stereoscopic floor and 360° panoramic projection video component. In addition, a massive multi-channel loudspeaker system shall be installed in order to be able to realise different spatial audio reproduction methods such as holophonic sound field synthesis (e.g. wave field synthesis, WFS) or reproduction by multi-channel stereophony (e.g. vector-base amplitude panning, VBAP). Reconciling the critical requirements of high quality acoustics with high resolution video formats is a challenge even at the planning stage - often current systems are designed and built with either high video or high audio quality in mind. The new environment will surpass the properties of the current FASP (built in 2006) by several generation levels in terms of performance and visual and acoustic resolution. This will create a new type of flexible CAVE environment at the TU Ilmenau that corresponds to the current state of the art and enables the university to address current and future-oriented research questions. Due to its comparatively simple construction, the large room can also be easily configured for audio and video playback using head-mounted displays (HMDs) for single or multiple people.

In the smaller room of the VR centre, a free AR/VR/MR experimental area was created. The video presentation takes place here by means of one or more HMDs. For the acoustic reproduction, a massive multi-channel loudspeaker system was implemented here. Due to the tracking technology available in both rooms, headphone-based audio reproduction methods can also be used in a simple way, such as dynamic binaural synthesis. With the use of an HMD for video playback and speaker-based audio playback, problems of limited externalisation of perceived audio objects can be circumvented with headphone-based methods. By networking both rooms and other laboratories on the campus of the TU Ilmenau, various types of interactive multi-user applications can be realised.

In 2017, the ML2 was expanded by high-resolution cinematographic camera systems (4k, High-Dynamic Range) together with a mirror rig for 3D video recordings and a motion tracking system as part of an infrastructure project acquired by the FG Electronic Media Technology (EMT) from the Free State of Thuringia (via Thüringer Aufbaubank TAB). In addition, the existing part of the ML2, which is designed as a virtual studio, will be upgraded to state-of-the-art technology in the future. In cooperation between the IMT and the Competence Center Virtual Reality (KVR), a replacement of the tracking technology of the existing virtual studio by the newly acquired motion tracking system has already been tested. In the future, these activities are to be supplemented by replacing the "Blueroom" with a "Greenroom" and a modular extension to a "Greenroom Cube". In such a virtual studio, so-called volumetric 3D recordings of objects and persons can then be made (see explanations earlier in the text). For this purpose, several additional cameras as well as corresponding lighting technology are to be procured in order to record different perspectives and thus generate realistic volumetric 3D models of the recorded objects.

For AR/VR/MR-specific productions as well as for more classic film and video formats with immersive recording technology such as 4k/UHD and High-Dynamic Range (HDR), the ML2 is to be equipped with up-to-date IP-based studio technology. In addition, it shall also be possible to record metadata during media production. For this purpose, the existing tracking technology is to be supplemented and an appropriate IT infrastructure for data analysis is to be procured, including the use of machine learning and artificial intelligence methods. As outlined in section 6, funding from public and university funds is to be flanked here by a longer-term development concept involving cooperation with companies from the environment of professional media production and IP-based production technology.

further information

The Audio Technology Lab meets the high requirements of the International Telecommunication Union specification ITU-R BS.1116. The listening lab was expanded by financial means of an acquired infrastructure project to include 22.2-channel loudspeaker-based audio reproduction as well as a freely configurable suspension of the loudspeakers. The free arrangement allows the setup of all common current loudspeaker arrangements for home applications up to professional cinema arrangements. Furthermore, any arrangement (e.g. ring, area, single positions) is possible for the needs of different experiments and research work. An additional professional video projection (4k, High-Dynamic Range) allows basic multimodal investigations in combination with spatial audio and video. Furthermore, microphones for spatial recording of audio signals were procured, which enable suitable signal generation for multi-channel loudspeaker arrangements as well as for spatial playback via headphones.

further information

The AVT-Lab was created in the course of Prof. Raake's appointment at the TU Ilmenau by converting existing laboratory rooms of the Department of Audiovisual Technology (FG AVT). It consists of three test rooms for performing measurements and subject tests on voice communication, teleconferencing and telemeeting use, and video quality assessment including audio playback. The three test rooms can be interconnected to perform multi-person communication tests. The rooms meet the requirements of relevant ITU standards such as BT.500, BT.2022, P.800, P.910, P.911, P.913, P.917 and P.920 acoustically and with regard to their equipment with appropriate light-grey walling and 6500 K lighting. Within the framework of ZIXR, these rooms will be integrated into the overall networked system.

further information

Complementary to the VR lab currently under construction at the University Computing Center, the XR-Lab offers possibilities for empirical research of smaller AR/VR/MR systems, such as driving simulations for the investigation of novel mobility concepts like autonomous driving. Using these lab spaces, it is also possible to study interactive telepresence systems where different subjects can be in different locations.

further information

In the premises of the former Competence Center Virtual Reality, the OpenI3TC-sensor Lab is currently being established, complementing the other laboratory facilities of the I3TC. In particular, additional possibilities are created to investigate immersive media and sensor technologies as well as their use and evaluation in the context of so-called Productive Teaming between humans and machines in an industrial production context. To this end, a range of non-contact and touch-based sensor technologies will be used, including electroencephalography (EEG), bioimpedance measurement, physiological force measurement, direct tactile input methods, motion capture for hyperscanning, real-time multimodal cameras, and audio systems. In addition, the OpenI3TC-sensor Lab will also provide the opportunity to look at special production technologies and human-machine systems for the application of welding.

The OpenI3TC-sensor Lab is also part of the CHIM network as a cooperation of the TU Ilmenau with the Chemnitz University of Technology and the Otto-von-Guericke-University Magdeburg.

Media Lab 1 is a professional audio recording studio. The previous Media Lab 1 of the Institute for Media Technology had to be demolished as part of the renovation measures at the Oeconomicum (building of the campus of the TU Ilmenau). It is currently unclear in which room of the TU Ilmenau this recording studio will be rebuilt. An alternative solution is currently being sought together with the Department of Buildings and Technology. In the new Media Lab 1, high-quality sound recordings, audio and music productions should be able to be made as before.