TU Ilmenau | Eckhardt Schön

Research objective

Our overarching research objective is to investigate the relationship between technical system properties and human perception and individual experience. This is done on the one hand through physical measurements of audiovisual media and on the other hand through the evaluation of the perception of these media.

 

The department is part of the Chemnitz-Ilmenau-Magdeburg Research and Innovation Network (CHIM).

End-to-end communication [according to Raake & Spors 2006, Spors et al., Proc. IEEE 2013]

Research profile

Our research looks at the entire chain from production, processing, transmission and presentation through to perception and personal experience. Voice, audio and video systems and services are examined. Particular attention is paid to the convergence of media in IP-based networks with regard to higher-quality multimedia services.

Research areas

Our research activities are divided into five subject areas:

  • Audiovisual Virtual Reality (VR) and Augmented Reality (AR): Here the focus is on the evaluation of current technologies in the field of virtual and augmented reality (VR and AR). This is done, among other things, by examining the reception of 3D video and spatial audio.
  • Communication and interactive systems: The focus here is on the evaluation of communication systems with a particular emphasis on highly interactive systems for video conferencing and telemeetings.
  • Evaluation of IP-based applications: This topic area deals with the evaluation of applications and services in the field of information and entertainment whose content is obtained via the Internet and displayed in a web browser or via TV. On the technical side, the influence of the various layers of the Internet protocol suite is examined.
  • Network-based studio technology: The focus of this research is on the evaluation and, in part, the implementation of professional studio technology that is based on an IT network infrastructure. This utilizes the Audio Video Bridging (AVB) standard.
  • Multimedia evaluation methods: The development of evaluation methods for multimedia content is also a subject area of our research. This involves combining methods and approaches from different areas, such as the combination of crowdsourcing and technical measurements.

The five subject areas are dealt with by several subgroups in different projects:

 

ViBe - Video quality and behavior modeling

ViBe is a specialized research subgroup that focuses on improving the understanding of video quality and user behavior in multimedia applications. Our goal is to develop innovative methods and models that ensure superior multimedia experiences in new technologies while exploring the complex relationship between video quality and user behavior.

Head: Rakesh Rao Ramachandra Rao

 

IVM - Image, Video and Machine Learning

The IVM subgroup deals with topics in the field of image and video processing in combination with machine learning. The aim is to evaluate the use of machine learning models and AI generators for visual content, e.g. high-resolution images/videos, 360-degree videos or point clouds as visual representations. Machine learning models can be used to predict quality aspects, e.g. taking into account the latest developments in compression technology. Or AI generators are used to generate content that is evaluated with singal-based features and deep learning models.

Head: Steve Göring