Audiovisual Feedback to Augmented Manual Activities During Space Walks

In space, it is silent and there is no acoustic feedback. However, such feedback has a major impact on the quality of work in space. Precise audiovisual feedback can ensure that tasks are performed optimally, for example when using a tool or disconnecting a cable. In this project, we will support working in the silence of space using an augmented reality (AR) auditory and visual feedback system. Astronauts can use the system during their spacewalks. It then outputs realistic synthetic sounds according to the current task or activity. The astronaut will also be supported by visual elements to provide the highest level of feedback possible. The system will enhance activities in space through audio-visual feedback. The addition of audio provides confirmation to the astronauts during the activity, which can lead to a more natural and precise execution of the task. The visual aspect additionally provides visual confirmation during the work, displays additional information, and can guide the astronaut step-by-step through the process.

The project is a collaborative effort between the VWDS department and the Electronic Media Technology (EMT) department and is funded by the European Space Agency (ESA).