Univ.-Prof. Dr. Matthias Hirth

TU Ilmenau/E. Schön

Fachgebietsleiter

Kirchhoffbau, Raum K 3005

+49 3677 69-2855
matthias.hirth@tu-ilmenau.de

Sprechzeiten nach Vereinbarung

Publikationsliste

 

0


 

0

 

 

0

 

(

 

 

)

     

    0


     

    0

     

     

    0

     

    (

     

     

    )

      Libreros, Jose Alejandro; Gamboa, Edwin; Henke, Erik; Hirth, Matthias:
      Assessing the influence of feedback strategies on errors in crowdsourced annotation of tumor images
      #!ilm_mods_00075616!#
      In: Big data and cognitive computing, vol. 9 (2025), no. 9, art. 220
      DOI: https://doi.org/10.3390/bdcc9090220
      Mayas, Cindy; Lengkong, Chikita; Krömker, Heidi; Hirth, Matthias:
      Trends in human-computer interaction in mobility for users with special needs – a literature review
      #!ilm_mods_00061248!#
      In: HCI in Mobility, Transport, and Automotive Systems: 7th International Conference, MobiTAS 2025, held as part of the 27th HCI International Conference, HCII 2025, Gothenburg, Sweden, June 22–27, 2025 : proceedings, part I (ISBN 978-3-031-92688-4), (2025), pp. 260–284
      DOI: https://doi.org/10.1007/978-3-031-92689-1_16
      Lengkong, Chikita; Mayas, Cindy; Hirth, Matthias:
      Accessible autonomous vehicles: a human-computer interaction literature review
      #!ilm_mods_00077656!#
      In: CHItaly 2025: proceedings of the 16th Biannual Conference of the Italian SIGCHI Chapter, Salerno, Italy, 6-10 October 2025, (2025), art. 44
      DOI: https://doi.org/10.1145/3750069.3750162
      Mayas, Cindy; Große, Ulrike; Czaska, Ulrike; Krömker, Heidi; Hirth, Matthias:
      Synthese beruflicher Weiterbildung mit informellem Lernen am Beispiel des kooperativen Wissensaustauschs in „MoNet Bildung“
      #!ilm_mods_00078763!#
      In: Wechselspiel von Theorie und Praxis in der Lehre: Wege zu technischer Bildung ; Tagungsband der 18. Ingenieurpädagogischen Jahrestagung 2024 an der Dualen Hochschule Baden-Württemberg, Standort Mosbach, 13.-15.06.2024, (2025), pp. 121–125
      DOI: https://doi.org/10.82321/01dhbw-47m51
      Schlechte, Florian; Farooqi, Yusra Tasnim; Hirth, Matthias:
      Assessing the influence of end-to-end request latency and response length on waiting time satisfaction of LLM users
      #!ilm_mods_00078842!#
      In: 2025 17th International Conference on Quality of Multimedia Experience (QoMEX): Madrid, Spain, 30 September 2025 - 02 October 2025 (ISBN 979-8-3315-5435-4), (2025)
      DOI: https://doi.org/10.1109/QoMEX65720.2025.11219949
      Mayas, Cindy; Steinert, Tobias; Reif, Boris; Krömker, Heidi; Hirth, Matthias:
      Pimp my lab? The impact of context-specific usability laboratory environments in public transport
      #!ilm_mods_00016174!#
      In: HCI in mobility, transport, and automotive systems: 6th International Conference, MobiTAS 2024, held as part of the 26th HCI International Conference, HCII 2024, Washington, DC, USA, June 29–July 4, 2024 : proceedings, part II (ISBN 978-3-031-60480-5), (2024), pp. 183–194
      DOI: https://doi.org/10.1007/978-3-031-60480-5_11
      Lengkong, Chikita Rini; Mayas, Cindy; Krömker, Heidi; Hirth, Matthias:
      The development of human-centered design in public transportation: a literature review
      #!ilm_mods_00016176!#
      In: HCI in mobility, transport, and automotive systems: 6th International Conference, MobiTAS 2024, held as part of the 26th HCI International Conference, HCII 2024, Washington, DC, USA, June 29–July 4, 2024 : proceedings, part II (ISBN 978-3-031-60480-5), (2024), pp. 40–62
      DOI: https://doi.org/10.1007/978-3-031-60480-5_3
      Mayas, Cindy; Libreros Montano, Jose Alejandro; Krömker, Heidi; Hirth, Matthias:
      Akzeptanz von Empfehlungssystemen für die berufliche Bildung
      #!ilm_mods_00020308!#
      In: Herausforderungen zeitgemässer Technikbildung im akademischen und berufsbildenden Sektor: Wege zu technischer Bildung : Referate der 17. Ingenieurpädagogischen Regionaltagung 2023 an der Technischen Universität Dresden und der Hochschule für Technik und Wirtschaft Dresden 15.-17. Juni 2023 (ISBN 978-3-9818728-7-3), (2024), pp. 259–264
      Jenadeleh, Mohsen; Heß, Alexander; Del Pin, Simon Hviid; Gamboa, Edwin; Hirth, Matthias; Saupe, Dietmar:
      Impact of feedback on crowdsourced visual quality assessment with paired comparisons
      #!ilm_mods_00018498!#
      In: 2024 16th International Conference on Quality of Multimedia Experience (QoMEX): 18-20 June 2024 in Karlshamn, Sweden (ISBN 979-8-3503-6158-2), (2024), pp. 125–131
      DOI: https://doi.org/10.1109/QoMEX61742.2024.10598256
      Libreros, Jose Alejandro; Shafiq, Muhammad Hamza; Gamboa, Edwin; Cleven, Martin; Hirth, Matthias:
      Visual transformers meet convolutional neural networks: providing context for convolution layers in semantic segmentation of remote sensing Photovoltaic Imaging
      #!ilm_mods_00019206!#
      In: Big data analytics and knowledge discovery: 26th international conference, DaWaK 2024, Naples, Italy, August 26-28, 2024 : proceedings (ISBN 978-3-031-68322-0), (2024), pp. 359–366
      DOI: https://doi.org/10.1007/978-3-031-68323-7_31
      Libreros, Jose; Gamboa, Edwin; Hirth, Matthias:
      Mistakes hold the key: reducing errors in a crowdsourced tumor annotation task by optimizing the training strategy
      #!ilm_mods_00014095!#
      In: Human-computer interaction: 9th Iberoamerican Workshop, HCI-COLLAB 2023, Buenos Aires, Argentina, September 13-15, 2023 : revised selected papers (ISBN 978-3-031-57983-7), (2024), pp. 210–224
      DOI: https://doi.org/10.1007/978-3-031-57982-0_17
      Ascheid, David; Baumann, Magdalena; Pinnecker, Jürgen; Friedrich, Mike; Szi-Marton, Daniel [et al.]:
      A vascularized breast cancer spheroid platform for the ranked evaluation of tumor microenvironment-targeted drugs by light sheet fluorescence microscopy
      #!ilm_mods_00014305!#
      In: Nature communications, vol. 15 (2024), art. 3599
      DOI: https://doi.org/10.1038/s41467-024-48010-z
      Reif, Boris A.; Schluifer, Karin; Mayas, Cindy; Hirth, Matthias:
      Analysis of gamification elements in e-learning
      #!ilm_mods_00016316!#
      In: Learning and collaboration technologies: 11th International Conference, LCT 2024, held as part of the 26th HCI International Conference, HCII 2024, Washington, DC, USA, June 29–July 4, 2024 : proceedings, part II (ISBN 978-3-031-61685-3), (2024), pp. 94–112
      DOI: https://doi.org/10.1007/978-3-031-61685-3_8
      Mayas, Cindy; Sheibani, Rozita; Hirth, Matthias:
      Expectations of emergency communication systems in autonomous bus shuttles
      #!ilm_mods_00030634!#
      In: Human factors in design, engineering, and computing: proceedings of the AHFE International Conference on Human Factors in Design, Engineering and Computing (AHFE 2024 Hawaii Edition), Honolulu, Hawaii, USA, 8-10, December 2024 (ISBN 978-1-964867-35-9), (2024), pp. 2118–2126
      DOI: https://doi.org/10.54941/ahfe1005780
      Laitenberger, Ulrich; Viete, Steffen; Slivko, Olga; Kummer, Michael E.; Borchert, Kathrin; Hirth, Matthias:
      Unemployment and online labor: evidence from microtasking
      #!ilm_mods_00008592!#
      In: MIS quarterly, vol. 47 (2023), no. 2, pp. 771–802
      DOI: https://doi.org/10.25300/MISQ/2022/17347
      Gamboa, Edwin; Libreros, Alejandro; Hirth, Matthias; Dubiner, Dan:
      Human-AI collaboration for improving the identification of cars for autonomous driving
      #!ilm_mods_00002040!#
      In: CIKM-WS 2022: proceedings of the CIKM 2022 workshops, co-located with 31st ACM International Conference on Information and Knowledge Management (CIKM 2022), Atlanta, USA, October 17-21, 2022, vol. 3318 (2023)
      [ACM CIKM Workshop Human-In-The-Loop Data Curation (HIL-DC) (Atlanta, Ga.; Online, 22.10.2022))]
      DOI: https://doi.org/10.22032/dbt.64547
      Mayas, Cindy; Steinert, Tobias; Krömker, Heidi; Kohlhoff, Fabia; Hirth, Matthias:
      Challenges of operators for autonomous shuttles
      #!ilm_mods_00006430!#
      In: HCI in mobility, transport, and automotive systems: 5th International Conference, MobiTAS 2023, held as part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23-28, 2023 : proceedings, part I (ISBN 978-3-031-35677-3), (2023), pp. 334–346
      DOI: https://doi.org/10.1007/978-3-031-35678-0_22
      Libreros, Jose Alejandro; Mayas, Cindy; Hirth, Matthias:
      Recommender systems in continuing professional education for public transport: challenges of a human-centered design
      #!ilm_mods_00005667!#
      In: Adjunct proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization: 26-30 June, 2023 Limassol, Cyprus (ISBN 978-1-4503-9891-6), (2023), pp. 331–336
      DOI: https://doi.org/10.1145/3563359.3596995
      Große, Ulrike; Krömker, Heidi; Hirth, Matthias; Steinert, Tobias; Menke, Stefanie; Radermacher, Berthold:
      Methoden zur Individualisierung der Auswahl von Beruflicher Bildung - Fallstudie öffentlicher Verkehr
      #!ilm_mods_00006732!#
      In: Technische Bildung für eine Nachhaltige Entwicklung: Wege zu technischer Bildung, Referate der 16. Ingenieurpädagogischen Regionaltagung 2022 (ISBN 3-9818728-6-X), (2023), pp. 207–214
      Gamboa, Edwin; Naderi, Babak; Hirth, Matthias; Möller, Sebastian:
      Evaluating the robustness of speech evaluation standards for the crowd
      #!ilm_mods_00001341!#
      In: 2022 14th International Conference on Quality of Multimedia Experience (QoMEX): Lippstadt, Germany, 5-7 September 2022 (ISBN 978-1-6654-8795-5), (2022)
      DOI: https://doi.org/10.1109/QoMEX55416.2022.9900894
      Gamboa, Edwin; Bauer, Mathias; Reham Khawaja, Muhammad; Hirth, Matthias:
      Rather multifaceted than disruptors: exploring gamification user types of crowdworkers
      #!ilm_mods_00001476!#
      In: Human factors in virtual environments and game design: proceedings of 13th AHFE International Conference on Human Factors in Virtual Environments and Game Design, New York, USA, July 24-28, 2022vironments and Game Design, New York, USA, July 24-28, 2022 (ISBN 978-1-958651-26-1), (2022), pp. 125–133
      DOI: https://doi.org/10.54941/ahfe1002069
      Steinert, Tobias; Große, Ulrike; Krömker, Heidi; Hirth, Matthias:
      Mobility Data Stories
      #!ilm_mods_00002017!#
      In: Der Nahverkehr: öffentlicher Personenverkehr in Stadt und Region ; offizielles Organ des Verbandes Deutscher Verkehrsunternehmen (VDV), vol. 40 (2022), no. 9, pp. 82–85
      URL: http://www.bibliothek.uni-regensburg.de/ezeit/?2911511
      Metzger, Florian; Stulier, Norman; Borchert, Kathrin; Hirth, Matthias:
      Relationship status: it’s complicated. Using APM as a QoE-qualifying tempo metric
      #!ilm_mods_00009441!#
      In: 2021 13th International Conference on Quality of Multimedia Experience (QoMEX): virtual conference 13-17 June 2021 (ISBN 978-1-6654-1183-7), (2021), pp. 145–150
      DOI: https://doi.org/10.1109/QoMEX51781.2021.9465396
      Kunz, Felix; Hirth, Matthias; Schweitzer, Tilmann; Linz, Christian; Goetz, Bernhard; Stellzig-Eisenhauer, Angelika; Borchert, Kathrin; Böhm, Hartmut:
      Subjective perception of craniofacial growth asymmetries in patients with deformational plagiocephaly
      #!ilm_mods_00002754!#
      In: Clinical oral investigations, vol. 25 (2021), no. 2, pp. 525–537
      DOI: https://doi.org/10.1007/s00784-020-03417-y
      Hirth, Matthias; Seufert, Michael; Lange, Stanislav; Meixner, Markus; Tran-Gia, Phuoc:
      Performance evaluation of hybrid crowdsensing and fixed sensor systems for event detection in urban environments
      #!ilm_mods_00007683!#
      In: Sensors, vol. 21 (2021), no. 17, art. 5880
      DOI: https://doi.org/10.3390/s21175880
      Zepernick, Hans-Jürgen; Pieper, Kerstin; Spang, Robert P.; Engelke, Ulrich; Hirth, Matthias; Naderi, Babak:
      On the impact of COVID-19 on subjective digital media quality assessment
      #!ilm_mods_00008748!#
      In: IEEE 23rd International Workshop on Multimedia Signal Processing: hybrid conference in Tampere, Finland, October 06-08, 2021 : IEEE MMSP 2021 (ISBN 978-1-6654-3289-4), (2021), pp. 1–6
      DOI: https://doi.org/10.1109/MMSP53017.2021.9733583
      Gamboa, Edwin; Galda, Rahul; Mayas, Cindy; Hirth, Matthias:
      The crowd thinks aloud: crowdsourcing usability testing with the thinking aloud method
      #!ilm_mods_00009139!#
      In: HCI International 2021 - late breaking papers: Design and user experience : 23rd HCI International Conference, HCII 2021, virtual event, July 24-29, 2021 : proceedings (ISBN 978-3-030-90237-7), (2021), pp. 24–39
      DOI: https://doi.org/10.1007/978-3-030-90238-4_3
      Göritz, Anja; Borchert, Kathrin; Hirth, Matthias:
      Using attention testing to select crowdsourced workers and research participants
      #!ilm_mods_00006021!#
      In: Social science computer review: SSCORE, vol. 39 (2021), no. 1, pp. 84–104
      DOI: https://doi.org/10.1177/0894439319848726
      Hirth, Matthias; Borchert, Kathrin; De Moor, Katrien; Borst, Vanessa; Hoßfeld, Tobias:
      Personal task design preferences of crowdworkers
      #!ilm_mods_00010662!#
      In: 2020 Twelfth International Conference on Quality of Multimedia Experience (Qomex): May 26-28, 2020, virtual conference (ISBN 978-1-7281-5964-5), (2020), art. 9123094
      DOI: https://doi.org/10.1109/QoMEX48832.2020.9123094
      Naderi, Babak; Hoßfeld, Tobias; Hirth, Matthias; Metzger, Florian; Möller, Sebastian; Zequeira Jiménez, Rafael:
      Impact of the number of votes on the reliability and validity of subjective speech quality assessment in the crowdsourcing approach
      #!ilm_mods_00010663!#
      In: 2020 Twelfth International Conference on Quality of Multimedia Experience (Qomex): May 26-28, 2020, virtual conference (ISBN 978-1-7281-5964-5), (2020), art. 9123115
      DOI: https://doi.org/10.1109/QoMEX48832.2020.9123115
      Naderi, Babak; Zequeira Jiménez, Rafael; Hirth, Matthias; Möller, Sebastian; Metzger, Florian; Hoßfeld, Tobias:
      Towards speech quality assessment using a crowdsourcing approach: evaluation of standardized methods
      #!ilm_mods_00010617!#
      In: Quality and user experience, vol. 6 (2020), no. 1, art. 2
      DOI: https://doi.org/10.1007/s41233-020-00042-1
      Borchert, Kathrin; Seufert, Anica; Gamboa, Edwin; Hirth, Matthias; Hoßfeld, Tobias:
      In vitro vs in vivo: does the study’s interface design influence crowdsourced video QoE?
      #!ilm_mods_00010616!#
      In: Quality and user experience, vol. 6 (2020), no. 1, art. 1
      DOI: https://doi.org/10.1007/s41233-020-00041-2
      Borchert, Kathrin; Hirth, Matthias; Stellzig-Eisenhauer, Angelika; Kunz, Felix:
      Correction to: Crowd-Based Assessment of Deformational Cranial Asymmetries
      #!ilm_mods_00001993!#
      In: Digital transformation for a sustainable society in the 21st century: I3E 2019 IFIP WG 6.11 International Workshops, Trondheim, Norway, September 18-20, 2019 : revised selected papers (ISBN 978-3-030-39634-3), (2020), pp. C1–C4
      DOI: https://doi.org/10.1007/978-3-030-39634-3_16
      Borchert, Kathrin; Hirth, Matthias; Stellzig-Eisenhauer, Angelika; Kunz, Felix:
      Crowd-based assessment of deformational cranial asymmetries
      #!ilm_mods_00001999!#
      In: Digital transformation for a sustainable society in the 21st century: I3E 2019 IFIP WG 6.11 International Workshops, Trondheim, Norway, September 18-20, 2019 : revised selected papers (ISBN 978-3-030-39634-3), (2020), pp. 145–157
      DOI: https://doi.org/10.1007/978-3-030-39634-3_13
      Ørting, Silas Nyboe; Doyle, Andrew; Hilten, Arno van; Hirth, Matthias; Inel, Oana; Madan, Christopher R.; Mavridis, Panagiotis; Spiers, Helen; Cheplygina, Veronika:
      A survey of crowdsourcing in medical image analysis
      #!ilm_mods_00010761!#
      In: Human computation: a transdisciplinary journal, vol. 7 (2020), no. 1, pp. 1–26
      DOI: https://doi.org/10.15346/hc.v7i1.1
      Hirth, Matthias; Steurer, Florian; Borchert, Kathrin; Dubiner, Dan:
      Task scheduling on crowdsourcing platforms for enabling completion time SLAs
      #!ilm_mods_00016771!#
      In: Proceedings of the 31th International Teletraffic Congress: ITC 31 : ITC 31 in Budapest, 27-29 August 2019, University of Budapest, Hungary (ISBN 978-1-72812-513-8), (2019), pp. 117–118
      DOI: https://doi.org/10.1109/ITC31.2019.00026
      Hirth, Matthias; Borchert, Kathrin; Allendorf, Fabian; Metzger, Florian; Hoßfeld, Tobias:
      Crowd-based study of gameplay impairments and player performance in DOTA 2
      #!ilm_mods_00016783!#
      In: Internet-QoE ’19: proceedings of the 4th Internet-QoE Workshop: QoE-based Analysis and Management of Data Communication Networks : October 21, 2019, Los Cabos, Mexico (ISBN 978-1-4503-6927-5), (2019), pp. 19–24
      DOI: https://doi.org/10.1145/3349611.3355545
      Lebreton, Pierre; Hupont, Isabelle; Hirth, Matthias; Mäki, Toni; Skodras, Evangelos; Schubert, Anton; Raake, Alexander:
      CrowdWatcher: an open-source platform to catch the eye of the crowd
      #!ilm_mods_00012268!#
      In: Quality and user experience, vol. 4 (2019), no. 1, art. 1
      DOI: https://doi.org/10.1007/s41233-019-0024-6
      Borchert, Kathrin; Schwind, Anika; Hirth, Matthias; Hoßfeld, Tobias:
      In vivo or in vitro?: influence of the study design on crowdsourced video QoE
      #!ilm_mods_00016559!#
      In: 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX): June 5-7, 2019, Berlin, Germany (ISBN 978-1-5386-8213-5), (2019)
      DOI: https://doi.org/10.1109/QoMEX.2019.8743317

      Publikationen

      Books and Book Chapters

      [B2] M. Hirth, J. Jacques, P. Rodgers, O. Scekic, and M. Wybrow, “Crowdsourcing Technology to Support Academic Research”, in Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments, Springer, 2017.

      [B1] S. Egger-Lampl, J. Redi, T. Hoßfeld, M. Hirth, S. Möller, B. Naderi, C. Keimel, and D. Saupe, “Crowdsourcing Quality of Experience Experiments”, in Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments, Springer, 2017.

      Journal Articles

      [J16] M. Hirth, M. Seufert, S. Lange, M. Meixner, and P. Tran-Gia "Performance Evaluation of Hybrid Crowdsensing and Fixed Sensor Systems for Event Detection in Urban Environments"? Sensors, vol. 21, Issue 17., 2021 Article

      [J15] F. Kunz, M. Hirth, T. Schweitzer, C. Linz, B. Goetz, A. Stellzig-Eisenhauer, K. Borchert, and H. Böhm, "Subjective Perception of Craniofacial Growth Asymmetries in Patients with Deformational Plagiocephaly", Clinical Oral Investigations, 2021. Article

      [J14] S. Ørting, A. Doyle, A. van Hilten, M. Hirth, O. Inel, C. Madan, P. Mavridis, H. Spiers, and V. Cheplygina "A Survey of Crowdsourcing in Medical Image Analysis", Human Computation, vol. 7, issue 1, 2020. Article

      [J13] B. Naderi, R. Zequeira Jiménez, M. Hirth, S. Möller, F. Metzger, and T.  Hoßfeld, "Towards Speech Quality Assessment Using a Crowdsourcing Approach: Evaluation of Standardized Methods"? Quality and User Experience, vol. 6, number 2., 2020 E-Print

      [J12] K. Borchert, A. Seufert, E. Gamboa, M. Hirth, and T.  Hoßfeld, "In vitro vs in vivo: does the study’s interface design influence crowdsourced video QoE"? Quality and User Experience, vol. 6, number 1., 2020 E-Print

      [J11] A. Görtiz, K. Borchert, and M. Hirth, “Using Attention Testing to Select Crowdsourced Workers and Research Participants”, Social Science Computer Review, Jun. 2019. E-Print

      [J10] P. Lebreton, I. Hupont, M. Hirth, T. Mäki, E. Skodras, A. Schubert, and A. Raake, “CrowdWatcher: An Open-source Platform to Catch the Eye of the Crowd”, Quality and User Experience, vol.4, Mar. 2019. Author version

      [J9] A. Schütz, T. Fertig, K. Weber, H. Vu, M. Hirth, and T. Tran-Gia, “Vertrauen ist gut, Blockchain ist besser–Einsatzmöglichkeiten von Blockchain für Vertrauensprobleme im Crowdsourcing”, HMD Praxis der Wirtschaftsinformatik 55 (6), Oct. 2018. Author version

      [J8]  M. Hirth, T. Hoßfeld, M. Mellia, C. Schwartz, and F. Lehrieder, “Crowd-sourced Network Measurements: Benefits and Best Practices”, Computer Networks, vol. 90, Special Issue on Crowdsourcing Oct. 2015. Author version

      [J7]  T. Hoßfeld, V. Burger, H. Hinrichsen, M. Hirth, and P. Tran-Gia, “On the Computation of Entropy Production in Stationary Social Networks”, Social Network Analysis and Mining, vol. 4, Apr. 2014. Author version

      [J6]  T. Hossfeld, C. Keimel, M. Hirth, B. Gardlo, J. Habigt, K. Diepold, and P. Tran-Gia, “Best Practices for QoE Crowdtesting: QoE Assessment with Crowdsourcing”, Transactions on Multimedia, vol. 16, no. 2, Feb. 2014. Author version

      [J5]  T. Hoßfeld, M. Hirth, and P. Tran-Gia, “Crowdsourcing - Modell einer neuen Arbeitswelt im Internet”, Wirtschaftsinformatik & Management, vol. 5, Oct. 2013. Author version

      [J4]  P. Tran-Gia, T. Hoßfeld, M. Hartmann, and M. Hirth, “Crowdsourcing and its Impact on Future Internet Usage”, IT - Information Technology, vol. 55, no. 4, Jul. 2013. Author version

      [J3]  T. Hoßfeld, M. Hirth, and P. Tran-Gia, “Aktuelles Schlagwort: Crowdsourcing”, Informatik Spektrum, vol. 35, no. 3, Apr. 2012. Author version

      [J2]  M. Hirth, T. Hossfeld, and P. Tran-Gia, “Analyzing Costs and Accuracy of Validation Mechanisms for Crowdsourcing Platforms”, Mathematical and Computer Modelling, vol. 57, no. 11-12, Jun. 2012. Author version

      [J1]  B. Staehle, F. Wamser, M. Hirth, D. Stezenbach, and D. Staehle, “AquareYoum: Application and Quality of Experience-Aware Resource Management for YouTube in Wireless Mesh Networks”, PIK - Praxis der Informationsverarbeitung und Kommunikation, vol. 34, no. 3, Aug. 2011. Author version

      Conference and Workshop Articles

      [P44] J. Zepernick, K. Pieper, P. Spang, U. Engelke, M. Hirth, and B. Naderi,  “On the Impact of COVID-19 on Subjective Digital Media Quality Assessment”, in Proceedings of the HCI International, Virtual, Jul., 2021.

      [P43] E. Gamboa, R. Galda, C. Mayas, and M. Hirth, “The Crowd Thinks Aloud: Crowdsourcing Usability Testing with the Thinking Aloud Method”, in Proceedings of the HCI International, Virtual, Jul., 2021.

      [P42] F. Metzger, N. Stulier, K. Borchert, and M. Hirth, “Relationship Status: It’s Complicated. Using APM as a QoE-qualifying Tempo Metric”, in Proceedings of the International Conference on Quality of Multimedia Experience, Montreal, Canada, Jun., 2021.

      [P41] M. Hirth, K. Borchert, K. de Moor, V. Borst, and T. Hoßfeld, “Personal Task Design Preferences of Crowdworkers”, in Proceedings of the International Conference on Quality of Multimedia Experience, Athlone, Ireland, Jun., 2020.

      [P40] B. Naderi, T. Hoßfeld, M. Hirth, F. Metzger, S. Möller, and R. Z. Jimenez, “Impact of the Number of Votes on the Reliabilty and Validity of Subjective Speech Quality Assessment in the Crowdsourcing Approach”, in Proceedings of the International Conference on Quality of Multimedia Experience, Athlone, Ireland, Jun., 2020.

      [P39] M. Hirth, K.Borchert, F. Allendorf, F. Metzger, and T. Hoßfeld, “Crowd-based Study of Gameplay Impairments and Player Performance in DOTA 2”, in Proceedings of the Workshop on QoE-based Analysis and Management of Data Communication Networks, Los Cabos, Mexico, Oct., 2019.

      [P38] K.Borchert, M. Hirth, A. Stellzig-Eisenhauer and F. Kunz, “Crowd-based Assessment of Deformational Cranial Asymmetries”, in Proceedings of the International Workshop on CROwd-Powered e-Services, Trondheim, Norway, Sep., 2019.

      [P37] M. Hirth, F. Steurer, K. Borchert and D. Dubiner, “Task Scheduling on Crowdsourcing Platforms for Enabling Completion Time SLAs”, in Proceedings of the International Teletraffic Congress, Budapest, Hungary, Aug., 2019.

      [P36] K. Borchert, A. Schwind, M. Hirth, and T. Hoßfeld, “In Vivo or in Vitro? Influence of the Study Design on Crowdsourced Video QoE”, in Proceedings of the International Conference on Quality of Multimedia Experience, Berlin, Germany, Jun., 2019.

      [P35] K. Borchert, S. Lange, T. Zinner, and M. Hirth, “Identification of Delay Thresholds Representing the Perceived Quality of Enterprise Applications”, in Proceedings of the International Conference on Quality of Multimedia Experience, Sardinia, Italy, May 2018.

      [P34] M. Hirth, S. Lange, M. Seufert, P. Tran-Gia, “Performance Evaluation of Mobile Crowdsensing for Event Detection”, in Proceedings of the Workshop on Crowd Assisted Sensing, Pervasive Systems and Communications, Athens, Greece, Mar., 2018.

      [P33] K. Borchert, M. Hirth, S. Schnitzer, C. Rensing, “Impact of Task Recommendation Systems in Crowdsourcing Platforms”, in Proceedings of the Workshop on Responsible Recommendation at RecSys, Como, Italy, Aug., 2017. Author version

      [P32] K. Borchert, M. Hirth, T. Zinner, A. Göritz, “Designing a Survey Tool for Monitoring Enterprise QoE”, in Proceedings of the SIGCOMM Workshop on QoE-based Analysis and Management of Data Communication Networks, Los Angeles, CA, USA, Aug., 2017. Author version

      [P31] K. Borchert, M. Hirth, T. Zinner, A. Göritz, “Collecting Subjective Ratings in Enterprise Environments”, in Proceedings of the International Conference on Quality of Multimedia Experience, Erfurt, Germany, May 2017. Author version

      [P30] O. Zach, M. Seufert, M. Hirth, M. Slanina, P. Tran-Gia, “On Use of Crowdsourcing for H.264/AVC and H.265/HEVC Video Quality Evaluation”, in Proceedings of the Radioelektronika, Brno, Czech Republic, Apr. 2017. Author version

      [P29]  T. Zinner, M. Hirth, V. Fischer, and O. Hohlfeld, “ERWIN - Enabling the Reproducible Investigation of WaItiNg Times for Arbitrary Workflows”, in Proceedings of the International Conference on Quality of Multimedia Experience, Lisbon, Portugal, Jun. 2016. Author version

      [P28]  M. Hirth, F. Allendorf, F. Metzger, and C. Schwartz, “Assessing the Accuracy of Network Estimations in the DOTA 2 Game Client”, in Proceedings of the Workshop on Perceptual Quality of Systems, Berlin, Germany, Aug. 2016. Author version

      [P27]  K. Borchert, M. Hirth, T. Zinner, and D. C. Mocanu, “Correlating QoE and Technical Parameters of an SAP System in an Enterprise Environment”, in Proceedings of the Workshop on QoE centric Management, Sep. 2016. Author version

      [P26]  V. Burger, M. Hirth, T. Hoßfeld, and P. Tran-Gia, “Principles of Information Neutrality and Counter Measures Against Biased Information”, in Lecture Notes in Informatics: Value-Sensitive Design of Internet-Based Services, Klagenfurt, Austria, Sep. 2016. Author version

      [P25]  C. Schwartz, K. Borchert, M. Hirth, and P. Tran-Gia, “Modeling Crowdsourcing Platforms to Enable Workforce Dimensioning”, in Proceedings of the International Telecommunication Networks and Applications Con- ference, Sydney, Australia, Nov. 2015. Author version

      [P24]  M. Becker, K. Borchert, M. Hirth, H. Mewes, A. Hotho, and P. Tran- Gia, “MicroTrails: Comparing Hypotheses about Task Selection on a Crowd Sourcing Platform”, in Proceedings of the International Conference on Knowledge Technologies and Data-driven Business, Graz, Austria, Oct. 2015. Author version

      [P23]  P. Lebreton, I. H. Torres, T. Mäki, E. Skodras, and M. Hirth, “Eye Tracker in the Wild: Studying the Delta Between What is Said and Measured in a Crowdsourcing Experiment”, in Proceedings of the Workshop on Crowd- sourcing for Multimedia, Brisbane, Australia, Oct. 2015. Author version

      [P22]  T. Zinner, F. Lemmerich, S. Schwarzmann, M. Hirth, P. Karg, and A. Hotho, “Text Categorization for Deriving the Application Quality in Enterprises using Ticketing Systems”, in Proceedings of the International Conference on Big Data Analytics and Knowledge Discovery, Valencia, Spain, Sep. 2015. Author version

      [P21]  L. Dinh-Xuan, C. Schwartz, M. Hirth, F. Wamser, and H. T. Thu, “Analyzing the Impact of Delay and Packet Loss on Google Docs”, in Proceedings of the International Conference on Mobile Networks and Management, Santander, Spain, Sep. 2015. Author version

      [P20]  S. Schnitzer, C. Rensing, S. Schmidt, K. Borchert, M. Hirth, and P. Tran- Gia, “Demands on Task Recommendation in Crowdsourcing Platforms - The Worker’s Perspective”, in Proceedings of the Workshop on Crowd- sourcing and Human Computation for Recommender Systems, Vienna, Austria, Sep. 2015. Author version

      [P19]  P. Lebreton, E. Skodras, T. Mäki, I. H. Torres, and M. Hirth, “Bridging the Gap Between Eye Tracking and Crowdsourcing”, in Proceedings of the SPIE 9394, Human Vision and Electronic Imaging XX, San Francisco, California, USA, Feb. 2015. Author version

      [P18]  C. Schwartz, M. Hirth, T. Hoßfeld, and P. Tran-Gia, “Performance Model for Waiting Times in Cloud File Synchronization Services”, in Proceedings of the International Teletraffic Congress, Karlskrona, Sweden, Sep. 2014. Author version

      [P17]  T. Hoßfeld, M. Hirth, P. Korshunov, P. Hanhart, B. Gardlo, C. Keimel, and C. Timmerer, “Survey of Web-based Crowdsourcing Frameworks for Subjective Quality Assessment”, in Proceedings of the International Workshop on Multimedia Signal Processing, Jakarta, Indonesia, Sep. 2014. Author version

      [P16]  S. Schwarzmann, T. Zinner, and M. Hirth, “Deriving the Employee-perceived Application Quality in Enterprise IT Infrastructures using In- formation from Ticketing Systems”, in Proceedings of the Workshop on Knowledge Discovery, Data Mining and Machine Learning, Aachen, Germany, Sep. 2014. Author version

      [P15]  I. Hupont, P. Lebreton, T. Mäki, E. Skodras, and M. Hirth, “Is Affective Crowdsourcing Reliable?”, in Proceedings of the International Conference on Communications and Electronics, Da Nang, Vietnam, Jul. 2014. Author version

      [P14]  M. Hirth, S. Scheuring, T. Hoßfeld, C. Schwartz, and P. Tran-Gia, “Predicting Result Quality in Crowdsourcing Using Application Layer Monitoring”, in Proceedings of the International Conference on Communications and Electronics, Da Nang, Vietnam, Jul. 2014. Author version

      [P13]  V. Burger, M. Hirth, C. Schwartz, and T. Hoßfeld, “Increasing the Coverage of Vantage Points in Distributed Active Network Measurements by Crowdsourcing”, in Proceedings of Measurement, Modelling and Evaluation of Computing Systems, Bamberg, Germany, Mar. 2014. Author version

      [P12]  M. Seufert, K. Lorey, M. Hirth, and T. Hoßfeld, “Gamification Framework for Personalized Surveys on Relationships in Online Social Networks”, in Proceedings of the International Workshop on Crowdsourcing and Gamification in the Cloud, Dresden, Germany, Dec. 2013. Author version

      [P11]  P. Amrehn, K. Vandenbroucke, T. Hoßfeld, K. de Moor, M. Hirth, R. Schatz, and P. Casas, “Need for Speed? On Quality of Experience for File Storage Services”, in Proceedings of the International Workshop on Perceptual Quality of Systems, Vienna, Austria, Sep. 2013. Author version

      [P10]  H. Hinrichsen, T. Hoßfeld, M. Hirth, and P. Tran-Gia, “Entropy Production in Stationary Social Networks”, in Proceedings of the Workshop on Complex Networks, Berlin, Germany, Mar. 2013. Author version

      [P9]  M. Hirth, F. Lehrieder, S. Oberste-Vorth, T. Hoßfeld, and P. Tran-Gia, “Wikipedia and its Network of Authors from a Social Network Perspective”, in Proceedings of the International Conference on Communications and Electronics, Hue, Vietnam, Aug. 2012. Author version

      [P8]  T. Hoßfeld, R. Schatz, M. Seufert, M. Hirth, T. Zinner, and P. Tran-Gia, “Quantification of YouTube QoE via Crowdsourcing”, in Proceedings of the International Workshop on Multimedia Quality of Experience - Modeling, Evaluation, and Directions, Dana Point, California, USA, Dec. 2011. Author version

      [P7]  T. Hoßfeld, M. Hirth, and P. Tran-Gia, “Modeling of Crowdsourcing Platforms and Granularity of Work Organization in Future Internet”, in Proceedings of the International Teletraffic Congress, San Francisco, California, USA, Sep. 2011. Author version

      [P6]  M. Hirth, T. Hoßfeld, and P. Tran-Gia, “Anatomy of a Crowdsourcing Platform - Using the Example of Microworkers.com”, in Proceedings of the Workshop on Future Internet and Next Generation Networks, Seoul, Korea, Jun. 2011. Author version

      [P5]  M. Hirth, T. Hoßfeld, and P. Tran-Gia, “Cost-Optimal Validation Mechanisms and Cheat-Detection for Crowdsourcing Platforms”, in Proceedings of the Workshop on Future Internet and Next Generation Networks, Seoul, Korea, Jun. 2011. Author version

      [P4]  B. Staehle, M. Hirth, R. Pries, F. Wamser, and D. Staehle, “Aquarema in Action: Improving the YouTube QoE in Wireless Mesh Networks”, in Proceedings of the Baltic Congress on Future Internet Communications, Riga, Latvia, Feb. 2011. Author version

      [P3]  B. Staehle, M. Hirth, R. Pries, F. Wamser, and D. Staehle, “YoMo: A YouTube Application Comfort Monitoring Tool”, in Proceedings of New Dimensions in the Assessment and Support of Quality of Experience for Multimedia Applications, Tampere, Finland, Jun. 2010. Author version

      [P2]  M. Hirth, B. Staehle, F. Wamser, R. Pries, and D. Staehle, “QoE Prediction for Radio Resource Management”, in Proceedings of the International Conference on Testbeds and Research Infrastructures for the Development of Networks & Communities, Berlin, Germany, May 2010.

      [P1]  B. Staehle, D. Staehle, R. Pries, M. Hirth, A. Kassler, and P. Dely, “Measuring One-Way Delay in Wireless Mesh Networks - An Experimental Investigation”, in Proceedings of the Workshop on Performance Monitoring and Measurement of Heterogeneous Wireless and Wired Networks, Tenerife, Canary Islands, Spain, Oct. 2009. Author version

      White Papers

      [W2] T. Hoßfeld, A. Beyer, A. Hall, A. Schwind, C. Gassner, F. Guillemin, F. Wamser, K. Wascinski, M. Hirth, M. Seufert, P. Casas, P. Tran-Gia, S. Wunderer, W. Robitza, W. Wascinski Z. B. Houidi, “Crowdsourced Network and QoE-Measurements - Definitions, Use-Cases and Challenges”, Mar., 2020. https://doi.org/10.25972/OPUS-20232

      [W1] T. Hoßfeld, M. Hirth, J. Redi, F. Mazza, P. Korshunov, B. Naderi, M. Seufert, B. Gardlo, S. Egger, and C. Keimel, “Best Practices and Recommendations for Crowdsourced QoE - Lessons learned from the Qualinet Task Force Crowdsourcing”, COST Action IC1003 European Network on Quality of Experience in Multimedia Systems and Services, 2014. Author version

      Research Reports

      [R8] S. Ørting, A. Doyle, M. Hirth, A. van Hilten, O. Inel, C. R. Madan, P. Mavridis, H. Spiers, and V. Cheplygina, “A Survey of Crowdsourcing in Medical Image Analysis”, Feb., 2019. https://arxiv.org/abs/1902.09159

      [R7] K. Borchert, M. Hirth, M. Kummer, U. Laitenberger, O. Slivko, and S.Viete, “Unemployment and Online Labor”, ZEW Discussion Papers No. 18-023, Apr., 2018.

      [R6] M. Hirth, F. Lehrieder, S. Oberste-Vorth, T. Hoßfeld, and P. Tran-Gia, “Wikipedia and its Network of Human and Automated Authors from a Social Network Perspective”, University of Wuerzburg, Apr., 2015. Author version

      [R5] T. Hoßfeld, C. Keimel, M. Hirth, B. Gardlo, J., Habigt, K. Diepold, P. Tran-Gia, “Best Practices for QoE Crowdtesting QoE Assessment with Crowdsourcing”, University of Wuerzburg, Feb., 2013. Author version

      [R4] M. Hirth, T. Hoßfeld, P. Tran-Gia, “Human Cloud as Emerging Internet Application - Anatomy of the Microworkers Crowdsourcing Platform”, University of Wuerzburg, Jan., 2011. Author version

      [R3] M. Hirth, T. Hoßfeld, P. Tran-Gia, “Cheat-Detection Mechanisms for Crowdsourcing”, University of Wuerzburg, Aug., 2010. Author version

      [R2] R. Pries, D. Staehle, D. Hock, M. Hirth, “A Policy-Based Vertical Handover System”, University of Wuerzburg, May, 2010. Author version

      [R1] B. Staehle, M. Hirth, F. Wamser, R. Pries, D. Staehle, “YoMo: A YouTube Application Comfort Monitoring Tool”, University of Wuerzburg, Mar., 2010. Author version

       
      Team Fachgebiet Nutzerzentrierte Analyse von Multimediadaten