Jun. Prof. Dr. Matthias Hirth

Head of group

Kirchhoffbau, room K 3005

Fax: +49 3677 69-2888

+49 3677 69-2855

matthias.hirth@tu-ilmenau.de

Publications

Books and Book Chapters

[B2] M. Hirth, J. Jacques, P. Rodgers, O. Scekic, and M. Wybrow, “Crowdsourcing Technology to Support Academic Research”, in Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments, Springer, 2017.

[B1] S. Egger-Lampl, J. Redi, T. Hoßfeld, M. Hirth, S. Möller, B. Naderi, C. Keimel, and D. Saupe, “Crowdsourcing Quality of Experience Experiments”, in Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments, Springer, 2017.

Journal Articles

[J16] M. Hirth, M. Seufert, S. Lange, M. Meixner, and P. Tran-Gia "Performance Evaluation of Hybrid Crowdsensing and Fixed Sensor Systems for Event Detection in Urban Environments"? Sensors, vol. 21, Issue 17., 2021 Article

[J15] F. Kunz, M. Hirth, T. Schweitzer, C. Linz, B. Goetz, A. Stellzig-Eisenhauer, K. Borchert, and H. Böhm, "Subjective Perception of Craniofacial Growth Asymmetries in Patients with Deformational Plagiocephaly", Clinical Oral Investigations, 2021. Article

[J14] S. Ørting, A. Doyle, A. van Hilten, M. Hirth, O. Inel, C. Madan, P. Mavridis, H. Spiers, and V. Cheplygina "A Survey of Crowdsourcing in Medical Image Analysis", Human Computation, vol. 7, issue 1, 2020. Article

[J13] B. Naderi, R. Zequeira Jiménez, M. Hirth, S. Möller, F. Metzger, and T.  Hoßfeld, "Towards Speech Quality Assessment Using a Crowdsourcing Approach: Evaluation of Standardized Methods"? Quality and User Experience, vol. 6, number 2., 2020 E-Print

[J12] K. Borchert, A. Seufert, E. Gamboa, M. Hirth, and T.  Hoßfeld, "In vitro vs in vivo: does the study’s interface design influence crowdsourced video QoE"? Quality and User Experience, vol. 6, number 1., 2020 E-Print

[J11] A. Görtiz, K. Borchert, and M. Hirth, “Using Attention Testing to Select Crowdsourced Workers and Research Participants”, Social Science Computer Review, Jun. 2019. E-Print

[J10] P. Lebreton, I. Hupont, M. Hirth, T. Mäki, E. Skodras, A. Schubert, and A. Raake, “CrowdWatcher: An Open-source Platform to Catch the Eye of the Crowd”, Quality and User Experience, vol.4, Mar. 2019. Author version

[J9] A. Schütz, T. Fertig, K. Weber, H. Vu, M. Hirth, and T. Tran-Gia, “Vertrauen ist gut, Blockchain ist besser–Einsatzmöglichkeiten von Blockchain für Vertrauensprobleme im Crowdsourcing”, HMD Praxis der Wirtschaftsinformatik 55 (6), Oct. 2018. Author version

[J8]  M. Hirth, T. Hoßfeld, M. Mellia, C. Schwartz, and F. Lehrieder, “Crowd-sourced Network Measurements: Benefits and Best Practices”, Computer Networks, vol. 90, Special Issue on Crowdsourcing Oct. 2015. Author version

[J7]  T. Hoßfeld, V. Burger, H. Hinrichsen, M. Hirth, and P. Tran-Gia, “On the Computation of Entropy Production in Stationary Social Networks”, Social Network Analysis and Mining, vol. 4, Apr. 2014. Author version

[J6]  T. Hossfeld, C. Keimel, M. Hirth, B. Gardlo, J. Habigt, K. Diepold, and P. Tran-Gia, “Best Practices for QoE Crowdtesting: QoE Assessment with Crowdsourcing”, Transactions on Multimedia, vol. 16, no. 2, Feb. 2014. Author version

[J5]  T. Hoßfeld, M. Hirth, and P. Tran-Gia, “Crowdsourcing - Modell einer neuen Arbeitswelt im Internet”, Wirtschaftsinformatik & Management, vol. 5, Oct. 2013. Author version

[J4]  P. Tran-Gia, T. Hoßfeld, M. Hartmann, and M. Hirth, “Crowdsourcing and its Impact on Future Internet Usage”, IT - Information Technology, vol. 55, no. 4, Jul. 2013. Author version

[J3]  T. Hoßfeld, M. Hirth, and P. Tran-Gia, “Aktuelles Schlagwort: Crowdsourcing”, Informatik Spektrum, vol. 35, no. 3, Apr. 2012. Author version

[J2]  M. Hirth, T. Hossfeld, and P. Tran-Gia, “Analyzing Costs and Accuracy of Validation Mechanisms for Crowdsourcing Platforms”, Mathematical and Computer Modelling, vol. 57, no. 11-12, Jun. 2012. Author version

[J1]  B. Staehle, F. Wamser, M. Hirth, D. Stezenbach, and D. Staehle, “AquareYoum: Application and Quality of Experience-Aware Resource Management for YouTube in Wireless Mesh Networks”, PIK - Praxis der Informationsverarbeitung und Kommunikation, vol. 34, no. 3, Aug. 2011. Author version

Conference and Workshop Articles

[P44] J. Zepernick, K. Pieper, P. Spang, U. Engelke, M. Hirth, and B. Naderi,  “On the Impact of COVID-19 on Subjective Digital Media Quality Assessment”, in Proceedings of International Workshop on Multimedia Signal Processing, Tampere, Finland, Oct., 2021.

[P43] E. Gamboa, R. Galda, C. Mayas, and M. Hirth, “The Crowd Thinks Aloud: Crowdsourcing Usability Testing with the Thinking Aloud Method”, in Proceedings of the HCI International, Virtual, Jul., 2021.

[P42] F. Metzger, N. Stulier, K. Borchert, and M. Hirth, “Relationship Status: It’s Complicated. Using APM as a QoE-qualifying Tempo Metric”, in Proceedings of the International Conference on Quality of Multimedia Experience, Montreal, Canada, Jun., 2021.

[P41] M. Hirth, K. Borchert, K. de Moor, V. Borst, and T. Hoßfeld, “Personal Task Design Preferences of Crowdworkers”, in Proceedings of the International Conference on Quality of Multimedia Experience, Athlone, Ireland, Jun., 2020.

[P40] B. Naderi, T. Hoßfeld, M. Hirth, F. Metzger, S. Möller, and R. Z. Jimenez, “Impact of the Number of Votes on the Reliabilty and Validity of Subjective Speech Quality Assessment in the Crowdsourcing Approach”, in Proceedings of the International Conference on Quality of Multimedia Experience, Athlone, Ireland, Jun., 2020.

[P39] M. Hirth, K.Borchert, F. Allendorf, F. Metzger, and T. Hoßfeld, “Crowd-based Study of Gameplay Impairments and Player Performance in DOTA 2”, in Proceedings of the Workshop on QoE-based Analysis and Management of Data Communication Networks, Los Cabos, Mexico, Oct., 2019.

[P38] K.Borchert, M. Hirth, A. Stellzig-Eisenhauer and F. Kunz, “Crowd-based Assessment of Deformational Cranial Asymmetries”, in Proceedings of the International Workshop on CROwd-Powered e-Services, Trondheim, Norway, Sep., 2019.

[P37] M. Hirth, F. Steurer, K. Borchert and D. Dubiner, “Task Scheduling on Crowdsourcing Platforms for Enabling Completion Time SLAs”, in Proceedings of the International Teletraffic Congress, Budapest, Hungary, Aug., 2019.

[P36] K. Borchert, A. Schwind, M. Hirth, and T. Hoßfeld, “In Vivo or in Vitro? Influence of the Study Design on Crowdsourced Video QoE”, in Proceedings of the International Conference on Quality of Multimedia Experience, Berlin, Germany, Jun., 2019.

[P35] K. Borchert, S. Lange, T. Zinner, and M. Hirth, “Identification of Delay Thresholds Representing the Perceived Quality of Enterprise Applications”, in Proceedings of the International Conference on Quality of Multimedia Experience, Sardinia, Italy, May 2018.

[P34] M. Hirth, S. Lange, M. Seufert, P. Tran-Gia, “Performance Evaluation of Mobile Crowdsensing for Event Detection”, in Proceedings of the Workshop on Crowd Assisted Sensing, Pervasive Systems and Communications, Athens, Greece, Mar., 2018.

[P33] K. Borchert, M. Hirth, S. Schnitzer, C. Rensing, “Impact of Task Recommendation Systems in Crowdsourcing Platforms”, in Proceedings of the Workshop on Responsible Recommendation at RecSys, Como, Italy, Aug., 2017. Author version

[P32] K. Borchert, M. Hirth, T. Zinner, A. Göritz, “Designing a Survey Tool for Monitoring Enterprise QoE”, in Proceedings of the SIGCOMM Workshop on QoE-based Analysis and Management of Data Communication Networks, Los Angeles, CA, USA, Aug., 2017. Author version

[P31] K. Borchert, M. Hirth, T. Zinner, A. Göritz, “Collecting Subjective Ratings in Enterprise Environments”, in Proceedings of the International Conference on Quality of Multimedia Experience, Erfurt, Germany, May 2017. Author version

[P30] O. Zach, M. Seufert, M. Hirth, M. Slanina, P. Tran-Gia, “On Use of Crowdsourcing for H.264/AVC and H.265/HEVC Video Quality Evaluation”, in Proceedings of the Radioelektronika, Brno, Czech Republic, Apr. 2017. Author version

[P29]  T. Zinner, M. Hirth, V. Fischer, and O. Hohlfeld, “ERWIN - Enabling the Reproducible Investigation of WaItiNg Times for Arbitrary Workflows”, in Proceedings of the International Conference on Quality of Multimedia Experience, Lisbon, Portugal, Jun. 2016. Author version

[P28]  M. Hirth, F. Allendorf, F. Metzger, and C. Schwartz, “Assessing the Accuracy of Network Estimations in the DOTA 2 Game Client”, in Proceedings of the Workshop on Perceptual Quality of Systems, Berlin, Germany, Aug. 2016. Author version

[P27]  K. Borchert, M. Hirth, T. Zinner, and D. C. Mocanu, “Correlating QoE and Technical Parameters of an SAP System in an Enterprise Environment”, in Proceedings of the Workshop on QoE centric Management, Sep. 2016. Author version

[P26]  V. Burger, M. Hirth, T. Hoßfeld, and P. Tran-Gia, “Principles of Information Neutrality and Counter Measures Against Biased Information”, in Lecture Notes in Informatics: Value-Sensitive Design of Internet-Based Services, Klagenfurt, Austria, Sep. 2016. Author version

[P25]  C. Schwartz, K. Borchert, M. Hirth, and P. Tran-Gia, “Modeling Crowdsourcing Platforms to Enable Workforce Dimensioning”, in Proceedings of the International Telecommunication Networks and Applications Con- ference, Sydney, Australia, Nov. 2015. Author version

[P24]  M. Becker, K. Borchert, M. Hirth, H. Mewes, A. Hotho, and P. Tran- Gia, “MicroTrails: Comparing Hypotheses about Task Selection on a Crowd Sourcing Platform”, in Proceedings of the International Conference on Knowledge Technologies and Data-driven Business, Graz, Austria, Oct. 2015. Author version

[P23]  P. Lebreton, I. H. Torres, T. Mäki, E. Skodras, and M. Hirth, “Eye Tracker in the Wild: Studying the Delta Between What is Said and Measured in a Crowdsourcing Experiment”, in Proceedings of the Workshop on Crowd- sourcing for Multimedia, Brisbane, Australia, Oct. 2015. Author version

[P22]  T. Zinner, F. Lemmerich, S. Schwarzmann, M. Hirth, P. Karg, and A. Hotho, “Text Categorization for Deriving the Application Quality in Enterprises using Ticketing Systems”, in Proceedings of the International Conference on Big Data Analytics and Knowledge Discovery, Valencia, Spain, Sep. 2015. Author version

[P21]  L. Dinh-Xuan, C. Schwartz, M. Hirth, F. Wamser, and H. T. Thu, “Analyzing the Impact of Delay and Packet Loss on Google Docs”, in Proceedings of the International Conference on Mobile Networks and Management, Santander, Spain, Sep. 2015. Author version

[P20]  S. Schnitzer, C. Rensing, S. Schmidt, K. Borchert, M. Hirth, and P. Tran- Gia, “Demands on Task Recommendation in Crowdsourcing Platforms - The Worker’s Perspective”, in Proceedings of the Workshop on Crowd- sourcing and Human Computation for Recommender Systems, Vienna, Austria, Sep. 2015. Author version

[P19]  P. Lebreton, E. Skodras, T. Mäki, I. H. Torres, and M. Hirth, “Bridging the Gap Between Eye Tracking and Crowdsourcing”, in Proceedings of the SPIE 9394, Human Vision and Electronic Imaging XX, San Francisco, California, USA, Feb. 2015. Author version

[P18]  C. Schwartz, M. Hirth, T. Hoßfeld, and P. Tran-Gia, “Performance Model for Waiting Times in Cloud File Synchronization Services”, in Proceedings of the International Teletraffic Congress, Karlskrona, Sweden, Sep. 2014. Author version

[P17]  T. Hoßfeld, M. Hirth, P. Korshunov, P. Hanhart, B. Gardlo, C. Keimel, and C. Timmerer, “Survey of Web-based Crowdsourcing Frameworks for Subjective Quality Assessment”, in Proceedings of the International Workshop on Multimedia Signal Processing, Jakarta, Indonesia, Sep. 2014. Author version

[P16]  S. Schwarzmann, T. Zinner, and M. Hirth, “Deriving the Employee-perceived Application Quality in Enterprise IT Infrastructures using In- formation from Ticketing Systems”, in Proceedings of the Workshop on Knowledge Discovery, Data Mining and Machine Learning, Aachen, Germany, Sep. 2014. Author version

[P15]  I. Hupont, P. Lebreton, T. Mäki, E. Skodras, and M. Hirth, “Is Affective Crowdsourcing Reliable?”, in Proceedings of the International Conference on Communications and Electronics, Da Nang, Vietnam, Jul. 2014. Author version

[P14]  M. Hirth, S. Scheuring, T. Hoßfeld, C. Schwartz, and P. Tran-Gia, “Predicting Result Quality in Crowdsourcing Using Application Layer Monitoring”, in Proceedings of the International Conference on Communications and Electronics, Da Nang, Vietnam, Jul. 2014. Author version

[P13]  V. Burger, M. Hirth, C. Schwartz, and T. Hoßfeld, “Increasing the Coverage of Vantage Points in Distributed Active Network Measurements by Crowdsourcing”, in Proceedings of Measurement, Modelling and Evaluation of Computing Systems, Bamberg, Germany, Mar. 2014. Author version

[P12]  M. Seufert, K. Lorey, M. Hirth, and T. Hoßfeld, “Gamification Framework for Personalized Surveys on Relationships in Online Social Networks”, in Proceedings of the International Workshop on Crowdsourcing and Gamification in the Cloud, Dresden, Germany, Dec. 2013. Author version

[P11]  P. Amrehn, K. Vandenbroucke, T. Hoßfeld, K. de Moor, M. Hirth, R. Schatz, and P. Casas, “Need for Speed? On Quality of Experience for File Storage Services”, in Proceedings of the International Workshop on Perceptual Quality of Systems, Vienna, Austria, Sep. 2013. Author version

[P10]  H. Hinrichsen, T. Hoßfeld, M. Hirth, and P. Tran-Gia, “Entropy Production in Stationary Social Networks”, in Proceedings of the Workshop on Complex Networks, Berlin, Germany, Mar. 2013. Author version

[P9]  M. Hirth, F. Lehrieder, S. Oberste-Vorth, T. Hoßfeld, and P. Tran-Gia, “Wikipedia and its Network of Authors from a Social Network Perspective”, in Proceedings of the International Conference on Communications and Electronics, Hue, Vietnam, Aug. 2012. Author version

[P8]  T. Hoßfeld, R. Schatz, M. Seufert, M. Hirth, T. Zinner, and P. Tran-Gia, “Quantification of YouTube QoE via Crowdsourcing”, in Proceedings of the International Workshop on Multimedia Quality of Experience - Modeling, Evaluation, and Directions, Dana Point, California, USA, Dec. 2011. Author version

[P7]  T. Hoßfeld, M. Hirth, and P. Tran-Gia, “Modeling of Crowdsourcing Platforms and Granularity of Work Organization in Future Internet”, in Proceedings of the International Teletraffic Congress, San Francisco, California, USA, Sep. 2011. Author version

[P6]  M. Hirth, T. Hoßfeld, and P. Tran-Gia, “Anatomy of a Crowdsourcing Platform - Using the Example of Microworkers.com”, in Proceedings of the Workshop on Future Internet and Next Generation Networks, Seoul, Korea, Jun. 2011. Author version

[P5]  M. Hirth, T. Hoßfeld, and P. Tran-Gia, “Cost-Optimal Validation Mechanisms and Cheat-Detection for Crowdsourcing Platforms”, in Proceedings of the Workshop on Future Internet and Next Generation Networks, Seoul, Korea, Jun. 2011. Author version

[P4]  B. Staehle, M. Hirth, R. Pries, F. Wamser, and D. Staehle, “Aquarema in Action: Improving the YouTube QoE in Wireless Mesh Networks”, in Proceedings of the Baltic Congress on Future Internet Communications, Riga, Latvia, Feb. 2011. Author version

[P3]  B. Staehle, M. Hirth, R. Pries, F. Wamser, and D. Staehle, “YoMo: A YouTube Application Comfort Monitoring Tool”, in Proceedings of New Dimensions in the Assessment and Support of Quality of Experience for Multimedia Applications, Tampere, Finland, Jun. 2010. Author version

[P2]  M. Hirth, B. Staehle, F. Wamser, R. Pries, and D. Staehle, “QoE Prediction for Radio Resource Management”, in Proceedings of the International Conference on Testbeds and Research Infrastructures for the Development of Networks & Communities, Berlin, Germany, May 2010.

[P1]  B. Staehle, D. Staehle, R. Pries, M. Hirth, A. Kassler, and P. Dely, “Measuring One-Way Delay in Wireless Mesh Networks - An Experimental Investigation”, in Proceedings of the Workshop on Performance Monitoring and Measurement of Heterogeneous Wireless and Wired Networks, Tenerife, Canary Islands, Spain, Oct. 2009. Author version

White Papers

[W2] T. Hoßfeld, A. Beyer, A. Hall, A. Schwind, C. Gassner, F. Guillemin, F. Wamser, K. Wascinski, M. Hirth, M. Seufert, P. Casas, P. Tran-Gia, S. Wunderer, W. Robitza, W. Wascinski Z. B. Houidi, “Crowdsourced Network and QoE-Measurements - Definitions, Use-Cases and Challenges”, Mar., 2020. https://doi.org/10.25972/OPUS-20232

[W1] T. Hoßfeld, M. Hirth, J. Redi, F. Mazza, P. Korshunov, B. Naderi, M. Seufert, B. Gardlo, S. Egger, and C. Keimel, “Best Practices and Recommendations for Crowdsourced QoE - Lessons learned from the Qualinet Task Force Crowdsourcing”, COST Action IC1003 European Network on Quality of Experience in Multimedia Systems and Services, 2014. Author version

Research Reports

[R8] S. Ørting, A. Doyle, M. Hirth, A. van Hilten, O. Inel, C. R. Madan, P. Mavridis, H. Spiers, and V. Cheplygina, “A Survey of Crowdsourcing in Medical Image Analysis”, Feb., 2019. https://arxiv.org/abs/1902.09159

[R7] K. Borchert, M. Hirth, M. Kummer, U. Laitenberger, O. Slivko, and S.Viete, “Unemployment and Online Labor”, ZEW Discussion Papers No. 18-023, Apr., 2018. 

[R6] M. Hirth, F. Lehrieder, S. Oberste-Vorth, T. Hoßfeld, and P. Tran-Gia, “Wikipedia and its Network of Human and Automated Authors from a Social Network Perspective”, University of Wuerzburg, Apr., 2015. Author version

[R5] T. Hoßfeld, C. Keimel, M. Hirth, B. Gardlo, J., Habigt, K. Diepold, P. Tran-Gia, “Best Practices for QoE Crowdtesting QoE Assessment with Crowdsourcing”, University of Wuerzburg, Feb., 2013. Author version

[R4] M. Hirth, T. Hoßfeld, P. Tran-Gia, “Human Cloud as Emerging Internet Application - Anatomy of the Microworkers Crowdsourcing Platform”, University of Wuerzburg, Jan., 2011. Author version

[R3] M. Hirth, T. Hoßfeld, P. Tran-Gia, “Cheat-Detection Mechanisms for Crowdsourcing”, University of Wuerzburg, Aug., 2010. Author version

[R2] R. Pries, D. Staehle, D. Hock, M. Hirth, “A Policy-Based Vertical Handover System”, University of Wuerzburg, May, 2010. Author version

[R1] B. Staehle, M. Hirth, F. Wamser, R. Pries, D. Staehle, “YoMo: A YouTube Application Comfort Monitoring Tool”, University of Wuerzburg, Mar., 2010. Author version