Challenges, Adaptations, and Fringe Benefits of Conducting Software Engineering Research with Human Participants during the COVID-19 Pandemic

• URL: http://arxiv.org/abs/2401.05668v1
• Date: Thu, 11 Jan 2024 05:02:57 GMT
• Title: Challenges, Adaptations, and Fringe Benefits of Conducting Software Engineering Research with Human Participants during the COVID-19 Pandemic
• Authors: Anuradha Madugalla, Tanjila Kanij, Rashina Hoda, Dulaji Hidellaarachchi, Aastha Pant, Samia Ferdousi, John Grundy
• Abstract summary: The COVID-19 pandemic changed the way we live, work and the way we conduct research. We conducted a mixed methods study to understand the extent of this impact. We identified the key challenges faced, the adaptations made, and the surprising fringe benefits of conducting research involving human participants during the pandemic.
• Score: 9.908359906110187
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The COVID-19 pandemic changed the way we live, work and the way we conduct research. With the restrictions of lockdowns and social distancing, various impacts were experienced by many software engineering researchers, especially whose studies depend on human participants. We conducted a mixed methods study to understand the extent of this impact. Through a detailed survey with 89 software engineering researchers working with human participants around the world and a further nine follow-up interviews, we identified the key challenges faced, the adaptations made, and the surprising fringe benefits of conducting research involving human participants during the pandemic. Our findings also revealed that in retrospect, many researchers did not wish to revert to the old ways of conducting human-oriented research. Based on our analysis and insights, we share recommendations on how to conduct remote studies with human participants effectively in an increasingly hybrid world when face-to-face engagement is not possible or where remote participation is preferred.

Related papers

• Who's actually being Studied? A Call for Population Analysis in Software Engineering Research [0.0]
  Population analysis is crucial for ensuring that empirical software engineering (ESE) research is representative and its findings are valid. We explore the challenges ranging from analysing populations of individual software engineers to organizations and projects.
  arXiv  Detail & Related papers  (2024-04-23T14:48:11Z)
• Expanding the Role of Affective Phenomena in Multimodal Interaction Research [57.069159905961214]
  We examined over 16,000 papers from selected conferences in multimodal interaction, affective computing, and natural language processing. We identify 910 affect-related papers and present our analysis of the role of affective phenomena in these papers. We find limited research on how affect and emotion predictions might be used by AI systems to enhance machine understanding of human social behaviors and cognitive states.
  arXiv  Detail & Related papers  (2023-05-18T09:08:39Z)
• How WEIRD is Usable Privacy and Security Research? (Extended Version) [7.669758543344074]
  We conducted a literature review to understand the extent to which participant samples in UPS papers were from WEIRD countries. Geographic and linguistic barriers in the study methods and recruitment methods may cause researchers to conduct user studies locally.
  arXiv  Detail & Related papers  (2023-05-08T19:21:18Z)
• Human Behavior in the Time of COVID-19: Learning from Big Data [71.26355067309193]
  Since March 2020, there have been over 600 million confirmed cases of COVID-19 and more than six million deaths. The pandemic has impacted and even changed human behavior in almost every aspect. Researchers have been employing big data techniques such as natural language processing, computer vision, audio signal processing, frequent pattern mining, and machine learning.
  arXiv  Detail & Related papers  (2023-03-23T17:19:26Z)
• Human-Centered Responsible Artificial Intelligence: Current & Future Trends [76.94037394832931]
  In recent years, the CHI community has seen significant growth in research on Human-Centered Responsible Artificial Intelligence. All of this work is aimed at developing AI that benefits humanity while being grounded in human rights and ethics, and reducing the potential harms of AI. In this special interest group, we aim to bring together researchers from academia and industry interested in these topics to map current and future research trends.
  arXiv  Detail & Related papers  (2023-02-16T08:59:42Z)
• A Survey on Computer Vision based Human Analysis in the COVID-19 Era [58.79053747159797]
  The emergence of COVID-19 has had a global and profound impact, not only on society as a whole, but also on the lives of individuals. Various prevention measures were introduced around the world to limit the transmission of the disease, including face masks, mandates for social distancing and regular disinfection in public spaces, and the use of screening applications. These developments triggered the need for novel and improved computer vision techniques capable of (i) providing support to the prevention measures through an automated analysis of visual data, on the one hand, and (ii) facilitating normal operation of existing vision-based services, such as biometric authentication
  arXiv  Detail & Related papers  (2022-11-07T17:20:39Z)
• The Impact of Personality on Requirements Engineering Activities: A Mixed-Methods Study [10.850726111343064]
  The objective of this study is to explore and identify the impact of personality on Requirements Engineering activities. We found a range of impacts related to the personality traits of software practitioners, their team members, and external stakeholders. We found a set of strategies that can be applied to mitigate the negative impact of personality on RE activities.
  arXiv  Detail & Related papers  (2022-10-13T01:25:00Z)
• Transferring Studies Across Embodiments: A Case Study in Confusion Detection [6.997674465889922]
  Human-robot studies are expensive to conduct and difficult to control. As such researchers sometimes turn to human-avatar interaction in the hope of faster and cheaper data collection. This work shows that despite attitudinal differences and technical control limitations, there were a number of similarities detected in user behaviour. This work suggests that, while avatar interaction is no true substitute for robot interaction studies, sufficient care in study design may allow well executed human-avatar studies to supplement more challenging human-robot studies.
  arXiv  Detail & Related papers  (2022-06-03T10:41:16Z)
• Human Factors in Security Research: Lessons Learned from 2008-2018 [8.255966566768484]
  We focus our analysis on the research on the crucial population of experts, whose human errors can impact many systems at once. We analyzed the past decade of human factors research in security and privacy, identifying 557 relevant publications.
  arXiv  Detail & Related papers  (2021-03-24T15:58:05Z)
• A Study of Knowledge Sharing related to Covid-19 Pandemic in Stack Overflow [69.5231754305538]
  Study of 464 Stack Overflow questions posted mainly in February and March 2020 and leveraging the power of text mining. Findings reveal that indeed this global crisis sparked off an intense and increasing activity in Stack Overflow with most post topics reflecting a strong interest on the analysis of Covid-19 data.
  arXiv  Detail & Related papers  (2020-04-18T08:19:46Z)
• Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities [52.59080024266596]
  We present a survey of the state-of-the-art deep learning methods for sensor-based human activity recognition. We first introduce the multi-modality of the sensory data and provide information for public datasets. We then propose a new taxonomy to structure the deep methods by challenges.
  arXiv  Detail & Related papers  (2020-01-21T09:55:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.