Human Factors in Security Research: Lessons Learned from 2008-2018

• URL: http://arxiv.org/abs/2103.13287v1
• Date: Wed, 24 Mar 2021 15:58:05 GMT
• Title: Human Factors in Security Research: Lessons Learned from 2008-2018
• Authors: Mannat Kaur, Michel van Eeten, Marijn Janssen, Kevin Borgolte, and Tobias Fiebig
• Abstract summary: We focus our analysis on the research on the crucial population of experts, whose human errors can impact many systems at once. We analyzed the past decade of human factors research in security and privacy, identifying 557 relevant publications.
• Score: 8.255966566768484
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Instead of only considering technology, computer security research now strives to also take into account the human factor by studying regular users and, to a lesser extent, experts like operators and developers of systems. We focus our analysis on the research on the crucial population of experts, whose human errors can impact many systems at once, and compare it to research on regular users. To understand how far we advanced in the area of human factors, how the field can further mature, and to provide a point of reference for researchers new to this field, we analyzed the past decade of human factors research in security and privacy, identifying 557 relevant publications. Of these, we found 48 publications focused on expert users and analyzed all in depth. For additional insights, we compare them to a stratified sample of 48 end-user studies. In this paper we investigate: (i) The perspective on human factors, and how we can learn from safety science (ii) How and who are the participants recruited, and how this -- as we find -- creates a western-centric perspective (iii) Research objectives, and how to align these with the chosen research methods (iv) How theories can be used to increase rigor in the communities scientific work, including limitations to the use of Grounded Theory, which is often incompletely applied (v) How researchers handle ethical implications, and what we can do to account for them more consistently Although our literature review has limitations, new insights were revealed and avenues for further research identified.

Related papers

• PersonaFlow: Boosting Research Ideation with LLM-Simulated Expert Personas [12.593617990325528]
  We introduce PersonaFlow, an LLM-based system using persona simulation to support research ideation. Our findings indicate that using multiple personas during ideation significantly enhances user-perceived quality of outcomes. Users' persona customization interactions significantly improved their sense of control and recall of generated ideas.
  arXiv  Detail & Related papers  (2024-09-19T07:54:29Z)
• ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models [56.08917291606421]
  ResearchAgent is a large language model-powered research idea writing agent. It generates problems, methods, and experiment designs while iteratively refining them based on scientific literature. We experimentally validate our ResearchAgent on scientific publications across multiple disciplines.
  arXiv  Detail & Related papers  (2024-04-11T13:36:29Z)
• AI Knowledge and Reasoning: Emulating Expert Creativity in Scientific Research [0.2209921757303168]
  We introduce novel methodology that utilizes original research articles published after the AI's training cutoff. The AI are tasked with redacting findings, predicting outcomes from redacted research, and assessing prediction accuracy against reported results.
  arXiv  Detail & Related papers  (2024-04-05T22:30:47Z)
• Challenges, Adaptations, and Fringe Benefits of Conducting Software Engineering Research with Human Participants during the COVID-19 Pandemic [9.908359906110187]
  The COVID-19 pandemic changed the way we live, work and the way we conduct research. We conducted a mixed methods study to understand the extent of this impact. We identified the key challenges faced, the adaptations made, and the surprising fringe benefits of conducting research involving human participants during the pandemic.
  arXiv  Detail & Related papers  (2024-01-11T05:02:57Z)
• A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning [58.107474025048866]
  Forgetting refers to the loss or deterioration of previously acquired knowledge. Forgetting is a prevalent phenomenon observed in various other research domains within deep learning.
  arXiv  Detail & Related papers  (2023-07-16T16:27:58Z)
• The ethical ambiguity of AI data enrichment: Measuring gaps in research ethics norms and practices [2.28438857884398]
  This study explores how, and to what extent, comparable research ethics requirements and norms have developed for AI research and data enrichment. Leading AI venues have begun to establish protocols for human data collection, but these are are inconsistently followed by authors.
  arXiv  Detail & Related papers  (2023-06-01T16:12:55Z)
• A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why? [84.46288849132634]
  We propose a systematic framework for analyzing the evolution of research topics in a scientific field using causal discovery and inference techniques. We define three variables to encompass diverse facets of the evolution of research topics within NLP. We utilize a causal discovery algorithm to unveil the causal connections among these variables using observational data.
  arXiv  Detail & Related papers  (2023-05-22T11:08:00Z)
• How WEIRD is Usable Privacy and Security Research? (Extended Version) [7.669758543344074]
  We conducted a literature review to understand the extent to which participant samples in UPS papers were from WEIRD countries. Geographic and linguistic barriers in the study methods and recruitment methods may cause researchers to conduct user studies locally.
  arXiv  Detail & Related papers  (2023-05-08T19:21:18Z)
• Fairness in Recommender Systems: Research Landscape and Future Directions [119.67643184567623]
  We review the concepts and notions of fairness that were put forward in the area in the recent past. We present an overview of how research in this field is currently operationalized. Overall, our analysis of recent works points to certain research gaps.
  arXiv  Detail & Related papers  (2022-05-23T08:34:25Z)
• Scaling up Search Engine Audits: Practical Insights for Algorithm Auditing [68.8204255655161]
  We set up experiments for eight search engines with hundreds of virtual agents placed in different regions. We demonstrate the successful performance of our research infrastructure across multiple data collections. We conclude that virtual agents are a promising venue for monitoring the performance of algorithms across long periods of time.
  arXiv  Detail & Related papers  (2021-06-10T15:49:58Z)
• A Survey on Causal Inference [64.45536158710014]
  Causal inference is a critical research topic across many domains, such as statistics, computer science, education, public policy and economics. Various causal effect estimation methods for observational data have sprung up.
  arXiv  Detail & Related papers  (2020-02-05T21:35:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.