All Factors Should Matter! Reference Checklist for Describing Research
Conditions in Pursuit of Comparable IVR Experiments
- URL: http://arxiv.org/abs/2101.01285v2
- Date: Mon, 5 Apr 2021 18:32:45 GMT
- Title: All Factors Should Matter! Reference Checklist for Describing Research
Conditions in Pursuit of Comparable IVR Experiments
- Authors: Kinga Skorupska, Daniel Cnotkowski, Julia Paluch, Rafa{\l} Mas{\l}yk,
Anna Jaskulska, Monika Kornacka, Wies{\l}aw Kope\'c
- Abstract summary: A significant problem with immersive virtual reality (IVR) experiments is the ability to compare research conditions.
VR kits and tactile environments are complex and diverse but researchers from different fields, e.g. ICT, psychology, or marketing, often neglect to describe them with a level of detail sufficient to their research on the landscape.
This article presents a reference checklist for describing research conditions of experiments.
- Score: 5.874802930380899
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: A significant problem with immersive virtual reality (IVR) experiments is the
ability to compare research conditions. VR kits and IVR environments are
complex and diverse but researchers from different fields, e.g. ICT,
psychology, or marketing, often neglect to describe them with a level of detail
sufficient to situate their research on the IVR landscape. Careful reporting of
these conditions may increase the applicability of research results and their
impact on the shared body of knowledge on HCI and IVR. Based on literature
review, our experience, practice and a synthesis of key IVR factors, in this
article we present a reference checklist for describing research conditions of
IVR experiments. Including these in publications will contribute to the
comparability of IVR research and help other researchers decide to what extent
reported results are relevant to their own research goals. The compiled
checklist is a ready-to-use reference tool and takes into account key hardware,
software and human factors as well as diverse factors connected to visual,
audio, tactile, and other aspects of interaction.
Related papers
- A systematic review and analysis of the viability of virtual reality (VR) in construction work and education [0.16385815610837165]
This systematic review explores the viability of virtual reality (VR) technologies for enhancing learning outcomes and operational efficiency within the construction industry.
It analyzed 36 peer-reviewed journal articles from databases such as the Web of Science, ERIC, and Scopus.
arXiv Detail & Related papers (2024-07-23T19:12:08Z) - DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents [49.74065769505137]
We introduce DISCOVERYWORLD, the first virtual environment for developing and benchmarking an agent's ability to perform complete cycles of novel scientific discovery.
It includes 120 different challenge tasks spanning eight topics each with three levels of difficulty and several parametric variations.
We find that strong baseline agents, that perform well in prior published environments, struggle on most DISCOVERYWORLD tasks.
arXiv Detail & Related papers (2024-06-10T20:08:44Z) - Inclusion in Virtual Reality Technology: A Scoping Review [0.3626013617212666]
We provide a scoping analysis of existing virtual reality research literature about inclusion.
We categorize the literature based on target group into ability, gender, and age, followed by those that study community-based design of VR experiences.
In the latter group, we focus mainly on Indigenous Peoples as a clearer and more important example.
arXiv Detail & Related papers (2023-10-23T18:55:48Z) - Large-scale information retrieval in software engineering -- an
experience report from industrial application [9.62054859086279]
We describe an engineering task, test case selection, and illustrate our problem analysis and solution discovery process.
We analyze, in the context of the studied company, how test case selection is performed and design a series of experiments evaluating the performance of different IR techniques.
arXiv Detail & Related papers (2023-08-22T19:30:56Z) - Towards Modeling Software Quality of Virtual Reality Applications from
Users' Perspectives [44.46088489942242]
We conduct the first large-scale empirical study to model the software quality of VR applications from users' perspectives.
We analyze 1,132,056 user reviews of 14,150 VR applications across seven app stores through a semiautomatic review mining approach.
Our analysis reveals that the VR-specific quality attributes are of utmost importance to users, which are closely related to the most unique properties of VR applications.
arXiv Detail & Related papers (2023-08-13T14:42:47Z) - Where are we in the search for an Artificial Visual Cortex for Embodied
Intelligence? [106.81451807227103]
We present the largest and most comprehensive empirical study of pre-trained visual representations (PVRs) or visual 'foundation models' for Embodied AI.
To study the effect of pre-training data size and diversity, we combine over 4,000 hours of egocentric videos from 7 different sources.
Our largest model, named VC-1, outperforms all prior PVRs on average but does not universally dominate either.
arXiv Detail & Related papers (2023-03-31T17:56:33Z) - Learning Action-Effect Dynamics for Hypothetical Vision-Language
Reasoning Task [50.72283841720014]
We propose a novel learning strategy that can improve reasoning about the effects of actions.
We demonstrate the effectiveness of our proposed approach and discuss its advantages over previous baselines in terms of performance, data efficiency, and generalization capability.
arXiv Detail & Related papers (2022-12-07T05:41:58Z) - A Review of Emerging Research Directions in Abstract Visual Reasoning [0.0]
We propose a taxonomy to categorise the tasks along 5 dimensions: input shapes, hidden rules, target task, cognitive function, and main challenge.
The perspective taken in this survey allows to characterise problems with respect to their shared and distinct properties, provides a unified view on the existing approaches for solving tasks.
One of them refers to the observation that in the machine learning literature different tasks are considered in isolation, which is in the stark contrast with the way the tasks are used to measure human intelligence.
arXiv Detail & Related papers (2022-02-21T14:58:02Z) - Scaling up Search Engine Audits: Practical Insights for Algorithm
Auditing [68.8204255655161]
We set up experiments for eight search engines with hundreds of virtual agents placed in different regions.
We demonstrate the successful performance of our research infrastructure across multiple data collections.
We conclude that virtual agents are a promising venue for monitoring the performance of algorithms across long periods of time.
arXiv Detail & Related papers (2021-06-10T15:49:58Z) - A survey on applications of augmented, mixed and virtual reality for
nature and environment [114.4879749449579]
Augmented reality (AR), virtual reality (VR) and mixed reality (MR) are technologies of great potential due to the engaging and enriching experiences they are capable of providing.
However, the possibilities that AR, VR and MR offer in the area of environmental applications are not yet widely explored.
We present the outcome of a survey meant to discover and classify existing AR/VR/MR applications that can benefit the environment or increase awareness on environmental issues.
arXiv Detail & Related papers (2020-08-27T09:59:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.