UX Heuristics and Checklist for Deep Learning powered Mobile Applications with Image Classification

• URL: http://arxiv.org/abs/2307.05513v1
• Date: Wed, 5 Jul 2023 20:23:34 GMT
• Title: UX Heuristics and Checklist for Deep Learning powered Mobile Applications with Image Classification
• Authors: Christiane Gresse von Wangenheim, Gustavo Dirschnabel
• Abstract summary: This study examines existing mobile applications with image classification and develops an initial set of AIXs for Deep Learning powered mobile applications with image classification decomposed into a checklist. In order to facilitate the usage of the checklist we also developed an online course presenting the concepts and conductions as well as a web-based tool in order to support an evaluation using theses.
• Score: 1.2437226707039446
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Advances in mobile applications providing image classification enabled by Deep Learning require innovative User Experience solutions in order to assure their adequate use by users. To aid the design process, usability heuristics are typically customized for a specific kind of application. Therefore, based on a literature review and analyzing existing mobile applications with image classification, we propose an initial set of AIX heuristics for Deep Learning powered mobile applications with image classification decomposed into a checklist. In order to facilitate the usage of the checklist we also developed an online course presenting the concepts and heuristics as well as a web-based tool in order to support an evaluation using these heuristics. These results of this research can be used to guide the design of the interfaces of such applications as well as support the conduction of heuristic evaluations supporting practitioners to develop image classification apps that people can understand, trust, and can engage with effectively.

Related papers

• Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototyping [55.98643055756135]
  We introduce Sketch2Code, a benchmark that evaluates state-of-the-art Vision Language Models (VLMs) on automating the conversion of rudimentary sketches into webpage prototypes. We analyze ten commercial and open-source models, showing that Sketch2Code is challenging for existing VLMs. A user study with UI/UX experts reveals a significant preference for proactive question-asking over passive feedback reception.
  arXiv  Detail & Related papers  (2024-10-21T17:39:49Z)
• CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update [69.59482029810198]
  CLOVA is a Closed-Loop Visual Assistant that operates within a framework encompassing inference, reflection, and learning phases. Results demonstrate that CLOVA surpasses existing tool-usage methods by 5% in visual question answering and multiple-image reasoning, by 10% in knowledge tagging, and by 20% in image editing.
  arXiv  Detail & Related papers  (2023-12-18T03:34:07Z)
• Embedding in Recommender Systems: A Survey [67.67966158305603]
  A crucial aspect is embedding techniques that covert the high-dimensional discrete features, such as user and item IDs, into low-dimensional continuous vectors. Applying embedding techniques captures complex entity relationships and has spurred substantial research. This survey covers embedding methods like collaborative filtering, self-supervised learning, and graph-based techniques.
  arXiv  Detail & Related papers  (2023-10-28T06:31:06Z)
• A Design and Development of Rubrics System for Android Applications [0.0]
  This application aims to provide an user-friendly interface for viewing the students performance. Our application promises to make the grading system easier and to enhance the effectiveness in terms of time and resources.
  arXiv  Detail & Related papers  (2023-09-23T16:14:27Z)
• Computational Approaches for App-to-App Retrieval and Design Consistency Check [19.689603972238583]
  Current approaches rely on machine learning models trained on small-sized mobile UI datasets to extract semantic vectors. We employ visual models trained with large web-scale images to test whether they could extract a UI representation in a zero-shot way. We also use mathematically founded methods to enable app-to-app retrieval and design consistency analysis.
  arXiv  Detail & Related papers  (2023-09-19T05:21:22Z)
• Knowledge-Aware Prompt Tuning for Generalizable Vision-Language Models [64.24227572048075]
  We propose a Knowledge-Aware Prompt Tuning (KAPT) framework for vision-language models. Our approach takes inspiration from human intelligence in which external knowledge is usually incorporated into recognizing novel categories of objects.
  arXiv  Detail & Related papers  (2023-08-22T04:24:45Z)
• A Game-Based Learning Application to Help Learners to Practice Mathematical Patterns and Structures [0.0]
  The purpose of this study is to develop a game-based mobile application to help learners practice mathematical patterns and structures. An instrument based on the Octalysis framework was developed as an evaluation tool for the study.
  arXiv  Detail & Related papers  (2023-06-22T13:15:12Z)
• An Empirical Investigation of Representation Learning for Imitation [76.48784376425911]
  Recent work in vision, reinforcement learning, and NLP has shown that auxiliary representation learning objectives can reduce the need for large amounts of expensive, task-specific data. We propose a modular framework for constructing representation learning algorithms, then use our framework to evaluate the utility of representation learning for imitation.
  arXiv  Detail & Related papers  (2022-05-16T11:23:42Z)
• Use Image Clustering to Facilitate Technology Assisted Review [0.5249805590164902]
  Technology Assisted Review (TAR) in electronic discovery is witnessing a rising need to incorporate multimedia content in the scope. We have developed innovative image analytics applications for TAR in the past years, such as image classification, image clustering, and object detection.
  arXiv  Detail & Related papers  (2021-12-16T04:02:51Z)
• A survey of image labelling for computer vision applications [0.0]
  Recent rise of deep learning algorithms for recognising image content has led to the emergence of ad-hoc labelling tools. We perform a structured literature review to compile the underlying concepts and features of image labelling software.
  arXiv  Detail & Related papers  (2021-04-18T16:01:55Z)
• Deep Learning feature selection to unhide demographic recommender systems factors [63.732639864601914]
  The matrix factorization model generates factors which do not incorporate semantic knowledge. DeepUnHide is able to extract demographic information from the users and items factors in collaborative filtering recommender systems.
  arXiv  Detail & Related papers  (2020-06-17T17:36:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.