The ISC Creator: Human-Centered Design of Learning Analytics Interactive Indicator Specification Cards

• URL: http://arxiv.org/abs/2504.07811v1
• Date: Thu, 10 Apr 2025 14:49:47 GMT
• Title: The ISC Creator: Human-Centered Design of Learning Analytics Interactive Indicator Specification Cards
• Authors: Shoeb Joarder, Mohamed Amine Chatti,
• Abstract summary: We present the systematic design, implementation, and evaluation details of the ISC Creator, an interactive learning analytics tool.<n>Our findings demonstrate the importance of carefully considered interactivity and recommendations for orienting and supporting non-expert LA stakeholders to design custom LA indicators.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Emerging research on human-centered learning analytics (HCLA) has demonstrated the importance of involving diverse stakeholders in co-designing learning analytics (LA) systems. However, there is still a demand for effective and efficient methods to co-design LA dashboards and indicators. Indicator Specification Cards (ISCs) have been introduced recently to facilitate the systematic co-design of indicators by different LA stakeholders. In this paper, we strive to enhance the user experience and usefulness of the ISC-based indicator design process. Towards this end, we present the systematic design, implementation, and evaluation details of the ISC Creator, an interactive LA tool that allows low-cost and flexible design of LA indicators. Our findings demonstrate the importance of carefully considered interactivity and recommendations for orienting and supporting non-expert LA stakeholders to design custom LA indicators.

Related papers

• How do Large Language Models Understand Relevance? A Mechanistic Interpretability Perspective [64.00022624183781]
  Large language models (LLMs) can assess relevance and support information retrieval (IR) tasks.<n>We investigate how different LLM modules contribute to relevance judgment through the lens of mechanistic interpretability.
  arXiv  Detail & Related papers  (2025-04-10T16:14:55Z)
• GUI Agents: A Survey [129.94551809688377]
  Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. Motivated by the growing interest and fundamental importance of GUI agents, we provide a comprehensive survey that categorizes their benchmarks, evaluation metrics, architectures, and training methods.
  arXiv  Detail & Related papers  (2024-12-18T04:48:28Z)
• Data Analysis in the Era of Generative AI [56.44807642944589]
  This paper explores the potential of AI-powered tools to reshape data analysis, focusing on design considerations and challenges. We explore how the emergence of large language and multimodal models offers new opportunities to enhance various stages of data analysis workflow. We then examine human-centered design principles that facilitate intuitive interactions, build user trust, and streamline the AI-assisted analysis workflow across multiple apps.
  arXiv  Detail & Related papers  (2024-09-27T06:31:03Z)
• Constraining Participation: Affordances of Feedback Features in Interfaces to Large Language Models [49.74265453289855]
  Large language models (LLMs) are now accessible to anyone with a computer, a web browser, and an internet connection via browser-based interfaces. This paper examines the affordances of interactive feedback features in ChatGPT's interface, analysing how they shape user input and participation in iteration.
  arXiv  Detail & Related papers  (2024-08-27T13:50:37Z)
• On the Element-Wise Representation and Reasoning in Zero-Shot Image Recognition: A Systematic Survey [82.49623756124357]
  Zero-shot image recognition (ZSIR) aims to recognize and reason in unseen domains by learning generalized knowledge from limited data.<n>This paper thoroughly investigates recent advances in element-wise ZSIR and provides a basis for its future development.
  arXiv  Detail & Related papers  (2024-08-09T05:49:21Z)
• AI-Assisted Causal Pathway Diagram for Human-Centered Design [11.95977545253811]
  This paper explores the integration of causal pathway diagrams (CPD) into human-centered design (HCD) A dedicated CPD plugin for the online whiteboard platform Miro was developed to streamline diagram creation and offer real-time AI-driven guidance. We found that CPD's branching and its emphasis on causal connections supported both divergent and convergent processes during design.
  arXiv  Detail & Related papers  (2024-03-12T22:36:27Z)
• OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied Instruction Following [38.99303334457817]
  Embodied Instruction Following (EIF) is a crucial task in embodied learning, requiring agents to interact with their environment through egocentric observations to fulfill natural language instructions. Recent advancements have seen a surge in employing large language models (LLMs) within a framework-centric approach to enhance performance in EIF. We introduce OPEx, a comprehensive framework that delineates the core components essential for solving EIF tasks: Observer, Planner, and Executor.
  arXiv  Detail & Related papers  (2024-03-05T14:53:53Z)
• Human-Centred Learning Analytics and AI in Education: a Systematic Literature Review [0.0]
  Excluding stakeholders from the design process can potentially lead to mistrust and inadequately aligned tools. Despite a shift towards human-centred design, there remain gaps in our understanding of the importance of human control, safety, reliability, and trustworthiness.
  arXiv  Detail & Related papers  (2023-12-20T04:15:01Z)
• Towards a Flexible User Interface for 'Quick and Dirty' Learning Analytics Indicator Design [0.0]
  There is a need for 'quick and dirty' methods to allow the low-cost design of LA indicators. We propose two approaches to support the flexible design of indicators, namely a task-driven approach and a data-driven approach.
  arXiv  Detail & Related papers  (2023-04-04T11:18:11Z)
• Designing Theory-Driven Analytics-Enhanced Self-Regulated Learning Applications [0.0]
  There is an increased interest in the application of learning analytics (LA) to promote self-regulated learning (SRL) This chapter seeks to explore theoretical underpinnings of the design of LA-enhanced SRL applications.
  arXiv  Detail & Related papers  (2023-03-22T08:52:54Z)
• Using Representation Expressiveness and Learnability to Evaluate Self-Supervised Learning Methods [61.49061000562676]
  We introduce Cluster Learnability (CL) to assess learnability. CL is measured in terms of the performance of a KNN trained to predict labels obtained by clustering the representations with K-means. We find that CL better correlates with in-distribution model performance than other competing recent evaluation schemes.
  arXiv  Detail & Related papers  (2022-06-02T19:05:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.