Explaining Clustering of Ecological Momentary Assessment Data Through Temporal and Feature Attention

• URL: http://arxiv.org/abs/2405.04854v1
• Date: Wed, 8 May 2024 07:09:43 GMT
• Title: Explaining Clustering of Ecological Momentary Assessment Data Through Temporal and Feature Attention
• Authors: Mandani Ntekouli, Gerasimos Spanakis, Lourens Waldorp, Anne Roefs,
• Abstract summary: Ecological Momentary Assessment (EMA) studies offer rich individual data on psychopathology-relevant variables in real-time. This paper proposes an attention-based interpretable framework to identify the important time-points and variables that play primary roles in distinguishing between clusters.
• Score: 4.951599300340955
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the field of psychopathology, Ecological Momentary Assessment (EMA) studies offer rich individual data on psychopathology-relevant variables (e.g., affect, behavior, etc) in real-time. EMA data is collected dynamically, represented as complex multivariate time series (MTS). Such information is crucial for a better understanding of mental disorders at the individual- and group-level. More specifically, clustering individuals in EMA data facilitates uncovering and studying the commonalities as well as variations of groups in the population. Nevertheless, since clustering is an unsupervised task and true EMA grouping is not commonly available, the evaluation of clustering is quite challenging. An important aspect of evaluation is clustering explainability. Thus, this paper proposes an attention-based interpretable framework to identify the important time-points and variables that play primary roles in distinguishing between clusters. A key part of this study is to examine ways to analyze, summarize, and interpret the attention weights as well as evaluate the patterns underlying the important segments of the data that differentiate across clusters. To evaluate the proposed approach, an EMA dataset of 187 individuals grouped in 3 clusters is used for analyzing the derived attention-based importance attributes. More specifically, this analysis provides the distinct characteristics at the cluster-, feature- and individual level. Such clustering explanations could be beneficial for generalizing existing concepts of mental disorders, discovering new insights, and even enhancing our knowledge at an individual level.

Related papers

• From A-to-Z Review of Clustering Validation Indices [4.08908337437878]
  We review and evaluate the performance of internal and external clustering validation indices on the most common clustering algorithms. We suggest a classification framework for examining the functionality of both internal and external clustering validation measures.
  arXiv  Detail & Related papers  (2024-07-18T13:52:02Z)
• Interpret3C: Interpretable Student Clustering Through Individualized Feature Selection [2.428031280449541]
  Clustering in education, particularly in large-scale online environments like MOOCs, is essential for understanding and adapting to diverse student needs. Existing clustering approaches often neglect individual differences in feature importance and rely on a homogenized feature set. We introduce Interpret3C, a novel clustering pipeline that incorporates interpretable neural networks (NNs) in an unsupervised learning context.
  arXiv  Detail & Related papers  (2024-05-28T15:32:05Z)
• Clustering individuals based on multivariate EMA time-series data [2.0824228840987447]
  Ecological Momentary Assessment (EMA) methodological advancements have offered new opportunities to collect time-intensive, repeated and intra-individual measurements. Advanced machine learning (ML) methods are needed to understand data characteristics and uncover meaningful relationships regarding the underlying complex psychological processes.
  arXiv  Detail & Related papers  (2022-12-02T13:33:36Z)
• Deep Clustering: A Comprehensive Survey [53.387957674512585]
  Clustering analysis plays an indispensable role in machine learning and data mining. Deep clustering, which can learn clustering-friendly representations using deep neural networks, has been broadly applied in a wide range of clustering tasks. Existing surveys for deep clustering mainly focus on the single-view fields and the network architectures, ignoring the complex application scenarios of clustering.
  arXiv  Detail & Related papers  (2022-10-09T02:31:32Z)
• Leveraging Ensembles and Self-Supervised Learning for Fully-Unsupervised Person Re-Identification and Text Authorship Attribution [77.85461690214551]
  Learning from fully-unlabeled data is challenging in Multimedia Forensics problems, such as Person Re-Identification and Text Authorship Attribution. Recent self-supervised learning methods have shown to be effective when dealing with fully-unlabeled data in cases where the underlying classes have significant semantic differences. We propose a strategy to tackle Person Re-Identification and Text Authorship Attribution by enabling learning from unlabeled data even when samples from different classes are not prominently diverse.
  arXiv  Detail & Related papers  (2022-02-07T13:08:11Z)
• Observing a group to infer individual characteristics [1.0152838128195465]
  We propose a new observer algorithm that infers, based only on observed movement information, how the local neighborhood aids or hinders agent movement. Unlike a traditional supervised learning approach, this algorithm is based on physical insights and scaling arguments, and does not rely on training-data. Data-agnostic approaches like this have relevance to a large class of real-world problems where clean, labeled data is difficult to obtain.
  arXiv  Detail & Related papers  (2021-10-12T09:59:54Z)
• You Never Cluster Alone [150.94921340034688]
  We extend the mainstream contrastive learning paradigm to a cluster-level scheme, where all the data subjected to the same cluster contribute to a unified representation. We define a set of categorical variables as clustering assignment confidence, which links the instance-level learning track with the cluster-level one. By reparametrizing the assignment variables, TCC is trained end-to-end, requiring no alternating steps.
  arXiv  Detail & Related papers  (2021-06-03T14:59:59Z)
• MultiFair: Multi-Group Fairness in Machine Learning [52.24956510371455]
  We study multi-group fairness in machine learning (MultiFair) We propose a generic end-to-end algorithmic framework to solve it. Our proposed framework is generalizable to many different settings.
  arXiv  Detail & Related papers  (2021-05-24T02:30:22Z)
• Through the Data Management Lens: Experimental Analysis and Evaluation of Fair Classification [75.49600684537117]
  Data management research is showing an increasing presence and interest in topics related to data and algorithmic fairness. We contribute a broad analysis of 13 fair classification approaches and additional variants, over their correctness, fairness, efficiency, scalability, and stability. Our analysis highlights novel insights on the impact of different metrics and high-level approach characteristics on different aspects of performance.
  arXiv  Detail & Related papers  (2021-01-18T22:55:40Z)
• Whole MILC: generalizing learned dynamics across tasks, datasets, and populations [14.99255412075299]
  Theory of disorder-specific dynamics crucial for early diagnosis and understanding disorder mechanism. In this paper we present a novel supervised training model which reinforces whole mutual sequence information local to context. We test our model on three different disorders (i) Schizophrenia (ii) and (iii) Alzheimers and four different studies.
  arXiv  Detail & Related papers  (2020-07-29T21:07:30Z)
• Temporal Phenotyping using Deep Predictive Clustering of Disease Progression [97.88605060346455]
  We develop a deep learning approach for clustering time-series data, where each cluster comprises patients who share similar future outcomes of interest. Experiments on two real-world datasets show that our model achieves superior clustering performance over state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2020-06-15T20:48:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.