Characterizing the visual representation of objects from the child's view

• URL: http://arxiv.org/abs/2605.14990v1
• Date: Thu, 14 May 2026 15:52:20 GMT
• Title: Characterizing the visual representation of objects from the child's view
• Abstract summary: We analyzed first-person videos of young children's visual experience at home from the BabyView dataset.<n>We found that children's object category exposure was highly skewed.<n> Category exemplars were highly variable: children encountered objects from unusual angles, in highly cluttered scenes, and partially occluded views.
• Score: 2.586100784625842
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Children acquire object category representations from their everyday experiences in the first few years of life. What do the inputs to this learning process look like? We analyzed first-person videos of young children's visual experience at home from the BabyView dataset ($N$ = 31 participants, 868 hours, ages 5--36 months), using a supervised object detection model to extract common object categories from more than 3 million frames. We found that children's object category exposure was highly skewed: a few categories (e.g., cups, chairs) dominated children's visual experiences while most categories appeared rarely, replicating previous findings from a more restricted set of contexts. Category exemplars were highly variable: children encountered objects from unusual angles, in highly cluttered scenes, and partially occluded views; many categories (especially animals) were most frequently viewed as depictions. Surprisingly, despite this variability, detected categories (e.g., giraffes, apples) showed stronger groupings within superordinate categories (e.g., animals, food) relative to groupings derived from canonical photographs of these categories. We found this same pattern when using high-dimensional embeddings from both self-supervised visual and multimodal models; this effect was also recapitulated in densely sampled data from individual children. Understanding the robustness and efficiency of visual category learning will require the development of models that can exploit strong superordinate structure and learn from non-canonical, sparse, and variable exemplars.

Related papers

• Assessing the alignment between infants' visual and linguistic experience using multimodal language models [2.275358921334511]
  How aligned in time are children's visual and linguistic experiences during everyday learning?<n>We show that idealized aligned moments for learning are relatively rare in children's everyday experiences compared to modern machine learning datasets.<n>These findings suggest that infrequent alignment is a constraint for models describing early word learning.
  arXiv  Detail & Related papers  (2025-11-24T06:58:16Z)
• A solution to generalized learning from small training sets found in everyday infant experiences [6.323444741009534]
  We analyze egocentric images from 14 infants (aged 7 to 11 months)<n>We show that their everyday visual input exhibits a lumpy similarity structure, with clusters of highly similar images interspersed with rarer, more variable ones.<n>Experiments show that mimicking this structure in machines improves generalization from small datasets in machine learning.
  arXiv  Detail & Related papers  (2025-10-16T18:21:55Z)
• Toddlers' Active Gaze Behavior Supports Self-Supervised Object Learning [4.612042044544857]
  We show that toddlers' gaze strategy supports the learning of invariant object representations.<n>Our work reveals how toddlers' gaze behavior may support their development of view-invariant object recognition.
  arXiv  Detail & Related papers  (2024-11-04T10:44:46Z)
• Evaluating Multiview Object Consistency in Humans and Image Models [68.36073530804296]
  We leverage an experimental design from the cognitive sciences which requires zero-shot visual inferences about object shape. We collect 35K trials of behavioral data from over 500 participants. We then evaluate the performance of common vision models.
  arXiv  Detail & Related papers  (2024-09-09T17:59:13Z)
• Learning high-level visual representations from a child's perspective without strong inductive biases [21.466000613898988]
  We train state-of-the-art neural networks on a realistic proxy of a child's visual experience without explicit supervision. We train both embedding models and generative models on 200 hours of headcam video from a single child. Generative models trained with the same data successfully extrapolate simple properties of partially masked objects.
  arXiv  Detail & Related papers  (2023-05-24T17:26:59Z)
• Embodied vision for learning object representations [4.211128681972148]
  We show that visual statistics mimicking those of a toddler improve object recognition accuracy in both familiar and novel environments. We argue that this effect is caused by the reduction of features extracted in the background, a neural network bias for large features in the image and a greater similarity between novel and familiar background regions.
  arXiv  Detail & Related papers  (2022-05-12T16:36:27Z)
• Unsupervised Part Discovery from Contrastive Reconstruction [90.88501867321573]
  The goal of self-supervised visual representation learning is to learn strong, transferable image representations. We propose an unsupervised approach to object part discovery and segmentation. Our method yields semantic parts consistent across fine-grained but visually distinct categories.
  arXiv  Detail & Related papers  (2021-11-11T17:59:42Z)
• Unsupervised Object Learning via Common Fate [61.14802390241075]
  Learning generative object models from unlabelled videos is a long standing problem and required for causal scene modeling. We decompose this problem into three easier subtasks, and provide candidate solutions for each of them. We show that our approach allows learning generative models that generalize beyond the occlusions present in the input videos.
  arXiv  Detail & Related papers  (2021-10-13T08:22:04Z)
• Closing the Generalization Gap in One-Shot Object Detection [92.82028853413516]
  We show that the key to strong few-shot detection models may not lie in sophisticated metric learning approaches, but instead in scaling the number of categories. Future data annotation efforts should therefore focus on wider datasets and annotate a larger number of categories.
  arXiv  Detail & Related papers  (2020-11-09T09:31:17Z)
• What Can You Learn from Your Muscles? Learning Visual Representation from Human Interactions [50.435861435121915]
  We use human interaction and attention cues to investigate whether we can learn better representations compared to visual-only representations. Our experiments show that our "muscly-supervised" representation outperforms a visual-only state-of-the-art method MoCo.
  arXiv  Detail & Related papers  (2020-10-16T17:46:53Z)
• Self-supervised Single-view 3D Reconstruction via Semantic Consistency [142.71430568330172]
  We learn a self-supervised, single-view 3D reconstruction model that predicts the shape, texture and camera pose of a target object. The proposed method does not necessitate 3D supervision, manually annotated keypoints, multi-view images of an object or a prior 3D template.
  arXiv  Detail & Related papers  (2020-03-13T20:29:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.