Seeing Fast and Slow: Learning the Flow of Time in Videos

• URL: http://arxiv.org/abs/2604.21931v1
• Date: Thu, 23 Apr 2026 17:59:57 GMT
• Title: Seeing Fast and Slow: Learning the Flow of Time in Videos
• Abstract summary: We study time as a learnable visual concept and develop models for reasoning about and manipulating the flow of time in videos.<n>We curate the largest slow-motion video dataset to date from noisy in-the-wild sources.<n>These learned temporal reasoning models enable us to curate the largest slow-motion video dataset to date from noisy in-the-wild sources.
• Score: 58.71893154112877
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: How can we tell whether a video has been sped up or slowed down? How can we generate videos at different speeds? Although videos have been central to modern computer vision research, little attention has been paid to perceiving and controlling the passage of time. In this paper, we study time as a learnable visual concept and develop models for reasoning about and manipulating the flow of time in videos. We first exploit the multimodal cues and temporal structure naturally present in videos to learn, in a self-supervised manner, to detect speed changes and estimate playback speed. We then show that these learned temporal reasoning models enable us to curate the largest slow-motion video dataset to date from noisy in-the-wild sources. Such slow-motion footage, typically filmed by high-speed cameras, contains substantially richer temporal detail than standard videos. Using this data, we further develop models capable of temporal control, including speed-conditioned video generation, which produces motion at specified playback speed, and temporal super-resolution, which tranforms low-FPS, blurry videos into high-FPS sequences with fine-grained temporal details. Our findings highlight time as a manipulable, perceptual dimension in video learning, opening doors to temporally controllable video generation, temporal forensics detection, and potentially richer world-models that understand how events unfold over time.

Related papers

• SlowFast-VGen: Slow-Fast Learning for Action-Driven Long Video Generation [153.46240555355408]
  SlowFast-VGen is a novel dual-speed learning system for action-driven long video generation. Our approach incorporates a conditional video diffusion model for the slow learning of world dynamics. We propose a slow-fast learning loop algorithm that seamlessly integrates the inner fast learning loop into the outer slow learning loop.
  arXiv  Detail & Related papers  (2024-10-30T17:55:52Z)
• VEnhancer: Generative Space-Time Enhancement for Video Generation [123.37212575364327]
  VEnhancer improves the existing text-to-video results by adding more details in spatial domain and synthetic detailed motion in temporal domain. We train a video ControlNet and inject it to the diffusion model as a condition on low frame-rate and low-resolution videos. VEnhancer surpasses existing state-of-the-art video super-resolution and space-time super-resolution methods in enhancing AI-generated videos.
  arXiv  Detail & Related papers  (2024-07-10T13:46:08Z)
• No Time to Waste: Squeeze Time into Channel for Mobile Video Understanding [38.60950616529459]
  We propose to squeeze the time axis of a video sequence into the channel dimension and present a lightweight video recognition network, term as textitSqueezeTime, for mobile video understanding. The proposed SqueezeTime is much lightweight and fast with high accuracies for mobile video understanding.
  arXiv  Detail & Related papers  (2024-05-14T06:32:40Z)
• Time Is MattEr: Temporal Self-supervision for Video Transformers [72.42240984211283]
  We design simple yet effective self-supervised tasks for video models to learn temporal dynamics better. Our method learns the temporal order of video frames as extra self-supervision and enforces the randomly shuffled frames to have low-confidence outputs. Under various video action recognition tasks, we demonstrate the effectiveness of our method and its compatibility with state-of-the-art Video Transformers.
  arXiv  Detail & Related papers  (2022-07-19T04:44:08Z)
• Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer [66.56167074658697]
  We present a method that builds on 3D-VQGAN and transformers to generate videos with thousands of frames. Our evaluation shows that our model trained on 16-frame video clips can generate diverse, coherent, and high-quality long videos. We also showcase conditional extensions of our approach for generating meaningful long videos by incorporating temporal information with text and audio.
  arXiv  Detail & Related papers  (2022-04-07T17:59:02Z)
• SpeedNet: Learning the Speediness in Videos [54.798526633714474]
  SpeedNet is a novel deep network trained to detect if a video is playing at normal rate, or if it is sped up. We show how this single, binary classification network can be used to detect arbitrary rates of speediness of objects.
  arXiv  Detail & Related papers  (2020-04-13T18:00:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.