It's Time to Get It Right: Improving Analog Clock Reading and Clock-Hand Spatial Reasoning in Vision-Language Models

• URL: http://arxiv.org/abs/2603.08011v1
• Date: Mon, 09 Mar 2026 06:33:49 GMT
• Title: It's Time to Get It Right: Improving Analog Clock Reading and Clock-Hand Spatial Reasoning in Vision-Language Models
• Abstract summary: Reading analog clocks in real-world environments remains a significant challenge for state-of-the-art vision-language models.<n>We introduce TickTockVQA, a human-annotated dataset containing analog clocks in diverse real-world scenarios.<n>We propose Swap-DPO, a direct preference optimization based fine-tuning framework to align model reasoning toward accurate time interpretation.
• Score: 1.8502648146670075
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Advances in vision-language models (VLMs) have achieved remarkable success on complex multimodal reasoning tasks, leading to the assumption that they should also excel at reading analog clocks. However, contrary to this expectation, our study reveals that reading analog clocks in real-world environments remains a significant challenge for state-of-the-art VLMs. Existing analog clock datasets are largely synthetic or planar with limited stylistic diversity and minimal background context, failing to capture the visual variability of real-world scenes. As a result, VLMs trained on such data exhibit weak spatial-temporal reasoning, frequently confusing the hour and minute hands and struggling under common visual conditions such as occlusion, lighting variation, and cluttered backgrounds. To address this issue, we introduce TickTockVQA, a human-annotated dataset containing analog clocks in diverse real-world scenarios. TickTockVQA provides explicit hour and minute annotations, and includes an AM/PM tag when it is inferable from the visual context. Furthermore, we propose Swap-DPO, a direct preference optimization based fine-tuning framework to align model reasoning toward accurate time interpretation. Experimental results demonstrate that our approach substantially enhances clock reading accuracy and robustness under real-world conditions, establishing a foundation for future research on spatial-temporal reasoning and visual understanding in VLMs.

Related papers

• TimeVista: Exploring and Exploiting Vision-Language Models as Judges for Time Series Forecasting [51.59529402134439]
  ''LLM-as-a-Judge'' paradigm has revolutionized text evaluation by providing flexible, human-aligned judgment.<n>We propose a novel framework integrating micro- and macro-level judgments informed by contextual information.<n>Extensive meta-evaluations demonstrate that Vision-Language Models (VLMs) are highly reliable judges.
  arXiv  Detail & Related papers  (2026-06-15T03:39:55Z)
• Seeing Time: Benchmarking Chronological Reasoning and Shortcut Biases in Vision-Language Models [12.772555267973123]
  We introduce a novel benchmark designed to evaluate how Vision-Language Models perceive and reason about chronological information.<n>Our work delves into the underlying logic of chronological judgment and the expansion toward multimodal integration.
  arXiv  Detail & Related papers  (2026-06-04T04:49:09Z)
• Tracking the Truth: Object-Centric Spatio-Temporal Monitoring for Video Large Language Models [154.39583176906893]
  Large language models (MLs) have advanced understanding, they remain highly prone to hallucinations in scenes.<n>We argue this stems from a failure intemporal monitoring, the ability to persistently track object dynamic identities, states, and relations over time.<n>Existing benchmarks obscure this deficit relying on single final-answer queries that can often be resolved via local visual cues or statistical priors.
  arXiv  Detail & Related papers  (2026-05-09T14:32:36Z)
• VETime: Vision Enhanced Zero-Shot Time Series Anomaly Detection [36.10754425277683]
  Time-series anomaly detection (TSAD) requires identifying both immediate Point Anomalies and long-range Context Anomalies.<n>We propose VETime, the first TSAD framework that unifies temporal and visual modalities through fine-grained visual-temporal alignment and dynamic fusion.<n> VETime significantly outperforms state-of-the-art models in zero-shot scenarios, achieving superior localization precision with lower computational overhead than current vision-based approaches.
  arXiv  Detail & Related papers  (2026-02-18T18:22:22Z)
• CycliST: A Video Language Model Benchmark for Reasoning on Cyclical State Transitions [35.80224795551762]
  We present CycliST, a novel benchmark dataset designed to evaluate Video Language Models (VLM) on their ability for textual reasoning over cyclical state transitions.<n>We conduct extensive experiments with current state-of-the-art VLMs, both open-source and proprietary, and reveal their limitations in generalizing to cyclical dynamics.<n>Our results demonstrate that present-day VLMs struggle to reliably detect and exploit cyclic patterns, lack a notion of temporal understanding, and are unable to extract quantitative insights from scenes such as the number of objects in motion.
  arXiv  Detail & Related papers  (2025-11-30T21:28:41Z)
• Harnessing Synthetic Preference Data for Enhancing Temporal Understanding of Video-LLMs [54.502280390499756]
  We propose TimeWarp to create a targeted synthetic temporal dataset to fine-tune the model's responses to encourage it to focus on the given input video.<n>We demonstrate that when our method is applied to existing models, it significantly improves performance on temporal understanding benchmarks.
  arXiv  Detail & Related papers  (2025-10-04T21:48:40Z)
• Bridging Past and Future: Distribution-Aware Alignment for Time Series Forecasting [30.686607555300366]
  We introduce TimeAlign, a representation-learning framework for time series forecasters.<n>We explicitly align past and future representations, thereby bridging the distributional gap between input histories and future targets.<n>The gains arise primarily from correcting frequency mismatches between historical inputs and future outputs.
  arXiv  Detail & Related papers  (2025-09-17T17:12:39Z)
• TimeCausality: Evaluating the Causal Ability in Time Dimension for Vision Language Models [13.018267909897014]
  Reasoning about temporal causality, particularly irreversible transformations of objects governed by real-world knowledge, is a fundamental aspect of human visual understanding.<n>We introduce textbfTimeCausality, a novel benchmark designed to evaluate the causal reasoning ability of Vision-Language Models (VLMs) in the temporal dimension.<n>We find that while the current SOTA open-source VLMs have achieved performance levels comparable to closed-source models like GPT-4o, they fall significantly behind on our benchmark compared with their closed-source competitors.
  arXiv  Detail & Related papers  (2025-05-21T12:18:02Z)
• ST-VLM: Kinematic Instruction Tuning for Spatio-Temporal Reasoning in Vision-Language Models [63.12671761097701]
  Vision-Language Models (Ms) struggle to analyze elements like traveled distance and speed of moving objects.<n>We construct a benchmark dataset referred to as STKit and ST-Bench.<n>We show that ST-VLM generalizes robustly across diverse domains and tasks.
  arXiv  Detail & Related papers  (2025-03-25T05:08:06Z)
• Zero-Shot Video Moment Retrieval from Frozen Vision-Language Models [58.17315970207874]
  We propose a zero-shot method for adapting generalisable visual-textual priors from arbitrary VLM to facilitate moment-text alignment. Experiments conducted on three VMR benchmark datasets demonstrate the notable performance advantages of our zero-shot algorithm.
  arXiv  Detail & Related papers  (2023-09-01T13:06:50Z)
• OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning [67.07363529640784]
  We propose OpenSTL to categorize prevalent approaches into recurrent-based and recurrent-free models. We conduct standard evaluations on datasets across various domains, including synthetic moving object trajectory, human motion, driving scenes, traffic flow and forecasting weather. We find that recurrent-free models achieve a good balance between efficiency and performance than recurrent models.
  arXiv  Detail & Related papers  (2023-06-20T03:02:14Z)
• It's About Time: Analog Clock Reading in the Wild [93.84801062680786]
  We present a framework for reading analog clocks in natural images or videos. We create a scalable pipeline for generating synthetic clocks, significantly reducing the requirements for the labour-intensive annotations. We show that the model trained on the proposed synthetic dataset generalises towards real clocks with good accuracy.
  arXiv  Detail & Related papers  (2021-11-17T14:52:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.