Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network

• URL: http://arxiv.org/abs/2607.26733v1
• Date: Wed, 29 Jul 2026 10:23:18 GMT
• Title: Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network
• Abstract summary: We focus on a digital pen equipped with sensors from which one wants to reconstruct the Online Handwriting trajectory.<n>We introduce a novel processing pipeline that maps the sensor signals of the pen to the corresponding OH trajectory.<n>We introduce a dedicated neural network architecture, inspired by a Temporal Convolutional Network, to reconstruct the online trajectory from the pen sensor signals.
• Score: 3.3424188506979147
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Handwriting with digital pens is a common way to facilitate human-computer interaction through the use of Online Handwriting (OH) trajectory reconstruction. In this work, we focus on a digital pen equipped with sensors from which one wants to reconstruct the OH trajectory. Such a pen allows to write on any surface and to get the digital trace, which can help learning to write, by writing on paper, and can be useful for many other applications such as collaborative meetings, etc. In this paper, we introduce a novel processing pipeline that maps the sensor signals of the pen to the corresponding OH trajectory. Notably, in order to tackle the difference of sampling rates between the pen and the tablet (which provides ground truth information), our preprocessing pipeline relies on Dynamic Time Warping to align the signals. We introduce a dedicated neural network architecture, inspired by a Temporal Convolutional Network, to reconstruct the online trajectory from the pen sensor signals. Finally, we also present a new benchmark dataset on which our method is evaluated both qualitatively and quantitatively, showing a notable improvement over its most notable competitor.

Related papers

• Write on Paper and Get the Online Digital Trace:\ ewline A New Era for Handwriting [0.04497001527881303]
  We propose an innovative solution that combines a digital pen, advanced artificial intelligence algorithms, and adaptive AI techniques to reconstruct the digital trace of handwriting.<n>This work aims to advance the state-of-the-art in automated trace reconstruction of handwriting, enabling a seamless connection between traditional handwriting on paper and capturing the trace digitally.
  arXiv  Detail & Related papers  (2026-09-11T10:53:46Z)
• Domain adaptation for handwriting trajectory reconstruction from IMU sensors [2.3759453477621864]
  This study focuses on a digital pen equipped with kinematic sensors, allowing users to write on any surface while simultaneously preserving a digital trajectory of handwriting.<n>A major issue is based on the difference in captured signals between adults and children.<n>For similar handwriting trace, we have large differences in sensor signals due to differences in speed and confidence in the handwriting gesture of children.
  arXiv  Detail & Related papers  (2026-07-29T10:29:08Z)
• Mixture-of-experts for handwriting trajectory reconstruction from IMU sensors [2.3759453477621864]
  We focus on a digital pen equipped with sensors where we aim at reconstructing the online handwriting trajectory.<n>This pen enables writing on any surface and preserving the digital trace of handwriting.
  arXiv  Detail & Related papers  (2026-07-29T09:53:26Z)
• Detecting Pen-In-Air States from Video: A Proof-of-Concept Toward Complementary Handwriting Analysis [1.8744230606349503]
  Tablet-based sensing restricts analysis of Pen-Up behavior to a short proximity range above the writing surface.<n>We propose a hybrid pipeline combining pen-tip tracking using a YOLO-based detector with kinematic feature extraction and machine learning classification.<n>Results support the feasibility of video-based Pen-Up detection as a low-cost and non-intrusive complement to digitizing tablets, and provide a foundation for future large-scale studies.
  arXiv  Detail & Related papers  (2026-06-01T14:50:27Z)
• Online Writer Retrieval with Chinese Handwritten Phrases: A Synergistic Temporal-Frequency Representation Learning Approach [53.189911918976655]
  We propose DOLPHIN, a novel retrieval model designed to enhance handwriting representations through synergistic temporal-frequency analysis.<n>We introduce OLIWER, a large-scale online writer retrieval dataset encompassing over 670,000 Chinese handwritten phrases from 1,731 individuals.<n>Our findings emphasize the significance of point sampling frequency and pressure features in improving handwriting representation quality.
  arXiv  Detail & Related papers  (2024-12-16T11:19:22Z)
• Sampling and Ranking for Digital Ink Generation on a tight computational budget [69.15275423815461]
  We study ways to maximize the quality of the output of a trained digital ink generative model. We use and compare the effect of multiple sampling and ranking techniques, in the first ablation study of its kind in the digital ink domain.
  arXiv  Detail & Related papers  (2023-06-02T09:55:15Z)
• Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits [61.94533459151743]
  This work addresses the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)
• LHNN: Lattice Hypergraph Neural Network for VLSI Congestion Prediction [70.31656245793302]
  lattice hypergraph (LH-graph) is a novel graph formulation for circuits. LHNN constantly achieves more than 35% improvements compared with U-nets and Pix2Pix on the F1 score.
  arXiv  Detail & Related papers  (2022-03-24T03:31:18Z)
• Digitizing Handwriting with a Sensor Pen: A Writer-Independent Recognizer [0.2580765958706854]
  This paper presents a writer-independent system that recognizes characters written on plain paper with the use of a sensor-equipped pen. The pen provides linear acceleration, angular velocity, magnetic field, and force applied by the user, and acts as a digitizer that transforms the analogue signals of the sensors into time data while writing on regular paper. We present the results of a convolutional neural network model for letter classification and show that this approach is practical and achieves promising results for writer-independent character recognition.
  arXiv  Detail & Related papers  (2021-07-08T09:25:59Z)
• Towards an IMU-based Pen Online Handwriting Recognizer [2.6707647984082357]
  We present a online handwriting recognition system for word recognition based on inertial measurement units (IMUs) This is obtained by means of a sensor-equipped pen that provides acceleration, angular velocity, and magnetic forces streamed via Bluetooth. Our model combines convolutional and bidirectional LSTM networks, and is trained with the Connectionist Temporal Classification loss.
  arXiv  Detail & Related papers  (2021-05-26T09:47:19Z)
• Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfaces [68.12457459590921]
  Reconstructing continuous surfaces from 3D point clouds is a fundamental operation in 3D geometry processing. We introduce textitNeural-Pull, a new approach that is simple and leads to high quality SDFs.
  arXiv  Detail & Related papers  (2020-11-26T23:18:10Z)
• Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition [131.6328804788164]
  We propose a framework, named Semantics-aware Adaptive Knowledge Distillation Networks (SAKDN), to enhance action recognition in vision-sensor modality (videos) The SAKDN uses multiple wearable-sensors as teacher modalities and uses RGB videos as student modality.
  arXiv  Detail & Related papers  (2020-09-01T03:38:31Z)
• One-step regression and classification with crosspoint resistive memory arrays [62.997667081978825]
  High speed, low energy computing machines are in demand to enable real-time artificial intelligence at the edge. One-step learning is supported by simulations of the prediction of the cost of a house in Boston and the training of a 2-layer neural network for MNIST digit recognition. Results are all obtained in one computational step, thanks to the physical, parallel, and analog computing within the crosspoint array.
  arXiv  Detail & Related papers  (2020-05-05T08:00:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.