Domain adaptation for handwriting trajectory reconstruction from IMU sensors
- URL: http://arxiv.org/abs/2607.26736v1
- Date: Wed, 29 Jul 2026 10:29:08 GMT
- Title: Domain adaptation for handwriting trajectory reconstruction from IMU sensors
- Abstract summary: This study focuses on a digital pen equipped with kinematic sensors, allowing users to write on any surface while simultaneously preserving a digital trajectory of handwriting.<n>A major issue is based on the difference in captured signals between adults and children.<n>For similar handwriting trace, we have large differences in sensor signals due to differences in speed and confidence in the handwriting gesture of children.
- Score: 2.3759453477621864
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Digital pens are commonly used to write on digital devices, providing the handwriting trace and enhancing human-computer interation. This study focuses on a digital pen equipped with kinematic sensors, allowing users to write on any surface while simultaneously preserving a digital trajectory of handwriting. This technology holds significant potential as a valuable educational tool, particularly in classrooms where it can facilitate the process of learning to write. A major issue is based on the difference in captured signals between adults and children. For similar handwriting trace, we have large differences in sensor signals due to differences in speed and confidence in the handwriting gesture of children. To address this, we investigate a domain adaptation approach to build a unified intermediate feature representation aimed at facilitating the trajectory reconstruction. We demonstrate the interest of domain adaptation methods in leveraging existing knowledge for application in different contexts. Specifically, we compare our domain adaptation approach with two other methods: training the model from scratch and fine-tuning the model.
Related papers
- Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network [3.3424188506979147]
We focus on a digital pen equipped with sensors from which one wants to reconstruct the Online Handwriting trajectory.<n>We introduce a novel processing pipeline that maps the sensor signals of the pen to the corresponding OH trajectory.<n>We introduce a dedicated neural network architecture, inspired by a Temporal Convolutional Network, to reconstruct the online trajectory from the pen sensor signals.
arXiv Detail & Related papers (2026-07-29T10:23:18Z) - Mixture-of-experts for handwriting trajectory reconstruction from IMU sensors [2.3759453477621864]
We focus on a digital pen equipped with sensors where we aim at reconstructing the online handwriting trajectory.<n>This pen enables writing on any surface and preserving the digital trace of handwriting.
arXiv Detail & Related papers (2026-07-29T09:53:26Z) - Online Writer Retrieval with Chinese Handwritten Phrases: A Synergistic Temporal-Frequency Representation Learning Approach [53.189911918976655]
We propose DOLPHIN, a novel retrieval model designed to enhance handwriting representations through synergistic temporal-frequency analysis.<n>We introduce OLIWER, a large-scale online writer retrieval dataset encompassing over 670,000 Chinese handwritten phrases from 1,731 individuals.<n>Our findings emphasize the significance of point sampling frequency and pressure features in improving handwriting representation quality.
arXiv Detail & Related papers (2024-12-16T11:19:22Z) - Sampling and Ranking for Digital Ink Generation on a tight computational
budget [69.15275423815461]
We study ways to maximize the quality of the output of a trained digital ink generative model.
We use and compare the effect of multiple sampling and ranking techniques, in the first ablation study of its kind in the digital ink domain.
arXiv Detail & Related papers (2023-06-02T09:55:15Z) - Representation Learning for Tablet and Paper Domain Adaptation in Favor
of Online Handwriting Recognition [3.071136270246468]
The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on.
This paper proposes a supervised domain adaptation (DA) approach to enhance learning for online handwriting (OnHW) recognition between tablet and paper data.
arXiv Detail & Related papers (2023-01-16T07:48:37Z) - Letter-level Online Writer Identification [86.13203975836556]
We focus on a novel problem, letter-level online writer-id, which requires only a few trajectories of written letters as identification cues.
A main challenge is that a person often writes a letter in different styles from time to time.
We refer to this problem as the variance of online writing styles (Var-O-Styles)
arXiv Detail & Related papers (2021-12-06T07:21:53Z) - Digitizing Handwriting with a Sensor Pen: A Writer-Independent
Recognizer [0.2580765958706854]
This paper presents a writer-independent system that recognizes characters written on plain paper with the use of a sensor-equipped pen.
The pen provides linear acceleration, angular velocity, magnetic field, and force applied by the user, and acts as a digitizer that transforms the analogue signals of the sensors into time data while writing on regular paper.
We present the results of a convolutional neural network model for letter classification and show that this approach is practical and achieves promising results for writer-independent character recognition.
arXiv Detail & Related papers (2021-07-08T09:25:59Z) - SmartPatch: Improving Handwritten Word Imitation with Patch
Discriminators [67.54204685189255]
We propose SmartPatch, a new technique increasing the performance of current state-of-the-art methods.
We combine the well-known patch loss with information gathered from the parallel trained handwritten text recognition system.
This leads to a more enhanced local discriminator and results in more realistic and higher-quality generated handwritten words.
arXiv Detail & Related papers (2021-05-21T18:34:21Z) - Handwriting Quality Analysis using Online-Offline Models [4.61479186986544]
This work is part of an innovative e-learning project allowing the development of an advanced digital educational tool.
It automatically detects mistakes, gives real-time on-line feedback for children's writing, and helps teachers comprehend and evaluate children's writing skills.
arXiv Detail & Related papers (2020-10-09T14:33:56Z) - Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision
Action Recognition [131.6328804788164]
We propose a framework, named Semantics-aware Adaptive Knowledge Distillation Networks (SAKDN), to enhance action recognition in vision-sensor modality (videos)
The SAKDN uses multiple wearable-sensors as teacher modalities and uses RGB videos as student modality.
arXiv Detail & Related papers (2020-09-01T03:38:31Z) - Transferring Cross-domain Knowledge for Video Sign Language Recognition [103.9216648495958]
Word-level sign language recognition (WSLR) is a fundamental task in sign language interpretation.
We propose a novel method that learns domain-invariant visual concepts and fertilizes WSLR models by transferring knowledge of subtitled news sign to them.
arXiv Detail & Related papers (2020-03-08T03:05:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.