Date Estimation in the Wild of Scanned Historical Photos: An Image
Retrieval Approach
- URL: http://arxiv.org/abs/2106.05618v1
- Date: Thu, 10 Jun 2021 09:53:03 GMT
- Title: Date Estimation in the Wild of Scanned Historical Photos: An Image
Retrieval Approach
- Authors: Adri\`a Molina and Pau Riba and Lluis Gomez and Oriol Ramos-Terrades
and Josep Llad\'os
- Abstract summary: This paper presents a novel method for date estimation of historical photographs from archival sources.
The main contribution is to formulate the date estimation as a retrieval task, where given a query, the retrieved images are ranked in terms of the estimated date similarity.
We have experimentally evaluated the performance of the method in two different tasks: date estimation and date-sensitive image retrieval.
- Score: 3.5698678013121334
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: This paper presents a novel method for date estimation of historical
photographs from archival sources. The main contribution is to formulate the
date estimation as a retrieval task, where given a query, the retrieved images
are ranked in terms of the estimated date similarity. The closer are their
embedded representations the closer are their dates. Contrary to the
traditional models that design a neural network that learns a classifier or a
regressor, we propose a learning objective based on the nDCG ranking metric. We
have experimentally evaluated the performance of the method in two different
tasks: date estimation and date-sensitive image retrieval, using the DEW public
database, overcoming the baseline methods.
Related papers
- Blind Dates: Examining the Expression of Temporality in Historical
Photographs [57.07335632641355]
We investigate the dating of images using OpenCLIP, an open-source implementation of CLIP, a multi-modal language and vision model.
We use the textitDe Boer Scene Detection dataset, containing 39,866 gray-scale historical press photographs from 1950 to 1999.
Our analysis reveals that images featuring buses, cars, cats, dogs, and people are more accurately dated, suggesting the presence of temporal markers.
arXiv Detail & Related papers (2023-10-10T13:51:24Z) - Exploring the Limits of Historical Information for Temporal Knowledge
Graph Extrapolation [59.417443739208146]
We propose a new event forecasting model based on a novel training framework of historical contrastive learning.
CENET learns both the historical and non-historical dependency to distinguish the most potential entities.
We evaluate our proposed model on five benchmark graphs.
arXiv Detail & Related papers (2023-08-29T03:26:38Z) - Pattern Spotting and Image Retrieval in Historical Documents using Deep
Hashing [60.67014034968582]
This paper presents a deep learning approach for image retrieval and pattern spotting in digital collections of historical documents.
Deep learning models are used for feature extraction, considering two distinct variants, which provide either real-valued or binary code representations.
The proposed approach also reduces the search time by up to 200x and the storage cost up to 6,000x when compared to related works.
arXiv Detail & Related papers (2022-08-04T01:39:37Z) - A Generic Image Retrieval Method for Date Estimation of Historical
Document Collections [0.4588028371034407]
This paper presents a robust date estimation system based in a retrieval approach that generalizes well in front of heterogeneous collections.
We use a ranking loss function named smooth-nDCG to train a Convolutional Neural Network that learns an ordination of documents for each problem.
arXiv Detail & Related papers (2022-04-08T12:30:39Z) - Fusing Local Similarities for Retrieval-based 3D Orientation Estimation
of Unseen Objects [70.49392581592089]
We tackle the task of estimating the 3D orientation of previously-unseen objects from monocular images.
We follow a retrieval-based strategy and prevent the network from learning object-specific features.
Our experiments on the LineMOD, LineMOD-Occluded, and T-LESS datasets show that our method yields a significantly better generalization to unseen objects than previous works.
arXiv Detail & Related papers (2022-03-16T08:53:00Z) - Contextual Similarity Aggregation with Self-attention for Visual
Re-ranking [96.55393026011811]
We propose a visual re-ranking method by contextual similarity aggregation with self-attention.
We conduct comprehensive experiments on four benchmark datasets to demonstrate the generality and effectiveness of our proposed visual re-ranking method.
arXiv Detail & Related papers (2021-10-26T06:20:31Z) - Visual Time Series Forecasting: An Image-driven Approach [15.98940788318796]
We capture input data as an image and train a model to produce the subsequent image.
This approach results in predicting distributions as opposed to pointwise values.
Our experiments show that our forecasting tool is effective for cyclic data but somewhat less for irregular data such as stock prices.
arXiv Detail & Related papers (2021-07-02T20:59:48Z) - Monocular Depth Estimation via Listwise Ranking using the Plackett-Luce
Model [15.472533971305367]
In many real-world applications, the relative depth of objects in an image is crucial for scene understanding.
Recent approaches mainly tackle the problem of depth prediction in monocular images by treating the problem as a regression task.
Yet, ranking methods suggest themselves as a natural alternative to regression, and indeed, ranking approaches leveraging pairwise comparisons have shown promising performance on this problem.
arXiv Detail & Related papers (2020-10-25T13:40:10Z) - Region Comparison Network for Interpretable Few-shot Image
Classification [97.97902360117368]
Few-shot image classification has been proposed to effectively use only a limited number of labeled examples to train models for new classes.
We propose a metric learning based method named Region Comparison Network (RCN), which is able to reveal how few-shot learning works.
We also present a new way to generalize the interpretability from the level of tasks to categories.
arXiv Detail & Related papers (2020-09-08T07:29:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.