Connecting Images through Sources: Exploring Low-Data, Heterogeneous Instance Retrieval - HAL Accéder directement au contenu
Article dans une revue Remote Sensing Année : 2021

Connecting Images through Sources: Exploring Low-Data, Heterogeneous Instance Retrieval

Résumé

Along with a new volume of images containing valuable information about our past, the digitization of historical territorial imagery has brought the challenge of understanding and interconnecting collections with unique or rare representation characteristics, and sparse metadata. Content-based image retrieval offers a promising solution in this context, by building links in the data without relying on human supervision. However, while the latest propositions in deep learning have shown impressive results in applications linked to feature learning, they often rely on the hypothesis that there exists a training dataset matching the use case. Increasing generalization and robustness to variations remains an open challenge, poorly understood in the context of real-world applications. Introducing the alegoria benchmark, containing multi-date vertical and oblique aerial digitized photography mixed with more modern street-level pictures, we formulate the problem of low-data, heterogeneous image retrieval, and propose associated evaluation setups and measures. We propose a review of ideas and methods to tackle this problem, extensively compare state-of-the-art descriptors and propose a new multi-descriptor diffusion method to exploit their comparative strengths. Our experiments highlight the benefits of combining descriptors and the compromise between absolute and cross-domain performance.
Loading...

Dates et versions

hal-03336000, version 1 (06-09-2021)

Identifiants

Citer

Dimitri Gominski, Valérie Gouet-Brunet, Liming Chen. Connecting Images through Sources: Exploring Low-Data, Heterogeneous Instance Retrieval. Remote Sensing, 2021, 13 (16), pp.3080. ⟨10.3390/rs13163080⟩. ⟨hal-03336000⟩
76 Consultations
0 Téléchargements
Dernière date de mise à jour le 07/04/2024
comment ces indicateurs sont-ils produits

Altmetric

Partager

Gmail Facebook Twitter LinkedIn Plus