DIFAIR: Towards Learning Differentiated Image Representations - Ecole Nationale du Génie de l'Eau et de l'Environnement de Strasbourg
Communication Dans Un Congrès Année : 2024

DIFAIR: Towards Learning Differentiated Image Representations

Résumé

Neural network classifiers are generally trained to differentiate between the same classes during training and testing. In order to prevent incorrect predictions, when an input image contains a class that was not part of the training set, it should be detected. The process of detection of "unknown" classes is called Open-Set Recognition (OSR). Given that a neural network extracts a representation (a feature vector) describing an image, its capacity to detect the presence of a class in an image, through the recognition of specific features, should also imply the ability to detect the absence of a "known" class, through the absence of those features in the representation. In this article, we present DIFAIR (DIFferentiAted Image Representations), a novel approach aimed at learning a representation exhibiting: (i) class separability, through predefined class positions in the representation space; (ii) the extraction of distinct features, which remain inactive if not present in the image; and (iii) semantic meaning when comparing representations. We present a distance-based loss function to optimize a network, in a supervised way, to obtain the proposed representation. The evaluation of DIFAIR in OSR shows a performance close to a similar, distance-based, method, but below state-of-the-art methods. Finally, we visually inspect learned representations to identify the limits of our approach and present directions for future improvement. Code and more figures are available at https://github.com/qchristoffel/DIFAIR.
Fichier principal
Vignette du fichier
1-s2.0-S1877050924022877-main.pdf (540.88 Ko) Télécharger le fichier
Origine Publication financée par une institution
licence

Dates et versions

hal-04875712 , version 1 (09-01-2025)

Licence

Identifiants

Citer

Quentin Christoffel, Aline Deruyver, Ali Ayadi, Anne Jeannin-Girardon. DIFAIR: Towards Learning Differentiated Image Representations. 28th International Conference on Knowledge Based and Intelligent information and Engineering Systems (KES 2024), Sep 2024, Séville, Spain. pp.216 - 225, ⟨10.1016/j.procs.2024.09.268⟩. ⟨hal-04875712⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More