Combination of Deep Learning-based and Handcrafted Features for Blind Image Quality Assessment

Aladine Chetouani (1, 2) , Maurice Quach (2) , Giuseppe Valenzise (2) , Frédéric Dufaux (2)

1 Axe Image Vision
2 L2S - Laboratoire des signaux et systèmes

This last decade, a plethora of handcrafted-based image quality metrics has been proposed in the literature. Some of them are based on structural analysis, while some others exploit mutual information or perceptual characteristics. Nowadays, deep learning-based methods are widely used in several domains due to its ability to well fit the target directly from the image. In this paper, we study the impact on the performance of combining handcrafted and Deep Learning-based (DL) features, since each of them extracts specific information. Indeed, DL-based image quality assessment methods often extract local information by extracting small patches, while the handcrafted ones provide global information through a global analysis. We analyzed the performance before and after combining the two using bilinear pooling strategy. Experimental results on commonly used datasets show the relevance of combining both approaches.

Mots clés: Image Quality; Deep learning-based Features; Handcrafted Features; Bilinear Pooling

Domaines: Traitement des images [eess.IV]; Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Aladine Chetouani, Maurice Quach, Giuseppe Valenzise, Frédéric Dufaux. Combination of Deep Learning-based and Handcrafted Features for Blind Image Quality Assessment. 9th European Workshop on Visual Information Processing (EUVIP 2021), Jun 2021, Paris (virtual), France. pp.1-6, ⟨10.1109/EUVIP50544.2021.9484013⟩. ⟨hal-03231269⟩