Despite the numerous approaches available in the state-of-the-art, the design of a full-reference image quality assessment metric aligned to human perception remains an open challenge. One possible reason is that most existing metrics fail to faithfully reproduce human judgments, as they disregard the global semantic structure of a scene. To fill this gap, we introduce a new method that evaluates image quality by explicitly modeling the preservation of semantic content. Segmentation masks are used to estimate semantic information loss, which is then integrated into the LPIPS framework, thus enabling the perceptual distance to account for semantic consistency. Experimental results show consistent improvements over the LPIPS baseline and competitive performance with respect to state-of-the-art methods, suggesting that semantic information loss is a useful cue for perceptual quality evaluation.

Beyond Pixels: Assessing Image Quality through Semantic Information Loss

Gallina, Annalisa;Baldoni, Sara;Battisti, Federica
2026

Abstract

Despite the numerous approaches available in the state-of-the-art, the design of a full-reference image quality assessment metric aligned to human perception remains an open challenge. One possible reason is that most existing metrics fail to faithfully reproduce human judgments, as they disregard the global semantic structure of a scene. To fill this gap, we introduce a new method that evaluates image quality by explicitly modeling the preservation of semantic content. Segmentation masks are used to estimate semantic information loss, which is then integrated into the LPIPS framework, thus enabling the perceptual distance to account for semantic consistency. Experimental results show consistent improvements over the LPIPS baseline and competitive performance with respect to state-of-the-art methods, suggesting that semantic information loss is a useful cue for perceptual quality evaluation.
2026
2026 18th International Conference on Quality of Multimedia Experience, QoMEX 2026
18th International Conference on Quality of Multimedia Experience, QoMEX 2026
   Hybrid Extended reAliTy
   HEAT
   European Commission
   Horizon Europe Framework Programme - HORIZON Research and Innovation Actions
   101135637
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/3617240
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact