Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive Dataset

In recent years, the development of metrics to evaluate image aesthetics and photographic quality has proliferated. However, validating these metrics presents challenges due to the inherently subjective nature of aesthetics and photographic quality, which can be influenced by cultural contexts and i...

Full description

Saved in:
Bibliographic Details
Main Authors: Iria Santos, Miguel A. Casal, João Correia, Álvaro Torrente-Patiño, Penousal Machado, Juan Romero
Format: Article
Language:English
Published: Wiley 2024-01-01
Series:Complexity
Online Access:http://dx.doi.org/10.1155/2024/8223586
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832543001486819328
author Iria Santos
Miguel A. Casal
João Correia
Álvaro Torrente-Patiño
Penousal Machado
Juan Romero
author_facet Iria Santos
Miguel A. Casal
João Correia
Álvaro Torrente-Patiño
Penousal Machado
Juan Romero
author_sort Iria Santos
collection DOAJ
description In recent years, the development of metrics to evaluate image aesthetics and photographic quality has proliferated. However, validating these metrics presents challenges due to the inherently subjective nature of aesthetics and photographic quality, which can be influenced by cultural contexts and individual preferences that evolve over time. This article presents a novel validation methodology utilizing a dataset assessed by individuals from two distinct nationalities: the United States and Spain. Evaluation criteria include photographic quality and aesthetic value, with the dataset comprising images previously rated on the DPChallenge photographic portal. We analyze the correlation between these values and provide the dataset for future research endeavors. Our investigation encompasses several metrics, including BRISQUE for assessing photographic quality, NIMA aesthetic and NIMA technical for evaluating both aesthetic and technical aspects, Diffusion Aesthetics (employed in Stable Diffusion), and PhotoILike for gauging the commercial appeal of real estate images. Our findings reveal a significant correlation between the Diffusion Aesthetics metric and aesthetic measures, as well as with the NIMA aesthetics metric, suggesting them as good potential candidates to capture aesthetic value.
format Article
id doaj-art-30d24540964a4d3788be9aeea14c1dfc
institution Kabale University
issn 1099-0526
language English
publishDate 2024-01-01
publisher Wiley
record_format Article
series Complexity
spelling doaj-art-30d24540964a4d3788be9aeea14c1dfc2025-02-03T11:53:34ZengWileyComplexity1099-05262024-01-01202410.1155/2024/8223586Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive DatasetIria Santos0Miguel A. Casal1João Correia2Álvaro Torrente-Patiño3Penousal Machado4Juan Romero5CITIC—Research Center of Information and Communication TechnologiesCITIC—Research Center of Information and Communication TechnologiesCISUCCITIC—Research Center of Information and Communication TechnologiesCISUCCITIC—Research Center of Information and Communication TechnologiesIn recent years, the development of metrics to evaluate image aesthetics and photographic quality has proliferated. However, validating these metrics presents challenges due to the inherently subjective nature of aesthetics and photographic quality, which can be influenced by cultural contexts and individual preferences that evolve over time. This article presents a novel validation methodology utilizing a dataset assessed by individuals from two distinct nationalities: the United States and Spain. Evaluation criteria include photographic quality and aesthetic value, with the dataset comprising images previously rated on the DPChallenge photographic portal. We analyze the correlation between these values and provide the dataset for future research endeavors. Our investigation encompasses several metrics, including BRISQUE for assessing photographic quality, NIMA aesthetic and NIMA technical for evaluating both aesthetic and technical aspects, Diffusion Aesthetics (employed in Stable Diffusion), and PhotoILike for gauging the commercial appeal of real estate images. Our findings reveal a significant correlation between the Diffusion Aesthetics metric and aesthetic measures, as well as with the NIMA aesthetics metric, suggesting them as good potential candidates to capture aesthetic value.http://dx.doi.org/10.1155/2024/8223586
spellingShingle Iria Santos
Miguel A. Casal
João Correia
Álvaro Torrente-Patiño
Penousal Machado
Juan Romero
Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive Dataset
Complexity
title Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive Dataset
title_full Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive Dataset
title_fullStr Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive Dataset
title_full_unstemmed Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive Dataset
title_short Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive Dataset
title_sort towards robust evaluation of aesthetic and photographic quality metrics insights from a comprehensive dataset
url http://dx.doi.org/10.1155/2024/8223586
work_keys_str_mv AT iriasantos towardsrobustevaluationofaestheticandphotographicqualitymetricsinsightsfromacomprehensivedataset
AT miguelacasal towardsrobustevaluationofaestheticandphotographicqualitymetricsinsightsfromacomprehensivedataset
AT joaocorreia towardsrobustevaluationofaestheticandphotographicqualitymetricsinsightsfromacomprehensivedataset
AT alvarotorrentepatino towardsrobustevaluationofaestheticandphotographicqualitymetricsinsightsfromacomprehensivedataset
AT penousalmachado towardsrobustevaluationofaestheticandphotographicqualitymetricsinsightsfromacomprehensivedataset
AT juanromero towardsrobustevaluationofaestheticandphotographicqualitymetricsinsightsfromacomprehensivedataset