How to measure consumer's inconsistency in sensory testing?

Consumer sensory testing is the basis for determining directions of product development in the food industry. However, while compliance assessment by trained and expert assessors is well developed, few information is available on testing consumer consistency. Therefore, we provide a statistical fram...

Full description

Saved in:
Bibliographic Details
Main Authors: László Sipos, Kolos Csaba Ágoston, Péter Biró, Sándor Bozóki, László Csató
Format: Article
Language:English
Published: Elsevier 2025-01-01
Series:Current Research in Food Science
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2665927125000139
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832573051163639808
author László Sipos
Kolos Csaba Ágoston
Péter Biró
Sándor Bozóki
László Csató
author_facet László Sipos
Kolos Csaba Ágoston
Péter Biró
Sándor Bozóki
László Csató
author_sort László Sipos
collection DOAJ
description Consumer sensory testing is the basis for determining directions of product development in the food industry. However, while compliance assessment by trained and expert assessors is well developed, few information is available on testing consumer consistency. Therefore, we provide a statistical framework to rank assessors and attributes according to the level of inconsistency, as well as to identify inconsistent assessors, based on Kendall rank correlation coefficients. The detection of (in)consistency requires evaluations on two connected scales. The suggested approach is illustrated by data from sensory tests of biscuits enriched with three pollens at different levels. 100 consumers evaluated the samples on two different scales (nine category monotonic ascending hedonic response scale, five-category just about right (JAR) intensity scale). The 88 consistent assessors are found using a wider range of both the liking scale and JAR scale than the 12 inconsistent assessors whose evaluations do not have a significantly negative rank correlation. Future consumer tests are recommended to include multiple scales. The proposed framework aims to identify and even filter out the potentially biasing inconsistent evaluations. Questions on attributes leading to highly inconsistent responses should be reconsidered in future sensory tests on the same food product.
format Article
id doaj-art-02a9692014b343469d6e6032a81f9da5
institution Kabale University
issn 2665-9271
language English
publishDate 2025-01-01
publisher Elsevier
record_format Article
series Current Research in Food Science
spelling doaj-art-02a9692014b343469d6e6032a81f9da52025-02-02T05:29:18ZengElsevierCurrent Research in Food Science2665-92712025-01-0110100982How to measure consumer's inconsistency in sensory testing?László Sipos0Kolos Csaba Ágoston1Péter Biró2Sándor Bozóki3László Csató4Department of Postharvest, Commercial and Sensory Science, Institute of Food Science and Technology, Hungarian University of Agriculture and Life Sciences, Budapest, Hungary; HUN-REN Institute of Economics, Centre for Economic and Regional Studies (HUN-REN KRTK), Budapest, Hungary; Corresponding author. Department of Postharvest, Commercial and Sensory Science, Institute of Food Science and Technology, Hungarian University of Agriculture and Life Sciences, Budapest, Hungary.Department of Operations Research and Actuarial Sciences, Institute of Operations and Decision Sciences, Corvinus University of Budapest, HungaryHUN-REN Institute of Economics, Centre for Economic and Regional Studies (HUN-REN KRTK), Budapest, Hungary; Department of Operations Research and Actuarial Sciences, Institute of Operations and Decision Sciences, Corvinus University of Budapest, HungaryDepartment of Operations Research and Actuarial Sciences, Institute of Operations and Decision Sciences, Corvinus University of Budapest, Hungary; HUN-REN Institute for Computer Science and Control (HUN-REN SZTAKI), Laboratory on Engineering and Management Intelligence, Research Group of Operations Research and Decision Systems, Budapest, HungaryDepartment of Operations Research and Actuarial Sciences, Institute of Operations and Decision Sciences, Corvinus University of Budapest, Hungary; HUN-REN Institute for Computer Science and Control (HUN-REN SZTAKI), Laboratory on Engineering and Management Intelligence, Research Group of Operations Research and Decision Systems, Budapest, HungaryConsumer sensory testing is the basis for determining directions of product development in the food industry. However, while compliance assessment by trained and expert assessors is well developed, few information is available on testing consumer consistency. Therefore, we provide a statistical framework to rank assessors and attributes according to the level of inconsistency, as well as to identify inconsistent assessors, based on Kendall rank correlation coefficients. The detection of (in)consistency requires evaluations on two connected scales. The suggested approach is illustrated by data from sensory tests of biscuits enriched with three pollens at different levels. 100 consumers evaluated the samples on two different scales (nine category monotonic ascending hedonic response scale, five-category just about right (JAR) intensity scale). The 88 consistent assessors are found using a wider range of both the liking scale and JAR scale than the 12 inconsistent assessors whose evaluations do not have a significantly negative rank correlation. Future consumer tests are recommended to include multiple scales. The proposed framework aims to identify and even filter out the potentially biasing inconsistent evaluations. Questions on attributes leading to highly inconsistent responses should be reconsidered in future sensory tests on the same food product.http://www.sciencedirect.com/science/article/pii/S2665927125000139ConsistencyConsumer sensory testingJAR scaleLiking scoreProduct development
spellingShingle László Sipos
Kolos Csaba Ágoston
Péter Biró
Sándor Bozóki
László Csató
How to measure consumer's inconsistency in sensory testing?
Current Research in Food Science
Consistency
Consumer sensory testing
JAR scale
Liking score
Product development
title How to measure consumer's inconsistency in sensory testing?
title_full How to measure consumer's inconsistency in sensory testing?
title_fullStr How to measure consumer's inconsistency in sensory testing?
title_full_unstemmed How to measure consumer's inconsistency in sensory testing?
title_short How to measure consumer's inconsistency in sensory testing?
title_sort how to measure consumer s inconsistency in sensory testing
topic Consistency
Consumer sensory testing
JAR scale
Liking score
Product development
url http://www.sciencedirect.com/science/article/pii/S2665927125000139
work_keys_str_mv AT laszlosipos howtomeasureconsumersinconsistencyinsensorytesting
AT koloscsabaagoston howtomeasureconsumersinconsistencyinsensorytesting
AT peterbiro howtomeasureconsumersinconsistencyinsensorytesting
AT sandorbozoki howtomeasureconsumersinconsistencyinsensorytesting
AT laszlocsato howtomeasureconsumersinconsistencyinsensorytesting