Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception
To quantify the excellence of multimedia quality, subjective evaluation experiments are conducted. In these experiments, the tradition of quantitative assessment is the most dominating, but it disregards the understanding of participants' interpretations, descriptions, and the evaluation criter...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2010-01-01
|
| Series: | Advances in Multimedia |
| Online Access: | http://dx.doi.org/10.1155/2010/658980 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832551899199438848 |
|---|---|
| author | D. Strohmeier S. Jumisko-Pyykkö K. Kunze |
| author_facet | D. Strohmeier S. Jumisko-Pyykkö K. Kunze |
| author_sort | D. Strohmeier |
| collection | DOAJ |
| description | To quantify the excellence of multimedia quality, subjective evaluation experiments are conducted. In these experiments, the tradition of quantitative assessment is the most dominating, but it disregards the understanding of participants' interpretations, descriptions, and the evaluation criteria of quality. The goal of this paper is to present a new multimedia quality evaluation method called Open Profiling of Quality (OPQ) as a tool for building a deeper understanding on subjective quality. OPQ is a mixed method combining a conventional quantitative psychoperceptual evaluation and qualitative descriptive quality evaluation based on the individual's own vocabulary. OPQ is targeted for naïve participants applicable to experiments with heterogeneous and multimodal stimulus material. The paper presents the theoretical basis of the development of OPQ and overviews the methods for audiovisual quality research. We present three extensive quality evaluation studies where OPQ has been used with 120 participants. Finally, we conclude further recommendations of use of the method in quality evaluation research. |
| format | Article |
| id | doaj-art-b3cd1f9bd80146c7a6a2d18d25249347 |
| institution | Kabale University |
| issn | 1687-5680 1687-5699 |
| language | English |
| publishDate | 2010-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Advances in Multimedia |
| spelling | doaj-art-b3cd1f9bd80146c7a6a2d18d252493472025-02-03T06:00:16ZengWileyAdvances in Multimedia1687-56801687-56992010-01-01201010.1155/2010/658980658980Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality PerceptionD. Strohmeier0S. Jumisko-Pyykkö1K. Kunze2Institute for Media Technology, Ilmenau University of Technology, 98693 Ilmenau, GermanyUnit of Human-Centered Technology, Tampere University of Technology, 33720 Tampere, FinlandInstitute for Media Technology, Ilmenau University of Technology, 98693 Ilmenau, GermanyTo quantify the excellence of multimedia quality, subjective evaluation experiments are conducted. In these experiments, the tradition of quantitative assessment is the most dominating, but it disregards the understanding of participants' interpretations, descriptions, and the evaluation criteria of quality. The goal of this paper is to present a new multimedia quality evaluation method called Open Profiling of Quality (OPQ) as a tool for building a deeper understanding on subjective quality. OPQ is a mixed method combining a conventional quantitative psychoperceptual evaluation and qualitative descriptive quality evaluation based on the individual's own vocabulary. OPQ is targeted for naïve participants applicable to experiments with heterogeneous and multimodal stimulus material. The paper presents the theoretical basis of the development of OPQ and overviews the methods for audiovisual quality research. We present three extensive quality evaluation studies where OPQ has been used with 120 participants. Finally, we conclude further recommendations of use of the method in quality evaluation research.http://dx.doi.org/10.1155/2010/658980 |
| spellingShingle | D. Strohmeier S. Jumisko-Pyykkö K. Kunze Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception Advances in Multimedia |
| title | Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception |
| title_full | Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception |
| title_fullStr | Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception |
| title_full_unstemmed | Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception |
| title_short | Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception |
| title_sort | open profiling of quality a mixed method approach to understanding multimodal quality perception |
| url | http://dx.doi.org/10.1155/2010/658980 |
| work_keys_str_mv | AT dstrohmeier openprofilingofqualityamixedmethodapproachtounderstandingmultimodalqualityperception AT sjumiskopyykko openprofilingofqualityamixedmethodapproachtounderstandingmultimodalqualityperception AT kkunze openprofilingofqualityamixedmethodapproachtounderstandingmultimodalqualityperception |