Utilizing Implicit User Feedback to Improve Interactive Video Retrieval

This paper describes an approach to exploit the implicit user feedback gathered during interactive video retrieval tasks. We propose a framework, where the video is first indexed according to temporal, textual, and visual features and then implicit user feedback analysis is realized using a graph-ba...

Full description

Saved in:
Bibliographic Details
Main Authors: Stefanos Vrochidis, Ioannis Kompatsiaris, Ioannis Patras
Format: Article
Language:English
Published: Wiley 2011-01-01
Series:Advances in Multimedia
Online Access:http://dx.doi.org/10.1155/2011/310762
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper describes an approach to exploit the implicit user feedback gathered during interactive video retrieval tasks. We propose a framework, where the video is first indexed according to temporal, textual, and visual features and then implicit user feedback analysis is realized using a graph-based methodology. The generated graph encodes the semantic relations between video segments based on past user interaction and is subsequently used to generate recommendations. Moreover, we combine the visual features and implicit feedback information by training a support vector machine classifier with examples generated from the aforementioned graph in order to optimize the query by visual example search. The proposed framework is evaluated by conducting real-user experiments. The results demonstrate that significant improvement in terms of precision and recall is reported after the exploitation of implicit user feedback, while an improved ranking is presented in most of the evaluated queries by visual example.
ISSN:1687-5680
1687-5699