Comparative analysis of relevance feedback methods based on two user studies.

Akuma, Stephen; Iqbal, Rahat; Jayne, Chrisina; Doctor, Faiyaz

Abstract

Rigorous analysis of user interest in web documents is essential for the development of recommender systems. This paper investigates the relationship between the implicit parameters and user explicit rating during their search and reading tasks. The objective of this paper is therefore three-fold: firstly, the paper identifies the implicit parameters which are statistically correlated with the user explicit rating through user study 1. These parameters are used to develop a predictive model which can be used to represent users' perceived relevance of documents. Secondly, it investigates the reliability and validity of the predictive model by comparing it with eye gaze during a reading task through user study 2. Our findings suggest that there is no significant difference between the predictive model based on implicit indicators and eye gaze within the context examined. Thirdly, we measured the consistency of user explicit rating in both studies and found significant consistency in user explicit rating of document relevance and interest level which further validates the predictive model. We envisage that the results presented in this paper can help to develop recommender and personalised systems for recommending documents to users based on their previous interaction with the system.

Citation

AKUMA, S., IQBAL, R., JAYNE, C. and DOCTOR, F. 2016. Comparative analysis of relevance feedback methods based on two user studies. Computers in human behavior [online], 60, pages 138-146. Available from: https://doi.org/10.1016/j.chb.2016.02.064

• Journal Article Type: Article
• Acceptance Date: Feb 15, 2016
• Online Publication Date: Feb 27, 2016
• Publication Date: Jul 31, 2016
• Deposit Date: Mar 11, 2016
• Publicly Available Date: Mar 11, 2016
• Journal: Computers in human behavior
• Print ISSN: 0747-5632
• Electronic ISSN: 1873-7692
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 60
• Pages: 138-146
• DOI: https://doi.org/10.1016/j.chb.2016.02.064
• Keywords: Implicit feedback; User interest; Explicit feedback; Implicit indicators; Explicit rating; Recommender system
• Public URL: http://hdl.handle.net/10059/1425