Image of User-centred versus system-centred evaluation of a personalization system

Journal Articles

User-centred versus system-centred evaluation of a personalization system

Some of the most popular measures to evaluate information filtering systems are usually independent of the
users because they are based in relevance judgments obtained from experts. On the other hand,
the user-centred evaluation allows showing the different impressions that the users have perceived about
the system running. This work is focused on discussing the problem of user-centred versus system-centred evaluation of a Web content personalization system where the personalization is based on a user model that stores long term (section, categories and keywords) and short term interests (adapted from user provided feedback). The user-centred evaluation is based on questionnaires filled in by the users before and after using the system and the system-centred evaluation is based on the comparison between ranking of documents, obtained from the application of a multi-tier selection process, and binary relevance judgments collected previously from real users. The user-centred and system-centred evaluations performed with 106 users during 14 working days have provided valuable data concerning the behaviour of the users with respect to issues such as document relevance or the relative importance attributed to different ways of personalization. The results obtained shows general satisfaction on both the personalization processes (selection, adaptation and presentation) and the system as a whole.

Availability

No copy data

Detail Information
Series Title
Information Processing & Management
Call Number
-
Publisher
s.l. : Elsevier.,
Collation
-
Language
English
ISBN/ISSN
0306-4573
Classification
-
Content Type
-
Media Type
-
Carrier Type
-
Edition
Vol. 44, No. 3, Page 1293-1307
Subject(s)
Evaluation
User-centred
System-centred
Personalization
Web contents
News services
Specific Detail Info
-
Statement of Responsibility
Other version/related

No other version available

File Attachment
No Data
Comments
You must be logged in to post a comment