How Do Gain and Discount Functions Affect the Correlation between DCG and User Satisfaction?
نویسندگان
چکیده
We present an empirical analysis of the effect that the gain and discount functions have in the correlation between DCG and user satisfaction. Through a large user study we estimate the relationship between satisfaction and the effectiveness computed with a test collection. In particular, we estimate the probabilities that users find a system satisfactory given a DCG score, and that they agree with a difference in DCG as to which of two systems is more satisfactory. We study this relationship for 36 combinations of gain and discount, and find that a linear gain and a constant discount are best correlated with user satisfaction.
منابع مشابه
Learning the Gain Values and Discount Factors of DCG
Evaluation metrics are an essential part of a ranking system, and in the past many evaluation metrics have been proposed in information retrieval and Web search. Discounted Cumulated Gains (DCG) has emerged as one of the evaluation metrics widely adopted for evaluating the performance of ranking functions used in Web search. However, the two sets of parameters, gain values and discount factors,...
متن کاملRelationship between Students’ Readiness for e-Learning, Learner Satisfaction and Student Performance: The case of a post-graduate education program
The aim of this study was to explore students’ readiness for e-learning during Covid-19, determining learner satisfaction with online learning experiences and their relations with students’ success. A descriptive-analytical research design and Spearman correlation coefficient were used in this study. Population under study, which was considered as the sample, included students of a course in a ...
متن کاملA New Hybrid Method for Web Pages Ranking in Search Engines
There are many algorithms for optimizing the search engine results, ranking takes place according to one or more parameters such as; Backward Links, Forward Links, Content, click through rate and etc. The quality and performance of these algorithms depend on the listed parameters. The ranking is one of the most important components of the search engine that represents the degree of the vitality...
متن کاملThe effect of quality components of hospital environment on user satisfaction, with a naturalistic approach in Tehran
Introduction: The hospital is of particular importance as a place where the process of caring for and treating the patient's human body (where part of his or her body and mind is damaged) takes place. The hospital environment creates tension and stress, so any effort to reduce this tension and stress will positively result in creating a pleasant feeling and increasing the quality of the environ...
متن کاملThe Impact of Accounting Information System on User Satisfaction: Empirical Studies on Local Government Bank
This study aims at investigating the factors that affect a user’s satisfaction of accounting information systems based on the quality and the perceived usefulness of such systems, and the quality of data involved. The paper analyses the given factors on data collected from Bank Sumut, Indonesia. In addition, this research also aims to find out whether the influence of perceived ease of use can...
متن کامل