Expert Search Evaluation by Supporting Documents
نویسندگان
چکیده
An expert search system assists users with their “expertise need” by suggesting people with relevant expertise to their query. Most systems work by ranking documents in response to the query, then ranking the candidates using information from this initial document ranking and known associations between documents and candidates. In this paper, we aim to determine whether we can approximate an evaluation of the expert search system using the underlying document ranking. We evaluate the accuracy of our document ranking evaluation by assessing how closely each measure correlates to the ground truth evaluation of the candidate ranking. Interestingly, we find that improving the underlying ranking of documents does not necessarily result in an improved candidate ranking.
منابع مشابه
DUTIR at TREC 2007 Enterprise Track
This paper describes our experiments on the two tasks of the TREC 2007 Enterprise track. In data preprocessing stage we stripped the non-letter character from documents and query. For the Document Search, we built the index by indri and lemur, handled the query topic and then retrieved relevant documents by indri and lemur. For the Expert Search, we recognized candidates from collection, establ...
متن کاملRanking Web Documents with Dynamic Evaluation by Expert Groups
In spite of the wide use of the Internet, it is difficult to develop desirable web documents evaluation that reflects users’ needs. Many automatic ranking systems have used this citation system to measure the relative importance of consumer products or documents. However, the automatic citation analysis has a limitation in that it does not truly reflect the importance of the varying viewpoints ...
متن کاملQuery expansion based on relevance feedback and latent semantic analysis
Web search engines are one of the most popular tools on the Internet which are widely-used by expert and novice users. Constructing an adequate query which represents the best specification of users’ information need to the search engine is an important concern of web users. Query expansion is a way to reduce this concern and increase user satisfaction. In this paper, a new method of query expa...
متن کاملPresenting a Framework for Supporting Life-long Learning in Iranian public libraries and Its validation
Purpose: Since nowadays public libraries are considered lifelong learning centers, these centers must have the required standards and conditions to support lifelong learning in order that they could help society members to achieve their personal and professional learning more effectively. Accordingly, it is necessary to develop and provide a mechanism to support lifelong learning in public libr...
متن کاملHeuristic Boolean Patent Search Comparative Patent Search Quality / Cost Evaluation “superboolean” vs. Legacy Boolean Search Engines
This paper explores the application of an expert system to Boolean patent searching. Speci fically, it will introduce skilled researchers to the next technological evolution of search methodologies that apply Heuristic Boolean methods to reduce cost, increase efficiency, and enhance search results quality. Boolean search methodology, otherwise known as " keyword searching, " only extracts docum...
متن کامل