iCLEF at Sheffield

Sheffield’s contribution to the interactive cross language information retrieval track took the approach of comparing user’s abilities at judging the relevance of machine translated French documents against ones written in the users’ native language: English. Conducting such an experiment is challenging, and the issues surrounding the experimental design are discussed. Experimental results strongly suggest that users are just as capable of judging relevance on the native language documents are they are on the translated.