Crowdsourcing has applications where machine learning falls short. We describe the design, implementation, and deployment of CrowdReply, a crowdsourced multiple choice question answering (MCQA) system. We deployed an Android app to enable the audience watching “Who wants to be millionaire?” quiz-show on TV to play along on their smartphones simultaneously. The app enabled us to collect data fro...

Since 1978, the vote reported for House incumbents in the American National Election Studies (NES) has been significantly higher than the actual incumbents' vote in the districts surveyed; in NES surveys before 1978, the reported vote was much closer to the actual vote. The prime suspect for the source of this bias is the new question format introduced in 1978 and used in all subsequent studies...

The article presents the experiments carried out as part of the participation in the pilot task of QA4MRE@CLEF 2013. In the developed system, we have first generated answer pattern by combining the question and each answer option to form the Hypothesis (H). Stop words and interrogative word are removed from each H and query words are identified to retrieve the most relevant sentences from the a...

In this paper, we present a study of MCQ aiming to define criteria in order to automatically select distractors. We are aiming to show that distractor editing follows rules like syntactic and semantic homogeneity according to associated answer, and the possibility to automatically identify this homogeneity. Manual analysis shows that homogeneity rule is respected to edit distractors and automat...

this paper investigates the effect of formal information and rumors on the real buyers’ choice in tehran stock exchange. following this study, the question is what kind of information has an effect on buyers’ choice of shares? the purpose of this study is to identify information affecting buyers selected stocks, in order to offer some solutions to enhance stock exchange performance. in this stu...