We propose a tightening sequence of optimistic approximations to the Gittins index in “Optimistic Indices.” show that use these concert with an increasing discount factor appears offer compelling alternative state-of-the-art schemes proposed for Bayesian multiarmed bandit problem. prove indices constitutes regret optimal algorithm. Perhaps more interestingly, even loosest substantial performanc...

Water quality indices (WQIs), which translate numerical values of several water quality characteristics of a sample into a single value, play a very important role in the monitoring, comparison and control of water quality. The WQIs of modern and post-modern times have been almost exclusively based on physical and chemical characteristics, and have seldom included 'biological' characteristics o...