This paper demonstrates the applicability of reinforcement learning for first person shooter bot artificial intelligence. Reinforcement learning is a machine learning technique where an agent learns a problem through interaction with the environment. The Sarsa( ) algorithm will be applied to a first person shooter bot controller to learn the tasks of (1) navigation and item collection, and (2) ...

In this paper we describe the design and implementation of a bot to play the arcade game Breakout. Instead of manually writing the bot, we use reinforcement learning techniques to learn a strategy by repeated sessions of Breakout where the learner is rewarded for advancing through the game and punished for losing. We show that our bot’s game performance increases with repeated plays, though it ...

PURPOSE To quantitatively evaluate the pulse waveform changes in macular choroidal blood flow by using laser speckle flowgraphy (LSFG) with regression of acute central serous chorioretinopathy (CSC). METHODS This retrospective observational case series included 20 eyes of 20 patients with acute CSC. Laser speckle flowgraphy was performed at baseline and after 6 months. On the LSFG monochrome ...

Botnets are a major threat to the security of computer systems and the Internet. An increasing number of individual Internet sites have been compromised by attacks from all across the world to become part of various kinds of malicious botnets. The Internet security research community has made significant efforts to identify botnets, to collect data on their activities, and to develop techniques...

Exploitation of Best Effort Distributed Computing Infrastructures (BE-DCIs) allow operators to maximize the utilization of the infrastructures, and users to access the unused resources at relatively low cost. Because providers do not guarantee that the computing resources remain available to the user during the entire execution of their applications, they offer a diminished Quality of Service (...

We consider (subclasses of) polynomial bottom-up and top-down tree series transducers over a partially ordered semiring A = (A,⊕, ,0,1, ), and we compare the classes of tree-to-tree-series and o-tree-to-tree-series transformations computed by such transducers. Our main result states the following. If, for some a ∈ A with 1 a, the semiring A is a weak a-growth semiring and either (i) the semirin...

Over the years, many private sector participation (PSP) models have been evolved for infrastructure procurement and the Build-Operate-Transfer (BOT) model is one of the most common approaches used for the same. Private infrastructure projects under BOT arrangement have a complex risk profile and to a considerable extent, the success of any BOT project is influenced by the degree to which variou...

OBJECTIVES/HYPOTHESIS To evaluate the efficacy of base of tongue (BOT) resection via transoral robotic surgery (TORS) in the treatment of obstructive sleep apnea/hypopnea syndrome (OSAHS). STUDY DESIGN Case series METHODS Between June 2010 and May 2012, BOT resection via TORS was performed on 27 patients with OSAHS. Patients were excluded from this analysis if other concomitant upper airway...