Multi-step methods are important in reinforcement learning (RL). Eligibility traces, the usual way of handling them, works well with linear function approximators. Recently, van Seijen (2016) had introduced a delayed learning approach, without eligibility traces, for handling the multi-step λ-return with nonlinear function approximators. However, this was limited to action-value methods. In thi...

We construct a new harmonic family: dielectric flow solutions with maximal supersymmetry in eleven-dimensional supergravity. These solutions are asymptotically AdS4 ×S7, while in the infra-red the M2 branes are dielectrically polarized into M5 branes. These solutions are holographically dual to vacua of the mass deformed theory on M2 branes. They also provide an interesting insight on the super...

As mentioned before, the success of CASE relies on two noteworthy properties: the Sure Screening (SS) property and the Separable After Screening (SAS) property. In this section, we discuss the two properties in detail, and illustrate how these properties enable us to decompose the original regression problem to many small-size regression problems which can be fit separately. We then use these p...

I describe a modification to Shanks’ baby-step giant-step algorithm for computing the order n of an element g of a group G, assuming n is finite. My method has the advantage of being able to compute n quickly, which Shanks’ method fails to do when the order of G is infinite, unknown, or much larger than n. I describe the algorithm in detail. I also present the results of implementations of my a...

Baby boomers will begin entering old age in 2011. They will be the largest and most diverse cohort ever to experience this life-course transition. The sheer number of baby boomers has challenged institutions time after time (Dychtwald, 1990). Despite extensive speculation regarding the political, economic, and social impact that the aging of baby boomers will have on American society, no one ha...

We argue that the giant graviton configurations known from the literature have a complementary, microscopical description in terms of multiple gravitational waves undergoing a dielectric (or magnetic moment) effect. We present a non-Abelian effective action for these gravitational waves with dielectric couplings and show that stable dielectric solutions exist. These solutions agree in the large...

We study a multi-step hider-seeker game where the hider is moving on a graph and, in each step, the seeker is able to search c subsets of the graph nodes. We model this game as a zero-sum Bayesian game, which can be solved in weakly polynomial time in the players’ action spaces. The seeker’s action space is exponential in c, and both players’ action spaces are exponential in the game horizon. T...

Inspired by previous work on emergent communication in referential games, we propose a novel multi-modal, multi-step referential game, where the sender and receiver have access to distinct modalities of an object, and their information exchange is bidirectional and of arbitrary duration. The multi-modal multi-step setting allows agents to develop an internal communication significantly closer t...

This paper introduces a new method for accelerating current sluggish FEM and improving memory demand in FEM problems with high node resolution or bulky structures. Like most of the numerical methods, FEM results to a matrix equation which normally has huge dimension. Breaking the main matrix equation into several smaller size matrices, the solving procedure can be accelerated. For implementing ...

one of the most important steps involved in mining operations is to select an appropriate extraction method for mine resources. after choosing the extraction method, it is usually impossible to replace it with another one because it may be so expensive that implementation of the entire project could be economically impossible. choosing a mining method depends on the geological and geometrical c...