The most data-efficient algorithms for reinforcement learning in robotics are model-based policy search algorithms, which alternate between learning a dynamical model of the robot and optimizing a policy to maximize the expected return given the model and its uncertainties. Among the few proposed approaches, the recently introduced BlackDROPS algorithm exploits a black-box optimization algorith...

We present a study of the influence of different approximation schemes on the convergence rate of volume rendering integral (VRI) numerical approximations. We experimentally evaluate the impact of numerical integration techniques on the rate of convergence to the correct solution of the VRI on a single ray. We report that the discretization of both the inner and outer integrals have influence o...

CR and PU hidden terminals in multi-channel Cognitive MAC protocols result in increased packet drops. This is due to inefficient node synchronization with existing “Control Channel” design. To date, In-band and Out-of-band CCC based MAC protocols are proposed to avoid PU and CR hidden terminals. But, In-band CCC based CR-MAC protocols cannot efficiently resolve the hidden terminal packet drops ...

The steady deformation and breakup of emulsion drops in a uniform electric field are considered experimentally. Due to the low volume fraction of inner drops, the emulsions can be effectively assumed as Newtonian fluids with spatial nonuniformity. The measurements of the electrical properties show that the oil-in-water (o/w) emulsion drop behaves like a conducting drop. On the other hand, the w...

OBJECTIVES This case series outlines the advantages of using 0.1% intranasal dexamethasone drops (IDD) to treat nasal obstruction in patients with congenital pyriform aperture stenosis (PAS). METHODS Five consecutive cases of PAS were reviewed. RESULTS Three patients were treated with IDD alone, and 2 were treated surgically and had residual postoperative nasal obstruction before IDD. Four ...

In this paper, we examine spatio-temporal evolution of free moving drops in a vertically stratified fluid and study the role of stratification on the rise velocity of a single drop, two drops and a swarm of rising drops. Utilizing fully resolved three-dimensional Direct Numerical Simulations (DNS), we discuss the effects of density stratification on the interaction of two drops and microstructu...

The combination of anti-glaucoma eye drops is frequently used in clinical treatment, and it is known that the combination can cause corneal damage. Recently, an anti-glaucoma combination eye drops is developed, and the treatment by the combination eye drops is expected to enhance quality of life. However, effects of the combination eye drops on corneal epithelial cell damage have not been clari...