In this paper we develop a theoretical analysis of the performance of sampling-based fitted value iteration (FVI) to solve infinite state-space, discounted-reward Markovian decision problems (MDPs) under the assumption that a generative model of the environment is available. Our main results come in the form of finite-time bounds on the performance of two versions of sampling-based FVI. The con...

Chromatography is a technique used to separate and quantify the components in a complex chemical mixture. We have created a 3D visualization system capable of comparing the chemical properties of chromatographic systems. The visualization system combines scatter plots, parallel coordinates, and specialized glyphs to assist in the analysis of chromatographic data and comparisons of multiple syst...

In this chapter we will study the differential structure of discrete images in detail. This is the structure described by the local multi-scale derivatives of the image. We start with the development of a toolkit for the definitions of heightlines, local coordinate systems and independence of our choice of coordinates. << FrontEndVision`FEV`; Off@General::spellD; Show@Import@"Spiral CT abdomen....

Positive-definite means that gp(v, v) > 0 for every v 6= 0, v ∈ TpM . Smoothly depending on p means that for every pair Xp,Yp of C ∞-smooth vector fields on M the expression gp(Xp, Yp) defines a C ∞-smooth function of p ∈M . Alternatively, consider a coordinate neighbourhood on M containing p and let x, i = 1, . . . , dimM be the local coordinates. Then any two tangent vectors u, v ∈ TpM may be...

This study is concerned with the numerical analysis, formulation, programming and computation of steady, 3D conservation equations of reacting laminar flow heat and mass transfer in ducts of arbitrary cross-sections. The non-orthogonal boundary-fitted coordinate transformation method is applied to the Cartesian form of overall-continuity, momenta, energy and species-continuity equations, parabo...

Severe Tropical Cyclones associated with surges frequently hits the coastal region of Bangladesh. For a reliable hydrodynamic model to simulate the severity of such cyclones, it is necessary to incorporate the meteorological and hydrological inputs properly. In order to incorporate the coastlines and the island boundaries properly in the numerical scheme a very fine grid resolution along the co...

This paper may be regarded as a new numerical method for the analysis of triangular thin plates using the natural area coordinates. Previous studies on the solution of triangular plates with different boundary conditions are mostly based on the Rayleigh-Ritz principle which is performed in the Cartesian coordinates. Consequently, manipulation of the geometry and numerical calculation of the int...

Understanding the adsorption of smoke stream (SR) on cigarette filter—cellulose acetate stick with different temperatures is beneficial for controlling chemical emissions and reducing toxic effect smoking human health. However investigation corresponding properties was missing because substances cellulose sensitive three-dimensional temperature gradient. In this work, typical substances, such a...