In this paper, with the aim of estimating internal dynamics matrix of a gimbaled Inertial Navigation system (as a discrete Linear system), the discretetime Hamilton-Jacobi-Bellman (HJB) equation for optimal control has been extracted. Heuristic Dynamic Programming algorithm (HDP) for solving equation has been presented and then a neural network approximation for cost function and control input ...

In this paper, we consider an optimal control problem in which the control takes values from a discrete set and the state and control are subject to continuous inequality constraints. By introducing auxiliary controls and applying a time-scaling transformation, we transform this optimal control problem into an equivalent problem subject to additional linear and quadratic constraints. The feasib...

A new approach to the solution of optimal control problems for mechanical systems is proposed. It is based on a direct discretization of the Lagrange-d’Alembert principle for the system (as opposed to using, for example, collocation or multiple shooting to enforce the equations of motion as constraints). The resulting forced discrete Euler-Lagrange equations then serve as constraints for the op...

The field of Preview Control is concerned with using advanced knowledge of disturbances or references in order to improve tracking quality or disturbance rejection. Areas of application include guidance of autonomous vehicles, robotics and process control. This thesis studies Optimal Discrete-Time Preview Control, in which the controlled plant is assumed to be unconstrained, linear and discrete...

We formalize the notion of optimal supervisory control of discrete event dynamical systems (DEDS's) in the framework of Ramadge and Wonham. A DEDS is modeled as a state machine, and is controlled by disabling some of its transitions. We de ne two types of cost functions: a cost of control function corresponding to disabling transitions in the state machine, and a penalty of control function cor...

This report presents an application of the recently developed theory of optimal Discrete Event Supervisory (DES) control that is based on a signed real measure of regular languages. The DES control techniques are validated on an aircraft gas turbine engine simulation test bed. The test bed is implemented on a networked computer system in which two computers operate in the client-server mode. Se...

Abstract: A formulation and solution of the discrete-time fractional optimal control problem in terms of the Caputo fractional derivative is presented in this paper. The performance index (PI) is considered in a quadratic form. The necessary and transversality conditions are obtained using a Hamiltonian approach. Both the free and fixed final state cases have been considered. Numerical examples...