Compositional Construction of Safety Controllers for Networks of Continuous-Space POMDPs

نویسندگان

چکیده

In this article, we propose a compositional framework for the synthesis of safety controllers networks partially observable discrete-time stochastic control systems (also known as continuous-space Markov decision processes (POMDPs)). Given an estimator, utilize discretization-free approach to synthesize ensuring specifications over finite-time horizons. The proposed is based on notion so-called local barrier functions computed subsystems in two different ways. first scheme, no prior knowledge estimation accuracy needed. second utilizes probability bound using xmlns:xlink="http://www.w3.org/1999/xlink">stochastic simulation . both schemes, derive sufficient small-gain-type conditions order compositionally construct functions interconnected POMDPs local subsystems. constructed overall enable us compute lower bounds probabilities that avoid certain unsafe regions We demonstrate effectiveness our approaches by applying them adaptive cruise problem.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

application and construction of carbon paste modified electrodes developed for determination of metal ions in some real samples

ساخت الکترودهاِی اصلاح شده ِیکِی از چالشهاِی همِیشگِی در دانش شیمِی بوِیژه شیمِی تجزیه مِی باشد ،که با در نظر گرفتن سادگِی ساخت، کاربردی بودن و ارزان بودن روش مِی توان به باارزش بودن چنِین سنسورهاِی پِی برد.آنچه که در ادامه آورده شده به ساخت و کاربرد الکترودهاِی اصلاح شده با استفاده از نانو ذرات در اندازه گِیرِی ولتامترِی آهن وکادمِیم اشاره دارد. کار اول اختصاص دارد به ساخت الکترود خمِیر کربن اصلاح شده با لِیگاند داِ...

15 صفحه اول

Compositional Construction of Real-Time Dataflow Networks

Increasing sizes of present-day distributed software systems call for coordination models which are both modular and scalable. Precise modelling of real-life applications further requires the notion of real-time. In this paper, we present a modular formal development of a compositional model for real-time coordination in dataflow networks. While real-time dataflow networks are typically asynchr...

متن کامل

Optimal Fixed-Size Controllers for Decentralized POMDPs

Solving decentralized partially observable Markov decision processes (DEC-POMDPs) is a difficult task. Exact solutions are intractable in all but the smallest problems and approximate solutions provide limited optimality guarantees. As a more principled alternative, we present a novel formulation of an optimal fixed-size solution of a DEC-POMDP as a nonlinear program. We discuss the benefits of...

متن کامل

Optimizing Memory-Bounded Controllers for Decentralized POMDPs

We present a memory-bounded optimization approach for solving infinite-horizon decentralized POMDPs. Policies for each agent are represented by stochastic finite state controllers. We formulate the problem of optimizing these policies as a nonlinear program, leveraging powerful existing nonlinear optimization techniques for solving the problem. While existing solvers only guarantee locally opti...

متن کامل

Sparse Stochastic Finite-State Controllers for POMDPs

Bounded policy iteration is an approach to solving infinite-horizon POMDPs that represents policies as stochastic finite-state controllers and iteratively improves a controller by adjusting the parameters of each node using linear programming. In the original algorithm, the size of the linear programs, and thus the complexity of policy improvement, depends on the number of parameters of each no...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Control of Network Systems

سال: 2023

ISSN: ['2325-5870', '2372-2533']

DOI: https://doi.org/10.1109/tcns.2022.3186649