Deep Learning Compatible Differentiable X-ray Projections for Inverse Rendering

نویسندگان

چکیده

Many minimally invasive interventional procedures still rely on 2D fluoroscopic imaging. Generating a patient-specific 3D model from these X-ray data would improve the procedural workflow, e.g., by providing assistance functions such as automatic positioning. To accomplish this, two things are required. First, statistical human shape of anatomy and second, differentiable renderer. We propose renderer deriving distance travelled ray inside mesh structures to generate map. demonstrate its functioning, we use it for simulating images models. Then show application solving inverse problem, namely reconstructing models real fluoroscopy pelvis, which is an ideal anatomical structure patient registration. This accomplished iterative optimization strategy using gradient descent. With majority pelvis being in field view, achieve mean Hausdorff 30mm between reconstructed ground truth segmentation.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Compatible Reward Inverse Reinforcement Learning

PROBLEM • Inverse Reinforcement Learning (IRL) problem: recover a reward function explaining a set of expert’s demonstrations. • Advantages of IRL over Behavioral Cloning (BC): – Transferability of the reward. • Issues with some IRL methods: – How to build the features for the reward function? – How to select a reward function among all the optimal ones? – What if no access to the environment? ...

متن کامل

Deep Structure for end-to-end inverse rendering

Inverse rendering in a 3D format denoted to recovering the 3D properties of a scene given 2D input image(s) and is typically done using 3D Morphable Model (3DMM) based methods from single view images. These models formulate each face as a weighted combination of some basis vectors extracted from the training data. In this paper a deep framework is proposed in which the coefficients and basis ve...

متن کامل

A Differentiable Physics Engine for Deep Learning in Robotics

One of the most important fields in robotics is the optimization of controllers. Currently, robots are often treated as a black box in this optimization process, which is the reason why derivative-free optimization methods such as evolutionary algorithms or reinforcement learning are omnipresent. When gradient-based methods are used, models are kept small or rely on finite difference approximat...

متن کامل

Wavelet Projections for Volume Rendering

We extended Gross’s 3 method of volume wavelet rendering by computing splats via an orthogonal projection operator. The method decomposes the volume data into a wavelet pyramid representation in the spline domain. The splats of the basis functions are approximated on a multiresolution grid. Using least-squares approximation ensures the smallest possible error for a given sampling step size. The...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Informatik aktuell

سال: 2021

ISSN: ['2628-8958', '1431-472X']

DOI: https://doi.org/10.1007/978-3-658-33198-6_70