Videos

Solving Backward Stochastic Differential Equation and Hamilton Jacobi Bellmann (HJB) equations with Tree Based Tensor Networks (HT/TT)

Presenter
March 30, 2021
Abstract
Reinhold Schneider - Technische Universität Berlin Institut für Mathematik, FG Modellierung, Simulation & Optimierung For many high dimensional PDEs of practical interest, e.g. Backward Kolmogorov equations etc. the PDE operator cannot be easily expanded in matrix product operator form. In this case, we propose a variational Monte Carlo approach confined to the manifold of tree based tensors with fixed multi-rank (i.e. bond dimensions). In particular the (stochastic) HJB can be reformulated by an (un-coupled) Forward Backward SDE system. The forward dynamics can be computed easily by standard Euler-Mayurana scheme. For the backward equation for the value function, we use variational interpolation (Bender et al.) by solving a regression problem in each time step. For this purpose we use tree based tensor networks, in partic-ular MPS/TT. The forward backward SDE is linked with (parabolic) PDEs by a non-linear Feynman-Kac theorem. This offers the possibility to compute approximate (local) solutions of wide class of non-linear parabolic PDEs. For solving our HJB equations, we need to compute the gradient of the value functions with desired precision. Solving regression problems by means of HT/TT tensors with good approximation of the gradients requires additional attention, and has been the technical key for a successful treatment. First numerical results have been obtained by my PhD students Leon Sallandt and M. Oster. We have compared with already published results using deep neural networks (E & Jentzen et al., Pham et al.). All results we have found in literature could be confirmed by our approach or even improved. Large part of the numerical method can be transferred formally for deterministic optimal control, and works well if additional regularity of the solution is granted.
Supplementary Materials