5
$\begingroup$

So I understand the derivation of the Kolmogorov Forward and Backward Equations, but I don't quite understand the intuition. Here is from Stokey, 2008:

"The backward equation involves time $t$ and the initial condition $x$, with the current state $y$ held fixed. A similar PDE, the Kolmogorov forward equation (KFE), involves $t$ and $y$, with the initial state $x$ fixed. The forward equation is useful for characterizing the limiting distribution, if one exists."

In what situations do the two arrise? For instance, if I know the current state and am interested in a probability distribution over possible initial states, I use the backward equation. If I know the current state and am interested in the probability distribution over the state in the future, I use the forward equation. Is this correct?

On a more technical note, how does one define boundary conditions for these PDE's? Are the boundary conditions a result of the derivation? Perhaps Stokey is not the best reference on this topic...

$\endgroup$
1
$\begingroup$

I will try to answer to your last question. I did not read the paper but in models with higher dimensions, it is always difficult to find an analytical solution. If there exists an analytical solution (for a very basic model with a one-state variable), it is possible to derive the initial conditions for your control and state variable from your differential equations.

However, in systems where there does not exist an analytical solution, you are supposed to solve it numerically, in which case you must give a numerical value for one of your variables (or more until you find steady state values for all your variables.)

After, you can find the steady-state values of your variables in which case, your initial conditions should not be so far from the steady state level (otherwise, there would be some convergence problems in your model if you don't choose the appropriate initial values, close to steady state. It is another issue.)

$\endgroup$
  • $\begingroup$ But in the case of numerical solution you are stuck assuming the boundary conditions? Or deducing them from some aspect of the problem, but they are not a result of the derivation? $\endgroup$ – pdevar Sep 11 '15 at 6:27
  • $\begingroup$ In many cases, you give an arbitrary value. This is the case in many macro papers with dynamic optimization. The reason behind is that, in some cases, for example, you have 4 unknowns and your system reduces to three dimensional equation system. So, in this case, you are obliged to give a numerical value for one the variables. After, you will find the numerical value for other three variables according to the value that you have given for one of them. For sure, the numerical values that you will find will be derived in your system of equation according to the value that you choose. $\endgroup$ – optimal control Sep 11 '15 at 9:50
0
$\begingroup$

Here's some information with regard to the intuition of each.

The Kolmogorov forward equation is often referred to as the Fokker-Planck equation. It is a partial differential equation (PDE) that describes the time evolution of the probability density function of a variable over a state. That is, suppose we have information about the state $x$ at a time $t$. The forward equation tells us the distribution of $x$ at a time $s>t$.

The Kolmogorov backward equation on the other hand is used to understand the probability of a state ending up in a set $B$ at some time $s$. Define a function of the state, $u_s(x)$. At the final time $s$, $u_s(x) = 1$ if $x \in B$. Otherwise, it is zero. Then, for any time $t < s$, $u_t(x)$ describes the probability that $X_s$ given $X_t = x_t$ will end up in the set $B$. The Kolmogorov backward equation described the evolution of the probability function. $u_s(x)$ then is the final condition of a this PDE.

I've taken this information mostly from Wikipedia:

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.