# Questions tagged [optimal-control]

The tag has no usage guidance.

43 questions
Filter by
Sorted by
Tagged with
1 vote
37 views

141 views

742 views

### What is state space representation for DSGE modeling

I'm beginning with DSGE modeling, and a mathematical representation (perhaps trivial for most of the people that are more with this topic) is the space-state state representation of a dynamical model, ...
146 views

### Optimization in discrete time

I have made optimizations in continuous time that belong to the control theory, for example one case: $\max(\min)V[u(t)]=\int_0^Tf(t,x(t),u(t))dt$ constraint to: $\dot x=g(t,x(t),u(t))$ Where: $x(t)$: ...
264 views

106 views

### Why do game theorists use a discounted payoff of this form?

Excuse the click-baity title. I notice the discounted payoff in the game theory literature usually takes the form $$\sum_{t=1}^\infty\lambda(1-\lambda)^{t-1}R_t$$ This differs from the discounted ...
71 views

### Finding optimal path in continuous time

I have the following optimal control problem $$\max_{c_t,l_t} \int_0^{\infty} [ln(c_t)+\theta ln(1-l_t)]e^{-pt}dt$$ st. $$\dot{k_t}=k_t^{1/2}l_t^{1/2}-c_t-\beta l_t$$ $$k_0>0$$ I do big part of ...
557 views

### Dynamic programming, optimal consumption-savings (finite horizon) problem

Let $w_t$ denote a consumer's wealth at time $t$ and $c_t$, the amount she chooses to consume, so her savings exiting this time period are $w_t-c_t$. Given this savings decision, her savings $w_{t+1}$ ...
286 views

### Optimal price function: application of calculus of variations

The problem, I am trying to solve is based on the paper by Rochet and Vila 1994 (see literature below). In fact, it is a variant of the seminal paper of Kyle 1985 in the finance/economics literature. ...
222 views

### Solution method in Smith (2006) A Closed Form Solution to the Ramsey Model

I am trying to understand the way Smith demonstrates that the general solution to his equation (12) is (13) (see page 6). (12) \begin{eqnarray} \dot{z} &=& (1- \alpha)\left[1-\left(\delta +...
623 views

### Optimal control theory: How to maximize Hamiltonian in this case?

The problem is to maximize $\int_0^1 y(t) + u(t)^2 dt$ where $y$ is state and $u$ is control. Further we have $y' = u, y(0) = 5$. I set up the Maximum Principle equations, but, in particular, I need ...
262 views

### An Optimal Control Model: A Ridiculous Result for a Steady State

I was experimenting with a seemingly simple optimal control problem that generates a system of differential equations. When I calculate the values of the steady state of the system I get some very ...
357 views

### Optimization: Dynamic Programming vs Kuhn-Tucker

Considering the standard utility maximization of representative household which lives forever, one may use dynamic programming and Kuhn-Tucker in case of discrete time. For instance, one would like to ...
3k views

### Does control system engineering have a place in economics?

Do central banks use some form of engineering-style PID control systems/feedback loops to implement monetary policy? I'm an electrical engineering student taking microeconomics/macroeconomics and a ...
175 views

### Analytically tractable Ramsey model: how to solve ODE for optimal trajectories

In Brunner and Strulik (2002) the authors claim, that the solution of \begin{align} \dot c &= \frac{c}{\sigma}(\alpha k^{\alpha-1} - \delta - \rho)\\ \dot k &= k^\alpha - \delta k - c \end{...
150 views

### Stability analysis and dimension of a dynamic control system

I have an optimal control problem where I have two control and one state variable. $$max\int_{0}^{\infty}\left(u\left(c\right)-P_{M}M\right)e^{-\rho t}dt\tag{1}$$ where $P_{M}$ is the unit price of ...
168 views

### Simple Derivation of Maximum Principle

Consider the simplest problem of optimal control \begin{align} &\max_u\int^T_0{F(y,u)dt}\\ \text{s.t.} \quad&\dot y = f(y,u)\\ & y(0) = y_0\\ & y(T)~~\text{free} \end{align} ...
93 views

### Optimal Stopping

When we solve Bellman equations, I normally would think of the Blanchard Kahn technique. But in the case that I have an optimal stopping problem, or where the decision that the agent has to take is to ...
508 views

### Autonomous or non-autonomous optimal control system?

I have a following system with endogeneous discounting. $c,k$ and $h(k)$ are consumption, capital and endogeneous discount function based on physical capital. (the properties of this function are not ...
578 views

### Stochastic growth in continuous time

Literature: See Chang (1988) for theoretical part and Achdou et al. (2015) for numerical part respectively. Model Consider the following stochastic optimal growth problem in per capita notation. \...
1 vote
57 views

### discount factor on rival and non-rival goods

I am asking to myself if we must use a different discount rate on rival and non rival goods. In standard Solow-Swann model, we use generally the discount factor $\rho$. More formally, let's give the ...
67 views

### Converging Trajectories and Sufficiency for Optimality

(The question is loosely relatet to this thread.) In the paper "Feedback Equilibria for a class of non-linear Differential Games" by Mäler et al. it is stated (p. 14) In fact sufficiency is ...