We use the Bellman Equation as an ample to illustrate the Envelope Theorem in dynamic programming.
The Setup
Start with the Bellman equation: subject to:
Step 1: Form the Lagrangian
where:
- is the multiplier on the budget constraint
- is the multiplier on the borrowing constraint
Step 2: First-Order Conditions
Take FOCs with respect to the choice variables and :
Step 3: The Envelope Condition (The Key Step!)
Now here’s where the envelope condition comes in. We want to know: how does the value function change when the state variable increases?
Take the derivative of the value function with respect to the state variable :
The Envelope Theorem says: When taking the derivative of a maximized function with respect to a parameter (here is the parameter), you can ignore the effect through the choice variables (because they’re already optimized, so small changes have no first-order effect).
So you only need to differentiate through the places where appears directly:
Looking at the Lagrangian:
The only place appears directly is in the term :
This is the envelope condition!
Economic Intuition
What does mean economically?
- Left side : The marginal value of having one more unit of assets
- Right side : The marginal utility of wealth () times the return on assets
So the envelope condition says: The value of an extra dollar of assets is equal to the marginal utility of wealth times what that dollar will grow to with interest.
Why “Envelope”?
The name comes from the idea that when you have a family of curves (like value functions for different values), the envelope is the curve that’s tangent to all of them. The derivative along the envelope only captures the “direct” effect, not the “indirect” effect through reoptimization.
Practical Use
In the next period, this becomes:
This lets us link the multipliers across time periods, which is how we derive the Euler equation!
Does this help clarify where it comes from? The key insight is that the envelope theorem lets us ignore the effect through the choice variables because they’re already optimal.
In Chinese, it is called 包络定理, emphasizing the idea of an “envelope” of optimized functions.