9. Real Business Cycle

“Macroeconomics has progressed beyond the stage of searching for a theory to the stage of deriving the implications of theory. In this way, macroeconomics has become like the natural sciences. Unlike the natural sciences, though, macroeconomics involves people making decisions based on what they think will happen, and what will happen depends on what decisions they make. This means that the concept of equilibrium must be dynamic, and [...] this dynamism is at the core of modern macroeconomics.” ~Edward C. Prescott [pre06]

Learning objectives:

  • Risk and Complete Markets, Asset Pricing and the Representative Agent Result
  • General (Competitive) Equilibrium and Rational Expectations Equilibrium
  • Modelling Business Cycles from Equilibrium Theory by applying dynamic programming
  • Empirical Plausibility
  • Extensions with Inefficient Competitive Equilibria applying Euler operator approach

9.1. Reading List

Minimal reading:

  • LS, 12; or
  • Mi, 14

Further reading:

  • Cooley, Thomas F., Frontiers of Business Cycle Research, 1995, Princeton University Press.

9.2. Part I

9.3. Introduction

The first part of this note follows closely Chapter 12 of [ls04]. We consider a more general version of the stochastic growth model with endogenous labor supply. First we recall a version of the Pareto problem for the planning economy under a benevolent social planner. From this we can characterize the Pareto optimal allocations across time and states. Second, we consider decentralized, or competitive equilibrium, allocation by some market pricing mechanism. We decentralize the economy into markets with the following assumptions:

  • There is a market for state/history contingent securities (either Arrow-Debreu or one-period Arrow securities),
  • Households supply labor service to Firm I and initial capital endowment to Firm II;
  • Firm II produces new capital stock and rents it to Firm I; and
  • Firm I produces output that can be sold as consumption (to household) and/or investment good (to Firm II).

In this market economy with general history dependence, we show that competitive equilibrium allocations (under either securities markets assumption) are Pareto optimal, thus restating a version of the First Fundamental Welfare Theorem.

Third, we proceed to make the model more useful by assuming that the history of technology shocks are generated by a Markov process. This allows us to recast the general competitive equilibrium into one that is a recursive competitive equilibrium. Here we will distinguish between individual state variables (individual capital stock, \(k\)) and aggregate states (aggregate capital stock, \(K\)) in characterizing the equilibrium. However, the requirement of equilibrium also prescribes that individual choices must be consistent with the aggregate. Since we have identical agents in this model, all that is required in equilibrium is \(k = K\). Further, since the model is stochastic and agents are solving their individual forward-looking optimization problems, equilibrium also requires that individual beliefs (governed by the subjective probabilities they assign to stochastic events and the transition law of the individual states) must be consistent with actual equilibrium beliefs (the objective probability distribution and transition law of the aggregate state). This is the bit that contributes to what is often called a “rational expectations equilibrium”. These conditions, along with a pricing system that clears markets and the requirement that all agents are optimizing, define a recursive competitive equilibrium.

9.4. Endogenous aggregate state variables

In the previous pure endowment economies, we showed equivalence between allocations in the Arrow-Debreu economy and the sequential markets economy that trades one-period Arrow securities. We then assumed endowments were Markovian stochastic processes. Arrow securities can then be made functions of an aggregate current state vector, \(s_{t}\). This allowed a recursive formulation of the household problems.

This equivalence is not so straightforward when part of the aggregate state variable is endogenous. We will look at the simple stochastic growth model and cast it in terms of decentralized competitive equilibrium. We will then show that the equivalence between allocations in the Arrow-Debreu economy and the sequential markets economy that trades one-period Arrow securities still arises in the competitive economies with production. However, the requirements here are a little bit more involved since we need to track the history of equilibrium interactions between agents’ (i.e. households and firms) decisions.

The stochastic growth framework under decentralized competitive equilibrium provides a basic foundation for the modeling of aggregate variables of an economy. More recent variations on the theme have built in market imperfections, such as monopolistically competitive firms, pricing rigidity, information asymmetry, lack of contractual enforcement, distortionary taxation and so on, to allow roles for government intervention such as monetary and fiscal policy. We will sample a few of these economies in the topics to come.

9.5. Pareto optimality in the stochastic growth model

Here we consider the discrete state-space version of a stochastic growth model with endogenous labor supply. The only source of stochastic shocks are shifts to the production function.[1]_ We do not impose any restriction on the stochastic process at this stage, thus allowing for allocations to be history dependent in general. Later we will look at Markovian shocks which allow us to focus on recursive competitive equilibria where allocations are functions of only the current aggregate state of the economy.

We define the following objects, along with some assumptions, for the model:

  • Production technology is subject to stochastic shocks.
  • Stochastic event, \(s_{t}\in S\).
  • History of events leading up to \(t\geq 0\) is \(h^{t}=\left(s_{t},s_{t-1},...,s_{0}\right)\).
  • Unconditional probability of history \(h^{t}\) is \(\pi _{t}\left(h^{t}\right)\).
  • Conditional probability \(\pi _{\tau }\left( h^{\tau}|h^{t}\right)\).
  • Assume \(\pi _{0}\left( s_{0}\right) =1\) for any \(s_{0}\in S\).
  • Goods are differentiated by history/state, so the commodity space is represented by \(S\).
  • Identical households and firms (so we can drop the \(i\)‘s from individual decision rules).

9.5.1. Planner’s problem

First we set up the Pareto problem. To do so, we outline the components representing preferences, technology, and resource constraint. Then we characterize the Pareto optimal allocation.

9.5.1.1. Preferences

The representative (average) household orders consumption and leisure streams according to the following criterion:

\[\sum_{t=0}^{\infty }\sum_{h^{t}}\beta ^{t}u\left( c_{t}\left( h^{t}\right),l_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right)\]

with \(\beta \in \left( 0,1\right)\) and \(u_{i}\left( c,l\right) >0\) and \(u_{ii}\left( c,l\right) <0\), and assuming Inada conditions \(\lim_{i\rightarrow 0}u_{i}\left( c,l\right) =+\infty\) for \(i=c,l\).

The household faces a time constraint, with total time endowment normalized to 1, without loss of generality:

(1)\[1=l_{t}\left( h^{t}\right) +n_{t}\left( h^{t}\right)\]

where \(l_{t}\left( h^{t}\right)\) is leisure and \(n_{t}\left( h^{t}\right)\) is labor. Households are assumed to be endowed with initial capital stock :math:k_{0}.

9.5.1.2. Technology

Let the function \(A: S^{t} \rightarrow \left[\underline{A},\overline{A}\right] \subset \mathbb{R}\) such that for each \(h^{t} \in S^{t}\), \(A_{t}\left( h^{t}\right)\) is the stochastic level of productivity. Let \(F: \mathbb{R}_{+} \times [ 0,1] \rightarrow \mathbb{R}_{+}\) be the aggregate production function. Given capital stock and labor inputs \((k,n)\), the output is \(F(k,n)\).

ASSUMPTION 1.

\(F\) satisfies:

  1. Constant returns to scale (homogeneous of degree 1): \(F\left( k,n\right) =nF\left( \hat{k},1\right):=nf\left( \hat{k}\right)\) where \(\hat{k}=k/n\).
  2. \(F_{i}\left( k,n\right) >0\) and \(F_{ii}\left( k,n\right) <0\)
  3. Inada conditions: \(\lim_{i\rightarrow 0}F_{i}\left( k,n\right) =\infty\) and \(\lim_{i\rightarrow \infty }F_{i}\left( k,n\right) =0\), for \(i=k,n\).

Note that if \(F\) is homogeneous of degree 1, then \(F\left( k,n\right) =nF\left( \hat{k},1\right)\) and the first derivatives are homogeneous of degree 0 functions:

\[F_{k}\left( k,n\right) =\frac{\partial nf\left( k/n\right) }{\partial k}=f^{\prime }\left( \hat{k}\right)\]
\[F_{n}\left( k,n\right) =\frac{\partial nf\left( k/n\right) }{\partial n}=f\left( \hat{k}\right) -f^{\prime }\left( \hat{k}\right)\hat{k}.\]

Let \(\delta \in (0,1]\) be the depreciation rate of capital. Net capital stock at the end of period \(t\) under history \(h^{t}\) must equal new investment:

(2)\[k_{t+1}\left( h^{t}\right) - \left( 1-\delta \right) k_{t}\left(h^{t-1}\right) = x_{t}\left( h^{t}\right).\]

9.5.1.3. Resource constraint

Aggregate resource demand in terms of consumption and investment must be feasibly met by aggregate output:

\[c_{t}\left( h^{t}\right) +x_{t}\left( h^{t}\right) \leq A_{t}\left(h^{t}\right) F\left( k_{t}\left( h^{t-1}\right) ,n_{t}\left( h^{t}\right)\right).\]

9.5.1.4. Pareto problem

Consider centralized planner’s problem. The planner controls allocation

\[\left\{ c_{t}\left( h^{t}\right) ,l_{t}\left(h^{t}\right) ,x_{t}\left( h^{t}\right) ,n_{t}\left( h^{t}\right),k_{t+1}\left( h^{t}\right) \right\} _{t=0}^{\infty }.\]

Given \(k_{0}\) and \(A_{t}\left( h^{t}\right)\) the planner maximizes

\[\begin{split}\begin{multline*} L=\sum_{t=0}^{\infty }\sum_{h^{t}}\beta ^{t}\pi _{t}\left( h^{t}\right) \left\{ u\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \right. \\ \qquad \qquad \qquad +\mu _{t}\left( h^{t}\right) \left[ A_{t}\left( h^{t}\right) F\left( k_{t}\left( h^{t-1}\right) ,n_{t}\left( h^{t}\right) \right) \right. +\left( 1-\delta \right) k_{t}\left( h^{t-1}\right) \\ \left. \left. -c_{t}\left( h^{t}\right) -k_{t+1}\left( h^{t}\right) \right] \right\}. \end{multline*}\end{split}\]

The first-order conditions with respect to \(c_{t}\left( h^{t}\right) ,n_{t}\left( h^{t}\right)\), and \(k_{t+1}\left( h^{t}\right)\) are:

\[\begin{split}\begin{equation*} u_{c}\left( c_{t}\left( h^{t}\right) \right) =\mu _{t}\left( h^{t}\right), \\ u_{l}\left( n_{t}\left( h^{t}\right) \right) =\mu _{t}\left( h^{t}\right) A_{t}\left( h^{t}\right) F_{n}\left( k_{t}\left( h^{t-1}\right) ,n_{t}\left( h^{t}\right) \right), \\ \pi _{t}\left( h^{t}\right) \mu _{t}\left( h^{t}\right) =\beta \sum_{h^{t+1}|h^{t}}\pi _{t+1}\left( h^{t+1}\right) \mu _{t+1}\left( h^{t+1}\right) \\ \cdot \left[ A_{t+1}\left( h^{t+1}\right) F_{k}\left( k_{t+1}\left( h^{t}\right) ,n_{t+1}\left( h^{t+1}\right) \right) +\left( 1-\delta \right) % \right], \end{equation*}\end{split}\]

for all \(t \geq 0\) and all \(h^{t}\). The first-order condition with respect to \(\mu_{t}(h^{t})\) yields the resource constraint

(3)\[\begin{equation} c_{t}\left( h^{t}\right) +x_{t}\left( h^{t}\right) \leq A_{t}\left( h^{t}\right) F\left( k_{t}\left( h^{t-1}\right) ,n_{t}\left( h^{t}\right) \right), \end{equation}\]

for all \(t \geq 0\) and all \(h^{t}\).

Simplify further to get rid of the dynamic Lagrange multipliers:

(4)\[\begin{equation} \frac{u_{l}\left( n_{t}\left( h^{t}\right) \right) }{u_{c}\left( c_{t}\left( h^{t}\right) \right) }=A_{t}\left( h^{t}\right) F_{n}\left( k_{t}\left( h^{t-1}\right) ,n_{t}\left( h^{t}\right) \right) %\tag{12.3.1b} \end{equation}\]

This static or intratemporal optimality condition tells us that the planner allocates resources optimally to the point where the marginal rate of substitution between consumption and leisure is equal to the opportunity cost of working as measured by the marginal product of labor. This condition characterizes the optimal allocation of labor/leisure.

The last optimality condition is quite familiar to us by now:

(5)\[\begin{split}\begin{multline} 1=\beta \sum_{h^{t+1}|h^{t}}\pi _{t+1}\left( h^{t+1}|h^{t}\right) \frac{% u_{c}\left( c_{t+1}\left( h^{t+1}\right) \right) }{u_{c}\left( c_{t}\left( h^{t}\right) \right) } % \tag{12.3.1c} \\ \cdot \left[ A_{t+1}\left( h^{t+1}\right) F_{k}\left( k_{t+1}\left( h^{t}\right) ,n_{t+1}\left( h^{t+1}\right) \right) +\left( 1-\delta \right) % \right] \end{multline}\end{split}\]

for all \(t\) and all \(h^{t}\). This is an Euler equation giving us the price of a time \(t\) history \(h^{t}\) claim to a random one-period gross return on capital. It is also the intertemporal condition for optimal state-contingent consumption allocation.

Definition 1

A Pareto optimal allocation or plan is the bounded sequence of functions \(\{ c_{t}(h^{t}), n_{t}(h^{t}), k_{t+1}(h^{t}),l_{t}(h^{t}),x_{t}(h^{t})\}_{t=0}^{\infty}\) satisfying

  1. feasibility and optimality conditions in equations (3), (4), (5),

  2. the time constraint and capital accumulation equation in (1) and (2), respectively,

  3. initial conditions \(k_{0} > 0\) and \(s_{0}\) given, and a boundary condition

    \(\lim_{t \rightarrow \infty}\sum_{h^{t}}\pi_{t}(h^{t}|s_{0}) \beta^{t+1} k_{t+1}(h^{t}) = 0\).

9.6. Competitive equilibrium in the stochastic growth model

Now we turn to markets and consider how real allocations are made when there is no benevolent planner. We consider the two formulations for a decentralized, competitive equilibrium for the stochastic growth model.

  • Time-0 trading Arrow-Debreu economy, and
  • Sequential markets with Arrow securities.

Either formulation of the competitive equilibrium will give identical allocations. Further, the allocations are one possible outcome of the social planner’s Pareto problem.

9.6.1. Time-0 trading

Consider first the time-0 trading Arrow-Debreu economy. We assume the existence of a complete set of time- and history-contingent securities. Firms are perfectly competitive in the product and factor markets.

We follow the decentralization assumptions in [ls04]:

  • Representative household buys consumption, supply labor and sells initial capital endowment to Firm II.
  • Firm I hires labor from household and capital from Firm II. The delivery of labor service and its price is time and history contingent.
  • Firm I produces consumption and investment goods using technology \(F\). The delivery of consumption/investment good and its price is time and history contingent.
  • Firm II buys \(k_{0}\) from h/hold and investment good from Firm I.
  • Firm II produces new capital stock to rent to Firm I. The delivery of capital service and its price is time and history contingent.

Thus there is a competitive labor market, product (consumption and investment good) market, a physical capital market, and a market for Arrow-Debreu contingent claims on all these resources.

9.6.1.1. Household

Households maximizes

\[\begin{equation*} \sum_{t=0}^{\infty }\sum_{h^{t}}\beta ^{t}\pi _{t}\left( h^{t}\right) u\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \end{equation*}\]

subject to the time-0 intertemporal budget constraint:

\[\begin{equation*} \sum_{t=0}^{\infty }\sum_{h^{t}}q_{t}^{0}\left( h^{t}\right) c_{t}\left( h^{t}\right) \leq \sum_{t=0}^{\infty }\sum_{h^{t}}w_{t}^{0}\left( h^{t}\right) n_{t}\left( h^{t}\right) +p_{k0}k_{0} \end{equation*}\]

The first-order conditions with respect to \(c_{t}(h^{t})\) and \(n_{t}(h^{t})\) are:

(6)\[\begin{align} \beta ^{t}u_{c}\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right) &=\eta q_{t}^{0}\left( h^{t}\right) %\tag{12.4.3a} \end{align}\]
(7)\[\begin{align} \beta ^{t}u_{l}\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right) &=\eta w_{t}^{0}\left( h^{t}\right) . %\tag{12.4.3b} \end{align}\]

for all \(t\) and all \(h^{t}\), and where \(\eta >0\).

9.6.1.2. Type I Firm

Firm I enters into state-contingent contracts at \(t=0\) to rent capital \(k_{t}^{I}\left( h^{t}\right)\) and labor \(n_{t}\left( h^{t}\right)\) for each possible \(h^{t}\) and \(t\geq 0\). Firm I maximizes time-0 value of expected profits (total revenue from sales in the product market net of capital and labor rental costs)

\[\begin{equation*} \sum_{t=0}^{\infty }\sum_{h^{t}}q_{t}^{0}\left( h^{t}\right) \left[ c_{t}\left( h^{t}\right) +x_{t}\left( h^{t}\right) \right] -r_{t}^{0}\left( h^{t}\right) k_{t}^{I}\left( h^{t}\right) -w_{t}^{0}\left( h^{t}\right) n_{t}\left( h^{t}\right) \end{equation*}\]

subject to

(8)\[\begin{equation} c_{t}\left( h^{t}\right) +x_{t}\left( h^{t}\right) \leq A_{t}\left( h^{t}\right) F\left( k_{t}^{I}\left( h^{t}\right) ,n_{t}\left( h^{t}\right) \right). \end{equation}\]

Note that \(q_{t}^{0}\left( h^{t}\right)\) is the time-t, history \(h^{t}\) contingent Arrow-Debreu price of one unit of output (transformable into consumption or investment goods) in time-0 terms. Likewise \(r^{0}_{t}(h^{t})\) and \(w^{0}_{t}(h^{t})\) are the corresponding contingent prices for capital and labor services.

Re-write Firm I’s problem as maximizing

\[\begin{equation*} \sum_{t=0}^{\infty }\sum_{h^{t}}n_{t}\left( h^{t}\right) \left\{ q_{t}^{0}\left( h^{t}\right) A_{t}\left( h^{t}\right) f\left( \hat{k}% _{t}\left( h^{t}\right) \right) -r_{t}^{0}\left( h^{t}\right) \hat{k}_{t}^{I}\left( h^{t}\right) -w_{t}^{0}\left( h^{t}\right) \right\} \end{equation*}\]

Optimality with respect to \(\hat{k}_{t}^{I}\left( h^{t}\right)\) is

(9)\[\begin{equation} r_{t}^{0}\left( h^{t}\right) =q_{t}^{0}\left( h^{t}\right) A_{t}\left( h^{t}\right) f^{\prime }\left( \hat{k}_{t}^{I}\left( h^{t}\right) \right) \notag \end{equation}\]

Optimal labor demand decision by Firm I each period is characterized by

\[\begin{split}\begin{multline*} \left\{ q_{t}^{0}\left( h^{t}\right) A_{t}\left( h^{t}\right) \left[ f\left( \hat{k}_{t}\left( h^{t}\right) \right) -f^{\prime }\left( \hat{k}% _{t}^{I}\left( h^{t}\right) \right) \hat{k}_{t}^{I}\left( h^{t}\right) \right] -w_{t}^{0}\left( h^{t}\right) \right\} \\ \left\{ \begin{array}{l} <0,n_{t}^{\ast }\left( h^{t}\right) =0 \\ =0,n_{t}^{\ast }\left( h^{t}\right) \in \lbrack 0,\infty ) \\ >0,n_{t}^{\ast }\left( h^{t}\right) =\infty% \end{array}% \right. \end{multline*}\end{split}\]

Inada conditions on \(F\left( k,n\right)\) imply that \(k_{t}^{I}\left(h^{t}\right) ,n_{t}^{\ast }\left( h^{t}\right) \in \left( 0,\infty \right)\). So the stuff in curly brackets must equal zero giving us the optimal labor demand equation:

(10)\[\begin{split}\begin{multline} w_{t}^{0}\left( h^{t}\right) =q_{t}^{0}\left( h^{t}\right) A_{t}\left( h^{t}\right) \left[ f\left( \hat{k}_{t}\left( h^{t}\right) \right) -f^{\prime }\left( \hat{k}_{t}^{I}\left( h^{t}\right) \right) \hat{k}_{t}^{I}\left( h^{t}\right) \right] %\tag{12.4.9b} \\ =q_{t}^{0}\left( h^{t}\right) A_{t}\left( h^{t}\right) F_{n}\left( k_{t}^{I}\left( h^{t}\right) ,n_{t}\left( h^{t}\right) \right) \end{multline}\end{split}\]

and capital demand

(11)\[\begin{equation} r_{t}^{0}\left( h^{t}\right) =q_{t}^{0}\left( h^{t}\right) A_{t}\left( h^{t}\right) F_{k}\left( k_{t}^{I}\left( h^{t}\right) ,n_{t}\left( h^{t}\right) \right). %\tag{12.4.3a} \end{equation}\]

9.6.1.3. Type II Firm

Firm II buys initial capital, \(k_{0}\), from household and buys investment good from Firm I, and produces in new capital, which is rented to Firm I. Firm II maximizes

\[\begin{equation*} \sum_{t=0}^{\infty }\sum_{h^{t}}\left\{ r_{t}^{0}\left( h^{t}\right) k_{t}^{II}\left( h^{t-1}\right) -q_{t}^{0}\left( h^{t}\right) x_{t}\left( h^{t}\right) \right\} -p_{k0}k_{0}^{II} \end{equation*}\]

subject to

\[\begin{equation*} k_{t+1}^{II}\left( h^{t}\right) =\left( 1-\delta \right) k_{t}^{II}\left( h^{t-1}\right) +x_{t}\left( h^{t}\right). \end{equation*}\]

Note the subtle difference in history dependence in terms of the capital stock between both firms. From Firm II’s perspective, it takes one period to assemble new capital before it becomes input for Firm I production. So it rents \(k_{t} = k_{t}^{II}(h^{t-1})\), which is predetermined at time \(t\), to firm I. In contrast, Firm I chooses how much time-\(t\) capital to rent contingent on history \(h^{t}\), so that Firm I hires \(k_{t} = k_{t}^{I}\left( h^{t}\right)\).

We can show that equilibrium prices satisfy

(12)\[\begin{align} p_{k0}&=r_{0}^{0}\left( s_{0}\right) +q_{0}^{0}\left( s_{0}\right) \left( 1-\delta \right) %\tag{12.4.13a} \end{align}\]
(13)\[\begin{align} q_{t}^{0}\left( h^{t}\right) &=\sum_{h^{t+1}|h^{t}}\left[ r_{t+1}^{0}\left( h^{t+1}\right) +q_{t+1}^{0}\left( h^{t+1}\right) \left( 1-\delta \right) % \right] %\tag{12.4.13b} \end{align}\]

since \(k_{0}^{II}\) and \(k_{t+1}^{II}\left( h^{t}\right)\) are strictly positive and finite in equilibrium.

9.6.1.4. Equilibrium prices and quantities

The labor market clears in equilibrium. This is pinned down by substituting (10) into (7):

(14)\[\begin{equation} \beta ^{t}u_{l}\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right) =\eta q_{t}^{0}\left( h^{t}\right) A_{t}\left( h^{t}\right) F_{n}\left( k_{t}^{I}\left( h^{t}\right) ,n_{t}\left( h^{t}\right) \right) %\tag{12.4.14a} \end{equation}\]

and the capital market clears: substitute (13), (11) into (6):

(15)\[\begin{split}\begin{multline} \beta ^{t}u_{c}\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right) %\tag{12.4.14b} \\ =\eta \sum_{h^{t+1}|h^{t}}\left[ r_{t+1}^{0}\left( h^{t+1}\right) +q_{t+1}^{0}\left( h^{t+1}\right) \left( 1-\delta \right) \right] \\ =\eta \sum_{h^{t+1}|h^{t}}q_{t+1}^{0}\left( h^{t+1}\right) \left[ A_{t+1}\left( h^{t+1}\right) F_{k}\left( h^{t+1}\right) +\left( 1-\delta \right) \right] \end{multline}\end{split}\]

Recall from (6) we have

\[\begin{equation*} q_{t}^{0}\left( h^{t}\right) =\frac{\beta ^{t}u_{c}\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right) }{\eta } \end{equation*}\]

and we can do the same for \(q_{t+1}^{0}\left( h^{t+1}\right)\).

Using these expressions in (14) and (15) we have, respectively

\[\begin{equation*} \frac{u_{l}\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right) }{u_{c}\left( c_{t}\left( h^{t}\right) ,1-n_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right) }% =A_{t}\left( h^{t}\right) F_{n}\left( k_{t}^{I}\left( h^{t}\right) ,n_{t}\left( h^{t}\right) \right) \end{equation*}\]

which is identical to the the planner’s optimal labor allocation condition (4); and

\[\begin{split}\begin{multline*} \beta ^{t}u_{c}\left( h^{t}\right) \pi _{t}\left( h^{t}\right) =\sum_{h^{t+1}|h^{t}}\beta ^{t}u_{c}\left( h^{t+1}\right) \pi _{t+1}\left( h^{t+1}\right) \\ \cdot \left[ A_{t+1}\left( h^{t+1}\right) F_{k}\left( h^{t+1}\right) +\left( 1-\delta \right) \right] \end{multline*}\end{split}\]

which is equal to the planner’s optimal consumption allocation condition (5). Finally the product market also clears so that (8) holds with equality. By Walras law, we also know that the Arrow-Debreu securities market has to clear.

Definition 2

An Arrow-Debreu competitive equilibrium in this economy is a sequence of pricing functions \(\{q_{t}^{0}(h^{t}),w_{t}^{0}(h^{t}),r_{t}^{0}(h^{t})\}_{t \geq 0}\) supporting the sequence of allocation functions \(\{c_{t}(h^{t}),n_{t}(h^{t}),k_{t+1}(h^{t}),x_{t}(h^{t}),l_{t}(h^{t}) \}_{t \geq 0}\) such that

  1. Households optimize: (6) and (7),
  2. Firms maximize profits: (10)-(11), and (12)-(13), and
  3. Markets clear: (14), (15) and (8).

for all \(h^{t}\) and all \(t \geq 0\).

9.6.1.5. A first fundamental welfare theorem

Again, without boring ourselves silly, we note that the Arrow-Debreu allocations will be identical to the Pareto optimal allocations chosen by the planner. This is another manifestation of the first fundamental welfare theorem in the case of a production economy with perfectly competitive markets without externalities or informational asymmetries.

From a solution point of view, when we have such economies, it is easier to solve the planner’s problem first for the allocations and then we can back out the implied relative prices in the competitive equilibrium using the optimality conditions we have just derived. We summarize this solution strategy below:

  1. Solve for allocations under PO problem.
  2. Given allocations, work out relative prices from household and firms’ first-order conditions:
    • \(q_{t}^{0}\left( h^{t}\right)\) from (6),
    • \(w_{t}^{0}\left( h^{t}\right)\) from (7),
    • \(r_{t}^{0}\left( h^{t}\right)\) from (11), and
    • \(p_{k0}\) from (12).
  3. To determine absolute prices, pin down a numeraire. For example, set \(q_{0}^{0}\left( s_{0}\right) =1\) which is equivalent to \(\eta =u_{c}\left(s_{0}\right)\).

9.6.1.6. Implied wealth dynamics

We can also track the implied household wealth (net of stream of labor income) over time. Convert all relative prices to time \(t\) history \(h^{t}\) values. For \(\tau \geq t\):

\[\begin{equation*} q_{\tau }^{t}\left( h^{\tau}\right) :=\frac{q_{\tau }^{0}\left( h^{\tau}\right) }{q_{t}^{0}\left( h^{t}\right) }=\beta ^{\tau -t}\frac{u_{c}\left( c_{\tau }\left( h^{\tau}\right) \right) }{u_{c}\left( c_{t}\left( h^{t}\right) \right) }\pi _{\tau }\left( h^{\tau}|h^{t}\right) . \end{equation*}%\]
\[\begin{equation*} w_{\tau }^{t}\left( h^{\tau}\right) :=\frac{w_{\tau }^{0}\left( h^{\tau}\right) }{q_{t}^{0}\left( h^{t}\right) } \end{equation*}\]
\[\begin{equation*} r_{\tau }^{t}\left( h^{\tau}\right) :=\frac{r_{\tau }^{0}\left( h^{\tau}\right) }{q_{t}^{0}\left( h^{t}\right) } \end{equation*}\]

We leave the reader here with a parting section gift of verifying that household wealth (value of all its time-\(t\) and future net claims) in terms of date \(t\), history \(h^{t}\) numeraire, is

(16)\[\begin{split}\begin{multline} \Upsilon _{t}\left( h^{t}\right) :=\sum_{\tau =t}^{\infty }\sum_{h^{\tau}|h^{t}}\left\{ q_{\tau }^{t}\left( h^{\tau}\right) c_{\tau }\left( h^{\tau}\right) -w_{\tau }^{t}\left( h^{\tau}\right) n_{\tau }\left( h^{\tau}\right) \right\} \vdots \\ =\left[ r_{t}^{t}\left( h^{t}\right) +\left( 1-\delta \right) \right] k_{t}\left( h^{t-1}\right) %\tag{12.4.16} \end{multline}\end{split}\]

Economically, the household wealth at time \(t\) under history \(h^{t}\) equals the rental income from current capital service and the value of remaining undepreciated capital.

9.6.2. Sequential trading economy

As before in the pure exchange economy, we can show that the economy with sequential trading in Arrow securities are dynamically consistent with the time-0 trading assumption in the Arrow-Debreu world. Define “tilde” variables as sequential markets variables.

We will use the following notation. At time \(t\) history \(h^{t}\), guess existence of

  • wage rate \(\widetilde{w}_{t}\left( h^{t}\right)\)
  • rental rate \(\widetilde{r}_{t}\left( h^{t}\right)\)
  • Arrow security prices (pricing kernel) \(\widetilde{Q}_{t}\left(s_{t+1}|h^{t}\right)\).

Let \(\widetilde{a}_{t}\left( h^{t}\right)\) be claim to time \(t\) consumption that households brings into time \(t\) if history \(h^{t}\) is realized.

9.6.2.1. Household

Now the household faces a sequence of budget constraint, one for each \(h^{t}\), and \(t \geq 0\):

\[\begin{equation*} \widetilde{c}_{t}\left( h^{t}\right) +\sum_{s_{t+1}}\widetilde{a}% _{t+1}\left( s_{t+1},h^{t}\right) \widetilde{Q}_{t}\left( s_{t+1}|h^{t}\right) \leq \widetilde{w}_{t}\left( h^{t}\right) \widetilde{n}% _{t}\left( h^{t}\right) +\widetilde{a}_{t}\left( h^{t}\right). \end{equation*}\]

where \(\left\{ \widetilde{a}_{t+1}\left( s_{t+1},h^{t}\right) \right\}_{s_{t+1}}\) is a vector of claims on time \(t+1\) consumption. The dimension of \(\left\{ \widetilde{a}_{t+1}\left( s_{t+1},h^{t}\right) \right\} _{s_{t+1}}\) is the same as the number of possible \(s_{t+1}\) reachable, given history \(h^{t}\).

We also need to rule out Ponzi schemes so that intertemporally, household budgets constraints are bounded. One way to do this is to use the natural debt limit which constrains debt levels state-by-state:

\[\begin{equation*} -\widetilde{a}_{t+1}\left( s_{t+1}\right) \leq A_{t+1}\left( h^{t+1}\right) =\sum_{\tau =t+1}^{\infty }\sum_{h^{\tau}|h^{t+1}}\widetilde{w}_{\tau }\left( h^{\tau}\right) \widetilde{n}_{\tau }\left( h^{\tau}\right). \end{equation*}\]

Another way is to assume an arbitrary constant \(A\geq 0\) such that

\[\begin{equation*} -\widetilde{a}_{t+1}\left( s_{t+1}\right) \leq A. \end{equation*}\]

for all \(s_{t+1}\) given \(h^{t}\). Here we can just set \(A=0\). Why?

The household maximizes the Lagrangian:

\[\begin{split}\begin{multline*} L=\sum_{t=0}^{\infty }\sum_{h^{t}}\left\{ \beta ^{t}u\left( \widetilde{c}% _{t}\left( h^{t}\right) ,1-\widetilde{n}_{t}\left( h^{t}\right) \right) \pi _{t}\left( h^{t}\right) \right. \\ \qquad\qquad +\eta _{t}\left( h^{t}\right) \left[ \widetilde{w}_{\tau }\left( h^{\tau}\right) \widetilde{n}_{\tau }\left( h^{\tau}\right) +\widetilde{a}% _{t}\left( h^{t}\right) -\widetilde{c}_{t}\left( h^{t}\right) \right. \\ \left. \left. -\sum_{s_{t+1}}\widetilde{a}_{t+1}\left( s_{t+1},h^{t}\right) \widetilde{Q}_{t}\left( s_{t+1}|h^{t}\right) \right] +\nu _{t}\left( h^{t};s_{t+1}\right) \widetilde{a}_{t+1}^{i}\left( s_{t+1}\right) \right\} \end{multline*}\end{split}\]

Note that the Inada conditions (utility and production functions) imply that \(\widetilde{c}_{t}\left( h^{t}\right) \in \left( 0,\infty \right)\) and \(\widetilde{n}_{t}\left( h^{t}\right) \in \left( 0,\infty \right)\). So the conjecture \(-\widetilde{a}_{t+1}^{i}\left( s_{t+1}\right) \leq A=0\) is not binding so that \(\nu _{t}\left( h^{t};s_{t+1}\right) =0\) almost surely.

Optimality for the household is characterized by

\[\begin{equation*} \widetilde{w}_{\tau }\left( h^{\tau}\right) =\frac{u_{l}\left( \widetilde{c}% _{t}\left( h^{t}\right) ,1-\widetilde{n}_{t}\left( h^{t}\right) \right) }{% u_{c}\left( \widetilde{c}_{t}\left( h^{t}\right) ,1-\widetilde{n}_{t}\left( h^{t}\right) \right) } \end{equation*}\]
\[\begin{equation*} \widetilde{Q}_{t}\left( s_{t+1}|h^{t}\right) =\beta \frac{u_{c}\left( \widetilde{c}_{t+1}\left( h^{t+1}\right) ,1-\widetilde{n}_{t+1}\left( h^{t+1}\right) \right) }{u_{c}\left( \widetilde{c}_{t}\left( h^{t}\right) ,1-% \widetilde{n}_{t}\left( h^{t}\right) \right) }\pi \left( h^{t+1}|h^{t}\right) \end{equation*}\]

for all \(t,h^{t}\) and \(s_{t+1}\).

9.6.2.2. Type I Firm

Each period, Firm I solves a static problem:

\[\begin{equation*} \text{max}\left\{ A_{t}\left( h^{t}\right) F\left( \widetilde{k}% _{t}^{I}\left( h^{t}\right) ,\widetilde{n}_{t}\left( h^{t}\right) \right) -% \widetilde{r}_{t}\left( h^{t}\right) \widetilde{k}_{t}^{I}\left( h^{t}\right) -\widetilde{w}_{t}\left( h^{t}\right) \widetilde{n}_{t}\left( h^{t}\right) \right\} \end{equation*}\]

with optimality given by:

\[\begin{equation*} \widetilde{r}_{t}\left( h^{t}\right) =A_{t}\left( h^{t}\right) F_{k}\left( \widetilde{k}_{t}^{I}\left( h^{t}\right) ,\widetilde{n}_{t}\left( h^{t}\right) \right) \end{equation*}%\]
\[\begin{equation*} \widetilde{w}_{t}\left( h^{t}\right) =A_{t}\left( h^{t}\right) F_{n}\left( \widetilde{k}_{t}^{I}\left( h^{t}\right) ,\widetilde{n}_{t}\left( h^{t}\right) \right). \end{equation*}\]

Firm I makes zero profit, and is willing to produce whatever quantity the market demands:

\[\begin{equation*} A_{t}\left( h^{t}\right) F\left( \widetilde{k}_{t}^{I}\left( h^{t}\right) ,% \widetilde{n}_{t}\left( h^{t}\right) \right) =\widetilde{c}_{t}\left( h^{t}\right) +\widetilde{x}_{t}\left( h^{t}\right) .\ \end{equation*}\]

9.6.2.3. Type II Firm

At each \(t\geq 0\), Firm II chooses \(\widetilde{k}_{t+1}^{II}\left(h^{t}\right)\) to solve

\[\begin{equation*} \max \left\{ \widetilde{k}_{t+1}^{II}\left( h^{t}\right) \sum_{s_{t+1}}% \widetilde{Q}_{t}\left( s_{t+1}|h^{t}\right) \left[ \widetilde{r}% _{t+1}\left( h^{t+1}\right) +\left( 1-\delta \right) \right] -\widetilde{k}% _{t+1}^{II}\left( h^{t}\right) \right\} \end{equation*}\]

where the term in curly parentheses is the expected \(t+1\) rental revenue plus undepreciated (liquidation value) capital net of capital stock stored at end of \(t\) to be rented to Firm I in \(t+1\).

The zero profit first-order condition is

(17)\[\begin{equation} \sum_{s_{t+1}}\widetilde{Q}_{t}\left( s_{t+1}|h^{t}\right) \left[ \widetilde{% r}_{t+1}\left( h^{t+1}\right) +\left( 1-\delta \right) \right] -1=0. %\tag{12.5.8} \end{equation}\]

The firm breaks even at any \(\widetilde{k}_{t+1}^{II}\left( h^{t}\right)\) satisfying this condition.

9.6.2.4. Equilibrium prices and quantities

We can show that in terms of allocations, the sequential markets economy and the Arrow-Debreu economy are equivalent. That is,

\[\begin{split}\begin{multline*} \left\{ \widetilde{c}_{t}\left( h^{t}\right) ,\widetilde{l}_{t}\left( h^{t}\right) ,\widetilde{x}_{t}\left( h^{t}\right) ,\widetilde{n}_{t}\left( h^{t}\right) ,\widetilde{k}_{t+1}\left( h^{t}\right) \right\} _{t=0}^{\infty } = \\ \qquad \qquad \left\{ c_{t}\left( h^{t}\right) ,l_{t}\left( h^{t}\right) ,x_{t}\left( h^{t}\right) ,n_{t}\left( h^{t}\right) ,k_{t+1}\left( h^{t}\right) \right\} _{t=0}^{\infty }. \end{multline*}\end{split}\]

Here is an outline of the proof:

  1. Guess price
\[\begin{equation*} \widetilde{Q}_{t}\left( s_{t+1}|h^{t}\right) =q_{t+1}^{t}\left( h^{t+1}\right) \end{equation*}\]
\[\begin{equation*} \widetilde{w}_{t}\left( h^{t}\right) =w_{t}^{t}\left( h^{t}\right) \end{equation*}%\]
\[\begin{equation*} \widetilde{r}_{t}\left( h^{t}\right) =r_{t}^{t}\left( h^{t}\right) \end{equation*}\]
  1. Guess portfolio \(\widetilde{a}_{t+1}\left( s_{t+1}\right) =\Upsilon_{t+1}\left( h^{t+1}\right)\) for all \(s_{t+1}\).
  2. Show asset portfolios are affordable given chosen allocations, where
\[\begin{equation*} \widetilde{a}_{0}=\left[ r_{0}^{0}\left( s_{0}\right) +\left( 1-\delta \right) \right] k_{0}=p_{k0}k_{0}. \end{equation*}\]

Definition 3

An sequential-markets competitive equilibrium in this economy is a sequence of pricing functions \(\{Q(s_{t+1}|h^{t}),\widetilde{w}_{t}^{0}(h^{t}),\widetilde{r}_{t}^{0}(h^{t})\}_{t \geq 0}\) supporting the sequence of allocation functions \(\{c_{t}(h^{t}),n_{t}(h^{t}),k_{t+1}(h^{t}),x_{t}(h^{t}),l_{t}(h^{t}) \}_{t \geq 0}\) such that

  1. Households optimize,
  2. Firms maximize profits, and
  3. Markets clear.

for all \(h^{t}\) and all \(t \geq 0\).

9.6.2.5. Why conjecture \(A=0\) is correct

It turns out that Firm II is entirely owned by its creditor, the household. Firm II finances \(\widetilde{k}_{t+1}^{II}\left( h^{t}\right)\) in time \(t\), by issuing one-period securities that promise to pay

\[\begin{equation*} \left[ \widetilde{r}_{t+1}\left( h^{t+1}\right) +\left( 1-\delta \right) % \right] \widetilde{k}_{t+1}^{II}\left( h^{t}\right) \end{equation*}\]

for all \(s_{t+1}\), \(t\) and \(h^{t}\), to break even, according to (17).

Taking expectations at time \(t\), history \(h^{t}\) (value of these payouts in time \(t\) consumption good):

\[\begin{equation*} \widetilde{k}_{t+1}^{II}\left( h^{t}\right) \sum_{s_{t+1}}\widetilde{Q}% _{t}\left( s_{t+1}|h^{t}\right) \left[ \widetilde{r}_{t+1}\left( h^{t+1}\right) +\left( 1-\delta \right) \right] \end{equation*}\]

The firm breaks even by issuing these claims to households – i.e. households are owners of Firm II.

Recall (16) implied wealth of Arrow-Debreu households:

\[\begin{equation*} \Upsilon _{t}\left( h^{t}\right) =\left[ r_{t}^{t}\left( h^{t}\right) +\left( 1-\delta \right) \right] k_{t}\left( h^{t-1}\right) =\widetilde{a}% _{t+1}\left( s_{t+1}\right) \end{equation*}\]

equals the sequential market economy households’ desired next period beginning wealth (positive), which is the value of Firm II at \(t\). That is,

\[\begin{equation*} -\widetilde{a}_{t+1}\left( s_{t+1}\right) <A=0. \end{equation*}\]

9.7. A recursive stochastic growth model

We have so far taken history to be generated by some unspecified stochastic process. That resulted in allocations and prices being completely history dependent. So we had to describe optimization as a Lagrangian problem – a problem that we cannot hope to solve. If we force history to be induced by a Markov process, optimization can be recursively computed as a Bellman equation problem.

Now we specialize the exogenous forcing process for technology, \(A_{t}\left( h^{t}\right)\). Let \(s\in S\) and \(s_{t}\) is a Markov process \(\left( \pi \left( s^{\prime}|s\right) ,\pi _{0}\left( s_{0}\right) \right)\) with \(\pi _{0}\left(s_{0}\right) =1\) for any \(s_{0}\in S\).

The likelihood of a \(t\)-history, \(h^{t}\) can now be recursively computed:

\[\begin{split}\begin{eqnarray*} \pi _{t}\left( h^{t}\right) &=&\pi \left( s_{t}|s_{t-1}\right) \pi _{t-1}\left( h^{t-1}\right) \\ &=&\pi \left( s_{t}|s_{t-1}\right) \pi \left( s_{t-1}|s_{t-2}\right) \cdots \pi \left( s_{1}|s_{0}\right) \pi _{0}\left( s_{0}\right) \end{eqnarray*}\end{split}\]

by exploiting the transition probability function or the Markov matrix in the case of finite states for the shock. Note that now

\[\frac{\pi _{t}\left( h^{t+1}\right)}{\pi _{t}\left( h^{t}\right)} = \pi(s_{t+1}|s_{t}).\]

Assume \(A_{t}\left( h^{t}\right) =\mathcal{A}\left( A_{t-1}\left( h^{t-1}\right) ,s_{t}\right)\), a time-invariant function \(\mathcal{A}\) measurable with respect to \(s_{t}\). For example,

\[A_{t}\left( h^{t}\right) = A_{t-1}(h^{t-1})s_{t} = A_{-1}s_{0}s_{1}\cdots s_{t},\]

with \(A_{-1}\) given. So current technology \(A_{t}\left( h^{t}\right) := A^{\prime }\) depends on last period technology and current shock \(s\). Dropping the time subscripts, we write

\[A^{\prime }=\mathcal{A}\left( A,s\right) = As.\]

Let the aggregate beginning of period capital stock be \(K := K_{t}(h^{t-1})\). To summarize current position of the economy, define aggregate state as

\[\begin{equation*} X:=\left( K,A,s\right) \end{equation*}\]

We will next look at the Pareto problem and then the sequential markets competitive equilibrium for the stochastic growth model with recursive technology shocks. To distinguish the notatation we use capital letters for the planners variables and lower case for the competitive equilibrium:

Planner RCE
\(C\) \(c\)
\(K\) \(k\)
\(N\) \(n\)

We’ll show they are the same in the end.

9.7.1. Recursive planning problem

The planner’s problem now can be written down recursively as the Bellman equation

\[\begin{equation*} v\left( K,A,s\right) =\max \left\{ u\left( C,1-N\right) +\beta \sum_{s^{\prime }}\pi \left( s^{\prime }|s\right) v\left( K^{\prime },A^{\prime },s^{\prime }\right) \right\} \end{equation*}\]

subject to

(18)\[\begin{split}\begin{align*} K^{\prime }+C & \leq AsF\left( K,N\right) +\left( 1-\delta \right) K \\ A^{\prime } & =As. %\tag{*} \end{align*}\end{split}\]

The optimal policy functions solving the Bellman equation are of the form

(19)\[\begin{split}\begin{align*} C&=C\left( K,A,s\right) \\ N&=N\left( K,A,s\right) \\ K^{\prime }&=K\left( K,A,s\right) %\tag{**} \end{align*}\end{split}\]

Note that the transition law for technology shocks together with the optimal policy function for capital accumulation,

\[\begin{equation} A^{\prime }=As %\tag{*} \end{equation}\]

and

\[\begin{equation} K^{\prime }=K\left( K,A,s\right), %\tag{**} \end{equation}\]

along with the Markov kernel for the shock \(\pi \left( s^{\prime }|s\right)\), induce a transition density function \(\Pi\left( X^{\prime }|X\right)\) on the aggregate state \(X=\left( K,A,s\right)\). \(\Pi\left( X^{\prime }|X\right)\) gives us the frequency of observing the next-period aggregate state \(X'\) given a known current state \(X\).

Define derivatives at the optimum as

\[\begin{equation*} u_{i}\left( X\right) :=u_{i}\left( C\left( K,A,s\right) ,1-N\left( K,A,s\right) \right) \text{ for }i=c,n \end{equation*}%\]
\[\begin{equation*} F_{j}\left( X\right) :=F_{j}\left( K,N\left( K,A,s\right) \right) \text{ for }j=k,n \end{equation*}\]

Then Pareto optimality of the allocations \({C, K', N}\) is characterized by

\[\begin{equation*} \frac{u_{l}\left( X\right) }{u_{c}\left( X\right) }=AsF_{n}\left( X\right) \end{equation*}\]
\[\begin{equation*} 1=\beta \sum_{X^{\prime }}\Pi \left( X^{\prime }|X\right) \frac{u_{c}\left( X^{\prime }\right) }{u_{c}\left( X\right) }\left[ A^{\prime }s^{\prime }F_{k}\left( X^{\prime }\right) +\left( 1-\delta \right) \right] \end{equation*}\]

along with

\[K^{\prime }+C = AsF\left( K,N\right) +\left( 1-\delta \right) K.\]

9.7.2. Recursive competitive equilibrium with sequential markets

Now we consider the decentralized economy with sequential markets. In describing the decision problem of households as price takers, we now denote \(K\) as the aggregate capital stock determined in the aggregate equilibrium, but individual capital \(k\) is chosen by individual household/firms. We will impose a notion of a “consistent” – in the sense of beliefs and actions – equilibrium later, so that \(k=K\). In doing so, we make explicit the idea of a rational expectations equilibrium or REE.

Because agents are “small” – viz. they take as given prices \(r\left( X\right)\), \(w\left( X\right)\), \(Q\left(X^{\prime }|X\right)\). In deciding their individual optimal actions (consuming, producing, selling and buying), agents need to forecast the evolution of \((K, A, s)\) in order to track prices.

For simplicity, assume that all agents know the true law of motion for technology shock,

\[A' = As\]

but they assign subjective probabilities to the shocks \(s\), denoted as \(\hat{\pi }\left( s^{\prime }|s\right)\), and have subjective views on how the aggregate capital stock \(K\) evolves. We will denote their perceived law of motion (PLM) for the aggregate capital stock as

\[\begin{equation*} K^{\prime }=G\left( X\right) =G\left( K,A,s\right), \end{equation*}\]

This subjective beliefs system \((G, \hat{\pi})\), in turn, will induce a perceived transition density for the aggregate state vector, \(\hat{\Pi }\left( X^{\prime }|X\right)\). When we define a REE, we will impose consistency of beliefs on \(G\) and \(\hat{\pi }\). Next we turn to describing the recursive decentralized economy.

9.7.2.1. Household

Individually, households hold the belief system \((G, \hat{\pi})\) or more compactly \(\hat{\Pi }\left( X^{\prime }|X\right)\). Households need to form a view of the evolution of the aggregate state \(X=\left( K,A,s\right)\). They also track their own individual state \(a\), which is the wealth they carry into each current period.

Let \(V\left( a,X\right)\) be the value function for the household at current state \(\left( a,X\right)\) which is the subjectively maximal indirect expected total discounted utility. We say “subjectively” because the household, off-equilibrium, calculates its expected continuation value using the subjective probabilities defined by \(\hat{\Pi }\left( X^{\prime }|X\right)\). The household recursive problem is now given by the Bellman equation:

\[\begin{equation*} V\left( a,X\right) =\max \left\{ u\left( c,1-n\right) +\beta \sum_{X^{\prime }}V\left( \overline{a}\left( X^{\prime }\right) ,X^{\prime }\right) \hat{ \Pi }\left( X^{\prime }|X\right) \right\} \end{equation*}\]

subject to

\[\begin{equation*} c+\sum_{X^{\prime }}Q\left( X^{\prime }|X\right) \overline{a}\left( X^{\prime }\right) \leq w\left( X\right) n+a \end{equation*}\]

Note that the price of a unit of consumption is normalized to unity so that now \(w\left( X\right)\) denotes the real wage rate. \(Q\left( X^{\prime }|X\right)\) is the price of a unit of Arrow security that pays off in terms of consumption if next-period state \(X'\) occurs given current state \(X\).

Household’s (subjectively) optimal policy functions are

\[\begin{equation*} c=\sigma ^{c}\left( a,X\right) \end{equation*}\]
\[\begin{equation*} n=\sigma ^{n}\left( a,X\right) \end{equation*}\]
\[\begin{equation*} \overline{a}\left( X^{\prime }\right) =\sigma ^{a}\left( a,X;X^{\prime }\right) \end{equation*}\]

Let the marginal utilities of consumption and leisure under the subjectively optimal household strategies, respectively, be denoted by

\[\begin{equation*} \overline{u}_{c}\left( a,X\right) :=u_{c}\left( \sigma ^{c}\left( a,X\right) ,1-\sigma ^{n}\left( a,X\right) \right), \end{equation*}\]

and

\[\begin{equation*} \overline{u}_{l}\left( a,X\right) :=u_{l}\left( \sigma ^{c}\left( a,X\right) ,1-\sigma ^{n}\left( a,X\right) \right). \end{equation*}\]

(Subjective) optimality is then characterized by

\[\begin{equation*} \frac{\overline{u}_{l}\left( a,X\right) }{\overline{u}_{c}\left( a,X\right) }% =w\left( X\right) \end{equation*}%\]
\[\begin{equation*} Q\left( X^{\prime }|X\right) =\beta \hat{\Pi }\left( X^{\prime }|X\right) \frac{\overline{u}_{c}\left( a^{\prime },X^{\prime }\right) }{% \overline{u}_{c}\left( a,X\right) } \end{equation*}\]

The first equation is the optimal leisure-consumption trade-off which, at the margin, must equal the opportunity cost of not working (the real wage). The second one is household’s perceived stochastic Euler equation, which governs the subjectively optimal consumption plan between any period and state.

9.7.2.2. Type I Firm

The static profit maximization problem for Firm I has the following zero profit conditions:

\[\begin{equation*} r\left( X\right) =AsF_{k}\left( k,n\right), \end{equation*}\]
\[\begin{equation*} w\left( X\right) =AsF_{n}\left( k,n\right). \end{equation*}\]

Firm I produces output up to the point where the marginal product of capital (labor) equals the market real rental rate on capital (labor).

9.7.2.3. Type II Firm

The Type II firm now solves its profit maximization problem with the optimality condition (zero profit condition) given by

\[\begin{equation*} 1= \sum_{X^{\prime }}Q\left( X^{\prime }|X\right) \left[ r\left( X^{\prime }\right) +\left( 1-\delta \right) \right] \end{equation*}\]

which again says that Firm II will rent any amount of capital to firm I as long as the marginal cost of a unit of investment good it purchases (equal to 1), is equal to the marginal return on its rental sales. The marginal return is made up of the state contingent rental return plus undepreciated capital return, and both discounted using the Arrow pricing kernel (stochastic discount factor), since the contracts between Firm II and Firm I are written in those terms.

9.7.3. Recursive competitive equilibrium

We now want to impose equilibrium conditions on

  • arbitrary prices \(r\left( X\right)\), \(w\left( X\right)\), \(Q\left(X^{\prime }|X\right)\) and
  • beliefs \((G\left( X\right),\hat{\pi})\) or \(\hat{\Pi }\left( X^{\prime}|X\right)\).

That is, (i) we want firms and households as to behave as price takers, so that \(k=K\), after solving their optimum problems, and (ii) a rational expectations competitive equilibrium.

State-contingent claim issued by Firm II must match the demand by household:

\[\begin{equation*} \overline{a}\left( X^{\prime }\right) =\left[ r\left( X^{\prime }\right) +\left( 1-\delta \right) \right] K^{\prime } \end{equation*}\]

and so beginning-of-period assets in the household budget constraint must satisfy

\[\begin{equation*} a=\left[ r\left( X\right) +\left( 1-\delta \right) \right] K \end{equation*}\]

Substitute these into the household sequential budget constraint:

\[c+\sum_{X^{\prime }}Q\left( X^{\prime }|X\right) \left[ r\left( X^{\prime }\right) +\left( 1-\delta \right) \right] K^{\prime } =w\left( X\right) n+\left[ r\left( X\right) +\left( 1-\delta \right) \right] K.\]

Using Firm II’s first-order condition we further get

\[\begin{equation*} c+K^{\prime }=w\left( X\right) n+\left[ r\left( X\right) +\left( 1-\delta \right) \right] K \end{equation*}\]

and also using Firm I’s first-order condition we further reduce the household budget constraint to get

\[\begin{equation*} K^{\prime }=AsF\left( K,\sigma ^{n}\left( a,X\right) \right) +\left( 1-\delta \right) K-\sigma ^{c}\left( a,X\right) \end{equation*}\]

where Euler’s theorem on the homogeneous of degree one function \(F\left( \cdot \right)\) was used.

Given individual optimality condition, impose equilibrium conditions which requires individual choices to be consistent with the aggregate:

\[\begin{equation*} k=K, \end{equation*}\]
\[\begin{equation*} n=\sigma ^{n}\left( a,X\right) =N, \end{equation*}\]
\[\begin{equation*} c=\sigma ^{c}\left( a,X\right) =C, \end{equation*}\]
\[\begin{equation*} a=\left[ r\left( X\right) +\left( 1-\delta \right) \right] K. \end{equation*}\]

Then we can write solely in terms of aggregate state \(X\):

(20)\[\begin{split}\begin{align} K^{\prime }&=AsF\left( K,\sigma ^{n}\left( \left[ r\left( X\right) +\left( 1-\delta \right) \right] K,X\right) \right) \notag \\ & \qquad\qquad +\left( 1-\delta \right) K-\sigma ^{c}\left( \left[ r\left( X\right) +\left( 1-\delta \right) \right] K,X\right) := \mathcal{G}[G(X)]. \end{align}\end{split}\]

Note that after substituting out firm decisions, the RHS contains household’s (subjectively) optimal decisions, under the beliefs induced by the PLM \((G\left( X\right),\hat{\pi})\), or \(\hat{\Pi }\left( X^{\prime }|X\right)\). This is the optimal evolution of the aggregate capital stock, or the actual law of motion (ALM) for \(K\). What we have here is a mapping from PLM to ALM for \(K\).

Definition 4

A consistent set of beliefs, or rational expectations equilibrium is a fixed-point of the mapping from perceived \(G\) and price system to an actual \(\mathcal{G}\) and \(\hat{\pi }=\pi\), so that \((G, \hat{\pi}) = (\mathcal{G},\pi)\).

In our case, REE or PLM = ALM, requires

(21)\[\begin{split}\begin{multline} G\left( X\right) =AsF\left( K,\sigma ^{n}\left( \left[ r\left( X\right) +\left( 1-\delta \right) \right] K,X\right) \right) \\ +\left( 1-\delta \right) K-\sigma ^{c}\left( \left[ r\left( X\right) +\left( 1-\delta \right) \right] K,X\right) := \mathcal{G}[G(X)] . \end{multline}\end{split}\]

Note LHS is implicitly a function of PLM \(G\left( X\right)\).

Definition 5

A RCE with Arrow securities is

  • a price system \(r\left( X\right) ,w\left( X\right) ,Q\left( X^{\prime}|X\right)\),
  • a perceived law of motion \(K^{\prime }=G\left( X\right)\) and induced

transition density \(\hat{\Pi }\left( X^{\prime }|X\right)\), and

  • a household value function \(V\left( a,X\right)\) and decision rules
\[\begin{equation*} \sigma ^{c}\left( a,X\right) ,\sigma ^{n}\left( a,X\right) ,\sigma ^{a}\left( a,X;X^{\prime }\right) \end{equation*}\]

such that

1. Given the price system and beliefs \(\hat{\Pi }\left( X^{\prime }|X\right)\), the decision rules and value function solve the household’s optimum problem;

2. For all \(X\), \(r\left( X\right) ,w\left( X\right)\) solve Firm I’s optimum problem given 1;

3. \(Q\left( X^{\prime }|X\right)\) and \(r\left( X\right)\) solve Firm II’s problem given 1 and 2;

4. Markets clear, \(G\left( X\right) ,r\left( X\right) ,\sigma ^{c}\left( a,X\right) ,\sigma ^{n}\left( a,X\right)\) satisfy ALM = PLM; and

  1. \(\hat{\pi }=\pi\).

Remark 1

Requirements 4 and 5 impose rational expectations, so that \(\hat{\Pi}\left( X^{\prime }|X\right) =\Pi \left( X^{\prime }|X\right)\).

9.8. Part II

9.9. An example recursive economy

We will use the generic notation \(\mathbb{E}\) now for the expectations operator so that our model can admit either finite-state-space technology shocks or continuous-state-space shocks.[2]_ How the shocks are specified will be a matter of choice for the researcher.

Now we will illustrate a more condensed example where we side-step Firm II altogether and assume that the household owns capital stock in every period and rents it to Firm I. We will impose the requirement of rational expectations from the outset so households will be forecasting based on the equilibrium, “correct” or model-consistent belief system.

9.9.1. Exogenous forcing process

Suppose the level of technology follows a continuous-state first-order Markov process:

(22)\[\begin{equation} A_{t} = A_{t-1}^{\rho}\exp\{s_{t}\}, \end{equation}\]

and \(s_{t} \sim \text{i.i.d.}(0, \sigma^{2})\).

9.9.2. Preferences

Let the aggregate state be \(X:=(K, A)\) and the individual state \(k\). Suppose that the per-period utility for the household is

\[u(c,1-n) = \epsilon_{c}\ln(c) + (1 - \epsilon_{c})\ln(1-n).\]

where \(\epsilon_{c} \in (0,1)\).

The household budget constraint is given by:

\[c + x = w(K,A)n + r(K,A)k,\]

which has that the household can purchase consumption or investment goods using labor or capital income. With the investment good, the household can produce more capital to rent to Firm I:

\[k' = x + (1-\delta)k.\]

So the household Bellman equation is now

(23)\[\begin{equation} V(k, K, A) = \max_{c, k', n} \left\{ [\epsilon_{c}\ln(c) + (1 - \epsilon_{c})\ln(1-n)] + \beta \mathbb{E}[V(k', K', A') | A ] \right\} \end{equation}\]

subject to

(24)\[\begin{equation} k' = [r(K,A) + (1-\delta)]k + w(K,A)n - c \end{equation}\]

We now suppress the dependency of prices and allocations on states and re-introduce the time subscripts. An optimal plan by the household with respect to \(n\) and \(k'\) satisfies

(25)\[\begin{equation} w_{t} = \left(\frac{1-\epsilon_{c}}{\epsilon_{c}}\right)\frac{c_{t}}{1-n_{t}}, \end{equation}\]

and

(26)\[\begin{equation} \frac{1}{c_{t}} = \beta \mathbb{E}_{t} \left\{\frac{(r_{t+1}+1-\delta)}{c_{t+1}}\right\}, \end{equation}\]

for all states and dates \(t \geq 0\). Or we can define \(R_{t} = r_{t} + 1 -\delta\), so that the Euler equation is re-written as

(27)\[\begin{equation} \frac{1}{c_{t}} = \beta \mathbb{E}_{t} \left\{\frac{R_{t+1}}{c_{t+1}}\right\}. \end{equation}\]

9.9.3. Technology

Firm I operates the following technology:

where \(\alpha \in (0,1)\). Firm I hires labor and capital services from the household up to the point that it maximizes profits:

(28)\[\begin{equation} w_{t} = (1-\alpha)A_{t}\left(\frac{k_{t}}{n_{t}}\right)^{\alpha}, \end{equation}\]

and

(29)\[\begin{equation} r_{t} = \alpha A_{t}\left(\frac{k_{t}}{n_{t}}\right)^{\alpha -1} \Rightarrow R_{t} = \alpha A_{t}\left(\frac{k_{t}}{n_{t}}\right)^{\alpha -1} +(1-\delta). \end{equation}\]

9.9.4. Recursive competitive equilibrium

A recursive competitive equilibrium with rational expectations is then a sequence of pricing functions \(\{w_{t}(K_{t},A_{t}),r_{t}(K_{t},A_{t}) \}_{t \geq 0}\) such that

  1. Households solve their Bellman equation problem: (25) and (27), and
  2. Firms maximize profit, (28) and (29), and
  3. Markets clear: \(k = K\), \(n = N\), \(c=C\), \(x = X\) and
\[K_{t+1} = (1-\delta)K_{t} + AK^{\alpha}N^{1-\alpha} - C_{t}.\]

9.9.5. Computing a sample equilibrium

In this section we show how to compute a solution to the recursive competitive equilibrium using a simple log-linear approximation technique.[3]_ This method is commonly used in the early real business cycle literature and also more recently in the monetary policy models with New Keynesian features (more on this later). The idea is to attack the optimality conditions (describing the competitive equilibrium) themselves and impose a stability condition (much stronger assumption than the transversality condition) on the equilibrium sequences.

This simple model has six parameters \((\beta, \epsilon_{c}, \delta, \alpha, \rho, \sigma^{2})\). At a deterministic steady state where \(A_{ss} = 1\) we have

\[\begin{split}\begin{align*} r_{ss} &= \beta^{-1} -1+\delta \\ \delta &= X_{ss}/K_{ss}. \end{align*}\end{split}\]

Recall we defined \(R_{t} = r_{t} + 1 -\delta\) so that now \(R_{ss} = r_{ss} + 1 -\delta\).

So we can calibrate the values of \(\beta\) and \(\delta\) from long run data on the real return on capital and investment-capital ratio. We also know from data the long run capital-labor ratio, so we can calibrate the real return on capital and labor as

\[\begin{split}\begin{align*} r_{ss} &= \alpha A_{ss}\left(\frac{K_{ss}}{N_{ss}}\right)^{\alpha - 1} \\ w_{ss} &= (1-\alpha)A_{ss}\left(\frac{K_{ss}}{N_{ss}}\right)^{\alpha}. \end{align*}\end{split}\]

We can also calculate the long run capital-output ratio from data, so then we can find

\[\frac{X_{ss}}{Y_{ss}} = \delta \frac{K_{ss}}{Y_{ss}}\]

and from the accounting identity we have

\[\frac{C_{ss}}{Y_{ss}} = 1 - \frac{X_{ss}}{Y_{ss}}.\]

It turns out that we don’t need to parameterize \(\epsilon_{c}\) since it does not appear in our linearized system below. A typical estimate of the share of capital in output is \(\alpha = 0.36\). So now we are ready to approximate and then solve the approximate model.

Define \(\hat{x}_{t} = \ln(X_{t}/X_{ss})\) as the percentage deviation of the original variable in levels from its steady state value. Using a first-order Taylor series approximation of the true nonlinear dynamical system around the latter’s deterministic steady state, we have the following approximate linear system of expectational difference equations:

\[\begin{split}\begin{align*} \hat{a}_{t} & = \rho\hat{a}_{t-1} + s_{t} \\ \hat{k}_{t+1} &\approx (1-\delta)\hat{k}_{t} + \delta \hat{x}_{t}, \\ \mathbb{E}_{t}\hat{c}_{t+1} &\approx \hat{c}_{t} + \mathbb{E}_{t}\hat{r}_{t+1} \\ \hat{y}_{t} &= \hat{a}_{t} +(1- \alpha) \hat{n}_{t} + \alpha \hat{k}_{t} \\ \hat{y}_{t} &\approx \omega_{c}\hat{c}_{t} +\omega_{x} \hat{x}_{t} \\ R_{ss}\hat{r}_{t} &= \alpha \frac{Y_{ss}}{K_{ss}}(\hat{y}_{t} - \hat{k}_{t}) \\ \hat{w}_{t} &=\hat{y}_{t} - \hat{n}_{t} \\ \omega_{l}\hat{w}_{t} &= \hat{n}_{t} + \omega_{l}\hat{c}_{t} \end{align*}\end{split}\]

where \(\omega_{c} = C_{ss}/Y_{ss}\), \(\omega_{x} = X_{ss}/Y_{ss}\) and \(\omega_{l} = (1-N_{ss})/N_{ss}\).

The system above can be reduced so that we only need to solve a two-dimensional system given by the first-order form:

\[\begin{split}\left[\begin{array}{c} \hat{k}_{t+1} \\ \mathbb{E}_{t}\hat{c}_{t+1} \end{array}\right] = M \left[\begin{array}{c}\hat{k}_{t} \\ \hat{c}_{t}\end{array}\right] + P\hat{a}_{t}.\end{split}\]

We leave as an exercise to the reader to figure out the parameters in \(M\) and \(P\).

9.9.5.1. Method of undetermined coefficients

To find the approximated REE solution we can use the method of undetermined coefficients. This example here in fact turns out to be a scalar case of the more general version in [uhl99]. We guess a linear optimal decision rule of the form[4]_

\[\hat{c}_{t} = d_{1}\hat{k}_{t} + d_{2}\hat{a}_{t}.\]

If this is correct, then

\[\mathbb{E}_{t}\hat{c}_{t+1} = d_{1}\hat{k}_{t+1} + d_{2}\mathbb{E}_{t}\hat{a}_{t+1} = d_{1}\hat{k}_{t+1} + d_{2}\rho\hat{a}_{t}.\]

The decision rule coefficients \((d_{1},d_{2})\) are as yet undetermined. We will solve for them using the stability conditions implied by an optimal plan. Under this rule, the expectational difference equation system can be written as

\[\begin{split}\left[\begin{array}{c} \hat{k}_{t+1}\\ d_{1}\hat{k}_{t+1}+d_{2}\rho\hat{a}_{t}\end{array}\right]=\left[\begin{array}{cc} m_{11} & m_{12}\\ m_{21} & m_{22}\end{array}\right]\left[\begin{array}{c} \hat{k}_{t}\\ d_{1}\hat{k}_{t}+d_{2}\hat{a}_{t}\end{array}\right]+\left[\begin{array}{c} p_{11}\\ p_{21}\end{array}\right]\hat{a}_{t}\end{split}\]

This controlled system under the conjectured decision rule, provides two expressions for the dynamics of \(\hat{k}_{t+1}\) as a function of \((\hat{k}_{t},\hat{a}_{t})\) which must be valid for all realizations of \((\hat{k}_{t},\hat{a}_{t})\). To see this clearly, we expand the system individually as:

\[\hat{k}_{t+1} = (m_{11}+m_{12}d_{1})\hat{k}_{t} + (p_{11}+m_{12}d_{2})\hat{a}_{t}\]

and

\[d_{1}\hat{k}_{t+1} = (m_{21}+m_{22}d_{1})\hat{k}_{t} + [p_{21}+(m_{22}-\rho)d_{2}]\hat{a}_{t}.\]

A REE for this approximate linear system implies that these two equations must be the same. That is, they characterize the same optimal contingent capital accumulation plan under the REE. Therefore, equating these two equation to eliminate the \(\hat{k}_{t+1}\) terms we have

\[d_{1}(m_{11}+m_{12}d_{1})\hat{k}_{t} + d_{1}(p_{11}+m_{12}d_{2})\hat{a}_{t} = (m_{21}+m_{22}d_{1})\hat{k}_{t} + [p_{21}+(m_{22}-\rho)d_{2}]\hat{a}_{t}.\]

Equating the coefficients, we then must have

\[m_{12}d_{1}^{2} + (m_{11}-m_{22})d_{1} -m_{21} = 0\]

and

\[d_{2} = \frac{-d_{1}p_{11}+p_{21}}{d_{1}m_{12}-(m_{22}-\rho)}.\]

The first is the characteristic equation which is a quadratic in the root \(d_{1}\). To ensure that the dynamics of \(\hat{k}_{t}\) is stable (so that it is also bounded) for any initial condition, we need to pick the \(d_{1}\) that would ensure \(| (m_{11}+m_{12}d_{1}) | < 1\) so that the path of capital is given by a stable REE (i.e. will satisfy the transversality condition). Given the values of \((m_{11}, m_{12}, m_{21}, m_{22})\) we pick the root

\[d_{1} = \frac{-(m_{11}-m_{22})\pm \sqrt{(m_{11}-m_{22})^{2}+4m_{12}m_{21}}}{2m_{12}}\]

such that \(| (m_{11}+m_{12}d_{1}) | < 1\).

Exercise 1

Show that the two possible distinct eigenvalues, \(\lambda := (m_{11}+m_{12}d_{1})\), occur as a reciprocal pair – viz. one eigenvalue is inversely related to the other so that there can be at most only one stable REE. We say that, in this case, the REE is unique and saddle-path stable.

Once we know \(d_{1}\) we can solve for \(d_{2}\) using the previous condition. Finally, we can solve for the optimal capital accumulation decision rule using what we derived before:

\[\hat{k}_{t+1} = (m_{11}+m_{12}d_{1})\hat{k}_{t} + (p_{11}+m_{12}d_{2})\hat{a}_{t},\]

and the consumption decision rule as

\[\hat{c}_{t} = d_{1}\hat{k}_{t} + d_{2}\hat{a}_{t},\]

given

\[\hat{a}_{t} = \rho\hat{a}_{t-1} + s_{t}.\]

This is just a linear stochastic difference equation system (in the “state-space form”) which we can then use to compute impulse responses and covariances of all other variables in the system, since they are just static identities. For an empiricist familiar with Vector Autoregressions (VARs), this (log-linear) approximate solution to the RCE-REE of the model implies a VAR with theory-implied restrictions on the VAR coefficient matrix and covariance structure.[5]_ The formulas for doing this was discussed in previous topics and in [ls04], chapter 2. We leave the computation as an exercise for the reader.

Finally, what if we have larger models with more than one Euler equation? The technique discussed in [uhl99] is a generalization of this simple hands on example.

9.10. Appendix A

9.11. Linear Stochastic Difference Equations

9.12. Setup

Consider a stochastic process for our state variables described by the canonical first-order linear stochastic difference equation (LSDE).[6]_ In some theories and applications (e.g. approximate linearized real or monetary business cycle models) that we will encounter, the solution to the (recursive competitive) equilibrium is approximately given by:

(30)\[\begin{equation} x_{t+1}=A_{0}x_{t}+Cw_{t+1}, \qquad w_{t+1} \sim \text{i.i.d.} (0,I) \end{equation}\]

The models may also induce a relationship between statistically observable variables \(y_t\) and the state variables in the theory \(x_t\) such that

(31)\[\begin{equation} y_{t}=Gx_{t}. \end{equation}\]

These items in (30) and (31), including the distribution of the shocks \(w_{t}\), define a Markov kernel for the economy. (How?)

Consider a small monetary policy model as example. The state vector and the observed vector may look like this

\[\begin{split}x_t = \left( \begin{array}{c} g_t \\ a_t \\ \pi_t \\ \tilde{y}_t \end{array} \right), y_t = \left( \begin{array}{c} \pi_t \\ \tilde{y}_t \\ r_t \end{array} \right).\end{split}\]

where the three variables in \(y_t\) having data counterparts, respectively, are inflation, output gap, and the nominal interest rate. The variables \((g_t,a_t)\) could be exogenous random variable that are Markov processes themselves and have the interpretation of exogenous forcing variables or serially-correlated shocks – e.g. respectively, a government spending (demand) shock and a technology (supply) shock.

9.13. Moments of the LSDE

9.13.1. Covariance stationary mean

To ensure that \(\left\{ x_{t}\right\}\) is covariance stationary we require that \(A_{0}\) be a stable matrix. Now take expectations on both sides of (32):

\[\begin{equation*} Ex_{t+1}=A_{0}Ex_{t}. \end{equation*}\]

Let \(\mu_{t} := E x_{t}\). Then we can also write the above as:

\[\begin{equation*} \mu_{t+1}=A_{0}\mu_{t}. \end{equation*}\]

A stationary mean is one that satisfies \(Ex_{t+1}=Ex_{t}=\mu\) which can be found as

\[\begin{equation*} \left( I-A_{0}\right) \mu = 0. \end{equation*}\]

So in this case, since \(A_{0}\) is a stable matrix, \(\mu\) is a vector of zeros. (Why?) Note that we have

\[\mu_{t} = (A_{0})^{t}\mu_{0}.\]

If \(A_{0}\) is stable, then,

\[\lim_{t \rightarrow 0} \mu_{t} \rightarrow \mu.\]

Note that if the state transition law has a constant

(32)\[\begin{equation} x_{t+1}=\kappa + A_{0}x_{t}+Cw_{t+1}, \qquad w_{t+1} \sim \text{i.i.d.} (0,I) \end{equation}\]

then the stationary mean is given by

\[\begin{equation*} \left( I-A_{0}\right) \mu = \kappa \Rightarrow \mu = ( I-A_{0})^{-1}\kappa. \end{equation*}\]

We can easily transform the variable so that the LSDE has no constant term \(\kappa\). In that case, the expanded matrix \(\tilde{A}_{0}\) will have some unit eigenvalue(s). (Why?)

9.13.2. Covariance stationary covariances

Given \(\mu\) we compute stationary covariance matrix as:

\[\begin{equation*} E\left( x_{t+1}-\mu \right) \left( x_{t+1}-\mu \right) ^{\prime }=A_{0}E\left( x_{t}-\mu \right) \left( x_{t}-\mu \right) ^{\prime }A_{0}^{\prime }+CC^{\prime } \end{equation*}\]

since \(Ew_{t+1}w_{t+1}^{\prime }=I\).

Define \(\Sigma _{x}\left( 0\right) =E\left( x_{t+1}-\mu \right) \left( x_{t+1}-\mu \right) ^{\prime }=E\left( x_{t}-\mu \right) \left( x_{t}-\mu \right) ^{\prime }\) as the stationary covariance matrix.

And \(\Sigma _{x}\left( 0\right)\) satisfies:

\[\begin{equation*} \Sigma _{x}\left( 0\right) =A_{0}\Sigma _{x}\left( 0\right) A_{0}^{\prime }+CC^{\prime } \end{equation*}\]

Stationary covariance matrix satisfies

\[\begin{equation*} \Sigma _{x}\left( 0\right) =A_{0}\Sigma _{x}\left( 0\right) A_{0}^{\prime }+CC^{\prime } \end{equation*}\]

This is a discrete Lyapunov equation in \(\Sigma _{x}\left( 0\right)\). We can in practice solve this as a recursion starting with an initial positive definite guess \(\Sigma _{x}^{0}=I\):

\[\begin{equation*} \Sigma _{x}^{s+1}=A_{0}\Sigma _{x}^{s}A_{0}^{\prime }+CC^{\prime } \end{equation*}\]

And since \(A_{0}\) is stable \(\lim_{s\rightarrow \infty }\Sigma_{x}^{s}\rightarrow \Sigma _{x}\left( 0\right)\).

We can also compute autocovariances at different time intervals, \(j\). We can write

\[\begin{split}\begin{eqnarray*} x_{t+j} &=&A_{0}x_{t+j-1}+Cw_{t+j} \\ x_{t+j}-\mu _{t+j} &=&A_{0}\left( x_{t+j-1}-\mu _{t+j-1}\right) +Cw_{t+j} \\ &=&A_{0}\left[ A_{0}\left( x_{t+j-2}-\mu _{t+j-2}\right) +Cw_{t+j-1}\right] +Cw_{t+j} \\ &&\vdots \\ &=&A_{0}^{j}\left( x_{t}-\mu _{t}\right) +Cw_{t+j}+A_{0}Cw_{t+j-1}+...+A_{0}^{j-1}Cw_{t+1} \end{eqnarray*}\end{split}\]

Postmultiply with \(\left( x_{t}-\mu _{t}\right) ^{\prime }\) and take expectations:

\[\begin{split}\begin{eqnarray*} E\left( x_{t+j}-\mu _{t+j}\right) \left( x_{t}-\mu _{t}\right) ^{\prime } &=&A_{0}^{j}E\left( x_{t}-\mu _{t}\right) \left( x_{t}-\mu _{t}\right) ^{\prime } \\ \Sigma _{x}\left( j\right) &=&A_{0}^{j}\Sigma _{x}\left( 0\right) \text{.} \end{eqnarray*}\end{split}\]

We worked out \(\Sigma _{x}\left( 0\right)\). So autocovariance at interval \(j\), \(\Sigma _{x}\left( j\right)\) is a function of \(A_{0}\) and \(\Sigma _{x}\left( 0\right)\). \(\Sigma _{x}\left( j\right)\) is independent of \(t\). It depends only on \(j\).

Observation equation: \(y_{t}=Gx_{t}\). Then we can also find

\[\begin{equation*} \Sigma _{y}\left( j\right) =E\left( y_{t+j}-\mu _{y,t+j}\right) \left( y_{t}-\mu _{y,t}\right) ^{\prime }=G\Sigma _{x}\left( j\right) G^{\prime } \end{equation*}\]

Note: \(C\) representing noise statistics does not appear in the calculation of \(\Sigma _{x}\left( j\right)\) for all \(j\).

9.14. Impulse response functions

Lag operator notation: \(Lx_{t+1}:=x_{t}\).

Suppose eigenvalues of \(A_{0}\) are less than 1. Write

\[\begin{equation*} x_{t+1}=A_{0}x_{t}+Cw_{t+1} \end{equation*}\]

as

\[\begin{equation*} \left( I-A_{0}L\right) x_{t+1}=Cw_{t+1} \end{equation*}\]

Neumann expansion

\[\begin{equation*} \left( I-A_{0}L\right) ^{-1}=I+A_{0}L+A_{0}^{2}L^{2}+... \end{equation*}\]

Multiply both sides of

\[\begin{equation*} \left( I-A_{0}L\right) x_{t+1}=Cw_{t+1} \end{equation*}\]

with \(\left( I-A_{0}L\right) ^{-1}\) to get

\[\begin{equation*} x_{t+1}=\left( I+A_{0}L+A_{0}^{2}L^{2}+...\right) Cw_{t+1}=\sum_{j=0}^{\infty }A_{0}^{j}Cw_{t+1-j} \end{equation*}\]

i.e. a finite lag VAR process has an infinite VMA representation.

Alternative moving average representation. Iterate

\[\begin{equation*} x_{t+1}=A_{0}x_{t}+Cw_{t+1} \end{equation*}\]

forward from \(t=0\):

\[\begin{split}\begin{eqnarray*} x_{1} &=&A_{0}x_{0}+Cw_{1} \\ x_{2} &=&A_{0}x_{1}+Cw_{2}=A_{0}^{2}x_{0}+Cw_{2}+A_{0}Cw_{1} \\ &&\vdots \\ x_{t} &=&A_{0}^{t}x_{0}+\sum_{j=0}^{t-1}A_{0}^{j}Cw_{t-j} \end{eqnarray*}\end{split}\]

and

\[\begin{equation*} y_{t}=Gx_{t}=GA_{0}^{t}x_{0}+G\sum_{j=0}^{t-1}A_{0}^{j}Cw_{t-j}. \end{equation*}\]

Impulse response functions: Either representation has \(A_{0}^{j}C\) as the response of \(x_{t+1}\) to \(w_{t+1-j}\) at each lag \(j\). E.g. a contribution of a shock \(w_{t-j}\) to \(x_{t}\) is \(A_{0}^{j}C\). Also, its contribution to \(y_{t}\) is \(GA_{0}^{j}C\).

9.15. Forecasting

Markov property. Time-\(t\) conditional forecast:

\[\begin{equation*} E_{t}x_{t+j}=A_{0}^{j}x_{t} \end{equation*}\]

where \(E_{t}x_{t+1}=E\left( x_{t+1}|x_{t},x_{t-1},...,x_{0}\right)\).

If \(y_{t}=Gx_{t}\) and we have

\[\begin{equation*} E_{t}\sum_{j=0}^{\infty }\beta ^{j}y_{t+j}=G\left( I-\beta A_{0}\right) ^{-1}x_{t}. \end{equation*}\]

provided \(\beta A_{0}\) has eigenvalues less than 1 in modulus.

Exercise 2

Suppose our state space model is AR \(\left( 1\right)\),

\[\begin{equation*} x_{t+1}=\rho x_{t}+\varepsilon _{t+1} \end{equation*}\]
\[\begin{equation*} y_{t}=\beta x_{t},\left\vert \rho \right\vert <1 \end{equation*}\]

where \(x_{t},y_t, \varepsilon _{t} \in \mathbb{R}\).

Compute

  1. the stationary mean, variance, and the autocovariance function of \(\left\{ y_{t}\right\}\).
  2. the impulse response function for \(\left\{ y_{t}\right\}\).

9.16. Real Business Cycle References

[ls04](1, 2, 3, 4) Ljungqvist, L., and T. J. Sargent (2004): Recursive Macroeconomic Theory. MIT Press, Cambridge, MA.
[pre06]Prescott, E. C. (2006): “Nobel Lecture: The Transformation of Macroeconomic Policy and Research,” Journal of Political Economy, 114, 203-235.
[uhl99](1, 2) Uhlig, H. (1999): “A Toolkit for Analyzing Nonlinear Dynamic Stochastic Models Easily,” in Computational Methods for the Study of Dyanmic Economies, ed. by R. Marimon, and A. Scott, pp. 30-61, Oxford University Press.

Footnotes

[1]We can introduce more shocks – e.g. on the preference side for example – to make the model quantitatively richer. We leave that as an exercise for the reader.
[2]With a Markovian economy, the expectations of (a function of) next period’s state conditional on the current realized state is conventionally written as \(\mathbb{E}_{t}[f(x_{t+1})] = \mathbb{E}[f(x_{t+1}) | x_{t}]\).
[3]You could also have used the non-linear discretized state space method we considered earlier in this course, but I leave it here as an exercise for the enthusiast.
[4]We could also simultaneous guess \(\hat{k}_{t+1} = d_{3}\hat{k}_{t} + d_{4}\hat{a}_{t}\), which is what the next problem set asks you to do.
[5]What this means, from a philosophy-of-doing-science view, is that if we are to have any useful interpretation of the behavior underlying time-series observations/outcomes of quantities and prices in reality, we need to have a theory to restrict what would otherwise be a free-form statistical relation between the variables in the data. Here, a particular theory gives us a strong identification scheme to separate out what is a supply shock and what is a demand shock (not present in our example here). This then, allows us to identify demand versus supply curve shifts, which are unobservables in purely price-quantity variations in the data. An ad-hoc VAR without theory will not be able to answer such a question. That is, the statistical time-series approach to modelling is often constrained to forecasting exercises, but any attempts to use these models for interpretation or policy analysis would be a foolish exercise. Hence, the Nobel laureate Tom Sargent once warned: “Beware of the econometrician bearing free parameters”.
[6]This note references Sections 2.1-2.3 in [ls04].