The Economics of Inaction: Stochastic Control Models with Fixed Costs available in Hardcover
The Economics of Inaction: Stochastic Control Models with Fixed Costs
- ISBN-10:
- 0691135053
- ISBN-13:
- 9780691135052
- Pub. Date:
- 11/09/2008
- Publisher:
- Princeton University Press
- ISBN-10:
- 0691135053
- ISBN-13:
- 9780691135052
- Pub. Date:
- 11/09/2008
- Publisher:
- Princeton University Press
The Economics of Inaction: Stochastic Control Models with Fixed Costs
Hardcover
Buy New
$85.00Buy Used
$50.43-
PICK UP IN STORE
Your local store may have stock of this item.
Available within 2 business hours
-
SHIP THIS ITEM
Temporarily Out of Stock Online
Please check back later for updated availability.
Overview
In The Economics of Inaction, leading economist Nancy Stokey shows how the tools of stochastic control can be applied to dynamic problems of decision making under uncertainty when fixed costs are present. Stokey provides a self-contained, rigorous, and clear treatment of two types of models, impulse and instantaneous control. She presents the relevant results about Brownian motion and other diffusion processes, develops methods for analyzing each type of problem, and discusses applications to price setting, investment, and durable goods purchases.
This authoritative book will be essential reading for graduate students and researchers in macroeconomics.
Product Details
ISBN-13: | 9780691135052 |
---|---|
Publisher: | Princeton University Press |
Publication date: | 11/09/2008 |
Edition description: | New Edition |
Pages: | 320 |
Product dimensions: | 6.20(w) x 9.30(h) x 1.10(d) |
Age Range: | 18 Years |
About the Author
Read an Excerpt
The Economics of Inaction
Stochastic Control Models with Fixed CostsBy Nancy L. Stokey
Princeton University Press
Copyright © 2009 Princeton University PressAll right reserved.
ISBN: 978-0-691-13505-2
Chapter One
Introduction
In situations where action entails a fixed cost, optimal policies involve doing nothing most of the time and exercising control only occasionally. Interest in economic models that exhibit this type of behavior has exploded in recent years, spurred by growing evidence that "lumpy" adjustment is typical in a number of important economic settings.
For example, the short-run effects of monetary policy are connected with the degree of price stickiness. Data from the U.S. Bureau of Labor Statistics on price changes at retail establishments for the period 1988-2003 suggest that price adjustment is sluggish, at least for some products. The average duration of a price varies greatly across different types of products, with some-gasoline, airfares, and produce-displaying frequent price changes, and others-taxi fares and many types of personal services-displaying much longer durations. The average duration across all products is about 5 months, but the range is wide, from 1.5 months at the 10th percentile to 15 months at the 90th percentile. The size distribution of adjustments is perhaps even more informative about price stickiness. Many adjustments are large, even after short-term sale prices have been removed. The average size is more than 8%. Moreover, 1988-2003 was a period of low inflation, so in the broad sample 45% of price changes are negative, and price cuts are almost as large as price increases. More detailed data for the largest three urban areas (New York, Los Angeles, and Chicago), show that about 30% of price changes are greater than 10% in magnitude, and the figure is about the same for increases and decreases.
The fact that many price changes are large suggests that there may be substantial fixed costs associated with changing a price. Otherwise it is difficult to explain why the changes are not carried out in series of smaller, more frequent increments.
Investment behavior provides a second example. Establishment-level data from the U.S. Census Bureau on 13,700 manufacturing plants for the period 1972-1988 show lumpy adjustment in two ways. First, more than half of the plants in the sample display an episode of large adjustment, at least 37%. In addition, a substantial fraction of aggregate investment, 25%, is concentrated in plants that are increasing their capital stock by more than 30%. At the other end of the distribution, over half of plants increase their capital stock by less than 2.5%, accounting for about 20% of total investment. Thus, for individual plants, changes in size come in substantial part from large one-year increases. From the aggregate point of view, a sizable share of total investment is devoted to these episodes of large increase. As with the price data, the evidence on investment suggests that fixed costs are important.
Evidence on job creation and destruction displays patterns similar to those in the investment data. The opening of a new establishment, the expansion of an old one, or the addition of a shift leads to concentrated job creation, while plant closings and mergers lead to concentrated destruction. Data from the U.S. Census Bureau on 300,000-400,000 manufacturing plants for the period 1972-88 show that two-thirds of total job creation and destruction occurs at plants where employment expands or contracts by more than 25% within a twelve-month period. One-quarter of job destruction arises from plant closings. Again, these adjustment patterns suggest that fixed costs are important.
For consumers, fixed costs are clearly important for durable goods such as housing and automobiles. U.S. Census Bureau data for 1996 show that among individuals aged 15 and older living in owner-occupied housing, the median tenure at the current residence is eight years, and about 40% have been at their current residence for more than eleven years. Although individuals have many motives for staying in their current residences, the substantial transaction costs-including time costs-involved in buying, selling, and moving clearly make frequent moves unattractive.
Evidence suggests that fixed costs are also important for explaining individual portfolio behavior. Absent fixed costs, it is hard to understand why so many households fail to participate in the stock market. The fact that lagged stock market participation increases the likelihood of current participation very strongly-by 32 percentage points, even after controlling for age, education, race, income, and other factors-strongly suggests that fixed entry costs are important. In addition, the fact that wealthier households are more likely both to own stocks and to trade suggests that fixed costs per period or per transaction are also important. In this context and others the costs of gathering and processing information are likely to be important components of the fixed cost.
These examples suggest that models using a representative firm and representative household may be inadequate for studying some questions. For example, the economic effects of an aggregate productivity shock or aggregate demand shock depend on the investment and hiring/firing response of firms. If fixed costs are important, describing the aggregate response requires averaging over a group of firms that are doing little or nothing and a group making substantial adjustments. Although it may happen that movements in the aggregate can be generated by a representative agent, it is difficult to confirm this-or to determine what the representative agent should look like-without explicitly carrying out the aggregation. Moreover, a representative agent that serves as an adequate proxy during periods of calm may be misleading during episodes when the economic environment becomes more turbulent. And on the household side, explicitly taking heterogeneity into account may have a substantial impact on conclusions about welfare.
In situations where fixed costs are important, continuous-time models in which the stochastic shocks follow a Brownian motion or some other diffusion have strong theoretical appeal. An optimal policy in this type of setting involves taking action when the state variable reaches or exceeds appropriately chosen upper and/or lower thresholds and doing nothing when the state lies inside the region defined by those thresholds. Continuous-time models permit a very sharp characterization of the thresholds that trigger an adjustment and the level(s) to which adjustment is made. Indeed, the thresholds and return points can often be characterized as the solution to a system of three or four equations in as many unknowns. The goal in this book is to develop the mathematical apparatus for analyzing models of this type. In the rest of this introduction the structure of typical models is briefly described and a few examples are discussed.
Suppose that in the absence of control the increments to a state variable X(t) are those of a Brownian motion. The (flow) return to the decision maker at any date, g(X(t)), depends on the current state, where the function g is continuous and single peaked. Suppose the peak is at x = a, so that g is increasing on (-[infinity], a) and decreasing on (a, +[infinity]). The decision maker can adjust the state by discrete amounts, and there is a fixed cost c associated with making any adjustment. For now suppose that the fixed cost is the only cost of adjustment. The decision maker's objective is to maximize the expected discounted value of returns net of adjustment costs, where future returns and costs are discounted at a constant interest rate r. The standard menu cost model has this structure, with X(t) interpreted as the firm's price (in log form) relative to an industrywide or economywide price index that fluctuates stochastically.
The problem for the decision maker is to balance two conflicting goals: maintaining a high return flow by keeping the state in the region around a and avoiding frequent payment of adjustment costs. An optimal policy in this setting has the following form: the decision maker chooses threshold values b, B for the points where control will be exercised, with b < a < B, and a return point S [member of] (b, B) to which the state is adjusted when control is exercised. As long as the state remains inside the open interval (b, B)-called the inaction region-the decision maker exercises no control: adjustment is not required. When the state falls to b or rises to B the fixed cost is paid and the state variable is adjusted to the return point S. If the initial state lies outside (b, B) an adjustment to S is made immediately. If the fixed cost c is sufficiently large relative to the range of the return function g, it is possible that b = -[infinity], B = +[infinity], or both.
Notice that in general an optimal policy does not involve returning to the point a where instantaneous returns are at a maximum. That is, in general S [not equal to] a. For example, if the drift is positive, ? > 0, the decision maker might choose S < a, anticipating that (on average) the state will rise. Or, if the return function g is asymmetric around a, he might skew the return point in the direction of higher returns.
Let v(x) denote the expected discounted return from following an optimal policy, given the initial state X(0) = x. The first step in finding the optimum is to formulate a Bellman equation involving the function v. That equation can then be used to characterize the optimal policy. Indeed, it can be used in two different ways.
Suppose that thresholds b and B have been selected and that the initial state X(0) = x lies between them, b < x < B. Let [E.sub.x] [?] and [Pr.sub.x] [?] denote expectations and probabilities conditional on the initial state x, and define the random variable T = T (b) [and] T (B) as the first time the process X(t) reaches b or B. T is an example of a stopping time. It is useful to think of v(x) as the sum of three terms:
v(x) = expected returns over [0, T) + expected returns over [T, +[infinity]) if b is reached before B + expected returns over [T, +[infinity]) if B is reached before b.
Let w(x, b, B) denote the first of these terms, the expected returns up to the stopping time T. The key to making this problem tractable is the fact that w(x, b, B), which is the expected value of an integral over time up to the stopping time T = T (b) [and] T(B), can be written as an integral over states in the interval [b, B]. Specifically,
[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]
where [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] is the expected discounted local time function. It is a weighting function-like a density-for each state [xi] up to the stopping time T(b) [and] T(B), conditional on the initial state x. For the second and third terms it is useful to define
[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]
[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]
Thus, [psi](x, b, B) is the expected discounted value, conditional on the initial state x, of an indicator function for the event of reaching the lower threshold b before the upper threshold B is reached. The value [psi](x, b, B) has a similar interpretation, with the roles of the thresholds reversed. For any r [greater than or equal to] 0, clearly [psi] and [psi] are bounded, taking values on the interval [0, 1]. With w, [psi], and [psi] so defined, the Principle of Optimality implies that v satisfies the Bellman equation
[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] (1.1)
where the optimization is over the choice of the threshold values b and B and return point S.
If X is a Brownian motion or geometric Brownian motion, closed-form expressions can be derived for the functions [??], [pai], and [pai], and (1.1) provides a direct method for characterizing the optimal policy. If X is a more general diffusion, closed forms for [??], [psi], and [psi] are not available, but fairly sharp characterizations can often be obtained. In either case, several properties of the solution are worth noting. First, it is immediate from (1.1) that the optimal return point [S.sup.*] maximizes v(S) and does not depend on x. Second, the Principal of Optimality implies that the thresholds [b.sup.*] and [B.sup.*] do not depend on x. That is, if [b.sup.*], [B.sup.*] attain the maximum in (1.1) for any x [member of] ([b.sup.*], [B.sup.*]), then they attain the maximum for all x [member of] [b.sup.*], [B.sup.*]. The rational decision maker does not alter his choice of thresholds as the state variable evolves. Finally, it is immediate from (1.1) that the value function is a constant function outside the inaction region, v(x) = v([S.sup.*]) - c, for all x [not member of] ([b.sup.*], [B.sup.*]).
An alternative method for characterizing the optimum involves an indirect approach based on (1.1). Notice that if x lies inside the open interval ([b.sup.*], [B.sup.*]), then for [DELTA]t sufficiently small the probability of reaching either threshold can be made arbitrarily small. Hence it follows from (1.1) and the definition of v that
[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]
where [DELTA]X is the (random) increment to the state over [DELTA]t. As will be shown more formally in Chapter 3, if X is a Brownian motion with parameters (?, [[sigma].sup.2]), then a second-order Taylor series approximation gives
[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]
Using this fact, rearranging terms, and letting [DELTA]t -> 0 gives
[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] (1.2)
This equation, a second-order ordinary differential equation (ODE), is called the Hamilton-Jacobi-Bellman (HJB) equation. The optimal value function v satisfies this equation on the inaction region, the interval ([b.sup.*], [B.sup.*]). To complete the solution of a second-order ODE two boundary conditions are needed. In addition, for this problem the thresholds [b.sup.*] and [B.sup.*] must be determined. Recall that v is known outside the inaction region, v(x) = v(S) - c, all x [not member of] ([b.sup.*], [B.sup.*]). The two boundary conditions for (1.2) and the thresholds [b.sup.*] and [B.sup.*] are determined by requiring that v and v' be continuous at [b.sup.*] and [B.sup.*]. These conditions, called value matching and smooth pasting, reproduce the solution obtained by maximizing in (1.1).
This approach can be applied to a variety of problems. For inventory or investment models it is natural to assume that there are proportional costs of adjustment as well as fixed costs, and that both types of costs can be different for upward and downward adjustments. Even with these changes, however, the overall structure of the solution is similar to the one for the menu cost model. The main difference is that there are two return points, [s.sup.*] < [S.sup.*], where the former applies for upward adjustments, from [b.sup.*], and the latter for downward adjustments, from [B.sup.*].
(Continues...)
Excerpted from The Economics of Inaction by Nancy L. Stokey Copyright © 2009 by Princeton University Press. Excerpted by permission.
All rights reserved. No part of this excerpt may be reproduced or reprinted without permission in writing from the publisher.
Excerpts are provided by Dial-A-Book Inc. solely for the personal use of visitors to this web site.
Table of Contents
Preface ix
Chapter 1: Introduction 1Notes 12
Part I: Mathematical Preliminaries 15
Chapter 2: Stochastic Processes, Brownian Motions, and Diffusions 172.1. Random Variables and Stochastic Processes 172.2. Independence 182.3. Wiener Processes and Brownian Motions 192.4. Random Walk Approximation of a Brownian Motion 202.5. Stopping Times 242.6. Strong Markov Property 242.7. Diffusions 252.8. Discrete Approximation of an Ornstein-Uhlenbeck Process 27Notes 28
Chapter 3: Stochastic Integrals and Ito's Lemma 303.1. The Hamilton-Jacobi-Bellman Equation 313.2. Stochastic Integrals 343.3. Ito's Lemma 373.4. Geometric Brownian Motion 383.5. Occupancy Measure and Local Time 413.6. Tanaka's Formula 433.7. The Kolmogorov Backward Equation 473.8. The Kolmogorov Forward Equation 50Notes 51
Chapter 4: Martingales 534.1. Definition and Examples 534.2. Martingales Based on Eigenvalues 574.3. The Wald Martingale 584.4. Sub- and Supermartingales 604.5. Optional Stopping Theorem 634.6. Optional Stopping Theorem, Extended 674.7. Martingale Convergence Theorem 70Notes 74
Chapter 5: Useful Formulas for Brownian Motions 755.1. Stopping Times Defined by Thresholds 785.2. Expected Values for Wald Martingales 795.3. The Functions ψ and Ψ 825.4. ODEs for Brownian Motions 875.5. Solutions for Brownian Motions When r = 0 885.6. Solutions for Brownian Motions When r > 0 935.7. ODEs for Diffusions 985.8. Solutions for Diffusions When r = 0 985.9. Solutions for Diffusions When r > 0 102Notes 106
Part II: Impulse Control Models 107
Chapter 6: Exercising an Option 1096.1. The Deterministic Problem 1106.2. The Stochastic Problem: A Direct Approach 1166.3. Using the Hamilton-Jacobi-Bellman Equation 1196.4. An Example 125Notes 128
Chapter 7: Models with Fixed Costs 1297.1. A Menu Cost Model 1307.2. Preliminary Results 1337.3. Optimizing: A Direct Approach 1367.4. Using the Hamilton-Jacobi-Bellman Equation 1407.5. Random Opportunities for Costless Adjustment 1457.6. An Example 146Notes 152
Chapter 8: Models with Fixed and Variable Costs 1538.1. An Inventory Model 1548.2. Preliminary Results 1578.3. Optimizing: A Direct Approach 1608.4. Using the Hamilton-Jacobi-Bellman Equation 1628.5. Long-Run Averages 1648.6. Examples 1668.7. Strictly Convex Adjustment Costs 174Notes 175
Chapter 9: Models with Continuous Control Variables 1769.1. Housing and Portfolio Choice with No Transaction Cost 1789.2. The Model with Transaction Costs 1829.3. Using the Hamilton-Jacobi-Bellman Equation 1849.4. Extensions 191Notes 196
Part III: Instantaneous Control Models 197
Chapter 10: Regulated Brownian Motion 19910.1. One- and Two-Sided Regulators 20110.2. Discounted Values 20510.3. The Stationary Distribution 21210.4. An Inventory Example 218Notes 224
Chapter 11: Investment: Linear and Convex Adjustment Costs 22511.1. Investment with Linear Costs 22711.2. Investment with Convex Adjustment Costs 23211.3. Some Special Cases 23611.4. Irreversible Investment 23911.5. Irreversible Investment with Two Shocks 24311.6. A Two-Sector Economy 247Notes 248
Part IV: Aggregation 251
Chapter 12: An Aggregate Model with Fixed Costs 25312.1. The Economic Environment 25612.2. An Economy with Monetary Neutrality 25912.3. An Economy with a Phillips Curve 26112.4. Optimizing Behavior and the Phillips Curve 26512.5. Motivating the Loss Function 278Notes 280
A Continuous Stochastic Processes 283A.1. Modes of Convergence 283A.2. Continuous Stochastic Processes 285A.3. Wiener Measure 287A.4. Nondifferentiability of Sample Paths 288Notes 289
B Optional Stopping Theorem 290B.1. Stopping with a Uniform Bound, T ≤ N 290B.2. Stopping with Pr {T < ∞} = 1 292Notes 294
References 295Part Index 303
What People are Saying About This
Fixed adjustment costs are pervasive in economic modeling and until this book there was no place where the needed tools were developed in a way that was accessible to a broad group of economists. Now there is. This brilliantly lucid book is self-contained, first developing the mathematical preliminaries and then using the tools in a number of illustrative economic applications. I advise economists to add this book to their bookshelf.
Edward C. Prescott, Nobel Laureate in Economics
Nancy Stokey has given us a clear, elegant, and rigorous distillation of why and how we should delay action until the status of a decision problem changes enough. By combining the mathematical apparatus with a wealth of applications to production, macroeconomics, and other fields, this book immediately becomes the definitive treatment. It will be the stepping stone into the subject for almost every interested researcher.
Darrell Duffie, Graduate School of Business, Stanford University
"Fixed adjustment costs are pervasive in economic modeling and until this book there was no place where the needed tools were developed in a way that was accessible to a broad group of economists. Now there is. This brilliantly lucid book is self-contained, first developing the mathematical preliminaries and then using the tools in a number of illustrative economic applications. I advise economists to add this book to their bookshelf."—Edward C. Prescott, Nobel Laureate in Economics"Stochastic control problems arise everywhere in modern economics. The Economics of Inaction gives a wonderful treatment for students and practitioners alike. It is rigorous yet clear, concise yet thorough. Inaction would not be the optimal decision about this book: read it now!"—Avinash Dixit, Princeton University"Nancy Stokey has given us a clear, elegant, and rigorous distillation of why and how we should delay action until the status of a decision problem changes enough. By combining the mathematical apparatus with a wealth of applications to production, macroeconomics, and other fields, this book immediately becomes the definitive treatment. It will be the stepping stone into the subject for almost every interested researcher."—Darrell Duffie, Graduate School of Business, Stanford University
Stochastic control problems arise everywhere in modern economics. The Economics of Inaction gives a wonderful treatment for students and practitioners alike. It is rigorous yet clear, concise yet thorough. Inaction would not be the optimal decision about this book: read it now!
Avinash Dixit, Princeton University