For rail projects, passenger flows were overestimated by more than 50 percent. Nearly 85 percent of rail projects overestimated passenger flows by more than 20 percent, 40 percent of the errors exceeded 60 percent.
Because policymakers favor mass transit, we’d expect the political pressure to be reversed when it comes to estimating the benefits of additional roads. The findings suggest this may be the case, as the researchers found that road traffic flows (the forecast of benefits) were underestimated by about 10 percent.
Such errors do not only plague public projects; overestimating benefits also occurs in privately financed toll roads, tunnels, and bridges. Transportation finance researcher Robert Bain examined the record for 100 private projects built worldwide between 2002 and 2005. He found the average forecast overestimated traffic flows by 23 percent. We would think that private investors, risking their own funds, would produce a more unbiased forecast. While the errors are somewhat smaller, the results suggest that private promoters also provide overly optimistic projections of traffic demand, perhaps as a way to improve access to capital.
Incentives and reforms / Government analysts and consultants conducting the cost-benefit analyses are under pressure to bias the projections in a way that favors the goals of the officials who employ the analysts. If widening a bridge will garner enough additional votes to win the next election, a politician may apply pressure to ensure that cost and benefit estimates place the project in the best light. A consultant’s future project opportunities or the salary of a staff analyst likely depends on how willing he or she is to play along. While reputation serves as a constraint on how far an analyst would massage a forecast, the evidence from actual projects suggests political forces dominate the decision process.
While it is not possible to completely eliminate the political pressure to cook the books, there are a number of reforms that would improve the estimates of the costs and benefits of transportation projects. First, specialists who are not directly involved in the project should review the analysis. This kind of review process has improved forecasts made by the Congressional Budget Office. Second, Flyvberg suggests comparing the cost and benefit estimates of proposed projects to those of completed projects with similar characteristics. If there are enough comparable projects, past outcomes can put a lid on overzealous estimates of benefits and underestimates of cost. Transparency is important. Making the results of these comparisons public would allow taxpayers to judge the viability of a given project. Third, cost and benefit estimates should be made using a range of economic assumptions. For example, what would happen to rail ridership if the economy grew 1 percent slower? How robust are the estimates? Finally, the salary of the analyst or consultant could be tied to the accuracy of an estimate. This would counteract political pressures to bias transportation project forecasts.
CONCLUSIONS
Taxpayers and investors need to be careful when it comes to projections of the costs and benefits of transportation infrastructure projects. They are likely to be biased to favor projects politicians want. This bias should give pause to any supporter of high-speed rail or any public megaproject in the United States or abroad.
A finding that the biases are large but, once built, the projects still produce a (small) net benefit does not mean there is no reason for concern. There are opportunity costs associated with low-return projects. Alternative non-transportation projects or tax cuts would have made taxpayers better off. Flyvbjerg and his coauthors conclude that politicians sell the projections as scientific, but they turn out to be “strategic misrepresentations” that end up being financial disasters that often provide negative net returns.
Readings
- “Error and Optimism Bias in Tollroad Forecasts,” by Robert Bain. Transportation, Vol. 36 (2009).
- “Forecast Bias of Government Agencies,” by Robert Krol. Cato Journal, Vol. 34 (2014).
- “Inaccuracy in Traffic Forecasts,” by Bent Flyvjerg, Mette Skamris Holm, and Søren Buhl. Transportation Reviews, Vol. 26 (2006).
- “Political Incentives and Transportation Funding,” by Robert Krol. Mercatus Research, 2015.
- “Survival of the Unfittest: Why the Worst Infrastructure Gets Built—and What We Can Do about It,” by Bent Flyvjerg. Oxford Review of Economic Policy, Vol. 25 (2009).
- “Underestimating Costs in Public Works Projects,” by Bent Flyvjerg, Mette Skamris Holm, and Søren Buhl. Journal of the American Planning Association, Vol. 68 (2002).