Economists looked even closer at Reinhart and Rogoff’s data—and the results might surprise you

Quartz

In order to predict the future, the ancient Romans would often sacrifice an animal, open up its guts and look closely at its entrails. Since the discovery of an Excel spreadsheet error in Carmen Reinhart and Ken Rogoff’s analysis of debt and growth by University of Massachusetts at Amherst graduate student Thomas Herndon and his professors Michael Ash and Robert Pollin, many economists have taken a cue from the Romans with the Reinhart and Rogoff data to see if there is any hint of an effect of high levels of national debt on economic growth. The two of us gave our first take in analyzing the Reinhart and Rogoff data in our May 29, 2013 column. We wrote that “…we could not find even a shred of evidence in the Reinhart and Rogoff data for a negative effect of government debt on growth.

Our further analysis since then (here, and here), and University of Massachusetts at Amherst Professor Arindrajit Dube’s analysis since then and full release of his previous work (herehere, and here) in response to our column have only confirmed that view. (Links to other reactions to our earlier column can be found here.) Indeed, although we have found no shred of evidence for a negative effect of government debt on growth in the Reinhart and Rogoff data, the two of us have found at least a mirage of a positive effect of debt on growth, as shown in the graph above.

The point of the graph at the top is to find out if the ratio of debt has any relationship to GDP growth, after isolating the part of GDP growth that can’t be predicted by past GDP growth alone. Let us give two examples of why it might be important to adjust for past growth rates when looking at the effect of debt on growth. First, if a country is run badly in other ways, is likely to grow slowly whatever its level of debt. In order to see if debt makes things worse, it is crucial to adjust for the fact that it was growing slowly to begin with. Second, if a country is run well, it is likely to grow fast while it is in the “catch-up” phase of copying proven techniques from other countries. Then as it gets closer to the technological frontier, its growth will naturally slow down. If getting richer in this way also tends to lead through typical political dynamics to a larger welfare state with higher levels of debt, one would see high levels of debt during that later mature phase of slower growth. This is not debt causing slow growth, but economic development having two separate effects: the slowdown in growth as a country nears the technological frontier, and the development of a welfare state. Adjusting for past growth helps us adjust for how far along a country is in its growth trajectory.

In the graph, if “GDP Growth Relative to Par” is positive, it means GDP growth is higher in the next 10 years than would be predicted by past GDP growth alone. If “GDP Growth Relative to Par” is negative, it means GDP growth is lower in the next 10 years than would be predicted by past GDP growth. (Here, in accounting for the effect of past GDP growth, we use data on the most recent five past years individually, and the average growth rate over the period from 10 years in the past to five years in the past.) The thick red line shows that, overall, high debt is associated with GDP growth just a little higher than what one would guess from looking at the past record of GDP growth alone. The thick blue curve gives more detail by showing in a flexible way what levels of debt are associated with above par growth and what levels of debt are associated with below par growth. We generated it with standard scatterplot smoothing techniques. The thick blue curve shows that, in particular, GDP growth seems surprisingly high in the range from debt about 60% of GDP to debt about 120% of GDP. Higher and lower debt levels are associated with future growth that is somewhat lower than would be predicted by looking at past growth alone. Interestingly, debt at 90% of GDP, instead of being a cliff beyond which the growth performance looks much worse, looks like the top of a gently rounded hill. If one took the tiny bit of evidence here much, much more seriously than we do, it would suggest that debt below 90% of GDP is just as bad as debt above 90% of GDP, but that neither is very bad.

Where does the evidence of above par growth in the range from 60% to 120% of GDP come from? Part of the answer is Ireland. In particular, all but one of the cases when GDP growth was more than 2.5% per year above what would be expected from looking at past growth occurred in a 10-year period after Ireland had a debt to GDP ratio in the range from 60% to 120% of GDP. It is well-known that Ireland has recently gotten into trouble because of its debt, but what does the overall picture of its growth performance over the last few decades look like? Here is a graph of Ireland’s per capita GDP from the Federal Reserve Bank of St. Louis data base:

The consequences of debt have reversed some of Ireland’s previous growth, but it is still a growth success story, despite the high levels of debt it had in the 1980s and ’90s.

In addition to Ireland, a bit of the evidence for good growth performance following high levels of debt comes from Greece. As the graph below shows, Greece has had more impressive growth in the last two decades than many people realize, despite the hit it has taken recently because of its debt troubles.

Greece:

We did a simple exercise to see if the bump up in the thick blue curve in the graph at the top is entirely due to Ireland’s and Greece’s growth that has been reversed recently because of their debt troubles.  To be sure that the bad consequences of Ireland’s and Greece’s debt for GDP in the last few years were accounted for when looking at the effect of debt on growth, we pretended that the recent declines in GDP had been spread out as a drag on growth over the period from 1990 to 2007 instead of happening in the last few years. Then we redid our analysis. Making this adjustment to the growth data is a simple, if ad hoc, way of trying to make sure that the consequences of Irish and Greek debt are not missed by the analysis.

Imagining slower growth earlier on to account for Ireland’s and Greece’s recent GDP declines makes the performance of Ireland and Greece in that period from 1990 to 2007 look less stellar. The key effect is on the thick blue curve estimating the effect of debt on growth. Looking closely at the graph below after adjusting Ireland’s and Greece’s growth rates, you can see that the bump up in the thick blue curve in the range where debt is between 60% and 120% of GDP has been cut down to size, but it is still there. So the bump cannot be attributed entirely to Ireland and Greece “stealing growth from the future” with their high levels of debt.

We want to stress that there is no real justification for making the adjustment for Ireland and Greece that we made except as a way of showing that the argument that Ireland and Greece had high growth in the 1990s and early 2000s, but now have had to pay the piper is not enough to turn the story about the effects of debt on growth around.

There are three broader points to make from this discussion of Ireland and Greece.

  • We still don’t recommend taking the upward bump in growth predicted by the thick blue curves in the 60% to 120% ranges for debt should not be taken seriously.
  • The fact that looking at the experience of two countries in two decades can account for a good share of the bump up in the 60% to 120% ranges illustrates just how little there is to go on from the Reinhart and Rogoff data set. Our scatter plots with the thick blue curves give the impression of more than there really is, because we have dots for growth from 1970 to 1980 and 1971 to 1981 and 1972 to 1982, and so on. And there is no way to escape this kind of issue when the economic forces one is interested have both short-run and long-run effects, and change as slowly over time as levels of national debt do. There are advanced statistical methods for correcting for such issues; the corrections almost always go in the direction of saying that there is less evidence in a set of data than it might seem. Even without being experts ourselves in making those statistical corrections, we feel reasonably confident in saying that the Reinhart and Rogoff data speak very softly about any positive or negative effect of debt on growth at all: barely a whisper.
  • Third, the inclusion of Ireland and Greece and the fact that the basic story survives after pretending their GDP declines were a drag on growth earlier contradicts to some extent the claim of economics blogger and blog critic Paul Andrews in his post “None the Wiser After Reinhart, Rogoff, et al.” that Reinhart and Rogoff’s data focus on “20 or so of the most healthy economies the world has ever seen.” After adjusting for the hit their economies have taken recently, the inclusion of Ireland and Greece gives some perspective on the effects of debt on the growth of economies that have subsequently had problems paying for their debt. There could certainly be other economies whose growth is more vulnerable to debt than Ireland and Greece, but to us these seem like exactly the kinds of cases people would have in mind when they argue that one should expect debt to have a negative effect on growth.

Understanding all of this matters because, as Mark Gongloff of Huffington Post writes:

Reinhart and Rogoff’s 2010 paper, “Growth in a Time of Debt,” … has been used to justify austerity programs around the world. In that paper, and in many other papers, op-ed pieces and congressional testimony over the years, Reinhart and Rogoff have warned that high debt slows down growth, making it a huge problem to be dealt with immediately. The human costs of this error have been enormous.

Even though there are many effective ways to stimulate economies without adding much to their national debt, the primary remedies for sluggish economies that are actually on the table politically are those that do increase national debt, so it matters whether people think debt is damning or think debt is just debt.  It is painful enough that debt has to be paid back (with some combination of interest and principal), and high levels of debt may help cause debt crises like those we have seen for Ireland and Greece. But the bottom line from our examination of the entrails is that the omens and portents in the Reinhart and Rogoff data do not back up the argument that debt has a negative effect on economic growth.

Follow Miles on Twitter at @mileskimball. His blog is supplysideliberal.com. Follow Yichuan on Twitter at @yichuanw. His blog is SynthenomicsWe welcome your comments at ideas@qz.com.



More from Quartz

Rates

View Comments (17)

Recommended for You

  • Tycoon buys 30 Rolls-Royces for Macau hotel

    A Hong Kong tycoon has placed the biggest ever order for Rolls-Royce cars, agreeing to buy 30 Phantoms to chauffeur guests at a luxury resort he's building in the global gambling capital of Macau. Stephen Hung's $20 million purchase surpasses the 14 Phantoms bought by Hong Kong's Peninsula Hotel in…

    Associated Press
  • Best Womens Wrinkle Creams 2014

    Mom reveals simple wrinkle solution that has researchers very excited. Try this free solution today to look and feel years younger.

    AdChoicesBellaLabs.comSponsored
  • Tycoon's arrest sends shock wave through Russia

    Tycoon's arrest sends shock wave through Russia MOSCOW (AP) — The arrest of a Russian telecoms and oil tycoon has sent shock waves through the country's business community, with some fearing a return to the dark days of a decade ago, when the Kremlin asserted its power by imprisoning the country's…

    Associated Press
  • Before You Buy Alibaba, Check Out 4 Top China Stocks

    Before You Buy Alibaba, Check Out 4 Top China Stocks While investors gear up for Alibaba Group 's (BABA) hotly anticipated initial public offering, don't forget about other Chinese stocks that are worth keeping an eye on. Today's Young Guns Screen of

    Investor's Business Daily
  • As Fed takes baby steps, Cramer's trick for profit

    In turn, Cramer says making money in the market, involves looking at the environment through the lens of the Fed. "The trick is to remember that they speak for the common person," Cramer said. "The Fed wants the common person to make money." With that backdrop always in mind, Cramer says it becomes…

    CNBC
  • Play

    Citi, Bank of America Offer Discounted Mortgages

    Citigroup and Bank of America will offer mortgages at discounted interest rates to help borrowers with low incomes or subprime credit. AnnaMaria Andriotis joins MoneyBeat. Photo: Getty.

    WSJ Live
  • "The Retiree Next Door": How successful retirees stretch their savings

    "The Retiree Next Door": How successful retirees stretch their savingsBy the time she hit her late 40s, Toni Eugenia wasn’t sure she would ever be able to retire. Eugenia, 56, a pharmacy technician who lived in Houston, was nearly $200,000 in debt and

    Yahoo Finance
  • Costco Stores in Canada to Stop Taking American Express

    “The credit card relationship between American Express and Costco Wholesale Canada will not be renewed when it expires” on Dec. 31, the company said today in an e-mail to Canadian customers. The message was attributed to Lorelle Gilpin, vice president of marketing and membership for Costco…

    Bloomberg
  • Tired of Living Paycheck to Paycheck?

    New website reveals how to save $1,000's when you're living paycheck to paycheck. See exactly how.

    AdChoices Media ForceSponsored
  • CNBC Anchor Calls Out Fed-Hater Bill Fleckenstein In Startling Shouting Match

    CNBC Bill Fleckenstein of Fleckenstein Capital appeared on CNBC's Futures Now program on Tuesday. Futures Now host Jackie DeAngelis came out swinging, asking Fleckenstein right at the top if he was willing to admit that he had misunderstood monetary policy. Sounding taken aback, Fleckenstein…

    Business Insider
  • Beanie Babies creator's sentence debated in court

    Beanie Babies creator's sentence debated in court CHICAGO (AP) — Federal prosecutors seeking to put the billionaire creator of Beanie Babies in prison for hiding millions in Swiss bank accounts told appellate court judges Wednesday that the toymaker's sentence of probation threatens to erode the…

    Associated Press
  • Apple to unveil new iPads, operating system on Oct. 21 : report

    The company plans to unveil the sixth generation of its iPad and the third edition of the iPad mini, as well as its operating system OS X Yosemite, which has undergone a complete visual overhaul, the Internet news website said. Trudy Muller, a spokeswoman for Apple, declined to comment. The iPad is…

    Reuters
  • Margaritaville casino owners seek bankruptcy

    The owner of Biloxi's Margaritaville casino has filed for Chapter 11 bankruptcy protection Tuesday, only hours before a hearing where the landlord aimed to seize the property. The filing by MVB Holding LLC in U.S. Don Dornan, a lawyer for landlord Clay Point LLC, said the company had planned to ask…

    Associated Press
  • Gilead Stock Is Falling On These Drug Setbacks

    Gilead Stock Is Falling On These Drug Setbacks Gilead Sciences (GILD) shares are backsliding Wednesday on news that the patient drop-out rate for hepatitis C drug Sovaldi is quadruple that of clinical trials. In addition, the biotech's Phase 2 study results

    Investor's Business Daily
  • Here's What Mark Cuban Wishes He Knew About Money In His 20s

    Cuban is the owner of the Dallas Mavericks basketball team. Billionaire investor and entrepreneur Mark Cuban is generous with his advice. When we asked him what he wishes he'd known about money in his 20s, he said:

    Business Insider
  • AARP® Auto Insurance Program from The Hartford

    50+? Request a free quote and you could save $404* on Auto Insurance from The Hartford!

    AdChoicesThe HartfordSponsored
  • Play

    What the Fed Meeting Means for Bonds

    Janet Yellen & Co. are expected to hint at their timetable for raising interest rates. Here's how investors should prepare ahead of the meeting.

    WSJ Live
  • Embraer to sell 50 E-175 jets to Republic in $2.1 billion deal

    Brazil's Embraer SA, the world's third largest commercial planemaker, said on Wednesday it booked a firm order from U.S. The deal, which will be included in Embraer's order book for the third quarter, is valued at $2.1 billion, the planemaker said in a securities filing. The planes will be operated…

    Reuters
  • SHOE COMPANY: Our CEO Just Disappeared And Most Of The Money Is Gone

    "and like that: he's gone." This is an actual headline from a company press release: "CEO and COO disappeared, most of the company's cash missing." (Via FastFT) In a statement, German-based shoe company Ultrasonic said its CFO,  Chi Kwong Clifford Chan, has been unable to reach the company's CEO,…

    Business Insider
  • Billionaire Investor Says Chinese People Work Harder And Western Companies Could Face Deep Trouble After Alibaba IPO

    Michael Moritz, the chairman of VC firm Sequoia Capital, is a huge fan of Chinese internet companies and reiterated his enthusiasm for the Chinese market in an interview with The Wall Street Journal Wednesday. The billionaire investor described the Alibaba IPO as a “major landmark event” that is as…

    Business Insider
  • Top Analyst Upgrades and Downgrades: AEP, BHP, GE, Incyte, 3M, Tyco, Under Armour and More

    Top Analyst Upgrades and Downgrades: AEP, BHP, GE, Incyte, 3M, Tyco, Under Armour and More Stocks were firm on Wednesday morning ahead of the FOMC meeting outcome. Tuesday’s rally may have sparked higher interest again, and investors are looking for bargains

    24/7 Wall St.
  • 6 Things Debt Collectors Wish You Knew

    The work debt collectors do is not popular, and has become increasingly derided by those who don’t like what we do or simply don’t know the facts about debt collection. Too often, debt collection is painted with a broad brush to create a portrait that isn’t accurate, and doesn’t properly educate…

    Credit.com
  • Take Your Career in Law to the Next Level!

    Earn an accredited Master of Laws in only 1 year. 100% online, No LSAT required, and 5 concentrations offered, including Taxation Law. Apply today!

    AdChoicesThomas Jefferson Law Sponsored
  • Boeing may have outfoxed Musk, but it could have bigger problems

    Elon Musk is arguably one of the greatest entrepreneurial minds of the 21st Century, but he was outsized an old school aerospace giant. Boeing won the bulk of NASA’s contract for a space taxi.  One of the other companies vying for the deal is SpaceX, the company headed by Tesla’s Musk, will get a…

    Talking Numbers