Hubbard and Strain, 'Has the Paycheck Protection Program Succeeded?', Brookings Papers on Economic Activity, Fall 2020
Summary
The paper "Has the Paycheck Protection Program Succeeded?" by Glenn Hubbard of Columbia University and Michael R. Strain of the American Enterprise Institute, published in Brookings Papers on Economic Activity, Fall 2020, with the discussion that followed. Using Dun & Bradstreet data, event studies and difference-in-differences models, the authors present evidence that PPP substantially increased the employment, financial health and survival of small businesses, with larger effects in August than in April or May. They note that their data only show applications for loans above $150,000 and conclude that it is too early to issue a definitive judgment on the program's success. The paper describes PPP as a revenue replacement and business continuity program with a $670 billion budget from April through August 2020, not a stimulus or jobs program.
Summary drafted by a model from the document's text below and checked by script against that text before publication. It is a navigation aid, not a reading of what the document proves. Where AI is used
- Document type
- Judgment
Cited in: Austan Goolsbee · Glenn Hubbard
Cite this document
“Hubbard and Strain, 'Has the Paycheck Protection Program Succeeded?', Brookings Papers on Economic Activity, Fall 2020.”
Original at www.brookings.edu. Archived at Pandemic Darlings, https://pandemicdarlings.com/source-documents/2020-03-27-brookings-papers-on-economic-activity/
, SHA-256 87b0fe1c748a5a5a8af78adb26668bf6ac050bb50ce289016e3598c7b709ee78.Full text
335 GLENN HUBBARD Columbia University MICHAEL R. STRAIN American Enterprise Institute Has the Paycheck Protection Program Succeeded? ABSTRACT Enacted March 27, 2020, the Paycheck Protection Program (PPP) was the most ambitious and creative fiscal policy response to the pandemic recession in the United States. PPP offers forgivable loans—essentially grants—to businesses with 500 or fewer employees that meet certain require- ments. In this paper, we present evidence that PPP has substantially increased the employment, financial health, and survival of small businesses, using data from Dun & Bradstreet, Inc. We use event studies and standard difference- in-differences models to estimate the effect of a small business applying for larger PPP loans and of a small business being eligible for PPP based on size. While our findings are informative, we believe it is too early to issue conclusive judgment on PPP’s success. We offer lessons for the future from the PPP experience thus far. T he Paycheck Protection Program (PPP) was the most ambitious and creative—and, potentially, the most important—fiscal policy response to the pandemic recession in the United States. With a $670 billion budget from April through August 2020, the program was the largest single component of the nation’s fiscal policy response to the crisis during that period, and by itself it approaches the total amount spent by Congress on the American Recovery and Reinvestment Act of 2009 in response to the Great Recession. Conflict of Interest Disclosure: The authors did not receive financial support from any firm or person for this paper or from any firm or person with a financial or political interest in this paper. They are currently not officers, directors, or board members of any organization with an interest in this paper. No outside party had the right to review this paper before publication. 336 Brookings Papers on Economic Activity, Fall 2020 PPP was enacted on March 27, 2020, as part of the Coronavirus Aid, Relief, and Economic Security (CARES) Act, the $1.8 trillion “phase 3” response to the pandemic crisis. An entirely new program, PPP began issuing loans seven days later, on April 3. Lending under PPP continued until August. PPP offers forgivable loans—essentially, grants—to businesses with 500 or fewer employees that meet certain requirements, including maintaining employment at prepandemic levels. Has it succeeded? In this paper, we present evidence that PPP has substantially increased the employment, financial health, and survival of small businesses. In addition, we find that the effect of PPP on small busi- ness outcomes is increasing over time, with larger effects in August than in April or May. We also find some evidence to suggest that PPP was most effective for relatively smaller firms. We use data from Dun & Bradstreet for our analysis, employing standard difference-in-differences models to estimate the effects of a small business applying for a PPP loan of greater than $150,000 (we only observe PPP applications for loans of that size) and of a small business being eligible for PPP based on size and using event studies to trace the dynamic effects of PPP. Despite this finding, our ultimate conclusion is that it is too early to issue any definitive judgment on PPP’s success. The program had important short- run goals, to be sure. These include supporting employment and replacing worker wages, maintaining worker-firm attachments, boosting consumer spending, and ensuring small business continuity during the shutdown. But the program had important medium-run goals, as well, including preventing a wave of bankruptcies once the economy partially reopened; increasing productivity by preserving firm-specific human capital, worker-firm matches, and networks; and helping the economy recover faster by keeping workers off the unemployment rolls. Our data run through August, and we cannot adequately investigate any of these outcomes. The effects of PPP are unfolding, and it will be particularly important to see what happens to businesses that received PPP and the workers they employ once they have exhausted their forgivable loan. PPP is a novel program, and many standard intuitions about fiscal policy do not apply to it. It was not a stimulus program in the sense that its purpose was not to stimulate the economy; that is, it is not a program calling for a measure of the multiplier. Instead, its purpose was to preserve the productive capacity of the small business sector and to shorten the tran- sition to a new, post-pandemic equilibrium by supporting labor demand over the medium term, allowing for a more rapid economic recovery. It was HUBBARD and STRAIN 337 not a jobs program in the sense that its goal was not exclusively to preserve employment. Instead, its goals were to maintain worker-firm attachments, particularly during the shutdown, and to ensure small business continuity. It intentionally did not attempt to exclude inframarginal recipients because the unique circumstances under which it was enacted made this impracti- cal. In the early days of the shutdown, how could the government have known which firms were inframarginal? And given the numerous goals of the program, it’s not clear how marginal would be defined in this context. These design features affect intuitive measures of the cost per job saved, as we describe later. In this paper, we discuss the need for, goals of, and key design features in a small business revenue replacement program (section II). We then describe PPP and contrast select features of the program to what we view as the best design (section III). We discuss the program’s implementa- tion challenges—extensively covered in the press—and offer qualitative analysis of PPP (section IV). In section V, we present our empirical analysis of PPP. In section VI, we offer a retrospective and discuss lessons for the future. I. The Pandemic Recession and Potential Policy Responses The pandemic recession is remarkable in both its suddenness and depth. In the week ending March 14, 2020, there were 282,000 initial claims for unemployment insurance benefits, about one-third higher than the average number of new claims over the preceding three months. The next week, there were 3.3 million initial claims, shattering the previous record of 695,000 new claims set in October 1982. The week after that, ending March 28, there were 6.9 million initial claims. The unemployment rate in February 2020 was 3.5 percent. In March, the first month of the pandemic recession, it stood at 4.4 percent. In April, it hit its peak of 14.7 percent, the highest rate since the Great Depression.1 In two months, the official unemployment rate increased by a factor of four. 1. The official unemployment rate reported by the Bureau of Labor Statistics for April 2020 was 14.7 percent. The household survey on which the unemployment rate is calculated showed a large increase in the number of respondents who were classified as employed but absent from work. Most of these responses should have been classified as unemployed on temporary layoff. Incorporating this change, the actual unemployment rate for April was likely 19.5 percent. 338 Brookings Papers on Economic Activity, Fall 2020 For comparison, during the Great Recession it took nearly two years for the unemployment rate to double, from 5 percent when the recession began in December 2007 to its peak of 10 percent in October 2009.2 The pandemic’s economic devastation extended beyond the labor market. Real GDP contracted at a 31.4 percent annual rate in the second quarter of 2020. Using the same measure, the worst quarter in the Great Recession saw an 8.4 percent decline, and the only quarter since the Great Depression to register a double-digit contraction was 1958:Q1, at 10 percent. Relative to the same quarter one year prior, 2020:Q2 real GDP contracted by 9 percent. The peak contraction using this metric in the Great Recession was 2009:Q2 at 3.9 percent. Some of the ways policy needed to respond to this unprecedented eco- nomic crisis were relatively straightforward. The Federal Reserve needed to support the economy and to ensure liquidity and smooth functioning in financial markets. Social insurance and safety net programs needed to be strengthened, and their gaps needed to be plugged. Large businesses, with diversified revenue streams and access to capital markets, could be supported with lending programs. But policy to support small and midsize businesses was harder to formulate. The need for a prolonged shutdown made interruption loans for such businesses inadequate, and even with a more conventional loan many businesses would likely not be able to survive. Firms needed more equity to shore up weakening balance sheets and replace lost cash flows and many businesses would not be interested in adding to debt burdens in any case. Equity injections were not implementable for many firms of this size, and operationalizing a program based on them would be extremely difficult to do in the time needed. The best available option was a revenue replacement program for small business. II. A Small Business Revenue Replacement Program The pandemic recession created the need for a revenue replacement program for small businesses. In this section, we discuss that need.3 We argue that the goals of such a program should be twofold: to ensure small business continuity and prevent a cascade of small business failures, and to 2. For research on the labor market effects of the pandemic, see Bartik, Bertrand, and others (2020), Coibion, Gorodnichenko, and Weber (2020), Goolsbee and Syverson (2020), and Forsythe and others (2020). 3. This section draws on Hubbard and Strain (2020) and Strain (2020). HUBBARD and STRAIN 339 preserve existing employment relationships while shelter-in-place orders are in effect. We offer our view on some key program design features to achieve these goals. We also address moral hazard concerns and briefly review programs enacted by other major economies. II.A. The Need to Replace Small Business Revenue The pandemic itself can be thought of as a large shock to aggregate supply: businesses could no longer produce goods and services because workers could not safely go to work. The inability of workers to work caused downstream supply chain disruptions, as well. Shelter-in-place orders ameliorated the supply shock by reducing the spread of the coronavirus. The catch is that these policies led to a precipitous drop in aggregate demand, including labor demand (Forsythe and others 2020) as businesses were temporarily closed and workers lost jobs, faced reductions in hours, and experienced nominal wage cuts (Cajner and others 2020). In the private economy, workers faced a large reduction in earned income and businesses lost revenue. The sharp and sudden nature of the pandemic recession left smaller firms in the service sector particularly at risk. Unlike larger businesses, these firms could not readily access capital markets to shore up their balance sheets. Capital market imperfections link equity contractions to business fluctuations, and these firms were particularly vulnerable to a lack of collateralizable net worth (Gertler and Hubbard 1988). Small and midsize businesses generally do not have diversified revenue streams, as well. And they have limited cash holdings. Only half of small businesses hold cash reserves sufficient to cover fifteen days, and only four in ten have a three- week cash buffer (Farrell, Wheat, and Grandet 2019). And unlike manufacturing firms, businesses in the service sector would not return to partial operations with a backlog of orders following the lockdowns. Nearly all of the revenue they lost during the lockdowns was lost forever—for example, diners did not eat twice as many meals out in May and June because restaurants were shut in March and April. To summarize, the economy was at risk of a cascade of small business bankruptcies. Small businesses play a critical role in the economy. In 2019, firms with fewer than 500 employees accounted for 47 percent of private sector employees and 41 percent of private sector payroll. There were 30.7 million such businesses, 19 percent of which had paid employees (US Small Business Administration 2019). A wave of small business failures could have created an aggregate demand doom loop, in which declining incomes and employment opportunities reinforced each other. 340 Brookings Papers on Economic Activity, Fall 2020 One way to address this concern would have been to lift lockdown orders. But the public health effects of the virus and concern workers had about getting sick would have made this strategy ineffective. The best option for the federal government in a short, temporary shutdown was to make up a large fraction of revenue businesses would have generated in normal times. We return later to the challenges posed by longer-term partial shutdowns. II.B. Goals, Cost, and Key Design Features The specific goals of such a program are to ensure small business continuity and prevent a wave of bankruptcies and, during the period of the shutdown, to preserve employment relationships. The overarching objec- tive is to preserve as much of the productive capacity of the economy as possible while short-term shelter-in-place orders are in effect and to help the economy transition quickly to a new, post-shutdown equilibrium by supporting labor demand over the medium term. For firms, preventing wasteful liquidations allows the black box of pro- ductive technologies and business relationships to remain intact. Profes- sional networks are preserved, relationships with suppliers and customers are maintained, and knowledge of local conditions and preferences can continue to be put to productive use. For workers, the value of firm-specific human capital is maintained, and maintaining employment relationships means they continue to be paid by their employer, and they are in a posi- tion to return to work immediately once shelter-in-place orders are lifted. No separation takes place, not even a temporary furlough of workers. For both workers and firms, productivity enhancing worker-firm matches are maintained. And the economy is in a position to snap back quickly because labor demand has been supported.4 This observation is especially true in a lockdown because the risk of mass closures is so real. Without a program to support small business continuity, a wave of closures would be followed by a period in which new businesses started. Eventually, the economy would reach a new equilibrium. 4. Papers that discuss the role of worker-firm matches include Mortensen and Pissarides (1999) and Davis and von Wachter (2011). Jackson (2013) measures match quality directly in the context of schools, estimating teacher, school, and match productivity on student outcomes. He finds that teacher-school (worker-firm) match effects are important, estimating that a one standard deviation increase in match quality increases math scores by an amount roughly equal to two-thirds of the effect of a one standard deviation increase in teacher quality. Using linked worker-firm data, Farooq, Kugler, and Muratori (2020) document an important role for match quality and find that more generous unemployment insurance benefits lead to higher quality matches. In our context, match quality likely matters the most for larger PPP-eligible firms. HUBBARD and STRAIN 341 But during the transition, labor demand would be depressed because there would be fewer businesses looking for workers, which would lead to lengthy spells of unemployment for millions of workers and a slower and more sluggish recovery. Because the (aggregate, present discounted value of) social benefits of these businesses exceed their (aggregate, present discounted value of) costs, a subsidy is justified under standard economic logic. Particularly given the possibility of an aggregate demand doom loop and the lengthy period of high unemployment it would cause, we argue that in the context of the pandemic, the appropriate revenue replacement rate is large. Once lockdown orders are lifted, partial revenue replacement may still be needed. But it is no longer necessary or economically desirable to compel firms to maintain pre-lockdown employment relationships or employ- ment levels. After the economy has partially reopened, policy should not introduce frictions into the process of reallocating labor (and capital) to its post-lockdown most productive use, and policy should allow firms the flexibility to reorganize their post-lockdown production functions to further the key overall goal of a revenue replacement program: ensuring small business continuity. There is an inherent tension between a revenue replacement program’s goal of maintaining employment relationships and keeping firms in business and the goal of efficiently reallocating factor inputs and swiftly transition- ing to a new, post-lockdown equilibrium. But for the reason we discussed earlier, there is less to this tension than meets the eye in this case. A revenue replacement program allows that transition to happen faster by preserving many otherwise viable firms during the shutdown. Once the economy has partially reopened, severing the link between program participation and maintaining prepandemic employment levels is critical to minimizing this tension. And a revenue replacement program should be of limited duration following the reopening of the economy. A revenue replacement program may also keep some businesses afloat that would have shut down in the absence of the pandemic. Presumably most businesses that were not viable prior to the pandemic will remain unviable once the revenue replacement program has ended. These considerations emphasize the need for the revenue replacement program to focus on revenue, not simply on payroll costs. A separate reason to focus on revenue rather than narrowly focusing on payroll costs is that nonpayroll expenses, like rent in many cities, are significant. A program replacing payroll costs but not overall revenue may not be sufficient to keep many businesses in high-rent cities from closing. 342 Brookings Papers on Economic Activity, Fall 2020 Replacing small business revenue is an expensive proposition. Hubbard and Strain (2020) estimate that replacing 80 percent of revenue for twelve weeks for service sector businesses—that is, for businesses in industries other than manufacturing, finance and insurance, health care, and educational services—with fewer than 500 employees would cost $1.2 trillion. Expensive as such an intervention is, the counterfactual would be even costlier, with cascading business failures, wasteful liquidations, plunging incomes, soaring unemployment, and little prospect for a rapid recovery because of the devastating effects on the small business ecosystem. Another budgetary consideration is the offsetting effects of less use of social insur- ance programs, like unemployment insurance, and safety net programs, like food stamps. So far, our discussion of a small business revenue replacement program has been general and could be applied to any situation in which small, service sector businesses needed to shut down for a period of several weeks. A key feature of the pandemic recession is that such a program did not exist, and Congress needed to create one quickly. Given this context, it was best for Congress to rely on the existing relationships many small businesses have (via checking accounts or loans) with commercial banks rather than to have had the government attempt to set up an entirely new direct transfer program. The government should have treated the banks essentially as conduits to get money into business accounts as quickly as possible. Of course, such an approach requires convincing banks that they will be held harmless in the event of borrower misrepresentation, both by the current administration and by future administrations. Strong assurances are necessary.5 To align better with an equity infusion, the revenue replacement grants should be structured as loans that are forgivable if certain conditions are met and should be fully backed by the government; that way banks assume no risk. Banks should be allowed to charge fees, paid for by the government, as an incentive to participate and for administrative costs. 5. Prior to the 2008 financial crisis, large US banks routinely made Federal Housing Administration (FHA) loans designed to help first-time home buyers and buyers with relatively poor credit purchase houses. To reach these borrowers, the government encouraged lax lending standards. This policy shift contributed to the housing bubble, and FHA’s solvency was in question following the crash. The government imposed fines on banks, arguing they did not adhere to FHA underwriting standards. The revenues from the fines helped to shore up FHA. This episode has left many large banks skittish about using anything but strict underwriting standards as part of government lending programs. HUBBARD and STRAIN 343 Forgivable loans (i.e., grants) are necessary for the program to succeed. The pandemic shutdown’s adverse consequences for firms’ collateralizable net worth and cash flows require equity contributions. Loans, even with low interest rates and long maturities, would likely be insufficient given the need for equity financing. Service sector businesses permanently lose revenue in a shutdown, and many would likely rather lay off workers than take on additional debt. Even if debt service could be deferred for a period of one or two years, many would be reluctant to take out a loan.6 These businesses often have low profit margins, and a loan program would likely have had an insufficient take-up rate to meet policymakers’ objectives.7 If the only concerns were cash flow challenges and a lack of access to equity capital, then a lending program might be all that is justified. But as we argued above, the divergence between the private and social value of small business continuity suggests that subsidies are justified using standard economic logic, particularly during the shutdown period. (In section VI, we discuss how a lending program might complement grants once the economy has partially reopened.) A revenue replacement program should be broad-based and should avoid too much targeting. In the fog-of-war atmosphere of the pandemic, policymakers have limited knowledge of the virus’s spread, and crafting an effective triggering mechanism based on public health metrics is difficult. The government should avoid picking winners and losers by targeting the program to select industries. Revenue tests or demonstrations of hardship should also be avoided. At the beginning of a sudden and unexpected lockdown, demonstrations significantly slow down the process of getting funds to businesses, putting the effectiveness of the program in jeopardy. Once the economy partially reopens, it can be argued that revenue tests target assistance to firms that need it most, as measured by revenue loss relative to normal circumstances. But forward-looking revenue tests serve as a disincentive to earn revenue by imposing implicit marginal tax rates on revenue. Backward-looking revenue tests avoid this disincentive but are less generous to otherwise 6. For a proposal that argues in favor of lending programs, see Ozimek and Lettieri (2020). Hanson and others (2020a) argue for equity-like arrangements and grants to support small business. Hanson and others (2020b) argue for payment assistance to impacted businesses to meet recurring fixed obligations (e.g., interest, rent, and utilities) during the health emergency. 7. At the time of this writing, the Federal Reserve’s Main Street Lending Facility has very few loans, suggesting that even among midsize businesses taking on debt under terms that are not borrower-friendly is not an attractive prospect. 344 Brookings Papers on Economic Activity, Fall 2020 identical firms that are doing better adjusting to the post-lockdown economic circumstances. The main appeal of revenue tests and hardship demonstrations are lower program costs and targeting aid based on “need.” The problem is that need is an amorphous concept in a partially reopened economy, and revenue tests bring their own problems. The best targeting strategy is broad-based, focusing on a large class of firms defined by size and industry type. II.C. Addressing Moral Hazard Concerns A program that replaces revenue for small businesses for a period of time is an extraordinary government intervention in the private economy. It is reasonable to be concerned that such a program would lead to excessive risk taking or other imprudent behavior on the part of firms by potentially creating the perception of a government “business revenue safety net.” In normal public programs under normal circumstances, this concern is certainly real. But in this instance, we are much less concerned about moral hazard. The need to shut down large segments of the economy will occur infrequently, and without advance notice. Businesses cannot purchase shutdown insurance from private firms in the way they can insure against risks from fires and floods. Government should communicate the extra ordinary nature of the assistance is driven by the extraordinary nature of the threat. This step should mitigate moral hazard concerns. II.D. Policy Response in Other OECD Nations Before turning to the Paycheck Protection Program, we briefly discuss programs enacted by member countries in the Organisation for Economic Cooperation and Development (OECD) during the pandemic recession. See table A1 in the online appendix for specific program descriptions and parameters for OECD countries. Many European nations relied on a version of a wage subsidy scheme in which workers saw their hours and pay reduced and their government picked up a large part of the cost of employing them.8 This type of program 8. Hamilton and Veuger (2020) argue that large expenditures to address the pandemic will heighten concern about the public finances of some European Union member states, implying that a broader European approach to fiscal policy is necessary. They suggest that the eurozone issue Eurobonds to placate markets and to avoid issues associated with sovereign debt overhang. HUBBARD and STRAIN 345 was used by Germany (Kurzarbeit, or short-term work) during the Great Recession and is widely credited with keeping the German unemployment rate down during that period. The way it often worked was that firms paid the benefit to their workers, which was typically somewhat lower than wages, and the government reimbursed the firm (Blanchard, Philippon, and Pisani-Ferry 2020). Austria implemented a similar program during the pandemic, replacing up to 90 percent of covered wages. A few examples: In the United Kingdom, the government reimbursed firms for 80 percent of the wages of furloughed workers. Germany covered 60 percent of wages for childless workers on furlough and 67 percent for furloughed workers with children. Depending on the month, the govern- ment of France covered 84 percent or 72 percent (as of June) of wages for workers on temporary layoff. Notably, these countries did not condition eligibility based on firm size, in contrast to the United States’ emphasis on small and midsize firms. Some European economies conditioned subsidies on a demonstration of a significant decline in revenue (e.g., the Netherlands, Estonia, and the Slovak Republic). Slovenia emphasized state- funded bonuses for hazard pay in certain sectors. These programs are similar to what we describe above. They maintain the worker-firm relationship during the shutdown period, making it easier for workers, firms, and the economy to recovery quickly once economic activity partially resumes. Keeping workers paid by the firms also allows government assistance to reach workers quickly. Such programs are similar to standard unemployment insurance in that the government is helping sup- port the incomes of workers who are underemployed, but unlike standard unemployment insurance, they allow for part-time work. At the same time, European programs have been more focused on supporting workers in their current employment matches, rather than smoothing a transition toward different employment matches. Programs generally permitted workers receiving nonwork or part-time work benefits to remain attached to the firm. As with the US Paycheck Protection Program, the state effectively assumed a portion of payroll costs for covered workers, albeit through payments made to firms.9 The US program formally worked as a combination of loans and outright grants to firms and wage subsidies. 9. Norway relied on layoffs, making it easier for firms to use temporary layoffs and increasing the generosity of unemployment benefits for workers. Norway also instituted a new compensation scheme for businesses that subsidized fixed costs. Alstadsæter and others (2020) find that this program reduced firms’ economic distress by a similar magnitude to PPP by reducing the negative effects of the crisis on profitability, liquidity, debt, and solvency. 346 Brookings Papers on Economic Activity, Fall 2020 As we describe later, a number of administrative challenges were “unforced errors” in its implementation. While some European pandemic unemployment or wage subsidy schemes have faced fewer administrative challenges than in the United States, they still raise concerns (to which we return later). Importantly, they were and are designed to maintain employment relationships in a tem- porary cyclical downturn (e.g., a moderate and short recession or a short pandemic shutdown). In a reopening of the economy, policy shifts would be needed to focus on rehiring workers and worker transitions by gradually reducing wage subsidies and the generosity of unemployment benefits. Employment policy responses in OECD countries outside Europe during the pandemic have been varied. Canada, for example, focused on rehiring workers previously laid off due to the COVID-19 pandemic, with subsidies of up to 75 percent of all covered wages. Israel relied on relaxing require- ments for unemployment benefits, direct and government-guaranteed loans to businesses of all sizes, special support for high-risk businesses, grants for small businesses, and a variety of measures to reduce the short-term burden of business taxes. Australia, like large European economies, imple- mented a wage subsidy for firms’ retention of employees. Japan financed wage subsidies for retained workers, but only for small and midsize firms. South Korea increased worker retention subsidies to up to 90 percent of covered wages for three months for all employers. A less generous subsidy to wages was provided in South Africa for firms whose operations were at least partially curtailed as a consequence of the COVID-19 pandemic.10 In Latin America, Chile provided partial support for wage declines, and Colombia assisted workers in firms with significant revenue declines with support of 40 percent of the minimum wage. III. The Paycheck Protection Program The Paycheck Protection Program (PPP) was created by the CARES Act, the $1.8 trillion “phase 3” economic recovery package passed by Congress and signed into law on March 27, 2020. In this section, we outline the statutory design of PPP, the program’s implementation by the Department of the Treasury and Small Business Administration, and the differences between PPP and the features of a small business revenue replacement program we discussed in the previous section. 10. South African Government, “Support to Business,” https://www.gov.za/covid-19/ companies-and-employees/support-business#; accessed August 21, 2020. HUBBARD and STRAIN 347 III.A. PPP’s Design PPP is a forgivable loan program. Businesses or nonprofits with 500 or fewer employees; sole proprietors, independent contractors, or self-employed individuals; and small businesses, 501(c)(19) veterans organizations, or tribal business concerns that otherwise meet the Small Business Admin- istration’s (SBA) size standards are eligible. Businesses in the accommo- dation and food services sector (North American Industry Classification System, or NAICS, code 72) may apply the 500 employee rule to each physical location, not to the corporation as a whole. Congress appropriated $349 billion for PPP in the CARES Act. Under the program, businesses can borrow up to two and a half times their average monthly payroll costs, capped at $10 million. Loans are issued by banks and are guaranteed by the government.11 The amount of the loan spent on payroll costs (including benefits), rent, utilities, and mortgage interest during the twenty-four-week period (originally eight-week period) after the loan is originated is forgiven—that is, it is converted to a grant— provided that 60 percent (originally 75 percent) of the amount forgiven is spent on payroll (a Treasury/SBA regulation not found in the CARES Act) and that the business does not reduce headcount relative to precrisis levels and does not reduce any employee’s compensation by more than 25 percent of his or her precrisis level. If headcount or compensation is reduced beyond those parameters, the amount of the loan forgiven may be reduced proportionately under some (but not all) circumstances. PPP encouraged businesses that had already laid off workers due to the pandemic to rehire them quickly without penalty.12 11. Financial technology (fintech) played an important role, as well. Erel and Liebersohn (2020) study the response of fintech to demand for financial services created by PPP. They find that fintech was disproportionately used in zip codes with fewer bank branches, lower incomes, and larger minority share of the population, in industries with less ex ante small business lending, and in counties where the economic effect of the pandemic was more severe. 12. Rules for loan forgiveness and for loan forgiveness reduction have been evolving. At the time of this writing, loans can be fully forgiven if loan proceeds are spent and qualify- ing costs are incurred during the covered period of the loan, which begins when the loan is disbursed (or during an alternative covered period, depending on how the borrower manages payroll); at least 60 percent of the loan amount (originally 75 percent) was used on payroll costs; and staffing and compensation levels are maintained in the covered period relative to the reference period. The covered period is twenty-four weeks for loans made after June 5, 2020. For loans made before June 5, 2020, borrowers can choose between a twenty-four-week or eight-week covered period. Borrowers can choose one of two reference periods: February 15, 2019, to June 30, 2019, or January 1, 2020, to February 29, 2020. (Seasonal employers have different rules.) PPP also includes a safe harbor provision that allows borrowers to avoid loan forgiveness reductions due to decreases in headcount or compensation that occurred 348 Brookings Papers on Economic Activity, Fall 2020 Borrowers do not need to demonstrate hardship in order to qualify for a forgivable loan, which streamlines the process and allows banks to get money to businesses quickly. Instead, they need to offer a series of good- faith certifications, including: “Current economic uncertainty makes this loan request necessary to support the ongoing operations of the Applicant.”13 Borrowers must also certify that the business intends to use the funds received for payroll and other operating expenses and that they are not applying for a duplicative loan. For a loan to be forgiven, in some cases, businesses may need to present documentation to lenders demonstrating that they complied with the terms of the loan. In other cases, businesses simply need to attest to this. To get funds to businesses quickly, PPP delegates authority to lenders to determine borrower eligibility. Given the PPP’s structure, lenders do not need to assess the ability of the borrower to repay the loan. No collateral or personal guarantees from borrowers are required, and no credit else- where tests are applied. Lenders simply need to establish that a business was operational on February 15, 2020, and verify its payroll. To entice banks to participate, the program allowed them to charge generous fees—5 percent of principal on loans up to $350,000, 3 percent on loans between $350,000 and $2 million, and 1 percent on loans above $2 million up to $10 million. Lenders can charge an interest rate of 1 percent on the portion of the loan that is not eligible for forgiveness, and loans have zero weight in banks’ capital requirements. In the statute, lenders are “held harmless” in the event of borrower misrepresentation, but the Treasury/ SBA did not waive requirements under the Bank Secrecy Act and required anti–money laundering compliance programs. The Paycheck Protection Program and Health Care Enhancement Act was signed into law on April 24, 2020, and increased PPP funding by between February 15, 2020, and April 26, 2020, provided that headcount and compensation are restored by December 31, 2020 (originally June 30, 2020). Loan forgiveness will also not be reduced if borrowers issue written offers to rehire workers who were employed on February 15, 2020, and those offers are not accepted, or if borrowers document an inability to rehire similarly qualified workers for vacancies as of December 31, 2020. Loan forgive- ness will not be reduced if borrowers cannot maintain employment levels due to an inability to return to the same level of business as of February 15, 2020, because they are complying with coronavirus-related guidance for social distancing, sanitation, or worker or customer safety requirements from various federal agencies and departments between March 1, 2020, and December 31, 2020. On October 8, the Treasury/SBA issued additional guidance that exempted borrowers with loans under $50,001 from any loan forgiveness reductions based on failing to maintain headcount or wages. 13. Paycheck Protection Program Borrower Application Form, revised June 24, 2020. HUBBARD and STRAIN 349 $320 billion. The Paycheck Protection Program Flexibility Act (PPPFA) was signed into law on June 5, 2020. The covered period of the forgiv- able loan was extended from eight weeks to twenty-four weeks (or until December 31, 2020). PPPFA also allowed businesses to spend 40 percent of forgivable funds on nonpayroll expenses, rather than the 25 percent previously established by Treasury/SBA regulation. The maturity of the loans was increased from two years to five years for loans issued after June 5. III.B. Design Concerns On the whole, PPP is well designed relative to objectives for financing during a short-term shutdown we described earlier. It was able to get an astonishing amount of money to millions of small businesses very quickly. It relied on what are essentially grants and not loans. It took measures to encourage banks to participate. It avoided revenue tests, and it did not target select industries. Its goals—ensuring small business continuity and preserving employment relationships—were the right ones. But we have four concerns about some design elements. First, PPP is too focused on payroll expenses. The goal should have been to replace revenue, not simply to assist businesses with meeting payroll obligations. Even the payroll share for forgiveness of 60 percent after PPPFA was enacted is too high from this perspective. Second, the program was designed with a short lockdown period in mind. This approach was reasonable given widely held expectations about the course of the pandemic in early March, and to some extent this was addressed by PPPFA modifications to the program. Even so, the program should be more flexible post-lockdown in allowing labor to be reallocated across firms and industries, a problem given a longer period of partial shutdown. PPP contains incentives that work against this needed reallocation. Third, a major flaw in PPP’s design was the original CARES Act appropriation of $349 billion, and a major flaw in its execution was the Treasury’s inability to convince banks that they would be held harmless in the event of borrower misrepresentation. Both of these flaws led to the reality and public perception that PPP funds were flowing to relatively better resourced and less vulnerable small and midsize businesses. Finally, Hubbard and Strain (2020) estimated that the PPP’s original goals would require around $1 trillion. With only $349 billion originally appropriated for PPP—and the intense demand for PPP loans in the early days of the program—a perception developed that only businesses with preexisting relationships with participating lenders would be able to access 350 Brookings Papers on Economic Activity, Fall 2020 the program. Lenders, in a rush to process applications and out of concern that they would not be held harmless in all circumstances, focused lending on existing bank customers. IV. Evaluating the PPP: Program Statistics, Implementation Challenges, and Existing Evidence In this section, we present basic statistics about PPP loans and discuss implementation challenges. We also review current empirical evidence on the effectiveness of PPP. IV.A. PPP Program Statistics Table 1 presents PPP program statistics. As of August 8, PPP had approved 5,212,128 loans representing a total of $525 billion provided by 5,460 lenders. The average loan size is $101,000. The solid majority of program dollars were included in loans of less than $2 million, and the overwhelming majority of loans were for less than that amount. Loans of over $2 million represent 0.6 percent of all loans and 20 percent of all dollars loaned. In contrast, around 87 percent of all PPP loans were made for less than $150,000, and 28 percent of all funds loaned were part of loans of less than that amount. Figure 1 shows loan counts and loan amounts over time. Granja and others (2020) study the targeting of these loans across geography and do not find evidence that the first round of PPP funds went to parts of the country that saw the largest declines in hours worked or business shutdowns. Further research is needed to study the targeting of the full program. We also note that the entire country was affected by shutdowns, and the degree to which different states were affected by the Table 1. Summary of PPP Lending, April 3–August 8 Cumulative lending Loan count Net loans ($) Number of lenders 5,212,128 525,012,201,124 5,460 Distribution by loan size % of count % of amount $150,000 and under 4,552,452 147,477,537,518 87.3 28.1 $150,000 to $2 million 630,694 272,228,531,130 12.1 51.9 Over $2 million 28,982 105,306,132,476 0.6 20.1 Source: SBA Paycheck Protection Program. HUBBARD and STRAIN 351 pandemic varied at different times, particularly as the nation entered the summer months.14 IV.B. Implementation Challenges Table 2 presents a timeline of selected PPP events and includes some implementation challenges. Before the program officially launched on April 3, banks and other industry associations were warning of a chaotic beginning to the program, arguing that borrower verification would be onerous and would hamper the government’s objective of getting money Source: SBA and Treasury Department micro data. Notes: This figure displays cumulative loans and dollars lent during the operation of the PPP program calculated as of August 20, 2020. Cumulative dollars lent are overstated in the micro data due to using the midpoints of loan ranges provided for loans greater than $150,000. The shaded areas represent a period of uncertainty over audits and the safe harbor deadline. The lightly shaded area covers the total period of uncertainty over audits from April 28 (audits announced) to May 18 (final deadline to return funds under safe harbor provision). The darker area covers the period of uncertainty over the safe harbor deadline from May 7 (the original deadline) to May 18 (the final deadline). 4/17 5/1 5/15 5/29 6/12 6/26 7/10 7/24 8/7 1 2 3 4 5 Loans approved (millions) 100 200 300 400 500 Dollars lent (billions) Initial $349B lent New $320B approved Flexibility Act signed Program ends Dollars approved Loan count Figure 1. Cumulative Number of PPP Loans and Dollars Approved, April 3–August 8 14. Figures A1 and A2 in the online appendix show loan counts and loan amounts by state and PPP loans and employment losses by industry, respectively. 352 Brookings Papers on Economic Activity, Fall 2020 Table 2. Timeline of Major Events in the PPP Program Date Description March 27, 2020 CARES Act signed, appropriating $349 billion for PPP. April 2 Treasury/SBA releases first interim final rule; 75 percent payroll requirement; two-year repayment period; 0.5 percent interest rate; eight weeks of covered expenses; application period to June 30. Faced with complaints from small banks, the Treasury raises the interest rate on PPP loans from 0.5 to 1 percent hours before the program launch. Bank associations, JPMorgan Chase Bank, and industry associations warn of chaotic PPP launch; borrower verification requirements and payroll cost calculations are unclear. April 3 First round of PPP officially launches; only eight of twenty-five largest SBA 7(a) lenders are taking applications. Bank of America and JPMorgan Chase begin accepting applications but only for existing customers. April 16 First round of PPP ends; original $349 billion appropriation exhausted. Thousands of submitted applications remain unapproved. April 20 Small businesses sue large banks over allocation of loans. They claim that banks violated first-come, first-served rules and gave priority to larger applications that would generate more fees. April 23 Treasury/SBA warns publicly traded companies and their subsidiaries against seeking loans; sets May 7 deadline to return funds. Treasury/SBA requires applicants to certify that the funds are necessary due to the current economic uncertainty, as well as a lack of other sources of funds to support their operations. April 24 Paycheck Protection Program and Health Care Enhancement Act signed into law authorizing an additional $320 billion for PPP. April 27 Second round of PPP begins with $320 billion in new funding. Treasury/SBA caps the dollar amount of loans that individual banks can originate at $60 billion. April 28 Secretary Steven Mnuchin announces full audits for loans > $2 million and warns of criminal penalties for noncompliers. April 29 SBA temporarily blocks large banks from submitting loans. April 30 Justice Department launches probe of PPP. IRS confirms that PPP loans are excluded from gross income, but expenses paid for using PPP loans are not tax deductible. May 5 Senate introduces Small Business Expense Protection Act to treat expenses paid using PPP loans as ordinary deductible business expenses. Deadline for companies to return funds without penalty under safe harbor provisions extended from May 7 to May 14. May 8 SBA inspector general warns that the requirement of 75 percent payroll costs and two-year repayment burdens borrowers and may not reflect statutory intent. May 13 SBA announces that loans below $2 million would be assumed to have satisfied good-faith certification requirements; creates opportunity for larger loans to be returned without penalty. Deadline for companies to return funds without penalty under safe harbor provisions extended from May 14 to May 18. HUBBARD and STRAIN 353 May 14 Treasury says companies must use the total number of employees to determine eligibility for PPP loans rather than full-time equivalent as indicated previously. May 22 Treasury/SBA warn that it may review PPP loans “of any size at any time at SBA’s discretion”; borrowers required to retain documentation for six years. June 5 PPP Flexibility Act passed; covered period extended from eight weeks to twenty-four weeks; repayment extended from two years to five years; payroll costs allowed to be 60 percent of total loan forgiveness amount, down from 75 percent. June 12 For determining PPP eligibility, the look-back period for criminal histories for nonfinancial felonies reduced from five years to one year. June 30 Hours before program expiration and with $130 billion left, Congress extends the PPP application period to August 8. July 6 Under pressure from Congress, SBA releases the names of borrowers and lenders and date of approval for loans of more than $150,000, representing 15 percent of all approved loans and 75 percent of dollars lent. Exact loan amounts are not disclosed. July 7 Using data released by the SBA, researchers estimate that banks will earn $24 billion in fees from PPP loans. July 12 New York City comptroller report alleges that the city did not receive its fair share of PPP loans. July 17 Secretary Mnuchin asks Congress to consider automatically forgiving all loans for less than $150,000, extending PPP, and suggesting terms for PPP in a phase 4 economic recovery package. August 4 Businesses, lobbyists, and professional organizations ask Congress to exempt PPP income from tax reporting. August 6 SBA releases guidelines on PPP loan forgiveness ahead of August 10 launch of forgiveness application platform. Many financial institu- tions delay submitting applications until regulatory and legislative uncertainty is resolved. August 8 PPP application period closes with nearly $140 billion in reserve as Congress debates “phase 4” economic recovery package. Source: Authors’ compilation. Table 2. Timeline of Major Events in the PPP Program (Continued) Date Description into the economy quickly, and due to confusion about basic program require- ments like how lenders should calculate payroll costs. Due to confusion about the program, on the day it launched only eight of the twenty-five largest SBA 7(a) lenders were taking applications. The early stage of PPP was also characterized by intense demand. By the end of its second week, all $349 billion of CARES Act PPP appropria- tions had been exhausted. Thousands of submitted applications remained unapproved. There were accusations that large banks violated the first- come, first-served structure of the program to favor large borrowers. 354 Brookings Papers on Economic Activity, Fall 2020 Articles in the press reported that some publicly traded companies or their subsidiaries had received PPP loans. On April 23, the SBA released guidance that publicly traded companies would likely find it difficult to certify in good faith that they needed PPP loans.15 The Treasury/SBA gave businesses until May 7 (later extended to May 14 and then May 18) to return PPP funds without facing a penalty.16 On April 28, Treasury Secretary Steven Mnuchin announced that a review of PPP loans in excess of $2 million would take place. The secretary warned of potential criminal penalties for borrowers found to have misrepresented themselves or not to have complied with the terms of the loan.17 On May 13, the SBA attempted to reassure borrowers and indicated that loans of less than $2 million would be assumed to have made certifications of need in good faith.18 In our view, publicly traded firms or their subsidiaries should not have been eligible for PPP loans. But confusion over eligibility for PPP loans, which borrowers would be audited, and under what terms those audits would take place had a profound effect on the program. During the period of uncertainty discussed above, shown in the light and dark gray bars in figure 1, the slope of both lines flattened. Dollars loaned have increased more slowly since this period of Treasury-sown confusion 15. See question 31, “Paycheck Protection Program Loans: Frequently Asked Questions,” https://home.treasury.gov/system/files/136/Paycheck-Protection-Program-Frequently-Asked- Questions.pdf (accessed August 21, 2020): “It is unlikely that a public company with substan- tial market value and access to capital markets will be able to make the required certification [of economic need] in good faith, and such a company should be prepared to demonstrate to SBA, upon request, the basis for its certification.” 16. See questions 43 and 47, “Paycheck Protection Program Loans: Frequently Asked Questions,” https://home.treasury.gov/system/files/136/Paycheck-Protection-Program- Frequently-Asked-Questions.pdf. 17. For example, Secretary Mnuchin made this statement on April 28 on CNBC: “I really fault the borrowers who made these certifications. Now, there were some banks early on who put things up on their website and prioritized their customers. We immediately told them that was wrong. They took it down. So, you know, I want to be very clear: it’s the borrowers who have criminal liability if they made this certification and it’s not true. And as I said, we’re going to do a full audit of every loan over $2 million. This was a program designed for small businesses, it was not a program that was designed for public companies that had liquidity. Again, the certification was very clear in saying that if people had other sources of liquidity, they could not take this loan”; https://www.cnbc.com/2020/04/28/cnbc-transcript- treasury-secretary-steven-mnuchin-speaks-to-cnbcs-squawk-box-today.html. 18. See question 46, “Paycheck Protection Program Loans: Frequently Asked Questions,” accessed August 21, 2020. https://home.treasury.gov/system/files/136/Paycheck-Protection- Program-Frequently-Asked-Questions.pdf: “Any borrower that, together with its affiliates, received PPP loans with an original principal amount of less than $2 million will be deemed to have made the required certification concerning the necessity of the loan request in good faith.” HUBBARD and STRAIN 355 ended on May 18. New PPP loans continued to be made in the second half of May and into June and July, but at a much slower rate than in April. Of course, implementation shortcomings were inevitable to some degree in setting up a program as ambitious as PPP in a short period of time in the midst of a pandemic. But the Treasury’s muddled management of PPP’s implementation is noteworthy because of its failure to take seri- ously the advice it was given by a range of private sector participants and policy experts, leading it to make mistakes that were both forecastable and forecasted. IV.C. Brief Review of Existing Economic Research on the PPP Study of the PPP by academic researchers is still in the working paper stage, but some notable findings exist that shed light on the early effects of the program. Bartik, Cullen, and others (2020) study the original $349 billion of PPP funds. Using a survey of small businesses, they find that PPP approval increased self-reported firm survival probability by 14 to 30 percentage points. They also find that banks allocated PPP funds to firms with higher PPP treatment effects. But these firms were also more likely to have stronger connections to banks, while firms with less cash on hand were less likely to have their applications approved. They find that PPP had a positive but statistically insignificant impact on employment. Quite modest employment effects are also found by Chetty and others (2020), who analyzed data from Earnin, a financial management applica- tion.19 Granja and others (2020) also do not find evidence that the first round of PPP had a substantial effect on employment or on other local economic outcomes. Bartik, Bertrand, and others (2020) find that states that received more PPP loans and those with more generous unemployment benefits had labor markets whose declines were relatively less deep and whose recoveries were relatively more rapid. Chodorow-Reich and others (2020) find that PPP relaxed liquidity constraints facing firms, allowing some firms to pay down existing credit line balances. Autor and others (2020) use weekly data from ADP, Inc., payroll records to study PPP’s effect on employment. Using a difference-in-differences event study framework, they compare employment at firms above and below the 500 employee PPP eligibility threshold. Through the first week 19. Autor and others (2020) discuss limitations in the study by Chetty and others (2020), including that Earnin data are focused on very low-wage workers, with median wages equal to roughly the 10th percentile of wages in their industry, and that the absence of reported standard errors makes the study results hard to interpret. 356 Brookings Papers on Economic Activity, Fall 2020 of June, they find that PPP increased employment by between 2 percent and 4.5 percent. After scaling by the take-up rate, they estimate PPP increased aggregate payroll employment by 2.3 million workers, again through the first week of June. Autor and others (2020) divide total program expenditures by their estimate of PPP’s effect on aggregate employment and report a cost per job supported estimate of around $224,000. The paper notes that “while this is a substantial cost per job supported, it would be premature to offer a cost-benefit analysis of the PPP at this time” and points to the need to take a longer-term view of PPP’s effects. We agree and would add that a short- term cost-benefit analysis should include other factors. For example, many workers who were kept on employer payrolls this spring would likely have been receiving unemployment insurance benefits in the absence of PPP. A short-term cost-benefit analysis should include cost savings from reducing the demand for social insurance and safety net benefits. More fundamentally, we disagree with Autor and others (2020) in that we do not find cost per job supported to be a sufficient statistic to assess PPP’s success. PPP is not exclusively a jobs program, and any evalua- tion of its effectiveness per dollar of program expense—even a short-run estimate—must include the benefit of preserving small businesses and employment relationships holistically, including social benefits in excess of private benefits and the benefits from hastening the economic recovery by supporting labor demand over the medium term. V. Evaluating PPP: Empirical Analysis We evaluate the effects of PPP on the employment, financial health, and continuity of small businesses. To do this, we use data from the Dun & Bradstreet Corporation (D&B), a company that provides commercial data and analytics to businesses. We are able to identify businesses in the Dun & Bradstreet data that applied for PPP loans of $150,000 or more. We do not observe if those companies received a loan or the exact amount (above $150,000 or more) of any loan received. We are not able to observe if a business applied for a PPP loan of less than $150,000. Information on loan applications comes from the SBA and is merged into the D&B data. We estimate standard difference-in-differences models of the effect of PPP application and of PPP eligibility based on size. We use several treat- ment control groups in our analysis. We also estimate the dynamic effect of PPP application and eligibility using event studies. We find evidence that PPP increased employment, financial health, and continuity. We also HUBBARD and STRAIN 357 find that the effect of PPP is unfolding, with effects on employment and financial health growing over time and reaching their peak in August, the last month for which we have data. In this section, we discuss the data, our methods, and these results in further detail. V.A. Dun & Bradstreet D&B is a global data and analytics company whose clients are busi- nesses. The company was founded in 1841 as the Mercantile Agency and became Dun & Bradstreet in 1933. It has extensive coverage, with over 355 million business records and data curated from tens of thousands of sources, including public registries, newspapers, and websites, its own investigations and telephone interviews, courts and legal filings, financial statements, insolvency records, and its own network, making use of proprie- tary and publicly available information. It is the world’s largest commercial database and counts 90 percent of the Fortune 500 companies as clients, along with every cabinet agency in the US government. D&B is able to track whether businesses pay their bills on time through its relationships with landlords, mortgage companies, credit card companies, office suppliers, and the like. Its clients make use of D&B’s ability to predict whether a particular establishment might be delinquent in order to help clients manage financial risk. D&B has significant reach. For example, the US government has historically required companies that want to receive federal contracts to register with D&B, as does Apple for compa- nies that want to distribute applications through its App Store. The Food and Drug Administration uses a company’s D&B registration number as a way to verify that importers of pharmaceutical products are legitimate businesses and to confirm that applicant contact information is accurate and complete. V.B. Sample, Variables, and Descriptive Statistics Our sample includes all establishments in the D&B database active as of October 2019 with one to 1,000 employees. We do not include sole proprietorships, establishments with zero reported employees, establish- ments with missing state and industry codes, and establishments with modeled employee counts. We assign each establishment to a business size category (one to 500 employees, 501 to 1,000 employees) based on employment in February 2020. We also stratify establishments based on whether they applied for a PPP loan worth $150,000 or more. (We are only able to observe whether businesses applied for PPP loans of at least $150,000.) 358 Brookings Papers on Economic Activity, Fall 2020 Table 3 presents summary means and standard deviations for key vari- ables and the distribution of establishments over industry. Businesses that applied for a PPP loan of $150,000 or more are nearly three times as large as those that did not. This difference is likely due to the relatively large size of the loan we are able to observe. Each group of businesses has comparable PAYDEX scores (discussed below), and over the entire sample period establishments with 501 to 1,000 employees are more likely to go out of business. The group least likely to go out of business during the sample period are establishments that we observe have applied for large PPP loans, and by a wide margin. Key variables for our analysis include PPP application (for loans of at least $150,000), establishment employment, state, and industry. We use Dun & Bradstreet’s PAYDEX variable as our measure of a business’s financial health. PAYDEX is an indicator based on whether and how a business is paying its bills. PAYDEX scores range from zero to 100. A PAYDEX score of 80 denotes that payments made to D&B have generally been made within the terms of the covered agreement. A PAYDEX score over 80 indicates that payments reported to D&B have been made earlier than their terms required. PAYDEX scores of 70, 60, 50, 40, 30, 20, or below 20 indicate that businesses are 15, 22, 30, 60, 90, 120, or over 120 days late, respec- tively, in paying their financial obligations. PAYDEX scores evolve slowly, and for each business a given month’s PAYDEX score reflects transactions that have taken place over the previous several months. Examples of recent papers that have used D&B data to examine changes in the financial health of small businesses include Barrot and Nanda (2020), who study the impact of the 2011 federal QuickPay reform using establishment-level employment data and PAYDEX scores from D&B. Chava, Oettl, and Singh (2019) examine the effects of state minimum wage increases on the financial health of small businesses. The authors use the D&B PAYDEX score as their primary measure of financial health for 15.2 million establishments from 1989 to 2013. D&B’s out-of-business indicator is our measure of business continuity. It is a zero-one variable. D&B determines a business is out of business if it is no longer engaging in transactions, through direct investigations, and in other ways. Two separate authorities—for example, management or owners of the company itself, the landlord at its address, its licensing body, and so on— must confirm a business has closed for it to be recorded as out of business. Panels A and B of figure 2 plot average establishment employment per month for establishments with one to 500 employees in our analysis sample and establishments with 501 to 1,000 employees. These plots indicate that Table 3. Summary Statistics, November 2019–March 2020 Group 1–500 employees and applied for a PPP loan ≥ $150,000 1–500 employees and did not apply for a PPP loan ≥ $150,000 All establishments 1–500 employees All establishments 501–1,000 employees Mean number of employees per establishment 33.8 11.5 12.5 722.0 (47.6) (35.2) (36.1) (167.0) Mean PAYDEX score 73.9 72.6 72.7 70.0 (9.57) (14.1) (13.1) (10.7) Out of business (%) 0.010 0.157 0.150 0.325 (0.985) (3.96) (3.86) (5.69) Annual sales in 2019 ($) 5,603,688 2,168,570 2,338,007 66,242,380 (24,365,380) (70,166,425) (68,691,245) (313,247,030) Sectors (% share of employment) Agriculture 2.7 3.4 3.4 0.5 Construction 14.2 8.0 8.2 1.7 Finance, insurance, real estate 3.9 10.3 10.0 5.8 Manufacturing 12.4 4.8 5.2 20.9 Mining 0.5 0.3 0.3 0.7 Public administration 0.1 3.1 2.9 16.5 Retail trade 11.5 13.6 13.5 5.7 Services 41.6 46.6 46.4 40.3 Transportation, communications 4.6 4.9 4.9 5.1 Wholesale trade 8.4 5.0 5.2 2.8 Source: Authors’ compilation using Dun & Bradstreet data. Notes: This table displays means and standard deviations (in parentheses) in our pretreatment period, November–March, for the main establishment employee size groups used in our analyses. We also calculate the distribution of employment across industries at the two-digit standard industrial classification level. The sample consists of all establishments operating as of October 2019 that meet our sample selection criteria. 360 Brookings Papers on Economic Activity, Fall 2020 employment within the D&B sample is very stable. Among businesses with one to 500 employees, employment decreased by 1.42 percent in August relative to November. Panel B shows employment declines of 1.83 percent among establishments with 501 to 1,000 employees. In contrast, employ- ment reported in official statistics shows much larger losses. The summary statistics we present suggest that employment evolves slowly among firms of all sizes, and our analysis does not indicate any relationship between the pace of evolution and PPP application. The relative stability of employ- ment in the D&B data biases against finding a PPP employment effect, in both our treatment-on-the-treated and intent-to-treat models. We interpret all our estimates of PPP’s effects relative to trends in the D&B data. We present the average PAYDEX score per month in panels C and D of figure 2. These figures indicate that businesses’ financial health in our sample is relatively stable, as well, falling in both panels by less than one point. This apparent stability is most likely due to the relatively lengthy look-back period for PAYDEX. As with the stability of employment, this biases against finding an effect of PPP on financial health. The share of establishments that went out of business is shown in panels E and F of figure 2. The share of businesses with fewer than 500 employees that went out of business increased by a factor of 16 between November and August. Businesses with 501 to 1,000 employees saw closure rates increase by a factor of 14. V.C. Estimation Strategy To identify the effect of PPP on business outcomes, we estimate the following equation: ( ) = α + β × + γ + δ + δ + ε y PPP Post PPP im ia m ia sm jm im (1) , where yim is an outcome experienced by business i in month m. Our analysis sample covers ten months, November 2019 through August 2020, with five months of pre-PPP period (the CARES Act was signed on March 27) and five months of post-PPP period (PPP launched on April 3). PPPia is an indicator as to whether business i applied for a PPP loan of at least $150,000. This variable is our measure of PPP—we do not observe whether businesses actually received PPP loans or, if they did receive loans, the size of the loan. The variable dsm is a state-by-month effect, and djm is an industry-by-month effect. The result of PPPia × Postm equals 1 if business i applied for a PPP loan and the month is April, May, June, July, or August. Standard errors are clustered by state. HUBBARD and STRAIN 361 Source: Dun & Bradstreet; authors’ calculations. Note: These graphs show average employment, PAYDEX score, and out-of-business rates from November 2019 to August 2020 for establishments with 1–500 employees and 501–1,000 employees. Establishments are assigned to an employment size group using February 2020 employment. Panels A, C, and E include establishments with 1–500 employees. Panels B, D, and F include all establishments with 501–1,000 employees. E: Out of Business 1–500 Employees 0.3 0.4 0.1 0.2 F: Out of Business 501–1,000 Employees 0.50 0.75 0.25 C: PAYDEX 1–500 Employees 72.6 72.8 72.4 D: PAYDEX 501–1,000 Employees 69.5 70.0 69.0 A: Employment 1–500 Employees 12.5 12.4 B: Employment 501–1,000 Employees 715 720 710 Jan Mar May Jul Jan Mar May Jul Jan Mar May Jul Jan Mar May Jul Jan Mar May Jul Jan Mar May Jul Figure 2. Average Establishment Employment, PAYDEX Scores, and Out-of-Business Rates by Month 362 Brookings Papers on Economic Activity, Fall 2020 The coefficient of interest is β, which captures the effect of applying for a PPP loan of $150,000 or greater on the outcome variable. The industry- month effects capture time varying shocks to businesses in a given industry, and the state-month effects capture time varying shocks to businesses in a given state. The effects of the pandemic and the lockdowns varied substan- tially across industries and states. Using within-state-by-month and within- industry-by-month variation to estimate the effect of PPP application helps ensure that our results are not driven by time varying public health or social distancing policy differences between states and industries. To trace the dynamics of PPP over the months since the CARES Act, we estimate a difference-in-differences event study of the following form: ∑ ( ) = α + β × ϕ + γ + δ + δ + ε =− y PPP PPP im t ia t t ia sm jm im (2) , 4 5 where βt is a vector of nine parameters estimating the dynamic effect of PPP, jt is a month dummy, and everything else is the same as in equation (1). The dynamics of the effect are interesting because of lags in receipt time, the time it may take employers to bring workers back onto payroll, and treatment control differences driven by the economic outcomes of control businesses worsening over time because they do not have access to PPP funds. The trend in the pre-PPP period coefficient vector is a partial check against differential employment trends among businesses that applied for a PPP loan and those that did not. We observe whether a business applied for a PPP loan of $150,000 or more. If some businesses that applied were turned down, then our estimates of PPP’s effect are biased downward, because the treatment group would be contaminated by control observations. Another important source of downward bias in our estimates of PPP’s effect is that many businesses in our control group applied for and received PPP loans of less than $150,000. As presented in table 1, around 87 percent of all PPP loans were made for $150,000 or less, and these loans accounted for 28 percent of all funds disbursed. These are treatment-on-the-treated estimates and do not control for selection into applying for PPP. Firms that did not apply could be very different from those that did, perhaps thinking that they did not need the funds to continue operating or, alternatively, perhaps thinking that the situation was hopeless. They might have also been less financially savvy, which could be correlated with other outcomes and characteristics. Knowing how PPP affected firms that selected into participating is inter- esting and important, but it confounds demand for PPP with PPP itself. To HUBBARD and STRAIN 363 address this distinction, we estimate intent-to-treat models. In these models, we do not use information on whether a business actually applied for a PPP loan. Instead, we compare outcomes for establishments that were eligible for PPP based on their size to establishments that were ineligible in a difference- in-differences framework. Specifically, we estimate the following equation: ( ) = α + β × + γ + δ + δ + ε y PPP Post PPP im ie m ie sm jm im (3) . All variables in equation (3) are the same as in equation (1) except PPPie, which equals 1 if a business is eligible for PPP based on its size, and equals 0 otherwise. We also estimate intent-to-treat event studies analogous to equation (2). V.D. Results RESULTS FOR EMPLOYMENT Table 4 presents estimates of equations (1) and (3) for (the log of) employment. The specification in the first column compares establishments with one to 500 employees that applied for a PPP loan of $150,000 or more to establishments in the same size class but that did not apply. PPP application is associated with a 0.90 percent increase in employment. Columns 2 and 3 present the same specification, but on smaller samples of establishments. Column 2 looks at establishments with one to 250 employees and similarly finds a 0.94 percent increase in employment from PPP. Column 3 analyzes a sample of establishments with 251 to 500 employees. Here, the effect on employment is negative, −3.2 per- cent. This result might be driven by greater demand for larger PPP loans within that size class among the treatment group, confounded by many control firms taking out PPP loans that we do not observe. But in evaluating the program as a whole, it is worth noting that there are approximately 81 million establishment-months with one to 500 employees in our sample, and around 360,000 of those are establishment-months with 251 to 500 employees. These estimates are valuable in part because they implicitly control for establishment size category. But they are likely biased downward because the treatment effect is defined as a business applying for a PPP loan of $150,000 or greater, while most PPP loans were for less than this amount, so PPP-treated establishments are in the control group. The specification in column 4 attempts to address this by defining the treatment group as establishments with less than 500 employees who applied for a PPP loan of at least $150,000 and the control group as establishments with 501 to 1,000 employees. Here, we estimate a PPP employment effect of 1.78 percent, substantially larger in magnitude than the coefficients discussed previously. Table 4. Estimating the Effect of PPP Loans on Establishment-Level Employment (1) (2) (3) (4) (5) (6) Treated × Post × 100 0.902*** 0.936*** −3.20*** 1.78*** 0.0772 1.38*** (0.0656) (0.0655) (0.470) (0.234) (0.366) (0.258) Treatment 1–500; loan 1–250; loan 251–500; loan 1–500; loan 400–475; all establishments 1–500; all establishments Control 1–500; no loan 1–250; no loan 251–500; no loan 501–1,000; no loan 525–600; all establishments 501–1,000; all establishments Observations 81,404,032 81,043,431 360,601 3,980,677 110,712 81,523,211 R2 0.1390 0.1373 0.0432 0.2343 0.3783 0.0966 Source: Authors’ compilation using Dun & Bradstreet data. Note: This table reports difference-in-differences estimates for the impact of PPP on establishment-level employment. The sample consists of establishments operational as of October 2019 that meet our sample selection criteria. For all regressions, the pretreatment period is November–March and the posttreatment period is April–August. Each column uses a different treatment and control group, indicating the size of the establishment by employment in February; “loan” indicates that we observe that the establishment applied for a PPP loan of at least $150,000; “no loan” indicates the opposite; “all establishments” indicates that we include all establishments in the analysis sample regardless of whether they applied for a loan. All regressions include state, month, and two-digit standard industrial classification fixed effects as well as state-by- month and industry-by-month fixed effects. Standard errors are clustered at the state level. Coefficients and standard errors are multiplied by 100 for ease of interpretation. *** p < .01 HUBBARD and STRAIN 365 The estimates reported in columns 1–4 are treatment-on-the-treated estimates. In the context of evaluating PPP, this is interesting because estimating program outcomes conditional on selection is important and relevant (program participation is voluntary) and survey evidence finds that over 70 percent of small businesses participated in PPP.20 But the estimates do confound the effect of demand for PPP with the effect of PPP, in addition to the limitation that we only observe PPP loans of at least $150,000. To address these limitations, column 6 reports intent-to-treat estimates in which we define the treatment group purely based on size eligibility—that is, we do not use information on whether a business applied for a PPP loan— and the control group is establishments with 501 to 1,000 employees. We estimate that PPP size eligibility increased employment by 1.38 percent. This result might suggest an important role for smaller PPP loans in supporting employment. Column 5 also reports intent-to-treat effects but for firms close to the 500 employee cutoff (eliminating firms near the cutoff). The advantage of this specification is that it directly controls for firm size. Comparing firms in the 400–600 employee window, we do not find a PPP employment effect. This result, along with the estimates reported in column 6, might suggest that PPP was most effective in supporting employment among smaller firms, at least through August. The specification that estimates the effect of PPP within the 400– 600 employee window arguably offers the strongest basis for causal infer- ence assuming that the effect of PPP loans on employment is similar for firms of different sizes. But this assumption is very strong, and it is quite likely that PPP loans have effects that vary by firm size. The estimates reported in table 4 suggest this is the case, and the $10 million maxi- mum for PPP loans also suggests that PPP would offer relatively more assistance to smaller firms. In the D&B data, 2019 average annual sales for firms with one to 500 employees were $2.4 million, while those for firms with 400–475 employees were $46.4 million. This consideration suggests that a holistic evaluation of PPP should include estimating its effects on firms of all eligible sizes. Therefore, our preferred specifications are presented in columns 4 and 6. Our results contrast with Autor and others (2020), who find employment effects for larger firms using ADP data. It is interesting to note that their 20. The Small Business Pulse Survey of the US Census Bureau finds that 72.7 percent of small businesses received financial assistance from PPP since March 13, 2020, as of August 22, 2020. 366 Brookings Papers on Economic Activity, Fall 2020 estimates become less precise as the window around the 500 employee eligibility cutoff shrinks. This finding may be due to sample size, or it could indicate that PPP is relatively less effective at supporting employment for larger firms in the ADP data. We present event study graphs using our two preferred treatment and control groups. Figure 3 presents results from equation (2). Panel A shows the dynamic effect of PPP on employment when the treatment group is establishments with one to 500 employees who applied for a PPP loan of at least $150,000 and the control group is establishments with 501 to 1,000 employees. There is no trend in the pre-PPP period coefficients, although the confidence interval on the negative coefficient in February does not include zero. The absence of a pre-PPP period trend supports a causal interpretation of the estimates. In the post-PPP period coefficients, the effect of PPP increases over time, rising to 3.13 percent in August. Panel B shows a similar effect of PPP on employment. Here, the dynamic effect captures intent to treat, comparing establishments with 500 or fewer employees to those with between 501 and 1,000 employees, regardless of whether the firms applied for a PPP loan. Like panel A, there is no notice- able trend in the pre-PPP period, and the strength of the effect increases in the post-PPP period with each month. In August PPP eligibility is found to increase employment by 3.83 percent. To interpret the magnitude of these effects, consider that average establishment employment fell by 1.6 percent in the D&B data for estab- lishments with one to 1,000 employees over the sample period, between November and August. In light of this change, the 1.78 percent increase in employment reported in column 4 of table 4 and the 1.38 percent increase reported in column 6 of table 4 are both substantial increases. The effects for the month of August specifically—3.13 and 3.83 percent, respectively— are even more substantial. RESULTS FOR FINANCIAL HEALTH Table 5 reports results for which the outcome variable is financial health, as captured by Dun & Bradstreet’s PAYDEX score. Table 5 is the same as table 4, except for the outcome variable. The first three columns of table 5 report results from speci- fications where the treatment and control groups are the same firm employee size class. Taken together, they suggest that financial health worsened for firms with one to 250 employees that applied for PPP loans of at least $150,000. We think this puzzling finding is most likely the result of PPP-treated observations (that is, establishments with less than 250 employees that applied for loans of less than $150,000) contaminat- ing the control group. HUBBARD and STRAIN 367 E: Out of Business F: Out of Business 0 0.5 –0.5 C: PAYDEX D: PAYDEX 0.5 0 A: Employment B: Employment 2 4 0 Source: Dun & Bradstreet; authors’ calculations. Note: These graphs show the results from event study regressions in equation (2) examining the impact of the Paycheck Protection Program on establishment employment, financial health, and survival. Panels A, C, and E examine PPP’s effect on employment, credit scores, and survival rates for establishments with 1–500 employees that applied for a PPP loan of $150,000 or more compared to establishments with 501–1,000 employees. Panels B, D, and F examine the effect of PPP eligibility on the same outcomes, comparing all establishments with 1–500 employees to all establishments with 501–1,000 employees (i.e., dynamic intent-to-treat effects). Establishments are assigned to an employment size group using February employment. Coefficients and standard errors for panels A, B, E, and F are multiplied by 100 to ease interpretation. Error bars represent 95 percent confidence intervals. 2 4 0 NovDec Jan Feb Mar AprMay Jun Jul Aug 0 0.5 –0.5 NovDec Jan Feb Mar AprMay Jun Jul Aug 0 0.5 –0.5 NovDec Jan Feb Mar AprMay Jun Jul Aug NovDec Jan Feb Mar AprMay Jun Jul Aug NovDec Jan Feb Mar AprMay Jun Jul Aug NovDec Jan Feb Mar AprMay Jun Jul Aug Figure 3. Event Study Regressions Table 5. Estimating the Effect of PPP Loans on Establishment-Level Credit Scores (1) (2) (3) (4) (5) (6) Treated × Post −0.0392* −0.0379* −0.0349 0.305*** 0.01 0.349*** (0.0220) (0.0219) (0.0969) (0.0686) (0.154) (0.0616) Treatment 1–500; loan 1–250; loan 251–500; loan 1–500; loan 400–475; all establishments 1–500; all establishments Control 1–500; no loan 1–250; no loan 251–500; no loan 501–1,000; no loan 525–600; all establishments 501–1,000; all establishments Observations 32,139,590 31,889,423 250,167 3,731,639 81,644 32,225,515 R2 0.013 0.013 0.021 0.024 0.027 0.012 Source: Authors’ compilation using Dun & Bradstreet data. Note: This table reports difference-in-differences estimates for the impact of PPP on establishment-level employment. The sample consists of establishments operational as of October 2019 that meet our sample selection criteria. For all regressions, the pretreatment period is November–March and the posttreatment period is April–August. Each column uses a different treatment and control group, indicating the size of the establishment by employment in February; “loan” indicates that we observe that the establishment applied for a PPP loan of at least $150,000; “no loan” indicates the opposite; “all establishments” indicates that we include all establishments in the analysis sample regardless of whether they applied for a loan. All regressions include state, month, and two-digit standard industrial classification fixed effects as well as state-by- month and industry-by-month fixed effects. Standard errors are clustered at the state level. Coefficients and standard errors are multiplied by 100 for ease of interpretation. * p < .1, *** p < .01 HUBBARD and STRAIN 369 For reasons discussed previously, our preferred specifications are reported in columns 4 and 6. The specification in column 4 compares firms with 500 or fewer employees that applied for PPP loans of at least $150,000 to firms with 501 to 1,000 employees that were not eligible for PPP. PPP pre- dicts a PAYDEX increase of about 0.31 points. Column 6 presents results from an intent-to-treat specification. Here, PPP eligibility boosts PAYDEX by about 0.35 points. Similar to our results for employment, PPP seems to have had a larger impact on firms with fewer than 400 employees, as suggested by comparing the results in column 5 with column 4. Figure 3, panels C and D, present event study graphs that trace out the dynamic effect of PPP for our two preferred specifications. As with employ- ment, the effect of PPP on financial health (as measured by PAYDEX) grows over time. Both figures show a flat trend centered on zero for the pre-PPP period coefficients estimating the effect of PPP in November through February relative to March. As with employment, this supports a causal interpretation of our estimates. The effect of PPP application on financial health was estimated imprecisely in April and precisely every month after. The magnitude of the effect increased considerably over time, more than doubling between June and August. The dynamic intent-to-treat estimate is shown in panel D. As with the results in panel C, PPP’s effect on financial health is estimated imprecisely in April but precisely for the following four months. The magnitude of the effect in August is more than double the effect in May. PPP eligibility is estimated to have increased PAYDEX in August by 0.51 points. The magnitude of the effect is substantial. For all firms with one to 1,000 employees, average monthly PAYDEX fell by 0.28 points from November to August. A PPP PAYDEX effect of 0.31 (column 4) and 0.35 (column 5) represents a significant increase relative to the change in finan- cial health of all firms during our sample period. As with employment, the effect of PPP on PAYDEX in June is substantially larger than the post-PPP period average, suggesting that the effects of PPP on financial health may be increasing over time. RESULTS FOR BUSINESS CONTINUITY Table 6 reports results for D&B’s out-of-business variable. Everything in table 6 is the same as in tables 4 and 5, except the outcome variable. PPP eligibility or application is esti- mated to have reduced business closure in every specification at conven- tional levels of statistical significance, except for column 5. Column 4 presents results from the specification that compares firms that applied for a PPP loan of at least $150,000 to firms with 501 to 1,000 employees, which were ineligible for PPP. PPP application is estimated to have reduced Table 6. Estimating the Effect of PPP Loans on the Probability an Establishment Goes Out of Business (1) (2) (3) (4) (5) (6) Treated × Post × 100 −0.237*** −0.236*** −0.616*** −0.471*** 0.0562 −0.219** (0.0222) (0.0224) (0.0836) (0.0853) (0.124) (0.0683) Treatment 1–500; loan 1–250; loan 251–500; loan 1–500; loan 400–475; all establishments 1–500; all establishments Control 1–500; no loan 1–250; no loan 251–500; no loan 501–1,000; no loan 525–600; all establishments 501–1,000; all establishments Observations 81,625,920 81,262,585 363,335 3,982,131 111,512 81,745,730 R2 0.00805 0.00804 0.02154 0.00344 0.0166 0.00789 Source: Authors’ compilation using Dun & Bradstreet data. Notes: This table reports difference-in-differences estimates for the impact of PPP on establishment-level employment. The sample consists of establishments operational as of October 2019 that meet our sample selection criteria. For all regressions, the pretreatment period is November–March and the posttreatment period is April–August. Each column uses a different treatment and control group, indicating the size of the establishment by employment in February 2020; “loan” indicates that we observe that the establishment applied for a PPP loan of at least $150,000; “no loan” indicates the opposite; “all establishments” indicates that we include all establishments in the analysis sample regardless of whether they applied for a loan. All regressions include state, month, and two-digit standard industrial classification fixed effects as well as state-by- month and industry-by-month fixed effects. Standard errors are clustered at the state level. Coefficients and standard errors are multiplied by 100 for ease of interpretation. ** p < .05, *** p < .01 HUBBARD and STRAIN 371 the odds of business closure by 0.47 percentage points. Column 6 presents results from our intent-to-treat model. Here, PPP eligibility is estimated to reduce business closure odds by 0.22 percentage points. Column 5 reports intent-to-treat results for a smaller window around the 500 employee cutoff. As with employment and financial health, we do not find a significant effect of PPP on business closure among firms with 400–475 employees. Panels E and F of figure 3 present event studies for those two models. The pre-PPP period coefficients show a trend, and these results should be interpreted cautiously. The confidence interval on pre-PPP period coeffi- cients includes zero in several cases. In the post-PPP period, the magnitude of the effect is larger in June than in April or May. This pattern is similar to our employment and PAYDEX results. The magnitude of these effects is large. To place the difference-in-differences estimates and June event study coefficient estimates in context, the average establishment out-of-business indicator in August was 0.42 percentage points higher than in November for firms with one to 1,000 employees. V.E. Discussion and Conclusions Our results point to PPP playing a significant role in the health and viability of small businesses. Both applying for a PPP loan of $150,000 or more and PPP eligibility as determined by firm size increase employment, financial health, and business continuity. In addition, we find that it may have taken a month or two for PPP to kick in. An alternative interpretation is that PPP was more effective in a partially reopened economy (that is, June–August) than during the lockdowns. Several caveats are in order. We avoid making strong statements about the success or failure of PPP because the program is so young, and we are only analyzing the first five months of the program. PPP did have impor- tant short-run goals, which included maintaining employment relationships during the lockdowns and supporting consumer spending by allowing workers to continue to be paid. But PPP has important medium-run goals as well, and it is too early to say anything definitive about its success or failure. Those goals include mitigating business closures after the economy had partially reopened (which we observe for about one month), supporting employment and reducing unemployment, and increasing productivity by preserving firm-specific human capital, worker-firm matches, and networks. Crucially, by preserving the productivity capacity of the small business sector, PPP stands to quicken the recovery by supporting labor demand over the medium run. In addition, the firms in the D&B data are not nationally 372 Brookings Papers on Economic Activity, Fall 2020 representative, and they exhibit employment and financial health indica- tors that are likely more stable than typical firms. We also want to stress the tentative nature of our conclusions. As shown in the dynamics of the effect (in figure 3), the effect of PPP on employment, financial health, and business continuity is evolving and is much stronger in July and August than in April and May. The effects of PPP are unfolding, and it will be particularly important to see what happens to businesses that received PPP and the workers they employ once they have exhausted their forgiv- able loan. VI. Retrospective and Lessons for the Future Many of the common criticisms of the PPP as failed by design and effect were too strong. Banks were skittish about participating, particularly in the early days of the program. But program demand by lenders was sufficient to allow the government to transfer funds in an amount roughly equal to 10 percent of a typical quarter’s GDP to small businesses. With the vast majority of loans and the sizeable majority of program dollars going to loans of less than $2 million, media coverage suggesting that PPP was in the main offering grants to large and well-connected firms was overblown. Many of the anecdotes in the media implying fraudulent participation in the program actually pointed to firms that were eligible for PPP loans under the statute. The criticism that the original CARES Act appropriation of $349 billion was too small, obvious from the outset, was quickly proven valid by events, but Congress rectified that swiftly. Could policymakers have designed a more effective and cost-effective intervention than a small business revenue replacement program? In theory, one could argue that relying on the unemployment insurance (UI) system to replace workers’ income and using a PPP-like program to help small busi- nesses with nonpayroll cost has appeal to some economists and analysts. But that plan would require worker-firm separations, albeit temporary, to take place. It would change the default for small businesses from keeping workers employed (as under a revenue replacement program) to recalling workers following a separation, which is the wrong place for the default to be during the shutdown. The UI system in many states was simply and troublingly unable to handle the demands placed on it during the shutdown— increasing those demands would not likely lead to the most successful outcomes. Finally, having both UI and a small business revenue replace- ment program is good policy design because it allows for redundancy, with multiple programs operating to replace workers’ incomes. HUBBARD and STRAIN 373 For the reasons we discussed previously, we do not view a loan program as an adequate substitute for a small business revenue replacement program. Many businesses would not want to add to their debt burdens, even under very favorable lending conditions. Many would resort to layoffs, which would disrupt other businesses, deepen the recession, and hurt workers’ employment and earnings opportunities. Even though a small business revenue replacement program may have been the best available option, the PPP could have been better designed and better implemented in ways we previously discussed: it is too focused on payroll expenses; banks should have been given stronger assurances that they would be held harmless; and its initial appropriation was too small. Much of the confusion about the program was driven by chaotic Treasury/ SBA management which weakened the program’s effectiveness, limited its reach, and ultimately led to a falloff in demand for PPP funds. PPP was designed for a short shutdown that would be followed by a strong and rapid recovery. But the shutdown was longer than anticipated and the recovery decelerated after a burst of improvement in May and June. In addition, partial shutdowns may remain in some regions for an extended period of time. Subsequent changes to PPP addressed these concerns, but the program needed to facilitate the transition from the “freeze the economy in place” stage to the “allow labor to reallocate across firms and industries” stage. The economy overall, including workers, will benefit from a fast transition from the pre- to post-lockdown equilibrium. PPP could facilitate this transition by eliminating any link between PPP loan forgiveness and precrisis employment levels. We have argued that many small businesses needed equity or grants, and not loans. But a lending program could—and in the future perhaps should— exist alongside a revenue replacement program, particularly for a partially reopened economy. An advantage of a lending program is that businesses that expect to be nonviable in the post-pandemic economy would be less likely to take out a loan than to accept a grant. This feature would keep the cost of the program lower, channel funds more effectively, and allow for a swifter transition to the post-pandemic equilibrium. A disadvantage—and the reason we do not support this during the shutdown period—is that some firms that might be viable in the absence of the loan could be tipped over into insolvency by taking out a loan. More practically, in the shutdown, we are concerned that few firms would participate in a lending program. One way to structure such a lending program could be in two stages, following a venture capital model preceded by a broadly available loan. In the first stage, the Treasury Department could issue a small loan to firms 374 Brookings Papers on Economic Activity, Fall 2020 using limited underwriting standards, knowing that the loan will have a high default rate. In the second stage, surviving firms could have access to additional funding. This financing would help to give many firms a lifeline for survival, while still well-stewarding taxpayer funds.21 An alternative approach would be a federal business interruption insurance program for small and midsize firms (analogous to the federal terrorism risk insurance program) layered on top of private business interruption insurance. Linking a trigger to a pandemic shutdown could require a shutdown order by a public official (for example, the governor of the state). Looking forward, there are broader lessons as well. For a situation in which the government is shutting down large sections of the economy, Congress and the White House need to be willing to tolerate stories of “undeserving” beneficiaries of economic recovery programs. The alternative is upfront targeting measures that slow down aid and worsen the downturn. Another alternative is that programs are much less effective. PPP stands a chance at succeeding because its relief was broad based. The Treasury Department was much more conservative with putting taxpayer dollars at risk when approving the terms of the PPP, limiting early take-up. The Treasury’s conservative approach has extended to the Federal Reserve’s Main Street Lending Facility, which received capital funds (along with other Federal Reserve facilities under the CARES Act). As a consequence of the Treasury’s aversion to putting that capital at risk, potentially driven in part by concern about stories of undeserving borrowers, the facility is not supporting the economic recovery yet because it, essentially, is not making loans. Another broader lesson is the need for government at the state and federal levels to upgrade computer systems. Banks were needed as inter- mediaries in part because the government’s IT constraint would not have allowed for it to lend directly to banks in a timely fashion. Finally, the government’s attempt to support small and midsize businesses in the pandemic recession calls into question the nature of the division between the Federal Reserve and the Treasury. Following the Dodd-Frank Act, the Treasury is required to approve the terms of 13(3) lending programs, including the Main Street programs. But these are labeled as Federal 21. The Federal Reserve’s Main Street Lending Facility offers another lending vehicle for small and midsize firms. While the facility’s design remains in flux, its structure could also mimic better patient equity financing. Terms could include much longer maturity and very low interest rates, for example. HUBBARD and STRAIN 375 Reserve programs, creating confusion about which agency is ultimately responsible for their success or failure. Furthermore, Congress appropriated $454 billion in the CARES Act to the Treasury to support Federal Reserve lending programs. At the time of this writing, little of those funds have been put to use to support the recovery, despite congressional intent. If the Treasury is unwilling to risk capital losses as part of Federal Reserve lending programs, then Congress should consider whether an alternative structure to support small and midsize businesses is advisable. ACKNOWLEDGMENTS We thank Duncan Hobbs for excellent research assistance. We gratefully acknowledge the Dun & Bradstreet Corporation for providing access to and assistance with its data; in particular, we thank Stephen Daffron and Andrew Byrnes. We thank Jeffrey Clemens, Steven Davis, Stan Veuger, and Eric Zwick for helpful comments. 376 Brookings Papers on Economic Activity, Fall 2020 References Alstadsæter, Annette, Julie Brun Bjørkheim, Wojciech Kopczuk, and Andreas Økland. 2020. “Norwegian and US Policies Alleviate Business Vulnerability Due to the COVID-19 Shock Equally Well.” National Tax Journal 73, no. 3: 805–28. Autor, David, David Cho, Leland D. Crane, Mita Goldar, Byron Lutz, Joshua Montes, William B. Peterman, David Ratner, Daniel Villar, and Ahu Yildirmaz. 2020. “An Evaluation of the Paycheck Protection Program Using Administrative Payroll Microdata.” Working Paper. Cambridge, Mass.: Massachusetts Institute of Technology. https://economics.mit.edu/files/20094. Barrot, Jean-Noël, and Ramana Nanda. 2020. “The Employment Effects of Faster Payment: Evidence from the Federal Quickpay Reform.” Journal of Finance 75, no. 6: 3139–73. Bartik, Alexander W., Marianne Bertrand, Feng Lin, Jesse Rothstein, and Matthew Unrath. 2020. “Measuring the Labor Market at the Onset of the COVID-19 Crisis.” Brookings Papers on Economic Activity, Summer, 239–68. Bartik, Alexander W., Zoe B. Cullen, Edward L. Glaeser, Michael Luca, Christopher T. Stanton, and Adi Sunderam. 2020. “The Targeting and Impact of Paycheck Protection Program Loans to Small Businesses.” Working Paper 27623. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber. org/papers/w27623. Blanchard, Olivier, Thomas Philippon, and Jean Pisani-Ferry. 2020. “A New Policy Toolkit Is Needed as Countries Exit COVID-19 Lockdowns.” Policy Brief 20-8. Washington: Peterson Institute for International Economics. https://www.piie.com/ publications/policy-briefs/new-policy-toolkit-needed-countries-exit-covid-19- lockdowns. Cajner, Tomaz, Leland D. Crane, Ryan A. Decker, John Grigsby, Adrian Hamins- Puertolas, Erik Hurst, Christopher Kurz, and Ahu Yildirmaz. 2020. “The US Labor Market during the Beginning of the Pandemic Recession.” Brookings Papers on Economic Activity, Summer, 3–33. Chava, Sudheer, Alexander Oettl, and Manpreet Singh. 2019. “Does a One-Size- Fits-All Minimum Wage Cause Financial Stress for Small Businesses?” Working Paper 26523. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber.org/papers/w26523. Chetty, Raj, John N. Friedman, Nathaniel Hendren, Michael Stepner, and Oppor- tunity Insights Team. 2020. “How Did COVID-19 and Stabilization Policies Affect Spending and Employment? A New Real-Time Economic Tracker Based on Private Sector Data.” Working Paper 27431. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber.org/papers/w27431. Chodorow-Reich, Gabriel, Olivier Darmouni, Stephan Luck, and Matthew C. Plosser. 2020. “Bank Liquidity Provision across the Firm Size Distribution.” Working Paper 27945. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber.org/papers/w27945. HUBBARD and STRAIN 377 Coibion, Olivier, Yuriy Gorodnichenko, and Michael Weber. 2020. “Labor Markets during the COVID-19 Crisis: A Preliminary View.” Working Paper 27017. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber. org/papers/w27017. Davis, Steven J., and Till von Wachter. 2011. “Recessions and the Costs of Job Loss.” Brookings Papers on Economic Activity, Fall, 1–55. Erel, Isil, and Jack Liebersohn. 2020. “Does FinTech Substitute for Banks? Evidence from the Paycheck Protection Program.” Working Paper 27659. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber. org/papers/w27659. Farooq, Ammar, Adriana D. Kugler, and Umberto Muratori. 2020. “Do Unemploy- ment Insurance Benefits Improve Match Quality? Evidence from Recent U.S. Recessions.” Working Paper 27574. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber.org/papers/w27574. Farrell, Diana, Christopher Wheat, and Carlos Grandet. 2019. Place Matters: Small Business Financial Health in Urban Communities. Washington: JPMorgan Chase Institute. https://www.jpmorganchase.com/content/dam/jpmc/jpmorgan-chase- and-co/institute/pdf/institute-place-matters.pdf. Forsythe, Eliza, Lisa B. Kahn, Fabian Lange, and David Wiczer. 2020. “Labor Demand in the Time of COVID-19: Evidence from Vacancy Postings and UI Claims.” Journal of Public Economics 189, article no. 104238. Gertler, Mark, and R. Glenn Hubbard. 1988. “Financial Factors in Business Fluctuations.” In Economic Policy Symposium Proceedings: Financial Market Volatility. Jackson Hole, Wyo.: Federal Reserve Bank of Kansas City. Goolsbee, Austan, and Chad Syverson. 2020. “Fear, Lockdown, and Diversion: Comparing Drivers of Pandemic Economic Decline 2020.” Working Paper 27432. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber.org/ papers/w27432. Granja, João, Christos Makridis, Constantine Yannelis, and Eric Zwick. 2020. “Did the Paycheck Protection Program Hit the Target?” Working Paper 27095. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber. org/papers/w27095. Hamilton, Steven, and Stan Veuger. 2020. “A Recession Is a Public Health Necessity—Let’s Keep It Short.” London: Centre for Economic Policy Research, VoxEU. https://voxeu.org/article/recession-public-health-necessity-let-s-keep- it-short. Hanson, Samuel G., Jeremy C. Stein, Adi Sunderam, and Eric Zwick. 2020a. “Business Continuity Loans: Keeping America’s Lights on during the Pandemic.” White Paper. Chicago: University of Chicago, Becker Friedman Institute. https:// bfi.uchicago.edu/wp-content/uploads/BFI_White-Paper_Zwick2_4.2020.pdf. Hanson, Samuel G., Jeremy C. Stein, Adi Sunderam, and Eric Zwick. 2020b. “Business Continuity Insurance: Keeping America’s Lights on during the Pandemic.” Working Paper. Boston: Harvard Business School. https://www. 378 Brookings Papers on Economic Activity, Fall 2020 igmchicago.org/wp-content/uploads/2020/04/Business-Continuity-Insurance- 20200408-FINAL.pdf. Hubbard, R. Glenn, and Michael R. Strain. 2020. A Business Fiscal Response to a COVID-19 Recession. Washington: American Enterprise Institute. https://www. aei.org/research-products/report/a-business-fiscal-response-to-covid-19-recession/. Jackson, C. Kirabo. 2013. “Match Quality, Worker Productivity, and Worker Mobility: Direct Evidence from Teachers.” Review of Economics and Statistics 95, no. 4: 1096–116. Mortensen, Dale T., and Christopher A. Pissarides. 1999. “New Developments in Models of Search in the Labor Market.” In Handbook of Labor Economics, Volume 3, Part B, edited by Orley C. Ashenfelter and David Card. Amsterdam: North-Holland. Ozimek, Adam, and John Lettieri. 2020. “How to Rescue Main Street from Corona- virus before It’s Too Late.” Blog post, March 18, Economic Innovation Group. https://eig.org/news/main-street-rescue-and-resiliency-program. Strain, Michael R. 2020. The Paycheck Protection Program: An Introduction. Washington: American Enterprise Institute. https://www.aei.org/research-products/ report/the-paycheck-protection-program-an-introduction/. US Small Business Administration, Office of Advocacy. 2019. “What’s New with Small Business?” Infographic. Washington: US Small Business Administration. https://cdn.advocacy.sba.gov/wp-content/uploads/2019/09/23172859/Whats- New-With-Small-Business-2019.pdf. 379 Comment and Discussion COMMENT BY ERIC ZWICK Hubbard and Strain offer a clear and comprehensive assessment of the initial months of the Paycheck Protection Program (PPP). My comment has two goals. First, I want to place the PPP into a framework for evaluating the welfare effects of such programs. Second, I want to place this analysis in the context of what we know from contemporaneous work about whether the PPP succeeded. While I agree with the authors that it is too soon to provide a complete grade of the PPP, we know enough now to offer a provisional assessment that can guide ongoing policy debates and future research on the program. GRADING THE PPP: A RUBRIC What kind of policy is the PPP? Many popu- lar commentators have described the program as fiscal stimulus, but this view is mistaken. The goal of the PPP was not to increase economic activity immediately. In fact, if the initial crisis response was aimed at suppressing the virus by reducing public interactions, the goal may well have been the opposite: to encourage everyone to stay home to slow the virus’s spread while supporting workers and firms during the lockdown. Thus, the goal of the PPP was more to enable future economic activity— by preserving firm-worker links and preventing permanent failures—than to stimulate immediately. Hubbard and Strain are right to point out that in this case we should not use metrics like cost per job or fiscal impact multi- pliers to grade the program. One might alternatively think of the program as support for capital markets in the spirit of liquidity support programs aimed at the financial system, which were pursued by the Federal Reserve and the Treasury both during this crisis and during the Great Recession. Again, this is not the right way to view the PPP. In particular, the lender-of-last-resort motivation for policy intervention is not the right model when output evaporates and 380 Brookings Papers on Economic Activity, Fall 2020 there are real losses. In this world, loans are unattractive from a private and public perspective because repayment is nonviable for many firms despite having positive long-term prospects.1 In such a case, and in stark contrast to the Great Recession, banks may be more unwilling than unable to lend to firms that were hard hit by the crisis. In my view, the closest policy analogy to the current situation is disaster relief and insurance. Firms face a severe noneconomic shock that entails an unusually low correlation between their short-run and long-run per formance. If these firms close, society will risk losing valuable firm-worker matches, fixed startup costs already paid, and sweat equity already accu- mulated. At the aggregate level, there is risk that congestion exter- nalities in bankruptcy courts and in the labor market could exacerbate economic losses. In all of these respects, the pandemic is similar to a large storm that devastates a local area, though this time the devastation is geographically widespread, of uncertain duration, and wrought with lost revenues instead of lost capital. Still, I believe that conceptualizing the PPP as a kind of social insurance program helps to illuminate the framework we ought to use to evaluate design and implementation. REVENUE REPLACEMENT VERSUS BUSINESS CONTINUITY INSURANCE An impor- tant part of the paper is a discussion of the key design elements of a busi- ness support program. If we think of the PPP as insurance, then we can fruitfully debate these elements in terms of their insurance value beyond being mere transfers. Let me contrast some of the authors’ preferred design elements to our business continuity insurance proposal (Hanson and others 2020a), which was itself inspired by Hubbard and Strain’s earlier writing on the program and by Emmanuel Saez and Gabriel Zucman’s buyer of last resort proposal (Saez and Zucman 2020). First is the question of what expenses to permit. The authors argue for including payroll in the category of eligible expenses to be covered by the PPP. Supporting payroll might help firms retain workers, thereby preserving valuable firm-worker matches. It also might keep workers from claiming unemployment insurance (UI) at a time when the risk of overwhelmed UI systems is a concern. Both arguments amplify the insurance value of the program. 1. Hanson and others (2020b) argue why it makes more sense to think of the govern- ment’s role as “venture capitalist of last resort,” that is, as needing to take on significant credit risk in this crisis. COMMENT and DISCUSSION 381 Nevertheless, I have several concerns with this element. First, including payroll dramatically raises the cost of the program, thus limiting the amount of time firms might be able to benefit from additional funds. Second, many of the hardest hit firms were bars and restaurants in the service sector, for which high rates of turnover in normal times imply the value of firm- worker matches might be low. Third, it is somewhat unnatural to expect firms to pay workers to be idle, when accounting and payroll systems are based on hours worked and when many firms have some workers that can still work. Fourth, though there were plenty of hiccups in the initial rollout, the UI system actually worked pretty well in supporting more than 30 million workers! Last, as the authors note, including payroll deters reallocation of workers across firms and industries by subsidizing newly inefficient matches. The second design question concerns how to deploy PPP funds. The authors argue in favor of using banks as conduits to access the program. Preexisting relationships between banks and firms might accelerate the transfer of funds, and the underwriting infrastructure could help detect fraud. These arguments speak to the efficiency and timeliness of the pro- gram, both key aspects of good insurance. At the same time, because banks do not have the same incentives as the government, we have to pay them to participate. And banks might steer preferred clients in one direction and new clients in another. While true that many firms are connected to banks, there are many others without prior relationships or whose banks were themselves disrupted by the lock- down orders. My view is that the IRS could have been more involved in implementing this policy, given its track record for large-scale stimulus in other contexts (such as economic impact payments, refunds for net operating losses, or the first-time homebuyer credit). A third question concerns targeting. The authors argue that the program should feature little or no targeting. Their logic is that, given the unknown shock severity and duration, trying to narrow eligibility for the program in a sophisticated way would fall prey to lobbying by connected industries. They also worry that conditioning loan forgiveness on revenues might discourage firms from reopening by subjecting them to high marginal tax rates. Here, viewing the program through the lens of insurance is especially instructive. Providing little or no targeting is both expensive and by defini- tion allocates funds to low-insurance-value types. To the extent there is a budget constraint at the federal level (which is debatable these days), we are now in a position where benefits have been exhausted though help is still needed. Moreover, it will surely strike many as unfair that firms that 382 Brookings Papers on Economic Activity, Fall 2020 were able to continue operating, or that operated in defiance of best public health practices, received the same level of support as those that tempo- rarily closed. I should note that we agree on many design features and general prin- ciples. For example, though the authors describe their proposal as “revenue replacement,” it is better thought of as “net value added” replacement. In other words, we agree to exclude profits, intermediates, and depreciation in the list of eligible expenses. More fundamentally, we agree that the loans should be closer to grants. We also agree that placing the demands solely on the Small Business Administration (SBA) to implement this program would not have made sense, given the agency’s size and the infrastructure in place prior to the crisis.2 And we agree that the largest firms should be treated less generously. The bottom line in this discussion is that this area deserves more formal study. Economics has a natural opportunity to contribute in this time of crisis by improving our understanding of the optimal features of business support policy. DID FUNDS GO TO HIGH-INSURANCE-VALUE TYPES? Ideally, we would grade the PPP in terms of insurance value provided relative to the program’s cost, but defining the notion of insurance value for firms is beyond the scope of my discussion. As a first pass, let’s consider what we know about program targeting and how firms used the funds. Judged by its timeliness, the program receives high marks. More than $500 billion in funds were distributed in just six weeks! One reason why funds could be deployed so quickly is that nearly all firms could apply. As a consequence, the targeting of the program was poor. In work with João Granja, Christos Makridis, and Constantine Yannelis (Granja and others 2020), I found that more of the program’s initial funds actually flowed to regions that were less hard hit by the shock (figure 1, top panel). This distribution is to a large extent due to differences across lenders in their participation in the program. For example, the top four banks alone account for 36 percent of total pre-policy small business loans but disbursed less than 3 percent of all PPP loans in the first round of funding. Ultimately, we find a weak correlation between initial shock severity and funding levels, reflecting the program’s broad eligibility criteria (figure 1, bottom panel). 2. Recently, the SBA inspector general released a report finding that the “unprecedented demand for COVID-19 EIDLs [relief loans] and the equally unprecedented challenges SBA had in responding to this pandemic combined with lowered controls resulted in billions of dollars in potentially fraudulent loans and loans to potentially ineligible businesses” (SBA 2020, 2). COMMENT and DISCUSSION 383 0.25 0.30 0.35 Share of businesses shut down during 03/22 to 03/28 (pre-PPP) Least PPP/Est 2 3 4 5 6 7 8 9 Most PPP/Est B. Rounds 1 and 2 Quantile of PPP loans relative to all establishments (both rounds) Quantile of PPP loans relative to all establishments (round 1) A. Round 1 0.25 0.30 0.35 Share of businesses shut down during 03/22 to 03/28 (pre-PPP) Least PPP/Est 2 3 4 5 6 7 8 9 Most PPP/Est Source: Granja and others (2020). Notes: The figure stratifies all businesses in Homebase in ten bins based on the fraction of establishments in their zip code receiving PPP during the first round and during both rounds combined. The figure plots for each bin the share of Homebase businesses that shut down in the week of March 22–March 28, that is, prior to the PPP. Figure 1. Weak Geographic Targeting of the PPP 384 Brookings Papers on Economic Activity, Fall 2020 Additional evidence on targeting and design elements comes from firm surveys (Alekseev and others 2020). Drawing on data from a large survey of business owners on Facebook, Alekseev and others (2020) find that 30–40 percent of small businesses did not experience sales declines in the first month of the crisis. Among the businesses that did experience declines, the severity of the decline varies widely from declines of 10–20 percent to nearly complete shutdowns. Moreover, only half of firms surveyed reported struggling to pay obligated expenses (though presumably this share increased over time). Such heterogeneity in experiences is at odds with the one-size-fits-all design of the program’s forgiveness formula. The evidence also points to other issues with the PPP’s rollout. First, firms that do report struggling to make payments appear to struggle equally to pay rent, wages, and interest on loans. This fact suggests the initial weight of 75 percent on payroll expenses was likely too high. Second, half of firms report not having preexisting relationships with banks as borrowers (Alekseev and others 2020), which appears to have led to such firms initially struggling to access the program and eventually switching lenders in order to receive funds (Rudegeair 2020). Data from the SBA show that, across participating banks, larger firms received funding first, and many smaller borrowers had to wait several months to access the program (Granja and others 2020). WHAT DID FIRMS DO WITH THE MONEY? The authors focus on a second approach to evaluating the PPP’s success to date. They use data from Dun & Bradstreet and a series of research designs to evaluate the impact of the program on employment, financial performance, and business closures. Their most compelling research design exploits the eligibility threshold of 500 workers; with some exceptions, firms above this threshold could not apply for PPP loans, providing a natural control group. The authors find modest but statistically significant effects on employ- ment that appear to grow over the six-month period their data cover. These employment effects are largely consistent with Autor and others (2020) and Chetty and others (2020), who use the same research design and data from different payroll processors. Using a bank exposure design at the regional level, Granja and others (2020) find null effects of the program in April that grow to modest effects in May and June. Across studies, the results appear to imply very high cost-per-job estimates (about $200,000 per job), though recall this metric is probably the wrong way to evaluate this program. The authors find modest impacts of the program in reducing financial vulnerability and business closures. These findings contrast somewhat with Granja and others (2020), who find no impact on business shutdowns and COMMENT and DISCUSSION 385 large effects on firms’ reported cash on hand and propensity to miss obli- gated loan and other payments. On the other hand, Bartik and others (2020) use a bank exposure design and find that the PPP had large effects on firms’ own forecasts of failure probabilities. Reconciling these contrasting find- ings is a task for future research, as more data become available. I do have a few concerns with the authors’ approach. First, in some analyses, they report differences that compare loan applicants to non applicants. These differences will tend to overstate program impacts because they do not isolate loan demand effects, which are likely to be correlated with business expenditure plans. For these reasons, I prefer estimates using the worker threshold as an instrument. Second, the aggregate time series in the Dun & Bradstreet data are extremely stable and indicate very limited aggregate impact of the pan demic and lockdowns on firms in the sample. These patterns stand in sharp contrast to pretty much every other real-time data set available, in which employment appears to fall by between 20 and 60 percent depend- ing on the sample of interest. I worry that the patterns in the Dun & Bradstreet data are an artifact of stale or incomplete measurement and updating. Moreover, if such measurement issues are more pronounced for small firms, this problem will confound estimates that compare firms across size thresholds. My bet is the Dun & Bradstreet data will ultimately be more useful for evaluating the question of permanent closures, once data are comprehensively updated. PENCILS DOWN The ultimate grade for the PPP will depend on the medium- term impacts that have yet to materialize. We see modest short-term employ- ment effects but more significant improvement in firm balance sheets. The PPP’s success will hinge on whether the cost of limited targeting is ulti- mately offset by the gains from preventing a large number of firm failures. If instead a large share of the funds prove inframarginal, the economic inci- dence of the program will fall largely on business owners, many of whom would have been able to weather the storm without this support. REFERENCES FOR THE ZWICK COMMENT Alekseev, Georgij, Safaa Amer, Manasa Gopal, Theresa Kuchler, J. W. Schneider, Johannes Stroebel, and Nils C. Wernerfelt. 2020. “The Effects of COVID-19 on U.S. Small Businesses: Evidence from Owners, Managers, and Employees.” Working Paper 27833. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber.org/papers/w27833. 386 Brookings Papers on Economic Activity, Fall 2020 Autor, David, David Cho, Leland D. Crane, Mita Goldar, Byron Lutz, Joshua Montes, William B. Peterman, David Ratner, Daniel Villar, and Ahu Yildirmaz. 2020. “An Evaluation of the Paycheck Protection Program Using Administra- tive Payroll Microdata.” Working Paper. Cambridge, Mass.: Massachusetts Insti- tute of Technology. https://economics.mit.edu/files/20094. Bartik, Alexander W., Zoe B. Cullen, Edward L. Glaeser, Michael Luca, Christopher T. Stanton, and Adi Sunderam. 2020. “The Targeting and Impact of Paycheck Protection Program Loans to Small Businesses.” Working Paper 27623. Cam- bridge, Mass.: National Bureau of Economic Research. https://www.nber.org/ papers/w27623. Chetty, Raj, John N. Friedman, Nathaniel Hendren, Michael Stepner, and Oppor- tunity Insights Team. 2020. “How Did COVID-19 and Stabilization Policies Affect Spending and Employment? A New Real-Time Economic Tracker Based on Private Sector Data.” Working Paper 27431. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber.org/papers/w27431. Granja, João, Christos Makridis, Constantine Yannelis, and Eric Zwick. 2020. “Did the Paycheck Protection Program Hit the Target?” Working Paper 27095. Cambridge, Mass.: National Bureau of Economic Research. https://www.nber. org/papers/w27095. Hanson, Samuel G., Jeremy C. Stein, Adi Sunderam, and Eric Zwick. 2020a. “Business Continuity Insurance: Keeping America’s Lights on during the Pandemic.” Working Paper. Boston: Harvard Business School. https://www. igmchicago.org/wp-content/uploads/2020/04/Business-Continuity-Insurance- 20200408-FINAL.pdf. Hanson, Samuel G., Jeremy C. Stein, Adi Sunderam, and Eric Zwick. 2020b. “Business Credit Programs in the Pandemic Era.” In the present volume of Brookings Papers on Economic Activity. Rudegeair, Peter. 2020. “When Their PPP Loans Didn’t Come Through, These Busi- nesses Broke Up with Their Banks.” Wall Street Journal, July 31. https://www. wsj.com/articles/when-their-ppp-loans-didnt-come-through-these-businesses- broke-up-with-their-banks-11596205736. Saez, Emmanuel, and Gabriel Zucman. 2020. “Keeping Business Alive: The Gov- ernment Will Pay.” Research Brief. Economics for Inclusive Prosperity. https:// econfip.org/wp-content/uploads/2020/03/20.Keeping-Businesses-Alive.pdf. US Small Business Administration, Office of the Inspector General (SBA). 2020. Inspection of Small Business Administration’s Initial Disaster Assistance Response to the Coronavirus Pandemic. Report no. 21-02, October 28. https:// www.sba.gov/sites/default/files/2020-10/SBA%20OIG%20Report%2021-02.pdf. GENERAL DISCUSSION Caroline Hoxby began the discussion by thanking the authors for a terrific paper and Eric Zwick for his excellent discussion. She agreed with Zwick’s concern that the Dun & Bradstreet data used in the paper are not very sensitive and are infrequently updated COMMENT and DISCUSSION 387 in comparison to other monthly sources of data. Hoxby then remarked that the specification in column 5 of tables 4 through 6, which compare firms with 400 to 475 employees to firms with 525 to 600 employees, was most persuasive because the control group and treatment group are similar and therefore most comparable. Her concern, however, was that the results for this specification showed very little. Hoxby closed her comments by lamenting that the eligibility threshold was 500 employees because that doesn’t allow the authors to identify the effects on very small firms, such as restaurants and small family businesses. She wondered whether any eligi- bility or identification strategy would allow the authors to look specifically at very small firms. Joshua Gotbaum asked, via the teleconferencing chat function, whether shifting the program from a wage subsidy to a revenue subsidy made the distributional effects of the Paycheck Protection Program (PPP) regressive, at least in comparison to the European programs. Gabriel Chodorow-Reich thanked the authors and the discussant and followed up on Zwick’s question regarding what firms did with the PPP money. He described his ongoing research with Darmouni, Luck, and Plosser that finds midsize firms were making large repayments on credit lines in the second quarter of 2020, which may be tied to PPP receipt.1 Chodorow-Reich wondered whether the authors’ view of the program’s success might be affected if it is true that the same businesses who were getting PPP loans were paying down credit lines. Jason Furman stated that he would like to see the employment impact of the PPP in December before gauging the PPP’s success. He noted that workers could have been given unemployment insurance (UI), which would have saved the firms the cost of their employment. Furthermore, assuming employment is determined by comparing the marginal cost of hiring someone to the firms’ marginal revenue product, then the PPP from earlier in the year will have no effect on employment in December. Furman stated that the effects the authors found could have been achieved more cheaply and efficiently through UI. For the PPP to have a lasting effect, he argued, it would need to keep some firms from going bankrupt such that the firm is employing more people in December than they otherwise would have. He concluded that whether a firm is hiring someone in December 1. Gabriel Chodorow-Reich, Olivier Darmouni, Stephan Luck, and Matthew C. Plosser, “Bank Liquidity Provision across the Firm Size Distribution,” Working Paper 27945 (Cambridge, Mass.: National Bureau of Economic Research, 2020). 388 Brookings Papers on Economic Activity, Fall 2020 is more likely to relate to the firm’s demand than whether they received a lump sum transfer many months earlier. Austan Goolsbee praised the authors’ work but cautioned them on the potential confounds correlated with size. He described recent work with Syverson using phone data of consumer visits to millions of businesses which finds a strong trend of people shopping at smaller, less busy stores correlated with the rise of the pandemic.2 Goolsbee noted that, given the paper’s use of size to separate treatment and control groups, this would confound the result of the paper; it may look like PPP is benefiting smaller firms when in fact this is an unobserved effect related to increases in rela- tive demand. Goolsbee concluded by offering to share the phone record data with the authors and suggesting they might be able to match some firms in their sample. Steven Davis began by following up on Furman’s point regarding the cost of the PPP program relative to other systems of distributing support to workers. He restated that the cost per worker of using the PPP to support workers is much larger than it would have been through the UI system. He asked whether the PPP was better than UI at preserving worker-firm matches in some way, and if so in what way. Relatedly, he pointed out that it’s not clear that retaining worker-firm matches is valuable given the kinds of employees who work for PPP-targeted firms. Davis noted that the displaced worker literature largely focuses on mass layoff events affecting high-tenure workers at large firms, typically in industrial jobs. He con- trasted this with the jobs lost in the pandemic, which he argued are very different, involving much less match-specific capital and match-specific rents than workers studied in the displaced worker literature. Davis went on to note that he knows little about the value of business continuity for the population targeted by the PPP. He suggested that if there is great evidence that business continuity is of high value beyond the value to the business owner, the discussion should emphasize this. Davis also wondered if the PPP, by sustaining incumbent firms, crowds out new firms. He noted that the Census Bureau now draws on administrative records to tabulate monthly business formation statistics by state and by industry. He suggested it would be interesting to use these data to investigate whether industries and states that received more PPP support show evidence of crowding-out effects in the form of weaker business formation. 2. Austan Goolsbee and Chad Syverson, “Fear, Lockdown, and Diversion: Comparing Drivers of Pandemic Economic Decline,” Working Paper 27432 (Cambridge, Mass.: National Bureau of Economic Research, 2020). COMMENT and DISCUSSION 389 Davis concluded by noting that the PPP, the $600 federal benefit supple- ment, and other recent expensive fiscal programs have been motivated by the need to compensate for administrative weaknesses in the UI system. To that end, he wondered what the cost of fixing the administrative weaknesses would be and posited it might cost a few tens of billions of dollars, which is much less than the trillion dollars spent on the current programs. Davis remarked that this would likely belong in a separate paper from the authors’ current one. Katharine Abraham seconded Davis’s point regarding the administrative capacity of the UI system, noting that the system infrastructure is fragile and inflexible. She lamented that many states’ UI systems still use COBOL software and many more couldn’t easily be modified to pay workers a higher replacement rate rather than a flat supplement to their benefit amount. Abraham then followed up on Furman’s and Davis’s comments stating that it would have been cheaper to allow individuals to be laid off and get UI than to keep them attached to their jobs through the PPP. Besides the value of business continuity and increasing the likelihood of workers still being employed in December, she stated, there is also value in reducing unemployment. Even beyond the associated loss of income, unemployment imposes significant mental and physical costs on affected individuals. Abraham argued that the value of the PPP thus includes the value to workers of having a job, even if the job eventually ends. She concluded that this should affect how the authors consider the policy’s effectiveness. Glenn Hubbard thanked the discussant and the audience for their ques- tions. In response to the comments regarding alternatives to the PPP, he reiterated that the value of worker-firm matches and business continuity is still unknown, making it difficult to decide whether it would have been better to put people on UI, irrespective of the UI system’s administrative deficiencies. Hubbard then agreed that the authors hoped to find an effect using the specification Hoxby noted she most preferred, found in column 5 of the results tables. Hubbard added that the authors suspect this specification did not show any significant results because this specification focuses on rela- tively larger firms and the effects are mostly found in much smaller firms. Hubbard concluded by addressing a question in the teleconferencing chat function regarding targeting. Hubbard noted that it would have been preferable to know exactly who could have been helped because that would have been more efficient, but there is no way to know. Given that the value of worker-firm matches and business continuity are also unknown, Hubbard stated that it isn’t obvious what the alternatives to the PPP were. 390 Brookings Papers on Economic Activity, Fall 2020 Michael Strain also thanked the discussant and audience for their com- ments. He then noted that the authors attempted to evaluate the program empirically, using specifications with different treatment and control groups, using treatment-on-the-treated effects and intent-to-treat effects. One such specification, he notes, is comparing only firms with one to 250 employees, using loan application as the treatment. Strain argued that this specification addresses some of the concerns about comparing firms with one to 500 employees to firms with 501 to 1,000 employees. However, he also acknowledged that their data only show firms that applied for a loan greater than $150,000, which muddles the control group. Strain added that there could also be issues with comparing groups based on eligibility because the PPP likely affected firms with 450 employees very differently from firms with 15 employees. The authors attempted to navigate these empirical challenges accordingly, he said. Strain then turned to Furman and others’ point regarding alternatives to the PPP. He stated that part of the program’s goal was to preserve the pro- ductive capacity of the economy over the medium term until the pandemic had subsided. Moreover, the program was promoted as an employment pro- gram which would make comparisons to UI natural, but he argued it was more along the lines of a continuity program for businesses. For example, a restaurant might survive the economic downturn due to the PPP, Strain said. He added that it’s reasonable to believe that the PPP loan doesn’t affect how many workers the restaurant hires in nine months; however, the con- clusion shouldn’t be that the PPP failed, he argued, because the business survived. Perhaps without the revenue replacement the restaurant received from the grant the business otherwise wouldn’t be there at all, he said. Strain concluded that when comparing the costs of the PPP to UI, it is crucial to consider whether the period of economic weakness was shorter because the PPP supported labor demand over the medium term during the transition by averting millions of business closures that otherwise would have happened. He noted that while this is difficult to quantify, comparing UI costs to the PPP would need to account for these concerns holistically.
File and source
- File
- Hubbard-Strain_Brookings-BPEA_has-ppp-succeeded.pdf
- Size
- 336,403 bytes
- SHA-256
- 87b0fe1c748a5a5a8af78adb26668bf6ac050bb50ce289016e3598c7b709ee78
- Original
- www.brookings.edu