Efficiency, surplus and market failure

The supply and demand model predicts prices and quantities. But economists also want to evaluate outcomes: is the market result good, and could a different allocation make people better off? This branch of economics is called welfare economics. Its central tools are consumer surplus and producer surplus, which measure the benefits buyers and sellers receive from participating in a market. With these tools we can show why competitive markets, under certain conditions, produce an efficient outcome, and we can measure precisely the losses caused by taxes, price controls, monopoly and pollution in the lessons that follow. We will also see why efficiency is not the only thing that matters, and where markets fail.

Willingness to pay and consumer surplus

Each buyer has a maximum price she is willing to pay for a good, her willingness to pay, which reflects how much she values it. If the market price is below her willingness to pay, she buys and gains the difference. Consumer surplus is the difference between what buyers are willing to pay and what they actually pay, summed over all units bought. Imagine four fans who would pay $200, $150, $120 and $90 for a concert ticket. If tickets sell for $100, the first three buy and receive surpluses of $100, $50 and $20, a total consumer surplus of $170; the fourth fan does not buy.

Because the demand curve shows the willingness to pay of the marginal buyer at each quantity, consumer surplus is the area below the demand curve and above the price, up to the quantity bought. When the price falls, consumer surplus rises for two reasons: existing buyers pay less, and new buyers enter the market. When the price rises, consumer surplus falls.

Cost and producer surplus

Each seller has a minimum price at which she is willing to sell, which reflects her cost of production, including the opportunity cost of her time and resources. Producer surplus is the difference between the price sellers receive and their cost, summed over all units sold. Because the supply curve shows the cost of the marginal seller at each quantity, producer surplus is the area above the supply curve and below the price. Producer surplus is closely related to, but not identical to, profit: it ignores fixed costs, which do not affect the decision to sell an extra unit.

Market efficiency

An allocation of resources is efficient if it maximizes total surplus: there is no way to rearrange production and consumption to make someone better off without making someone else worse off, a condition called Pareto efficiency after the Italian economist Vilfredo Pareto. The competitive equilibrium has three remarkable properties. First, it allocates the good to the buyers who value it most, those whose willingness to pay exceeds the price. Second, it allocates production to the sellers who can produce at the lowest cost, those whose cost is below the price. Third, it produces the quantity that maximizes total surplus: at any smaller quantity, some buyers value an extra unit more than it costs to produce, so producing it would add surplus; at any larger quantity, the extra units cost more to produce than buyers value them.

This is a modern statement of Adam Smith's famous observation that individuals pursuing their own interest are 'led by an invisible hand' to promote the interest of society. It is one of the most important results in economics, and it underlies the general presumption among economists that markets should be left to work unless there is a specific reason to intervene. But the result depends on conditions that do not always hold, as we will see shortly.

# Total surplus is largest at the competitive quantity (coffee example)
a, b = 140, 5      # demand Qd = a - bP  -> willingness to pay P = (a - Q) / b
c, d = -20, 5      # supply Qs = c + dP  -> marginal cost  P = (Q - c) / d
def wtp(q): return (a - q) / b
def mc(q):  return (q - c) / d
def total_surplus(q, steps=6000):
    # integrate (WTP - MC) from 0 to q with the midpoint rule
    h = q / steps
    return sum((wtp((i + 0.5) * h) - mc((i + 0.5) * h)) * h for i in range(steps))
for q in [40, 50, 60, 70, 80]:
    print(f"Q = {q} thousand kg: total surplus = ${total_surplus(q) * 1000:,.0f} per week")

Q = 40 thousand kg: total surplus = $640,000 per week
Q = 50 thousand kg: total surplus = $700,000 per week
Q = 60 thousand kg: total surplus = $720,000 per week
Q = 70 thousand kg: total surplus = $700,000 per week
Q = 80 thousand kg: total surplus = $640,000 per week

The code confirms that total surplus peaks at the equilibrium quantity of 60 thousand kg. Producing only 40 or 50 thousand kg leaves mutually beneficial trades unmade; producing 70 or 80 thousand kg uses resources worth more than buyers value the extra coffee. The loss of total surplus relative to the efficient level is called deadweight loss, and lesson 6 uses it to measure the cost of taxes and price controls.

Efficiency and equity

Efficiency concerns the size of the economic pie; equity concerns how fairly it is divided. A competitive market may be efficient while leaving some people with very little, because the market distributes goods according to willingness to pay, which depends on income. A wealthy person's willingness to pay for a second home may exceed a poor family's willingness to pay for basic housing. Most people think that fairness matters, and judgments about what is fair are normative, as lesson 1 explained. Different principles lead to different answers: some emphasize equal outcomes, some equal opportunity, some rewards based on contribution, and some the protection of the least well off, as in the philosopher John Rawls's theory of justice.

Economists often argue that it is better to pursue equity through taxes and transfers than by interfering with prices in particular markets. Interventions in prices, such as rent control, tend to reduce the size of the pie and can be poorly targeted, helping some people who are not poor while hurting some who are. Taxes and transfers also have efficiency costs, because taxes discourage work and investment to some degree, so there is a trade-off between efficiency and equity. How much efficiency a society should sacrifice for greater equality is one of the central questions of politics, and economics can inform it but not settle it.

In the United States, the tax and transfer system also reduces measured income inequality, though by less than in most other high-income countries. Programs such as Social Security, Medicaid, the Supplemental Nutrition Assistance Program (SNAP), the Earned Income Tax Credit and the Child Tax Credit transfer income mainly to lower-income and older households, while the federal income tax is progressive. Census Bureau and Congressional Budget Office data show that the Gini coefficient of market income is much higher than that of income after taxes and transfers. ECON-102 examines income distribution and these programs in more detail.

When markets fail

The efficiency of competitive markets rests on several conditions. When one or more fails, the market outcome may not maximize total surplus, a situation called market failure. There are four main sources of market failure, each of which we study later in the course.

Information problems deserve a brief introduction here. George Akerlof's 1970 paper 'The Market for Lemons' showed that when sellers of used cars know more about quality than buyers, buyers will offer only an average price; owners of good cars then withdraw from the market, the average quality falls, and the market can unravel. This is called adverse selection. A related problem is moral hazard: once insured, people may take less care, because they no longer bear the full cost of accidents. Warranties, reputations, inspections, certification, deductibles and mandatory insurance are among the private and public responses. Market failure does not automatically justify government intervention, because governments can fail too, through poor information, political pressure, regulatory capture by the industries they regulate, or unintended consequences. The practical question is always whether a particular intervention is likely to improve on the imperfect market outcome.

The limits of surplus analysis

Surplus analysis has limitations that a careful economist acknowledges. It treats a dollar of surplus the same whoever receives it, though a dollar may matter more to a poor person than a rich one. It measures value by willingness to pay, which reflects people's preferences as they are, including preferences that may be poorly informed or that people themselves regret, such as addictions. And it values things that are not traded, such as clean air or cultural heritage, only if we can estimate willingness to pay indirectly. Behavioral economics, which we touch on in lesson 7, has documented systematic departures from the rational choices that surplus analysis assumes. None of this makes the tools useless; it means they should be used with judgment and combined with other considerations.