Why measurement is harder than it sounds
Saying that a regeneration scheme “worked” means comparing what happened with what would have happened without it. The second part cannot be observed, so every measure is an approximation. Even so, a handful of indicators are widely used, and understanding what each shows and hides helps readers judge claims of success.
Jobs and employment
Jobs are the most common headline measure. Typical figures include jobs created on site, jobs supported elsewhere, and the share held by local residents.
What to watch for:
- Gross versus net. Counting every job in a new building overstates the effect if the employers simply moved from nearby. Net figures subtract jobs displaced from elsewhere and jobs that would have appeared anyway.
- Construction versus permanent work. Building jobs end when the building does.
- Job quality. Pay, hours and stability matter as much as counts.
- Who gets them. A rise in jobs in an area does not mean residents hold them. Resident employment rates and incomes tell a different story from jobs located in the area.
Vacancy and occupancy
Vacancy rates for storefronts, offices and housing are intuitive signals. A falling vacancy rate suggests renewed demand. Counting needs care, because definitions differ: what counts as vacant, whether buildings under renovation count, and how often the survey is repeated. Systematic vacancy surveys help by applying one method over time.
Vacancy can mislead in both directions. Low vacancy may reflect rising rents that squeeze out weaker tenants only to leave different users. High vacancy during a transition may be temporary and tell little about long-run outcomes.
Property values and rents
Rising property values are often treated as the clearest sign of success, partly because they are easy to find. Sale prices, assessed values and rents all show how the market values the area. Because property appraisal rests on estimates, assessed values can lag behind actual sales.
The weakness is that a rise in value is not the same as a benefit to residents. Owners gain, while tenants may face higher costs. A rising price is partly a sign of success and partly a sign of who may find the area unaffordable. For that reason, evaluators often track rents and housing costs alongside values, since the link between renewal and rents is central to who benefits.
Public revenue
Changes in property tax receipts, sales tax and business license income show the fiscal effect. These matter for judging whether a project repays public spending. The difficulty is attribution: revenue may have grown for citywide reasons, and some of it may be revenue moved from other parts of the city.
Business activity
Counts of new businesses, closures, sales and survival rates describe the commercial side. A high opening rate with high closures may signal churn rather than health. Looking at whether older, locally rooted businesses survive can show whether the benefits are broad.
Resident outcomes
Income, poverty rates, educational attainment and health are harder to link to a single project, but they speak to whether people are better off. Population turnover complicates this: if lower-income households leave and higher-income households arrive, area averages improve while no original resident is better off. Following the same households over time, where data allow, is more informative. Broader measures such as resident wellbeing sit alongside the economic ones.
Building a sound evaluation
Good measurement tends to share certain features.
- A baseline. Record conditions before work starts. Without it, “improvement” has no reference point.
- A comparison area. Track a similar area that did not receive the project. If both rise together, the project may deserve little credit.
- Several indicators. No single measure captures a place, so a mix of jobs, vacancy, values, revenue and resident outcomes is safer.
- A realistic time horizon. Many effects take years. Very early results can be encouraging or discouraging for reasons unrelated to the long term.
- Clear definitions and consistent methods. Changing definitions mid-stream makes trends meaningless.
- Stated goals up front. If a project’s goal was local employment, then property values alone do not measure it.
This is the thinking behind project evaluation after a scheme opens, and behind well-designed planning indicators generally.
The limits of indicators
Indicators are proxies. They can be gamed, as when a project is judged by jobs and so counts temporary placements. They can also crowd out what is hard to measure, such as a sense of belonging or the survival of a community. A dashboard that is easy to read may be less informative than a few careful studies.
A good habit is to ask what each indicator leaves out. If a report celebrates rising values, ask about rents. If it celebrates new jobs, ask who holds them. If it celebrates falling vacancy, ask about who was displaced to get there.
Takeaway
Regeneration metrics are useful tools, but none gives a verdict alone. The most credible assessments use several indicators, compare against a baseline and a similar area, state their uncertainty and look at who gained as well as how much. Where a claim of success relies on a single number, it is reasonable to treat it with caution.