← All sections

Technical development note

Postman Data Pipelines

Technical issues and development needs for the three data pipelines currently being pulled through Postman / API workflows.

ONS Data
Demographic and socio-economic baseline for personas and Places Scores.

Currently pulled

Population, age structure, median age, population density, ethnicity, employment, employment by industry, key workers, deprivation score and households with children.

Current issue

Output relies on older Census 2011 indicators. Some fields needed for stronger persona development and Places Scores are missing or underdeveloped, including housing tenure, accommodation type, health and disability indicators, wellbeing indicators, income or income proxy, detailed household composition, and housing affordability indicators.

Why it matters

The platform needs the most recent reliable ONS data; especially Census 2021; when producing local profiles and persona inputs. Outdated values weaken the evidence base for both persona creation and the Places Scores taxonomy.

Improvement needed

Update the ONS data pull so it prioritises Census 2021 and other latest available ONS sources. Add a verification layer to confirm data is being pulled for the correct local authority geography and not from a wider county or neighbouring district. Refresh outdated values with Census 2021 data, especially population, ethnicity, median age and age structure, and add newer or more suitable Census 2021 variables into the taxonomy where available.

Expected output

A refreshed ONS pipeline that feeds both resident persona creation and the Places Scores taxonomy with current, geographically accurate data. Missing, unavailable or non-comparable indicators should be clearly flagged rather than filled with unsupported values.

IMD Scores
Deprivation mapping for local area comparison over time.

Currently pulled

2019 Indices of Multiple Deprivation data at LSOA level, mapped or aggregated into wards.

Current issue

IMD is published at LSOA level, which is smaller than ward level. The pipeline currently uses 2019 IMD and has not yet incorporated the newly published 2025 IMD data.

Why it matters

For the platform to show deprivation at a more usable local geography, LSOA-level data needs to be mapped or aggregated into wards. The platform requirement also includes comparison over time, so the system needs to support comparison between 2019 and 2025 deprivation scores.

Improvement needed

Extend the pipeline beyond 2019 and add the newly published 2025 IMD data. Keep the existing LSOA-to-ward mapping system as part of the backend workflow. Carefully handle boundary changes and flag any unmatched or non-comparable areas.

Expected output

An improved IMD pipeline that shows whether areas appear to have improved, declined or remained broadly stable between 2019 and 2025, while making clear that IMD is not annual data but a comparison between official snapshot years.

Places Scores
Local profiling taxonomy derived from ONS indicators.

Currently pulled

ONS-derived indicators including country of birth, economic activity status, general health, highest qualification level, hours worked, occupation, English proficiency for non-native speakers, unpaid care, socio-economic classification, household tenure and accommodation type.

Current issue

The taxonomy still relies on Census 2011 data. The scoring logic, weighting or category mapping may need adjustment if Census 2021 uses different classifications or provides better replacement indicators.

Why it matters

The underlying data needs to be updated and verified against Census 2021 and latest ONS sources. Presenting outdated 2011-based scores as current would undermine the reliability of local profiling.

Improvement needed

Update the data source behind the Places Scores and review whether the existing taxonomy still matches the newer Census 2021 variables. Adjust scoring logic, weighting or category mapping where Census 2021 uses different classifications or provides better replacement indicators.

Expected output

An updated Places Scores pipeline that uses current data, clearly flags unavailable or non-comparable indicators, and avoids presenting outdated 2011-based scores as current.

This page documents technical development needs. It does not contain final report content.