Technical development note
Postman Data Pipelines
Technical issues and development needs for the three data pipelines currently being pulled through Postman / API workflows.
Currently pulled
Population, age structure, median age, population density, ethnicity, employment, employment by industry, key workers, deprivation score and households with children.
Current issue
Output relies on older Census 2011 indicators. Some fields needed for stronger persona development and Places Scores are missing or underdeveloped, including housing tenure, accommodation type, health and disability indicators, wellbeing indicators, income or income proxy, detailed household composition, and housing affordability indicators.
Why it matters
The platform needs the most recent reliable ONS data; especially Census 2021; when producing local profiles and persona inputs. Outdated values weaken the evidence base for both persona creation and the Places Scores taxonomy.
Improvement needed
Update the ONS data pull so it prioritises Census 2021 and other latest available ONS sources. Add a verification layer to confirm data is being pulled for the correct local authority geography and not from a wider county or neighbouring district. Refresh outdated values with Census 2021 data, especially population, ethnicity, median age and age structure, and add newer or more suitable Census 2021 variables into the taxonomy where available.
Expected output
A refreshed ONS pipeline that feeds both resident persona creation and the Places Scores taxonomy with current, geographically accurate data. Missing, unavailable or non-comparable indicators should be clearly flagged rather than filled with unsupported values.
Currently pulled
2019 Indices of Multiple Deprivation data at LSOA level, mapped or aggregated into wards.
Current issue
IMD is published at LSOA level, which is smaller than ward level. The pipeline currently uses 2019 IMD and has not yet incorporated the newly published 2025 IMD data.
Why it matters
For the platform to show deprivation at a more usable local geography, LSOA-level data needs to be mapped or aggregated into wards. The platform requirement also includes comparison over time, so the system needs to support comparison between 2019 and 2025 deprivation scores.
Improvement needed
Extend the pipeline beyond 2019 and add the newly published 2025 IMD data. Keep the existing LSOA-to-ward mapping system as part of the backend workflow. Carefully handle boundary changes and flag any unmatched or non-comparable areas.
Expected output
An improved IMD pipeline that shows whether areas appear to have improved, declined or remained broadly stable between 2019 and 2025, while making clear that IMD is not annual data but a comparison between official snapshot years.
Currently pulled
ONS-derived indicators including country of birth, economic activity status, general health, highest qualification level, hours worked, occupation, English proficiency for non-native speakers, unpaid care, socio-economic classification, household tenure and accommodation type.
Current issue
The taxonomy still relies on Census 2011 data. The scoring logic, weighting or category mapping may need adjustment if Census 2021 uses different classifications or provides better replacement indicators.
Why it matters
The underlying data needs to be updated and verified against Census 2021 and latest ONS sources. Presenting outdated 2011-based scores as current would undermine the reliability of local profiling.
Improvement needed
Update the data source behind the Places Scores and review whether the existing taxonomy still matches the newer Census 2021 variables. Adjust scoring logic, weighting or category mapping where Census 2021 uses different classifications or provides better replacement indicators.
Expected output
An updated Places Scores pipeline that uses current data, clearly flags unavailable or non-comparable indicators, and avoids presenting outdated 2011-based scores as current.
This page documents technical development needs. It does not contain final report content.