Data Engineer
Il y a 2 jours
Job, Auvergne-Rhône-Alpes, France
GIS CareerHub
Temps plein
Gratuit avec email ou Google
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Gratuit avec email ou Google
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
corporate_fare
RiskPod
verifiedVerified Listing
Data Engineer
- Geospatial Data location_onUnited Kingdom (On-site) schedulePosted today workFull time bar_chartSenior CI/CDData QualityGeoJSONGeoPandasGeospatialGeospatial EngineeringGIS Data PipelinesGitPopulation analysisPythonQGISQuality ChecksShapelySpatial DataSQLUAV Data ProcessingWGS84
About The Role
Data Engineer – Demographic & Geospatial Data
About the Role
We are seeking a hands-on Data Engineer to build Databricks pipelines that combine demographic data with geographic reference data, delivering reliable, reconciled datasets for population analysis and service planning.
Key Responsibilities
Design and deploy pipelines using Databricks, Python, PySpark, SQL and Delta Lake Standardise postcodes and enrich records using NHS and ONS postcode products and ODS reference data Implement spatial joins and point-in-polygon matching, handling edge cases and multiple matches Version lookups and boundaries so historical outputs stay reproducible Automate data quality checks and reconcile counts before and after joins Optimise Spark and spatial processing as data volumes grow Apply access, pseudonymisation and disclosure controls to sensitive data Essential Skills Strong Databricks, Python, PySpark and SQL in production Geospatial engineering: CRS (BNG, WGS84), geometry validation, GeoJSON, WKT/WKB, GeoParquet Apache Sedona or native Databricks spatial functions Git, CI/CD, automated testing and clear communication with analysts Desirable NHS demographic or registration data; LSOAs, MSOAs, ICBs; UPRNs GeoPandas, Shapely or QGIS; regulated data environments domain RiskPod Leading-edge innovations and technical excellence in the geospatial domain.
About The Role
Data Engineer – Demographic & Geospatial Data
About the Role
We are seeking a hands-on Data Engineer to build Databricks pipelines that combine demographic data with geographic reference data, delivering reliable, reconciled datasets for population analysis and service planning.
Key Responsibilities
Design and deploy pipelines using Databricks, Python, PySpark, SQL and Delta Lake Standardise postcodes and enrich records using NHS and ONS postcode products and ODS reference data Implement spatial joins and point-in-polygon matching, handling edge cases and multiple matches Version lookups and boundaries so historical outputs stay reproducible Automate data quality checks and reconcile counts before and after joins Optimise Spark and spatial processing as data volumes grow Apply access, pseudonymisation and disclosure controls to sensitive data Essential Skills Strong Databricks, Python, PySpark and SQL in production Geospatial engineering: CRS (BNG, WGS84), geometry validation, GeoJSON, WKT/WKB, GeoParquet Apache Sedona or native Databricks spatial functions Git, CI/CD, automated testing and clear communication with analysts Desirable NHS demographic or registration data; LSOAs, MSOAs, ICBs; UPRNs GeoPandas, Shapely or QGIS; regulated data environments
- Geospatial Data location_onUnited Kingdom (On-site) schedulePosted today workFull time bar_chartSenior CI/CDData QualityGeoJSONGeoPandasGeospatialGeospatial EngineeringGIS Data PipelinesGitPopulation analysisPythonQGISQuality ChecksShapelySpatial DataSQLUAV Data ProcessingWGS84
About The Role
Data Engineer – Demographic & Geospatial Data
About the Role
We are seeking a hands-on Data Engineer to build Databricks pipelines that combine demographic data with geographic reference data, delivering reliable, reconciled datasets for population analysis and service planning.
Key Responsibilities
Design and deploy pipelines using Databricks, Python, PySpark, SQL and Delta Lake Standardise postcodes and enrich records using NHS and ONS postcode products and ODS reference data Implement spatial joins and point-in-polygon matching, handling edge cases and multiple matches Version lookups and boundaries so historical outputs stay reproducible Automate data quality checks and reconcile counts before and after joins Optimise Spark and spatial processing as data volumes grow Apply access, pseudonymisation and disclosure controls to sensitive data Essential Skills Strong Databricks, Python, PySpark and SQL in production Geospatial engineering: CRS (BNG, WGS84), geometry validation, GeoJSON, WKT/WKB, GeoParquet Apache Sedona or native Databricks spatial functions Git, CI/CD, automated testing and clear communication with analysts Desirable NHS demographic or registration data; LSOAs, MSOAs, ICBs; UPRNs GeoPandas, Shapely or QGIS; regulated data environments domain RiskPod Leading-edge innovations and technical excellence in the geospatial domain.
About The Role
Data Engineer – Demographic & Geospatial Data
About the Role
We are seeking a hands-on Data Engineer to build Databricks pipelines that combine demographic data with geographic reference data, delivering reliable, reconciled datasets for population analysis and service planning.
Key Responsibilities
Design and deploy pipelines using Databricks, Python, PySpark, SQL and Delta Lake Standardise postcodes and enrich records using NHS and ONS postcode products and ODS reference data Implement spatial joins and point-in-polygon matching, handling edge cases and multiple matches Version lookups and boundaries so historical outputs stay reproducible Automate data quality checks and reconcile counts before and after joins Optimise Spark and spatial processing as data volumes grow Apply access, pseudonymisation and disclosure controls to sensitive data Essential Skills Strong Databricks, Python, PySpark and SQL in production Geospatial engineering: CRS (BNG, WGS84), geometry validation, GeoJSON, WKT/WKB, GeoParquet Apache Sedona or native Databricks spatial functions Git, CI/CD, automated testing and clear communication with analysts Desirable NHS demographic or registration data; LSOAs, MSOAs, ICBs; UPRNs GeoPandas, Shapely or QGIS; regulated data environments