Skip to content

JCMenchi/immotep

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

62 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data collection

Pour les données de base DVF https://www.data.gouv.fr/fr/datasets/demandes-de-valeurs-foncieres/

Pour le geocodage: https://www.data.gouv.fr/fr/datasets/base-adresse-nationale/

Pour le code postaux manquants https://www.data.gouv.fr/fr/datasets/base-officielle-des-codes-postaux/

Pour les lignes haute tension https://opendata.reseaux-energies.fr/explore/dataset/lignes-aeriennes-rte/information/?disjunctive.etat&disjunctive.tension

Pour les limites departements et ville https://geo.api.gouv.fr/decoupage-administratif/communes

https://geo.api.gouv.fr/communes?lat=48.838052499999996&lon=2.7151414&fields=code,nom,codesPostaux,surface,population,centre,contour

Get all regions curl 'https://geo.api.gouv.fr/regions' Get all dep for a region curl 'https://geo.api.gouv.fr/regions/{regioncode}/departement' Get all communes for a departement curl 'https://geo.api.gouv.fr/departements/{depcode}/communes?fields=center'

curl 'https://geo.api.gouv.fr/communes/{codecommune}?fields=code,nom,contour'

GCP

Mount gcloud storage inside VM

See doc https://cloud.google.com/storage/docs/gcsfuse-quickstart-mount-bucket

export GCSFUSE_REPO=gcsfuse-lsb_release -c -s echo "deb https://packages.cloud.google.com/apt $GCSFUSE_REPO main" | sudo tee /etc/apt/sources.list.d/gcsfuse.list curl https://packages.cloud.google.com/apt/doc/apt-key.gpg | sudo apt-key add - sudo apt-get update sudo apt-get install fuse gcsfuse

Confirm that Cloud Storage FUSE has been installed:

gcsfuse -v

gcsfuse version 0.41.12 (Go version go1.18.4)

Mount bucket mkdir ${HOME}/data alias s3mount='gcsfuse im-test-storage ${HOME}/data'

query to fill postgis column

WITH rsubquery AS (SELECT code, ST_GeomFromGeoJSON(contour::json->>'geometry') as imp FROM regions) UPDATE regions SET geom=rsubquery.imp FROM rsubquery WHERE regions.code=rsubquery.code;

WITH csubquery AS (SELECT code, ST_GeomFromGeoJSON(contour::json->>'geometry') as imp FROM cities) UPDATE cities SET geom=csubquery.imp FROM csubquery WHERE cities.code=csubquery.code;

WITH dsubquery AS (SELECT code, ST_GeomFromGeoJSON(contour::json->>'geometry') as imp FROM departments) UPDATE departments SET geom=dsubquery.imp FROM dsubquery WHERE departments.code=dsubquery.code;

select in bbox

SELECT name, zip_code, ST_AsText(ST_Boundary(geom)) FROM cities WHERE ST_MakeEnvelope(4.8, 45, 4.9, 46, 4326) && geom ;

About

Data science lab

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published