j40-cejst-2/data/data-pipeline/data_pipeline
Jorge Escobar 7b05ee9c76
S3 Parallel Upload and Deletions (#1410)
* installation step

* trigger action

* installing to home dir

* dry-run

* pyenv

* py 2.8

* trying s4cmd

* removing pyenv

* poetry s4cmd

* num-threads

* public read

* poetry cache

* s4cmd all around

* poetry cache

* poetry cache

* install poetry packages

* poetry echo

* let's do this

* s4cmd install on run

* s4cmd

* ad aws back

* add aws back

* testing census api key and poetry caching

* census api key

* census api

* census api key #3

* 250

* poetry update

* poetry change

* check census api key

* force flag

* update score gen and tilefy; remove cached fips

* small gdal update

* invalidation

* missing cache ids
2022-03-17 23:19:23 -04:00
..
content/config Updating higher education to be reversed (#1387) 2022-03-15 16:43:32 -04:00
data Creating shapefiles for ArcGIS users (#1275) 2022-02-24 10:32:49 -05:00
etl S3 Parallel Upload and Deletions (#1410) 2022-03-17 23:19:23 -04:00
files 548-update-pdf (#1081) 2021-12-21 14:12:20 -05:00
ipython FEMA data check (#1270) 2022-02-17 16:53:04 -05:00
score Updating higher education to be reversed (#1387) 2022-03-15 16:43:32 -04:00
tests Quick fix: updating snapshots to have more sigfigs (#1409) 2022-03-14 21:44:35 -04:00
tile Prototype G (#672) 2021-09-14 10:48:11 -04:00
__init__.py Data directory should adopt standard Poetry-suggested python package structure (#457) 2021-08-05 15:35:54 -04:00
application.py Reducing Docker start up and adding ArcGIS URL (#1386) 2022-03-09 08:55:17 -05:00
config.py Data directory should adopt standard Poetry-suggested python package structure (#457) 2021-08-05 15:35:54 -04:00
utils.py YAML Config for Downloadable Assets (#1252) 2022-03-04 15:02:09 -05:00