j40-cejst-2/data
Travis Newby 6f39033dde
Add ability to cache ETL data sources (#2169)
* Add a rough prototype allowing a developer to pre-download data sources for all ETLs

* Update code to be more production-ish

* Move fetch to Extract part of ETL
* Create a downloader to house all downloading operations
* Remove unnecessary "name" in data source

* Format source files with black

* Fix issues from pylint and get the tests working with the new folder structure

* Clean up files with black

* Fix unzip test

* Add caching notes to README

* Fix tests (linting and case sensitivity bug)

* Address PR comments and add API keys for census where missing

* Merging comparator changes from main into this branch for the sake of the PR

* Add note on using cache (-u) during pipeline
2023-03-03 12:26:24 -06:00
..
data-pipeline Add ability to cache ETL data sources (#2169) 2023-03-03 12:26:24 -06:00
data-serve dockerize front-end and pass env vars to npm build (#614) 2021-09-07 10:35:11 -07:00
__init__.py Issue 1075: Add refactored ETL tests to NRI (#1088) 2022-02-08 19:05:32 -05:00