5 commits

Author	SHA1	Message	Date
Carlos Felix	d4898b8f55	Improve download retry logic	2025-01-13 09:34:16 -05:00
ericiwamoto	7af92f575b	Add retry logic to downloader	2024-12-27 13:28:28 -05:00
Carlos Felix	3e087a37a4	Fix linter and dependency issues	2024-12-04 21:28:56 -05:00
Carlos Felix	ff9e7b9aa2	Changes to allow local runs	2024-12-04 21:28:51 -05:00
Travis Newby	6f39033dde	Add ability to cache ETL data sources (#2169) ... * Add a rough prototype allowing a developer to pre-download data sources for all ETLs * Update code to be more production-ish * Move fetch to Extract part of ETL * Create a downloader to house all downloading operations * Remove unnecessary "name" in data source * Format source files with black * Fix issues from pylint and get the tests working with the new folder structure * Clean up files with black * Fix unzip test * Add caching notes to README * Fix tests (linting and case sensitivity bug) * Address PR comments and add API keys for census where missing * Merging comparator changes from main into this branch for the sake of the PR * Add note on using cache (-u) during pipeline	2023-03-03 12:26:24 -06:00