* Consolidate esri codebook data into main codebook, and write that instead of the esri codebook with the shapefile
* Format and fix any issues from linter
* Remove final reference to columns.csv
* Add more info to logging for geo-score
* Add a rough prototype allowing a developer to pre-download data sources for all ETLs
* Update code to be more production-ish
* Move fetch to Extract part of ETL
* Create a downloader to house all downloading operations
* Remove unnecessary "name" in data source
* Format source files with black
* Fix issues from pylint and get the tests working with the new folder structure
* Clean up files with black
* Fix unzip test
* Add caching notes to README
* Fix tests (linting and case sensitivity bug)
* Address PR comments and add API keys for census where missing
* Merging comparator changes from main into this branch for the sake of the PR
* Add note on using cache (-u) during pipeline
* ipython notebook to debug greenspace indicator
* changing greenspace and income to just greenspace
* fixing greenspace indicator to not include low income
* Update greenspace_indicator.ipynb
* running tox checks
* update score narwhal to pass smoke test (fix donut threshold)
---------
Co-authored-by: Travis Newby <travis.b.newby@omb.eop.gov>
* Update code owners to include new folks and remove the departed ones
* Update maintainers to reflect the current personnel
* Update contributing with the latest, and make small changes to readme to make it easier to read
* Update maintainers with Lucas Brown
* Update installation guide to refine instructions and make them easier to follow
* Try emojis to make notes stand out more
* Experiment with note
* Moved installation of data pipeline into a new file (contents TBD), and redid most part of the data pipeline README for clarity and readability
* Add mermaid diagram
* Fix table
* Update readme for clarity and correctness
* Update TOC
* Fix comparator doc
* Add section on internal score comparison
* Move tox information from installation to testing
* Update installation for data pipeline
* Add emojis to make picking out platform-specific instructions easier
* Fix Git caps
* Update for readability
* Add direct link to VS Code instructions
* Fix broken link and improve readability
* Update installation for clarity and proper case
* Update python text
* Clean up information about poetry and poetry lockfiles
* Remove duplicate paragraph
* Fix case
* update date table
* re-adjust table to put links at the end
* Fix a few minor typos
---------
Co-authored-by: Sam Powers <121890478+sampowers-usds@users.noreply.github.com>
* Add ability to perform score comparisons, and include that ability in github action
* Update version of add-pr-comment
* Update code with black
* Update comparator.py
* Fix message-path and remove extra parameter
* Update the text to be a bit more friendly and easy to read
Update logging messages and message consistency
This update includes changes to the level of many log messages. Rather than everything being logged at the info level, it differentiates between debug, info, warning, and error messages. It also changes the default log level to info to avoid much of the noise previously in the logs.
It also removes many extra log messages, and adds additional decorators at the beginning of each pipeline run.
Two zip files were not getting cleared prior to running geo score. This was resulting in them growing between runs until the application ground to a halt. This fix clears those two zip files before geo score and before the full run.
