j40-cejst-2/data/data-pipeline/data_pipeline/etl
Jorge Escobar 1c448a77f9
NRI dataset and initial score YAML configuration (#1534)
* update be staging gha

* NRI dataset and initial score YAML configuration

* checkpoint

* adding data checks for release branch

* passing tests

* adding INPUT_EXTRACTED_FILE_NAME to base class

* lint

* columns to keep and tests

* update be staging gha

* checkpoint

* update be staging gha

* NRI dataset and initial score YAML configuration

* checkpoint

* adding data checks for release branch

* passing tests

* adding INPUT_EXTRACTED_FILE_NAME to base class

* lint

* columns to keep and tests

* checkpoint

* PR Review

* renoving source url

* tests

* stop execution of ETL if there's a YAML schema issue

* update be staging gha

* adding source url as class var again

* clean up

* force cache bust

* gha cache bust

* dynamically set score vars from YAML

* docsctrings

* removing last updated year - optional reverse percentile

* passing tests

* sort order

* column ordening

* PR review

* class level vars

* Updating DatasetsConfig

* fix pylint errors

* moving metadata hint back to code

Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>
2022-08-09 16:37:10 -04:00
..
score NRI dataset and initial score YAML configuration (#1534) 2022-08-09 16:37:10 -04:00
sources NRI dataset and initial score YAML configuration (#1534) 2022-08-09 16:37:10 -04:00
__init__.py Data directory should adopt standard Poetry-suggested python package structure (#457) 2021-08-05 15:35:54 -04:00
base.py NRI dataset and initial score YAML configuration (#1534) 2022-08-09 16:37:10 -04:00
constants.py Starting Tribal Boundaries Work (#1736) 2022-07-30 01:13:10 -04:00
runner.py Starting Tribal Boundaries Work (#1736) 2022-07-30 01:13:10 -04:00