7 commits

Author	SHA1	Message	Date
Jorge Escobar	1c448a77f9	NRI dataset and initial score YAML configuration (#1534) ... * update be staging gha * NRI dataset and initial score YAML configuration * checkpoint * adding data checks for release branch * passing tests * adding INPUT_EXTRACTED_FILE_NAME to base class * lint * columns to keep and tests * update be staging gha * checkpoint * update be staging gha * NRI dataset and initial score YAML configuration * checkpoint * adding data checks for release branch * passing tests * adding INPUT_EXTRACTED_FILE_NAME to base class * lint * columns to keep and tests * checkpoint * PR Review * renoving source url * tests * stop execution of ETL if there's a YAML schema issue * update be staging gha * adding source url as class var again * clean up * force cache bust * gha cache bust * dynamically set score vars from YAML * docsctrings * removing last updated year - optional reverse percentile * passing tests * sort order * column ordening * PR review * class level vars * Updating DatasetsConfig * fix pylint errors * moving metadata hint back to code Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>	2022-08-09 16:37:10 -04:00
Jorge Escobar	dd723b6c19	PyPi Packaging of Data Pipeline (#1464) ... * PyPi Packaging of Data Pipeline * package rename * adding python version * trigger data checks * print env vars * python version 2 * trigger data check * python version 3 * update caching for other GHAs	2022-03-21 18:55:15 -04:00
Katherine D. Mlika	68c882b3de	updating column E label to "Identified as disadvantaged" (#1406) ... * updating column E label to "Identified as disadvantaged" * passing tests * adding cached poetry flow * working dir Co-authored-by: Jorge Escobar <jorge.e.escobar@omb.eop.gov>	2022-03-18 14:50:03 -04:00
Jorge Escobar	1d399d3ca9	Tox Security Fix (#1242) ... * checkpoint * safety ignore * update python matrix for data checks * downloading census once	2022-02-03 17:05:51 -05:00
Jorge Escobar	ac746741ea	disabling data checks on non-data folders (#532)	2021-08-16 15:12:58 -04:00
Jorge Escobar	d259d97ba9	adding layer to mvts (#503) ... * adding layer to mvts * small fix for GHA	2021-08-12 10:56:54 -04:00
Billy Daly	55dabb2b57	Issue 379 tox setup (#405) ... * Adds tox as a dev dependency to data/data-pipeline/pyproject.toml: Also updates poetry.lock and requirements.txt * Adds tox.ini to test build of data/data-pipeline * Sets up GitHub actions workflow for data/ directory * Tries to get Data Checks GitHub action to run * Fixes error with GitHub action * Migrates data/data-roadmap from setuptools to poetry * Sets up tox file for data/data-roadmap * Adds github action for data/data-roadmap * Fixes syntax error in data-checks.yml * Second attempt at fixing data-checks.yml * Export poetry requirements to requirements.txt * Revert "Migrates data/data-roadmap from setuptools to poetry" This reverts commit e8367652d43c1c9beee500f792c8f41e1c1fc462. * Removes pyproject.toml and reverts requirements.txt as well	2021-07-29 14:00:20 -04:00