j40-cejst-2/data/data-pipeline/data_pipeline/etl/score
Matt Bowen 49623e4da0
Add abandoned mine lands data (#1824)
* Add notebook to generate test data (#1780)

* Add Abandoned Mine Land data (#1780)

Using a similar structure but simpler apporach compared to FUDs, add an
indicator for whether a tract has an abandonded mine.

* Adding some detail to dataset readmes

Just a thought!

* Apply feedback from revieiw (#1780)

* Fixup bad string that broke test (#1780)

* Update a string that I should have renamed (#1780)

* Reduce number of threads to reduce memory pressure (#1780)

* Try not running geo data (#1780)

* Run the high-memory sets separately (#1780)

* Actually deduplicate (#1780)

* Add flag for memory intensive ETLs (#1780)

* Document new flag for datasets (#1780)

* Add flag for new datasets fro rebase (#1780)

Co-authored-by: Emma Nechamkin <97977170+emma-nechamkin@users.noreply.github.com>
2022-08-17 11:33:59 -04:00
..
config Add abandoned mine lands data (#1824) 2022-08-17 11:33:59 -04:00
schemas Add FUDS ETL (#1817) 2022-08-16 13:28:39 -04:00
tests Adding first street foundation data (#1823) 2022-08-17 10:14:23 -04:00
__init__.py Data directory should adopt standard Poetry-suggested python package structure (#457) 2021-08-05 15:35:54 -04:00
constants.py Adding first street foundation data (#1823) 2022-08-17 10:14:23 -04:00
etl_score.py Adding first street foundation data (#1823) 2022-08-17 10:14:23 -04:00
etl_score_geo.py updated to fix linting errors (#1818) 2022-08-11 16:34:56 -04:00
etl_score_post.py Do not drop Guam and USVI from ETL (#1681) 2022-08-11 12:33:46 -04:00
etl_utils.py Creating a data dictionary for the download packet (#1469) 2022-03-30 11:01:43 -04:00