j40-cejst-2/data/data-pipeline/data_pipeline/etl/sources
Lucas Merrill Brown aca226165c
Issue 1900: Tribal overlap with Census tracts (#1903)
* working notebook

* updating notebook

* wip

* fixing broken tests

* adding tribal overlap files

* WIP

* WIP

* WIP, calculated count and names

* working

* partial cleanup

* partial cleanup

* updating field names

* fixing bug

* removing pyogrio

* removing unused imports

* updating test fixtures to be more realistic

* cleaning up notebook

* fixing black

* fixing flake8 errors

* adding tox instructions

* updating etl_score

* suppressing warning

* Use projected CRSes, ignore geom types (#1900)

I looked into this a bit, and in general the geometry type mismatch
changes very little about the calculation; we have a mix of
multipolygons and polygons. The fastest thing to do is just not keep
geom type; I did some runs with it set to both True and False, and
they're the same within 9 digits of precision. Logically we just want to
overlaps, regardless of how the actual geometries are encoded between
the frames, so we can in this case ignore the geom types and feel OKAY.

I also moved to projected CRSes, since we are actually trying to do area
calculations and so like, we should. Again, the change is small in
magnitude but logically more sound.

* Readd CDC dataset config (#1900)

* adding comments to fips code

* delete unnecessary loggers

Co-authored-by: matt bowen <matthew.r.bowen@omb.eop.gov>
2022-09-20 14:53:12 -04:00
..
calenviroscreen Run ETL processes in parallel (#1253) 2022-02-11 14:04:53 -05:00
cdc_life_expectancy Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
cdc_places Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
cdc_svi_index Issue 1141: Definition M (#1151) 2022-01-18 14:56:55 -05:00
census Add FUDS ETL (#1817) 2022-08-16 13:28:39 -04:00
census_acs Score tests (#1847) 2022-08-26 15:23:20 -04:00
census_acs_2010 Run ETL processes in parallel (#1253) 2022-02-11 14:04:53 -05:00
census_acs_median_income Score tests (#1847) 2022-08-26 15:23:20 -04:00
census_decennial Score tests (#1847) 2022-08-26 15:23:20 -04:00
child_opportunity_index Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
doe_energy_burden Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
dot_travel_composite Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
eamlis Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
ejscreen Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
ejscreen_areas_of_concern Issue 838: Update comparison tool to use tracts (#934) 2021-11-30 18:46:29 -05:00
energy_definition_alternative_draft Run ETL processes in parallel (#1253) 2022-02-11 14:04:53 -05:00
epa_rsei Run ETL processes in parallel (#1253) 2022-02-11 14:04:53 -05:00
fsf_flood_risk Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
fsf_wildfire_risk Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
geocorr Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
historic_redlining Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
housing_and_transportation Run ETL processes in parallel (#1253) 2022-02-11 14:04:53 -05:00
hud_housing Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
hud_recap Score tests (#1847) 2022-08-26 15:23:20 -04:00
mapping_for_ej Run ETL processes in parallel (#1253) 2022-02-11 14:04:53 -05:00
mapping_inequality Adding HOLC indicator (#1579) 2022-08-11 12:33:46 -04:00
maryland_ejscreen Add a react component generator (#1745) 2022-07-15 09:54:58 -07:00
michigan_ejscreen Disable markdown check for link 2022-08-16 10:35:57 -07:00
national_risk_index Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
nlcd_nature_deprived Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
persistent_poverty Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
tree_equity_score Run ETL processes in parallel (#1253) 2022-02-11 14:04:53 -05:00
tribal Issue 1900: Tribal overlap with Census tracts (#1903) 2022-09-20 14:53:12 -04:00
tribal_overlap Issue 1900: Tribal overlap with Census tracts (#1903) 2022-09-20 14:53:12 -04:00
us_army_fuds Add tests for all non-census sources (#1899) 2022-09-19 15:17:00 -04:00
__init__.py Data directory should adopt standard Poetry-suggested python package structure (#457) 2021-08-05 15:35:54 -04:00
geo_utils.py Issue 1900: Tribal overlap with Census tracts (#1903) 2022-09-20 14:53:12 -04:00