Commit graph

6 commits

Author SHA1 Message Date
Jorge Escobar
842312f69f
ETL Classes for Data Sets (#260)
* first commit

* checkpoint

* checkpoint

* first extract module 🎉

* completed census acs etl class

* completed ejscreen etl

* completed etl

* score generation ready

* improving census load and separation

* score generation working 🎉

* completed etls

* new score generation

* PR reviews

* run specific etl; starting docstrings

* docstrings work

* more docstrings

* completed docstrings

* adding pyenv version

* more reasonable poetry req for python

* PR comments
2021-07-12 15:50:44 -04:00
Lucas Merrill Brown
11d13e034e
Comparison tool refactor & ETL HUD RECAP (#272)
* Refactoring comparison tool and creating two new ETL notebooks
2021-07-06 12:10:58 -05:00
Jorge Escobar
67c73dde2a
Modularization + Poetry + Docker (#213)
* reorg

* added configuration management; initial click cmds

* reset dirs completed

* major modularization effort

* prepping mbtiles

* first round of PR review updates

* round 2 of feedback review

* checkpoint

* habemus dockerfile 🎉

* updated dock-er-compose with long running container

* census generation works

* logging working

* updated README

* updated README

* last small update to README

* added instructions for log visualization

* census etl update for reusable fips module

* ejscreem etl updated

* further modularization

* score modularization

* tmp cleanup
2021-06-28 16:16:14 -04:00
Lucas Merrill Brown
589ec483e3
Ingest census data directly, add unemployment to the score (#214)
* Ingest two data sources and add to score

Co-authored-by: Jorge Escobar <jorge.e.escobar@omb.eop.gov>
2021-06-24 14:11:07 -07:00
Lucas Merrill Brown
a2a321d93d
Score comparison tool, first draft (#140) 2021-06-22 11:57:59 -04:00
Jorge Escobar
6f568b0e20
Setup Census Block Group download and GeoJSON encoding (#122)
* initial commit

* checkpoint

* census block group downloader complete

* checkpoint

* docker command for ogr2ogr

* detecting OS and downloaded fiels

* generate mbtiles

* per state and national csv

* removing testing correction

* generating uncompressed mvt

* completed ticket

* final changes from code review
2021-06-15 16:36:49 -04:00