Lucas Merrill Brown
65ceb7900f
Score F, testing methodology ( #510 )
...
* fixing dependency issue
* fixing more dependencies
* including fraction of state AMI
* wip
* nitpick whitespace
* etl working now
* wip on scoring
* fix rename error
* reducing metrics
* fixing score f
* fixing readme
* adding dependency
* passing tests;
* linting/black
* removing unnecessary sample
* fixing error
* adding verify flag on etl/base
Co-authored-by: Jorge Escobar <jorge.e.escobar@omb.eop.gov>
2021-08-24 16:40:54 -04:00
Jorge Escobar
773c035493
AWS Sync Public Read ( #508 )
...
* adding layer to mvts
* small fix for GHA
* AWS Sync Public Read
* removed temp file
* updated state media income ftp
2021-08-12 14:17:25 -04:00
lucasmbrown-usds
ce5e8c5351
including fraction of state AMI
2021-08-09 21:30:41 -05:00
lucasmbrown-usds
4ae7eff4c4
adding median income field and running black
2021-08-09 20:47:51 -05:00
Nat Hillard
ec19d86f6f
Adding back census to list of potential datasets, but separating out from standard list ( #484 )
...
Error this addresses:
File "/Users/lucas/Documents/usds/repos/justice40-tool/data/data-pipeline/data_pipeline/etl/runner.py", line 71, in etl_runner
f"data_pipeline.etl.sources.{dataset['module_dir']}.etl"
TypeError: 'NoneType' object is not subscriptable
2021-08-09 09:52:06 -04:00
Jorge Escobar
f51b0d69d9
Poetry updates for application ( #483 )
2021-08-06 16:24:30 -04:00
Nat Hillard
9d962eb5d9
Moving from relative imports to absolute to enable poetry run python data-pipeline/application.py [command] ( #476 )
2021-08-06 11:41:28 -04:00
Nat Hillard
45a8b1c026
Census ETL should use standard ETL form ( #474 )
...
* Fixes #473
Census ETL should use standard ETL form
* linter fixes
2021-08-06 11:01:51 -04:00
Nat Hillard
9f3b2f056b
Fixes #467 : ( #470 )
...
If the census download task is run more than once,
us.csv doubles in size and all data is removed from dataframe
2021-08-05 16:20:18 -04:00
Nat Hillard
c1568e87c0
Data directory should adopt standard Poetry-suggested python package structure ( #457 )
...
* Fixes #456 - Our data directory should adopt standard python package structure
* a few missed references
* updating readme
* updating requirements
* Running Black
* Fixes for flake8
* updating pylint
2021-08-05 15:35:54 -04:00
