Jorge Escobar
c19cd3ee55
hotfix on float cols ( #526 )
2021-08-13 15:48:31 -04:00
Vim
1dbb1018d6
sets column as percentiles ( #525 )
...
* sets column as percentiles
* adds trailing comma
2021-08-13 12:01:34 -07:00
Jorge Escobar
773c035493
AWS Sync Public Read ( #508 )
...
* adding layer to mvts
* small fix for GHA
* AWS Sync Public Read
* removed temp file
* updated state media income ftp
2021-08-12 14:17:25 -04:00
Jorge Escobar
6dc1283ee2
added comment
2021-08-10 15:37:36 -04:00
Jorge Escobar
3d8dbb293c
Tile-baking columns with floating rounds completed ( #491 )
...
* Tile-baking columns with floating rounds completed
* completed
* correction on github workflow
* tiles folder no longer needed
* addressed comments
* updating requirements.txt
* poetry lock update
* adding xlswriter
* final poetrylock
* updated requirements.txt
* checkpoint
* removed matplotlib
* ignoring pylint too many statements
* reinstated too many statements
* converting data sync to generate score GHA UI-driven
2021-08-10 15:28:50 -04:00
lucasmbrown-usds
ebe6180f7c
wip
2021-08-09 22:24:14 -05:00
lucasmbrown-usds
ce5e8c5351
including fraction of state AMI
2021-08-09 21:30:41 -05:00
lucasmbrown-usds
4ae7eff4c4
adding median income field and running black
2021-08-09 20:47:51 -05:00
Nat Hillard
9a9d5fdf7f
Backend change for Zipfile pt. 2 ( #469 )
...
* Fixes #303 : adding downloadable zip archive logic
* linter recommendations
* Pushes data directory to AWS. We'll want to move to use AWS for this ASAP, but this works for now
* updating pattern
2021-08-09 10:39:59 -04:00
Nat Hillard
ec19d86f6f
Adding back census to list of potential datasets, but separating out from standard list ( #484 )
...
Error this addresses:
File "/Users/lucas/Documents/usds/repos/justice40-tool/data/data-pipeline/data_pipeline/etl/runner.py", line 71, in etl_runner
f"data_pipeline.etl.sources.{dataset['module_dir']}.etl"
TypeError: 'NoneType' object is not subscriptable
2021-08-09 09:52:06 -04:00
Jorge Escobar
f51b0d69d9
Poetry updates for application ( #483 )
2021-08-06 16:24:30 -04:00
Nat Hillard
9d962eb5d9
Moving from relative imports to absolute to enable poetry run python data-pipeline/application.py [command] ( #476 )
2021-08-06 11:41:28 -04:00
Nat Hillard
45a8b1c026
Census ETL should use standard ETL form ( #474 )
...
* Fixes #473
Census ETL should use standard ETL form
* linter fixes
2021-08-06 11:01:51 -04:00
Nat Hillard
9f3b2f056b
Fixes #467 : ( #470 )
...
If the census download task is run more than once,
us.csv doubles in size and all data is removed from dataframe
2021-08-05 16:20:18 -04:00
Nat Hillard
c1568e87c0
Data directory should adopt standard Poetry-suggested python package structure ( #457 )
...
* Fixes #456 - Our data directory should adopt standard python package structure
* a few missed references
* updating readme
* updating requirements
* Running Black
* Fixes for flake8
* updating pylint
2021-08-05 15:35:54 -04:00
