Tile-baking columns with floating rounds completed (#491)

* Tile-baking columns with floating rounds completed

* completed

* correction on github workflow

* tiles folder no longer needed

* addressed comments

* updating requirements.txt

* poetry lock update

* adding xlswriter

* final poetrylock

* updated requirements.txt

* checkpoint

* removed matplotlib

* ignoring pylint too many statements

* reinstated too many statements

* converting data sync to generate score GHA UI-driven
This commit is contained in:
Jorge Escobar 2021-08-10 15:28:50 -04:00 committed by GitHub
commit 3d8dbb293c
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
8 changed files with 311 additions and 209 deletions

View file

@ -1,11 +1,11 @@
name: Deploy Data
name: Generate Score
on:
push:
paths:
- 'data/data-pipeline/*'
pull_request:
paths:
- 'data/data-pipeline/*'
workflow_dispatch:
inputs:
confirm-action:
description: This will rebuild the data sources and regenerate the score, are you sure you want to proceed? (Y/n)
default: n
required: true
jobs:
deploy_data:
@ -49,7 +49,9 @@ jobs:
aws-region: us-east-1
- name: Deploy to Geoplatform AWS
run: |
aws s3 sync ./data_pipeline/data/ s3://justice40-data/data-pipeline/data --delete
aws s3 sync ./data_pipeline/data/dataset/ s3://justice40-data/data-pipeline/data/dataset --delete
aws s3 sync ./data_pipeline/data/score/csv/ s3://justice40-data/data-pipeline/data/score/csv --delete
aws s3 sync ./data_pipeline/data/score/downloadable/ s3://justice40-data/data-pipeline/data/score/downloadable --delete
- name: Update PR with Comment about deployment
uses: mshick/add-pr-comment@v1
with:
@ -57,4 +59,4 @@ jobs:
Data Synced! Find it here: s3://justice40-data/data-pipeline/data/
repo-token: ${{ secrets.GITHUB_TOKEN }}
repo-token-user-login: 'github-actions[bot]' # The user.login for temporary GitHub tokens
allow-repeats: false # This is the default
allow-repeats: false # This is the default