j40-cejst-2/.github/workflows
Matt Bowen d5fbb802e8
Add FUDS ETL (#1817)
* Add spatial join method (#1871)

Since we'll need to figure out the tracts for a large number of points
in future tickets, add a utility to handle grabbing the tract geometries
and adding tract data to a point dataset.

* Add FUDS, also jupyter lab (#1871)

* Add YAML configs for FUDS (#1871)

* Allow input geoid to be optional (#1871)

* Add FUDS ETL, tests, test-datae noteobook (#1871)

This adds the ETL class for Formerly Used Defense Sites (FUDS). This is
different from most other ETLs since these FUDS are not provided by
tract, but instead by geographic point, so we need to assign FUDS to
tracts and then do calculations from there.

* Floats -> Ints, as I intended (#1871)

* Floats -> Ints, as I intended (#1871)

* Formatting fixes (#1871)

* Add test false positive GEOIDs (#1871)

* Add gdal binaries (#1871)

* Refactor pandas code to be more idiomatic (#1871)

Per Emma, the more pandas-y way of doing my counts is using np.where to
add the values i need, then groupby and size. It is definitely more
compact, and also I think more correct!

* Update configs per Emma suggestions (#1871)

* Type fixed! (#1871)

* Remove spurious import from vscode (#1871)

* Snapshot update after changing col name (#1871)

* Move up GDAL (#1871)

* Adjust geojson strategy (#1871)

* Try running census separately first (#1871)

* Fix import order (#1871)

* Cleanup cache strategy (#1871)

* Download census data from S3 instead of re-calculating (#1871)

* Clarify pandas code per Emma (#1871)
2022-08-16 13:28:39 -04:00
..
closed_be_pr.yml rm backend staging folder 2022-02-17 17:36:48 -05:00
closed_fe_pr.yml Github Actions for Staging Backend (#1281) 2022-02-16 16:40:25 -05:00
codeql-analysis.yml Release of improve census tract display info (#1480) 2022-03-29 19:49:57 -07:00
combine-tilefy.yml PyPi Packaging of Data Pipeline (#1464) 2022-03-21 18:55:15 -04:00
compile_mermaid.yml Fix broken YML links and add PR template (#1340) 2022-02-25 11:39:38 -08:00
data-checks.yml NRI dataset and initial score YAML configuration (#1534) 2022-08-09 16:37:10 -04:00
deploy_be_staging.yml Add FUDS ETL (#1817) 2022-08-16 13:28:39 -04:00
deploy_fe_main.yml Marshmallow Schemas for YAML files (#1497) 2022-03-31 13:56:10 -04:00
deploy_fe_staging.yml Update Cypress GHA to v4 (#1768) 2022-07-26 10:59:12 -07:00
e2e.yml Fix broken YML links and add PR template (#1340) 2022-02-25 11:39:38 -08:00
generate-census.yml Update generate-census.yml 2021-11-30 13:49:21 -05:00
generate-score.yml Update generate-score.yml 2022-04-27 10:49:56 -04:00
main.yml Update main.yml (#704) 2021-09-17 10:06:59 -04:00
markdown-link-check.yml Run markdown link checker only on markdown changes (#1117) 2022-01-12 13:01:52 -05:00
README.md Update documentation to make it easier for users to find the right content for them (#1016) 2021-12-16 10:16:28 -05:00
refresh-be-cdn.yml Modify data tile server to static URL to fix CORS (#1512) 2022-03-30 13:44:58 -07:00
tribal-deploy.yml Starting Tribal Boundaries Work (#1736) 2022-07-30 01:13:10 -04:00

Justice40 Github Actions Workflows

This directory has the github actions workflows for the Justice40 Project.

This project is deployed on an AWS account managed by GeoPlatform.gov, and github actions is used to automate the data pipeline and all deployment steps.

The names of the Github Actions stages in the yaml files should describe what each step does, so it is best to refer there to understand the latest of what everything is doing.

To mitigate the risk of having this README quickly become outdated as the project evolves, avoid documenting anything application or data pipeline specific here. Instead, go back up to the top level project README and refer to the documentation on those components directly.