Commit graph

845 commits

Author SHA1 Message Date
Vim
6a18d59ba3
Update glossary.md (#224)
fixes #114
2021-06-30 07:13:59 -07:00
Lucas Scharenbroich
38fff9cea8
Fargate Serverless Workers for Census Data Enrichment and Tile Generation (#230)
* add basic infrastructure

* add cloudfront distribution

* WIP checkpoint

* add ecs cluster

* add conditions and route53 dns entry to cloudfront

* WIP checkin

* Added a raw execution mode for demo/testing

* Add pre-defined Task for ogr2ogr

* Tweak Task Definition name

* Mostly working except for logging error

* Add additional logging permissions

* Succesfully executed ogr2ogr in fargate.  S3 permissions needs to be addresses

* Add multipart permissions

* Add a few more actions

* Put IAM Policy on the correct resource

* Deploy lambda and update events

* fix iam permissions 🤦🏻‍♂️

* Add reference to Tippecanoe container

* Clean up to only use named actions

* Refactor resources to include support for tippecanoe

* Make a more interesting GDAL command

* Pull all ECS variables into environment file; successful test of running tippecanoe container

* Support pre/post commands

* Refactor codebase and enable linting

* Implement many-to-many enrichment between USDS CSV files and Census zipped shapefiles

* Change the GDAL image to one with the built-in drivers

* Add some additional fixes to support the enrichment use case

* Clean up old hello-world example

* Expand the README to include ways to execute the lambdas

* Validate scheduled lambda execution and then comment out

Co-authored-by: Tim Zwolak <timothypage@gmail.com>
2021-06-30 09:29:01 -04:00
Nat Hillard
92efc5c937
Zoom fade for higher zoom levels (#265) 2021-06-30 07:08:22 -04:00
Vim
f9ffe305b2
Update README.md
adds installation steps for app on MacOS
2021-06-29 14:33:03 -07:00
Lucas Merrill Brown
41e394972c
Scores D & E (#266)
* running black throughout

* adding housing

* hud housing etl working

* got score d and e working

* updating scoring comparison

* minor fixes

* small changes

* small comments
2021-06-29 11:20:23 -04:00
Jorge Escobar
67c73dde2a
Modularization + Poetry + Docker (#213)
* reorg

* added configuration management; initial click cmds

* reset dirs completed

* major modularization effort

* prepping mbtiles

* first round of PR review updates

* round 2 of feedback review

* checkpoint

* habemus dockerfile 🎉

* updated dock-er-compose with long running container

* census generation works

* logging working

* updated README

* updated README

* last small update to README

* added instructions for log visualization

* census etl update for reusable fips module

* ejscreem etl updated

* further modularization

* score modularization

* tmp cleanup
2021-06-28 16:16:14 -04:00
Nat Hillard
6f4087d247
Fix Github Actions deploy for merges to main
Addresses part of #125 - merges to main now go to a path with a `main` prefix
2021-06-28 10:59:08 -04:00
Lucas Merrill Brown
589ec483e3
Ingest census data directly, add unemployment to the score (#214)
* Ingest two data sources and add to score

Co-authored-by: Jorge Escobar <jorge.e.escobar@omb.eop.gov>
2021-06-24 14:11:07 -07:00
Nat Hillard
f12ab4d3b7
Issue 191 - Multi-state visualization (#226)
Addresses issue #191 - As a stakeholder interested in the cumulative impact score, I want to see more states in the map, so that I can further analyze the score results. Introduces gradient coloration on limited 5-state dataset as well as the core of a few key visual aspects of the map to be expanded upon later.
2021-06-24 13:20:45 -04:00
Nat Hillard
8b8314aeb3
Addresses #199 - removing non-functioning layer switcher for now (#212)
* Addresses #199 , but just the switcher part. Not functioning at the moment, we should remove to minimize confusion
* Adding comment
2021-06-23 13:31:03 -04:00
Nat Hillard
922740a4cb
Addresses #210, aside should not appear on map page (#211) 2021-06-23 12:47:31 -04:00
Lucas Merrill Brown
f542d0e675
"CalEnviroScreen for the US" example score (#204) 2021-06-22 20:09:53 -04:00
Lucas Merrill Brown
a2a321d93d
Score comparison tool, first draft (#140) 2021-06-22 11:57:59 -04:00
Shelby Switzer
b61d971f15
Add diagrams detailing our geo data pipeline (#170)
* Detailed flow for data inputs, census data, score creation, and geo
data generation (geoJSON and MVT)
* Include diagram showing vision for geoplatform ownership

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
2021-06-18 10:21:23 -04:00
Jorge Escobar
c8a7f81f7c
habemus score! 🎉 (#185)
* habemus score!

* etl process for score

* small typo

* adding in score percentiles

Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>
2021-06-18 10:16:19 -04:00
Shelby Switzer
b34c25bb21
Add community guidelines (#83)
* Add community guidelines

* Update community guidelines

* Fix typo
* Add superpower, because this is fun and we did it in community intros in our last chat

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
2021-06-18 09:18:48 -04:00
Jorge Escobar
78615e9b1a
ACS data baked in for map (#153)
* starting etl for score

* projection fix

* projection flags

* proper ejscreen etl csv generation

* failing CSV merge -- investigating

* checkpoint

* some etl changes

* completed ticket

* small typo
2021-06-17 18:12:39 -04:00
Gina Maini
eed9bd311d
Added readme information under /docs about building and prerequisites (#126)
Co-authored-by: Gina Maini <gina.maini@cms.hhs.gov>
2021-06-17 15:44:41 -04:00
TomNUSDS
e7ccd35aa6
Minimal refactor to make maps wider (#149)
Not particularly pretty, but it works.
2021-06-17 07:31:18 -07:00
Nat Hillard
a67b79a748
Adding ol-mapbox-style for easier styling (#148) 2021-06-17 09:28:37 -04:00
Nat Hillard
292c5bc8f5
CEJST Map (#139)
* styles prettier fix
* Addresses issue #100 from the frontend:
* Creates new cejst page and related OL components
* temporarily loads census-derived tileserver at higher zoom levels
* lays out cejst page : TODO :  remove aside
* temporarily removing license check - TODO: fix jsonlint
* review comments
2021-06-16 18:16:49 -04:00
Jorge Escobar
244b3663d1
Starting etl for score (#141)
* starting etl for score

* projection fix

* projection flags
2021-06-16 13:47:27 -04:00
Jorge Escobar
6f568b0e20
Setup Census Block Group download and GeoJSON encoding (#122)
* initial commit

* checkpoint

* census block group downloader complete

* checkpoint

* docker command for ogr2ogr

* detecting OS and downloaded fiels

* generate mbtiles

* per state and national csv

* removing testing correction

* generating uncompressed mvt

* completed ticket

* final changes from code review
2021-06-15 16:36:49 -04:00
TomNUSDS
9155326775
Make the accessibility checkers happy (#129)
* Make the accessibility checkers happy
* Include a lang specification in the `<html>` tag.
* reorder `<h#>` header tags.
The `<Aside` to from `<h1>`, `<h2>` to be `<h2>`, `<h3>`. This is because trusswork's `<Footer>` uses and `<h4>` and the accessibility checkers complain it was skipping from `<h2>` -> `<h4>`
* Change `<aria-details>` to `<aria-label>` for milestone list
* Update J40Header.tsx 80 column line
2021-06-14 19:35:35 -07:00
TomNUSDS
760edb4feb
Update global.scss (#127)
Fix some low-contrast accessibility issues for mobile menu.
2021-06-14 13:21:18 -07:00
TomNUSDS
3837538e51
Tomn usds/template8 (#118)
* Fix issues from #120
* Include USWDS scss into build.
  Allows us to do theme things. Compile time slower... Not sure if it's worth it since most items can be overridden in css and we can't theme the Navbar (e.g. invert colors).
* Update J40Footer.spec.tsx.snap
* Update gatsby-config.js
2021-06-14 11:06:23 -07:00
Nat Hillard
96fb0e8805
Documenting ADR Process ADR (#108)
* Adding ADR for updated project board-based ADR process. Issue here: https://github.com/usds/justice40-tool/issues/76
2021-06-14 12:44:25 -04:00
Nat Hillard
9ea0f946eb
Adding SHA (for PRs)/ Main (for main) to URL (#121)
* Fixes #90 - adds a GHA SHA to PR branches and 'main' for merges to main
2021-06-14 10:42:09 -04:00
Nat Hillard
7ab14c7f3d
Adding Simple URL-based feature flags (#117)
* Fixes #66: As a developer, I want to limit the audience
that sees new features, so that we can control
the message and positioning of our tool.
Implements simple feature flagging via URL parameters.
Provide "?flags=x,y,z" to enable flags x, y, and z.
* Fixing type to use Location instead of URL
* Updating README with info on how to use feature flags
2021-06-09 15:32:59 -04:00
Nat Hillard
c07a14a8db
Fixes issue #107 Geoplatform AWS throws errors on load - we had configured a prefix-path for use with github pages, but this didn't match the path within the s3 bucket. Upload content to a subfolder and ensure pusers access site from /justice40-tool/ (#115) 2021-06-08 10:44:56 -04:00
Jorge Escobar
cd06100925
Adding fork methodology to contributions (#106) 2021-06-07 12:23:31 -04:00
TomNUSDS
acfcf523a7
Add timeline page (#105)
* Add timeline page
* Factor out common aside into component.
* Update J40Footer.spec.tsx.snap
TODO: Get nav menu working.
2021-06-07 09:22:07 -07:00
Nat Hillard
13a5bd008e
Addresses issue #13 - adding workflow to deploy to Geoplatform AWS (#103) 2021-06-07 11:57:46 -04:00
TomNUSDS
63d33b40d0
More layout fixes (#94)
* More layout fixes
* Get aside flush with top/bottom
* Media change iconlist to one column on mobile
* Misc other fixes
* convert className to use React syntax consistently.
* Update J40Footer.spec.tsx.snap
TODO: body font need to be addressed at the theme level?
2021-06-04 07:36:16 -07:00
Nat Hillard
55d6e6635b
addresses issue #11 sub-item 'license checker' (#92) 2021-06-03 15:03:10 -04:00
Nat Hillard
dddd6d5e03
Warning Banner (#86)
* Addresses #78 - As a member of the public, I want to know that our site is a work in progress, so I can set appropriate expectations

* updating wording

* eslint changes

* package-lock updates

* Updating styling slightly and moving to top of page
2021-06-03 13:49:38 -04:00
TomNUSDS
f9ac170c6a
More tweaks from today's meeting (#87)
Just playing with layout.
- Inverted header
- updated snapshot
- adjusted column widths
- Update J40Footer.spec.tsx.snap
2021-06-02 18:34:21 -07:00
Nat Hillard
426f596c7a
Adding Cypress for e2e testing (#85)
* using the higher-level react-testing-library, and regenerating snapshot - renders real DOM elements
* Basic e2e testing with Cypress, following the guide here: https://www.gatsbyjs.com/docs/how-to/testing/end-to-end-testing/ ; needed to install cypress-local to avoid jest-cypress collision
* Adding accessibility testing support and basic a11y tests
* adding failure logging
* Adding nightly test run
* Fix misc stuff from lighthouse (#81)
* Removing local-cypress, relying instead on a combination
of type reference and eslint-plugin-cypress;
adding cypress to jest ignore paths to avoid conflict -
`npm test` is now jest-only, use `npm run test:e2e` to run cypress tests
* updating comment to clarify timezone
2021-06-02 20:53:22 -04:00
Jorge Escobar
7e6144c96f
Create .gitattributes (#89) 2021-06-02 18:08:11 -04:00
Nat Hillard
394260bbec
Splitting dev and prod dependencies, adding npm audit step to catch security vulnerabilities (#88) 2021-06-02 13:21:23 -04:00
TomNUSDS
9f3a030fd5
Fix misc stuff from lighthouse (#81)
* Fix misc stuff from lighthouse

- Icons in list were resizing to be too small.
- Added robots.txt (full exclude for now)
- Add favicon.ico placeholder
- Added page title using helmet (react-helmet + gatsby-plugin-react-helmet)
Note: not sure if react-helmet can be in dev section of package.json?

* Move helmet to header file
- Moved  `<Helmet><title>{title}</title></Helmet>` to Header.
- Added ts support for Helmet.
* Fix title header
2021-05-28 17:07:50 -07:00
Nat Hillard
cf3d14d3b1
Update MAINTAINERS.md
typo
2021-05-28 10:30:45 -04:00
Nat Hillard
668236ec6e
Update MAINTAINERS.md
Formatting MAINTAINERS file
2021-05-28 10:29:34 -04:00
Shelby Switzer
09a06aad56
Update README (#82)
* Update README

* Add info on Community channels (google group, chats)
* Restructure main section on background and core team

* Fix typos and add CODEOWNERS

* Rename CODEOWNERS to MAINTAINERS

This includes all team members, not just engineers, and we are already
tracking code owner engineers under .github/CODEOWNERS

* Add link to and explanation of CODEOWNERS

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
2021-05-28 10:23:29 -04:00
TomNUSDS
3ca4ca9e6d
Basic Layout (#80)
* Basic Layout

 - Merge with main into new branch
 - Most of main content and footer working.
 - Could not get fixed branch of trussworks to `npm install` correctly, so reverted back to public version. (`trussworks/react-uswds#kh-serverside-rendering-fix-1250"`)

TODO:
 - stack sgv warning+cloud icons
 - get timeline image (which as text that needs to scale)
 - localization support
 - move icon includes out of header?
 - start converting elements over to trussworks

* Cleanup

- removed unused styles
- added some better comments

* Revert trussworks to fixed branch
* Update package-lock.json
* Temporarily pointing toward personal fork until SSR issue has been addressed
* Update J40Footer.spec.tsx.snap
* setting jestEnvironment to the proper 'jsdom' value, needed for snapshot tests
* lingering prettier fix
* small version bump

Co-authored-by: Nat Hillard <Nathaniel.K.Hillard@omb.eop.gov>
2021-05-27 09:54:42 -07:00
Nat Hillard
ce7245b1a2
Addresses issue #11 items unit testing, snapshot testing. Follows instructions from https://www.gatsbyjs.com/docs/how-to/testing/unit-testing/ ; Adding typescript config, mocks, snapshot capabilities; initial test for j40footer and snapshot, readme update, test helper for intl plugin (#79) 2021-05-26 10:01:05 -04:00
Nat Hillard
a432a0d8c9
Adding Linting and Formatting (#77)
Addresses #11 item "Linting/formatting (eg eslnt, prettier)":
* Adding eslint, prettier, and config targeting Google, typescript, and both nodejs and client builds
* Addressing linter-found issues
* Adding lint and lint:fix commands
* Adding documentation
* Renaming workflow and adding lint check
* Adding documentation about VSCode linting/formatting, ran formatting on a few files, set up exclude list for gatsby develop, setup build to fail on error
2021-05-25 16:21:21 -04:00
Nat Hillard
16a9e67db0
Static Deploy to Github Pages (#73)
Addresses #58 , "As a member of the public, I want to see J40's website live on the internet, so that I know it's real!" - hosting on github pages for now as a temporary measure. This fix does NOT: 1) add .gov domain hosting, or 2) post to the geoplatform s3 bucket. This will need to happen in a subsequent fix. 

The changes made specifically to enable this for now:
* Adding github action to build, test, and deploy on pushes to client/
* Adding path prefix to build gh-pages at https://usds.github.io/justice40-tool/
* (Temporarily) pointing to fix branch for trussworks to enable SSR building
* Removing the workaround for the above bug in gatsby-node.js
* Setting build target to be 14.x due to version number limitations
* Adding gh-pages dependency, deploy action for manual deploy
* Force renaming J40header -> J40Header and J40footer -> J40Footer due to Linux case sensitivity
2021-05-25 12:07:45 -04:00
Nat Hillard
da76d6b180 Update issue templates
Updating reviewer list
2021-05-24 10:51:28 -04:00
Shelby Switzer
4430b401de
As an open source community member, I want to know what Justice40-specific terms and acronyms mean. (#75)
* Add glossary from open source kickoff

* Updates to glossary

* Add EVCM because we use this in user stories in this repo's sprint
backlog (which is visible / recorded in the form of Github Issuess)
* Update Climate and Environment Justice Screening Tool to Climate and
Economic Justice Screening Tool, as per the original Executive Order

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
2021-05-24 10:14:39 -04:00