Commit graph

154 commits

Author SHA1 Message Date
Jorge Escobar
930465f411 updating combtilefy 2021-11-02 12:06:06 -04:00
Jorge Escobar
4c26e8e97c generate score update 2021-11-02 10:32:23 -04:00
Jorge Escobar
ebc363e300 updating score generate 2021-11-02 10:29:49 -04:00
Jorge Escobar
1b17af84c8
Combine + Tilefy (#806)
* init

* score-post

* added score csv s3 download; remore poetry cmds from readme

* working census tile fetch

* PR review

* Github Actions Work
2021-11-01 18:05:05 -04:00
Vim
29d5b52f84
Add build status badges to client README (#799)
* Add build status badges to client README

* Update GHA names
2021-10-14 15:28:25 -07:00
Jorge Escobar
a94b8e2761 final census GHA 2021-10-14 13:50:56 -04:00
Jorge Escobar
8b2225f22e typo on gen score 2021-10-14 13:48:46 -04:00
Jorge Escobar
b60830da0e removing delete 2021-10-14 13:44:44 -04:00
Jorge Escobar
77ccc78f76 temp comment gdal 2021-10-14 13:41:55 -04:00
Jorge Escobar
361654f4e2 use aws cp instead of sync 2021-10-14 13:40:48 -04:00
Jorge Escobar
d66439138e
Update generate-census.yml 2021-10-14 13:15:11 -04:00
Jorge Escobar
12a1a20b8b
Update generate-census.yml 2021-10-14 13:08:55 -04:00
Vim
92d76fb6f4
Gherkin workflows for desktop (#788)
* Add gherkin tests for page navigation links

- test that every page will load when navigating from any other page
- update snapshots

* Add gherkin workflows 2 - 5

- add test for Federal program officer key information and CTA
- add test for Community members key information and CTA
- add test for Send feedback
- add test for Join the Open Source community
- update snapshots

* Add gherkin tests for footer links

- add footerlinks feature gherkin file
- adds a comment to the hyphenizeString()
- adds keyword functions for footer
- adds data-cy tags to footer component
- updates snapshots

* Adds workflow to learn more about EO

* Add gherkin test for dataset links

- add data-cy tags to dataset sections
- modify Cy command functions names
- update snapshots

* Add cypress test to deploy_staging.yml

* Add working directory env

* Remove keywords.js from cypress test

* Add a Then step to all About and Footer tests

* Refactor step definitions

- use globalStepDefinitions
- rename keywords to commonSteps
- remove keyword from exclusion list
2021-10-13 14:06:05 -07:00
Jorge Escobar
3b04356fb3
Data sources from S3 (#769)
* Started 535

* Data sources from S3

* lint

* renove breakpoints

* PR comments

* lint

* census data completed

* lint

* renaming data source
2021-10-13 16:00:33 -04:00
Vim
b913cf21e6
remove frontend PR artifacts from S3 (#665)
* adds initial prefix

* adds steps

* adds names

* adds runs-on

* tests direct env

* add prefix to folder

* rm AWS

* adds s3 uri

* adds recursive

* removes slash

* Trigger Build

* Trigger Build

* remove recursive

* update GHA name

* adds slash to s3 uri

* Trigger Build

* adds ls

* Trigger Build

* Trigger Build

* Trigger Build

* list main s3 bucket

* Trigger Build

* list j4-tool dir

* Trigger Build

* Trigger Build

* Add rm cmd

* adds CDN as env var

* modify web cdn id

* update cdn id

* Trigger Build

* Remove artifacts on PR merge

- also make the web cdn an env variable

* make web CDN an env variable

* Update CDN ID to newest CDN

* Add test remove artifacts yml file

* Add jobs to test.yml

* Update PR number to 111

* Remove testing artifacts yaml file
2021-10-07 17:38:37 -07:00
Vim
e2f68dc46f
Add sentry monitoring for all runtime errors (#767)
* Add sentry monitoring for all runtime errors

* Modify CDN ID to older CDN

- waiting for access from Zivaro
2021-10-04 10:19:08 -07:00
Vim
72d80a5803
Attempt to merge Lighthouse Fix branch from Nat (#758)
* Add a11y tests in cypress for methodology page

- update cypress to version 8.5
- add HTML lang the <head> element
- change process list headings to h4
- add alt tag to download image icon
- move <GovBanner> into <Header>
- add documentation around a11y testing

* Add cypress a11y tests for cejst page

- add alt icon for mapIntro page
- change legend to be a normal div
- add a class that mimics the h4 styles
- remove superfluous styles

* Add cypress a11y tests for contact and 404 page

* Update snapshots

* Move static text in footer to copy folder

* Add cypress a11y test to About page

- add required h1 tag
- updates snapshot

* Add site_url.xml and modify robots.txt file

- adds plugins for robots.txt and sitemap
- remove env.local and will add env.production
- modifiy all yml files (docker and GHA) to specify new env variables
- refactor env variables to either DATA_SOURCE, SITE_URL or PATH_PREFIX
- set defaults for env variables in gatsby-config
- remove timeline component
- will add blank index page
- update README on info on env variables

* Add plugin to allow custom env vars

- allows system env vars, ie, DATA_SOURCE on client-side application

* Update displayed URLs in GHA to new CDN (d29)

- also updates the blank index.html

* Correct spacing

* Set SITE_URL to new CDN for robots.txt

* Remove SITE_URL as this is set by GHA

* Update README around docker and env vars
2021-10-04 08:43:33 -07:00
Vim
aaf304fc89
Add analytics script (#707)
* Add analytics script

- also add the geoplatform official site to yml file

* update analytics link
2021-09-20 15:00:50 -07:00
Vim
a532b652b4
Add env variable to set path prefix (#706)
* Add env variable to set path prefix

- When routing traffic to our new URL, the path prefix needs to be blank
- adding path prefix to be set by env var to yml files

* Update reference to env var in PATH_PREFIX

* Update PR message URL with CDN

- The actual website will point to the base url CDN
2021-09-17 11:52:27 -07:00
Shelby Switzer
75c261fc3d
Update main.yml (#704)
Update name of workflow and only send slack notification on failure
2021-09-17 10:06:59 -04:00
Shelby Switzer
c457ba85db
Add action for ping test and alert to Slack (#695)
* Add action for ping test and alert to Slack

Based on @sverchdotgov 's https://github.com/sverchdotgov/github-actions-experiments/blob/master/.github/workflows/scheduled-email.yml

This is set to run every hour. We can modify as needed. It is also using our cloudfront URL and we'll need to change this to our new URL once we have it.

* Update main.yml

Change to run every 5 minutes and update env var to be more descriptive based on PR convo
2021-09-16 21:26:54 -04:00
Vim
5ef8c8d6ff
testing cache busting on client CDN (#661) 2021-09-10 13:17:30 -07:00
Vim
dc8e82b8e2
adds comment to trigger build on PR open (#657)
* adds comment to trigger build on PR open

* removes uncommented code from GHA files
2021-09-10 11:37:58 -07:00
Vim
88c8209bb0
Splits up build deploy GHA (#656)
* Revert "dockerize front end (#558)"

This reverts commit 89c23faf7a.

* splits build_deploy

* Trigger Build

* adds space to trigger build

* trigger build

* adds comment

* changes staging base url

* adds comment
2021-09-10 11:05:35 -07:00
Vim
704831159f
dockerize front-end and pass env vars to npm build (#614)
* Revert "dockerize front end (#558)"

This reverts commit 89c23faf7a.

* dockerize frontend
- adds score server and website docker compose
- creates docker ignore
- adds .env.* for dev, prod and local
- adds dockerfile for website
- adds env to gatsby-config
- adds hostaddress to develop / start script
- adds istructions in README for running docker
- replaces fixed URLS with ones based on env vars
- creates a score server dockerfile

* updates README to change map tiles source

* adds env DATA_SOURCE:development to deploy GHA

* capitalize readme
2021-09-07 10:35:11 -07:00
Vim
d449e9c554
update areaDetail with data from d3 CDN (#547)
* update areaDetail with data from d3 CDN

- updated constants with d3 CDN info
- placed AreaDetail component in folder
- fixed J40Alert padding-left console warning
- added tests for both J40Alert rendering

* udpates FE to percentile data

* testing CORS on PR'd URL

* testing PR'd URL
2021-08-18 08:47:34 -07:00
Jorge Escobar
c24e13c930
Update GHA to push only client changes to S3 (#543) 2021-08-16 17:00:43 -04:00
Jorge Escobar
ac746741ea
disabling data checks on non-data folders (#532) 2021-08-16 15:12:58 -04:00
Jorge Escobar
6851c0a38d
Wrong creds name (#531) 2021-08-16 14:47:15 -04:00
Jorge Escobar
86c45ab3f0
Updating Front End Deploy Keys (#530) 2021-08-16 14:25:34 -04:00
Jorge Escobar
773c035493
AWS Sync Public Read (#508)
* adding layer to mvts

* small fix for GHA

* AWS Sync Public Read

* removed temp file

* updated state media income ftp
2021-08-12 14:17:25 -04:00
Jorge Escobar
d259d97ba9
adding layer to mvts (#503)
* adding layer to mvts

* small fix for GHA
2021-08-12 10:56:54 -04:00
Jorge Escobar
3d8dbb293c
Tile-baking columns with floating rounds completed (#491)
* Tile-baking columns with floating rounds completed

* completed

* correction on github workflow

* tiles folder no longer needed

* addressed comments

* updating requirements.txt

* poetry lock update

* adding xlswriter

* final poetrylock

* updated requirements.txt

* checkpoint

* removed matplotlib

* ignoring pylint too many statements

* reinstated too many statements

* converting data sync to generate score GHA UI-driven
2021-08-10 15:28:50 -04:00
Nat Hillard
9a9d5fdf7f
Backend change for Zipfile pt. 2 (#469)
* Fixes #303 : adding downloadable zip archive logic
* linter recommendations
* Pushes data directory to AWS. We'll want to move to use AWS for this ASAP, but this works for now
* updating pattern
2021-08-09 10:39:59 -04:00
Billy Daly
55dabb2b57
Issue 379 tox setup (#405)
* Adds tox as a dev dependency to data/data-pipeline/pyproject.toml: Also updates poetry.lock and requirements.txt

* Adds tox.ini to test build of data/data-pipeline

* Sets up GitHub actions workflow for data/ directory

* Tries to get Data Checks GitHub action to run

* Fixes error with GitHub action

* Migrates data/data-roadmap from setuptools to poetry

* Sets up tox file for data/data-roadmap

* Adds github action for data/data-roadmap

* Fixes syntax error in data-checks.yml

* Second attempt at fixing data-checks.yml

* Export poetry requirements to requirements.txt

* Revert "Migrates data/data-roadmap from setuptools to poetry"

This reverts commit e8367652d43c1c9beee500f792c8f41e1c1fc462.

* Removes pyproject.toml and reverts requirements.txt as well
2021-07-29 14:00:20 -04:00
Nat Hillard
a787bd71ab
Merges to main don't get posted to main && it should be clearer how branches are deployed (#415)
* fixes #319 - merges to main still don't get posted to /main , and #362 It should be clearer how branches are deployed -- move to using 'pull_request' instead of 'push' (we can't push to master directly anyhow), and run on 'closed'; also add comment on PR itself
* updating to add subsequent pushes to the same PR
2021-07-27 12:37:17 -04:00
Vim
e5908cf7d7
updates filename and comments (#378) 2021-07-19 08:05:32 -07:00
Shelby Switzer
a1a3a013a8
Create codeql-analysis.yml 2021-07-19 09:21:28 -04:00
Vim
f301dfcd80
cypress e2e nightly (#360)
* fixes nightly e2e test

* adds on command
2021-07-15 10:27:22 -07:00
Vim
a5e79604a7
changes root directory 2021-07-12 10:38:24 -07:00
Nat Hillard
00fd51de8b
One more attempt to fix merging to main, it appears it doesn't like curly brackets (#277) 2021-06-30 18:58:54 -04:00
Nat Hillard
6f4087d247
Fix Github Actions deploy for merges to main
Addresses part of #125 - merges to main now go to a path with a `main` prefix
2021-06-28 10:59:08 -04:00
Nat Hillard
292c5bc8f5
CEJST Map (#139)
* styles prettier fix
* Addresses issue #100 from the frontend:
* Creates new cejst page and related OL components
* temporarily loads census-derived tileserver at higher zoom levels
* lays out cejst page : TODO :  remove aside
* temporarily removing license check - TODO: fix jsonlint
* review comments
2021-06-16 18:16:49 -04:00
Nat Hillard
9ea0f946eb
Adding SHA (for PRs)/ Main (for main) to URL (#121)
* Fixes #90 - adds a GHA SHA to PR branches and 'main' for merges to main
2021-06-14 10:42:09 -04:00
Nat Hillard
c07a14a8db
Fixes issue #107 Geoplatform AWS throws errors on load - we had configured a prefix-path for use with github pages, but this didn't match the path within the s3 bucket. Upload content to a subfolder and ensure pusers access site from /justice40-tool/ (#115) 2021-06-08 10:44:56 -04:00
Nat Hillard
13a5bd008e
Addresses issue #13 - adding workflow to deploy to Geoplatform AWS (#103) 2021-06-07 11:57:46 -04:00
Nat Hillard
55d6e6635b
addresses issue #11 sub-item 'license checker' (#92) 2021-06-03 15:03:10 -04:00
Nat Hillard
426f596c7a
Adding Cypress for e2e testing (#85)
* using the higher-level react-testing-library, and regenerating snapshot - renders real DOM elements
* Basic e2e testing with Cypress, following the guide here: https://www.gatsbyjs.com/docs/how-to/testing/end-to-end-testing/ ; needed to install cypress-local to avoid jest-cypress collision
* Adding accessibility testing support and basic a11y tests
* adding failure logging
* Adding nightly test run
* Fix misc stuff from lighthouse (#81)
* Removing local-cypress, relying instead on a combination
of type reference and eslint-plugin-cypress;
adding cypress to jest ignore paths to avoid conflict -
`npm test` is now jest-only, use `npm run test:e2e` to run cypress tests
* updating comment to clarify timezone
2021-06-02 20:53:22 -04:00
Nat Hillard
394260bbec
Splitting dev and prod dependencies, adding npm audit step to catch security vulnerabilities (#88) 2021-06-02 13:21:23 -04:00
Nat Hillard
a432a0d8c9
Adding Linting and Formatting (#77)
Addresses #11 item "Linting/formatting (eg eslnt, prettier)":
* Adding eslint, prettier, and config targeting Google, typescript, and both nodejs and client builds
* Addressing linter-found issues
* Adding lint and lint:fix commands
* Adding documentation
* Renaming workflow and adding lint check
* Adding documentation about VSCode linting/formatting, ran formatting on a few files, set up exclude list for gatsby develop, setup build to fail on error
2021-05-25 16:21:21 -04:00