Commit graph

452 commits

Author SHA1 Message Date
Jorge Escobar
e012b09ed6 tz env var 2021-11-02 13:40:37 -04:00
Jorge Escobar
a91deea0d0 tippecanoe 2021-11-02 13:34:12 -04:00
Jorge Escobar
930465f411 updating combtilefy 2021-11-02 12:06:06 -04:00
Jorge Escobar
4c26e8e97c generate score update 2021-11-02 10:32:23 -04:00
Jorge Escobar
ebc363e300 updating score generate 2021-11-02 10:29:49 -04:00
Jorge Escobar
1b17af84c8
Combine + Tilefy (#806)
* init

* score-post

* added score csv s3 download; remore poetry cmds from readme

* working census tile fetch

* PR review

* Github Actions Work
2021-11-01 18:05:05 -04:00
Shelby Switzer
7b87e0ec99
Add Score L (#812)
* Create ScoreCalculator

This calculates all the factors for score L for now (with placeholder
formulae because this is a WIP). I think ideallly we'll want to
refactor all the score code to be extracted into this or  similar
classes.

* Add factor logic for score L

Updated factor logic to match score L factors methodology.
Still need to get the Score L field itself working.

Cleanup needed: Pull field names into constants file, extract all score
calculation into score calculator

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>
2021-10-28 16:07:41 -04:00
Vim
b1adc1f69f
Add beta site banner (#802)
* Add new BetaBanner and remove legacy Alerts

- add BetaBanner component and test
- update AboutCard test
- remove AlertWrapper component, copy and tests
- remove AlertWrapper from all pages
- add BetaBanner copy and intl
- update logo and color
- add styles using USWDS tokens to globals.scss

* Add Beta pill to header

- refactor Header to use Grid and USWDS
- refactor global.scss to use Grid and USWDS
- updates snapshots

* Move styles from global to modules

- move BetaBanner styles from global to modules
- move J40Header to a folder component and module styles
- add J40Header unit test
- add a design-system.scss file that allows USWDS styles in modules
- updates snapshots

* Update en.json file

* Trigger Build

* Add initial Spanish content

- add README for translation team
- add createSpanishJson script
- add initial version of es.json
- add a spanish string variable to test translation

* Add retry and timeout config to stalled test

* Remove redundant test cases for AboutCard

- update snapshot

* Update BetaBanner description
2021-10-21 14:56:32 -07:00
Vim
e64e7fda60
Fix typos on Explore Tool page (#803)
- update snapshot
2021-10-20 15:13:56 -07:00
Vim
29d5b52f84
Add build status badges to client README (#799)
* Add build status badges to client README

* Update GHA names
2021-10-14 15:28:25 -07:00
Vim
54d07bddc8
Migrates global footer styles to USDS (#798)
- enables colors in settings file
- updates snapshots
2021-10-14 15:09:33 -07:00
Vim
d1511287b8
Updates intl file with latest copy (#795)
* Extract 404 page copy to intl

* Move all copy to data copy folder and add tests

- Add test:intl-extraction script
- Fix certain defaultMessages not appearing
- update snapshot
2021-10-14 13:49:16 -07:00
Jorge Escobar
a94b8e2761 final census GHA 2021-10-14 13:50:56 -04:00
Jorge Escobar
8b2225f22e typo on gen score 2021-10-14 13:48:46 -04:00
Jorge Escobar
b60830da0e removing delete 2021-10-14 13:44:44 -04:00
Jorge Escobar
77ccc78f76 temp comment gdal 2021-10-14 13:41:55 -04:00
Jorge Escobar
361654f4e2 use aws cp instead of sync 2021-10-14 13:40:48 -04:00
Jorge Escobar
8ddfc6b305
Update application.py 2021-10-14 13:31:37 -04:00
Jorge Escobar
d66439138e
Update generate-census.yml 2021-10-14 13:15:11 -04:00
Jorge Escobar
12a1a20b8b
Update generate-census.yml 2021-10-14 13:08:55 -04:00
Vim
6f64acf8cd
Turns on jest coverage reports (#793) 2021-10-13 17:25:02 -07:00
Vim
92d76fb6f4
Gherkin workflows for desktop (#788)
* Add gherkin tests for page navigation links

- test that every page will load when navigating from any other page
- update snapshots

* Add gherkin workflows 2 - 5

- add test for Federal program officer key information and CTA
- add test for Community members key information and CTA
- add test for Send feedback
- add test for Join the Open Source community
- update snapshots

* Add gherkin tests for footer links

- add footerlinks feature gherkin file
- adds a comment to the hyphenizeString()
- adds keyword functions for footer
- adds data-cy tags to footer component
- updates snapshots

* Adds workflow to learn more about EO

* Add gherkin test for dataset links

- add data-cy tags to dataset sections
- modify Cy command functions names
- update snapshots

* Add cypress test to deploy_staging.yml

* Add working directory env

* Remove keywords.js from cypress test

* Add a Then step to all About and Footer tests

* Refactor step definitions

- use globalStepDefinitions
- rename keywords to commonSteps
- remove keyword from exclusion list
2021-10-13 14:06:05 -07:00
Jorge Escobar
3b04356fb3
Data sources from S3 (#769)
* Started 535

* Data sources from S3

* lint

* renove breakpoints

* PR comments

* lint

* census data completed

* lint

* renaming data source
2021-10-13 16:00:33 -04:00
Billy Daly
d1273b63c5
Add ETL Contract Checks (#619)
* Adds dev dependencies to requirements.txt and re-runs black on codebase

* Adds test and code for national risk index etl, still in progress

* Removes test_data from .gitignore

* Adds test data to nation_risk_index tests

* Creates tests and ETL class for NRI data

* Adds tests for load() and transform() methods of NationalRiskIndexETL

* Updates README.md with info about the NRI dataset

* Adds to dos

* Moves tests and test data into a tests/ dir in national_risk_index

* Moves tmp_dir for tests into data/tmp/tests/

* Promotes fixtures to conftest and relocates national_risk_index tests:
The relocation of national_risk_index tests is necessary because tests 
can only use fixtures specified in conftests within the same package

* Fixes issue with df.equals() in test_transform()

* Files reformatted by black

* Commit changes to other files after re-running black

* Fixes unused import that caused lint checks to fail

* Moves tests/ directory to app root for data_pipeline

* Adds new methods to ExtractTransformLoad base class:
- __init__() Initializes class attributes
- _get_census_fips_codes() Loads a dataframe with the fips codes for 
census block group and tract
- validate_init() Checks that the class was initialized correctly
- validate_output() Checks that the output was loaded correctly

* Adds test for ExtractTransformLoad.__init__() and base.py

* Fixes failing flake8 test

* Changes geo_col to geoid_col and changes is_dataset to is_census in yaml

* Adds test for validate_output()

* Adds remaining tests

* Removes is_dataset from init method

* Makes CENSUS_CSV a class attribute instead of a class global:
This ensures that CENSUS_CSV is only set when the ETL class is for a 
non-census dataset and removes the need to overwrite the value in 
mock_etl fixture

* Re-formats files with black and fixes broken tox tests
2021-10-13 15:54:15 -04:00
Shelby Switzer
1f78920f63
Update diagrams in architecture docs (#790)
* Update diagrams in architecture docs

* Updates overall diagram to represent current arch and process
(including vision for data selection)
* Updates geo data pipleline arch diagram and removes geoplatform
version since we only have one version of this for the foreseeable
future and we're using geoplatform infradstructure

* Update diagram to remove something we do not yet do

* Updating Diagram

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
Co-authored-by: GitHub Action <action@github.com>
2021-10-08 13:12:03 -04:00
Vim
55fc8721e0
Add a comment to trigger build (#791)
* Add a comment to trigger build

* Remove comment to trigger build

* Add comment to trigger build
2021-10-08 08:19:27 -07:00
Vim
b913cf21e6
remove frontend PR artifacts from S3 (#665)
* adds initial prefix

* adds steps

* adds names

* adds runs-on

* tests direct env

* add prefix to folder

* rm AWS

* adds s3 uri

* adds recursive

* removes slash

* Trigger Build

* Trigger Build

* remove recursive

* update GHA name

* adds slash to s3 uri

* Trigger Build

* adds ls

* Trigger Build

* Trigger Build

* Trigger Build

* list main s3 bucket

* Trigger Build

* list j4-tool dir

* Trigger Build

* Trigger Build

* Add rm cmd

* adds CDN as env var

* modify web cdn id

* update cdn id

* Trigger Build

* Remove artifacts on PR merge

- also make the web cdn an env variable

* make web CDN an env variable

* Update CDN ID to newest CDN

* Add test remove artifacts yml file

* Add jobs to test.yml

* Update PR number to 111

* Remove testing artifacts yaml file
2021-10-07 17:38:37 -07:00
Vim
819113ceb7
Fix all failing cypress tests (#774)
* Fix all failing cypress tests

- update test name to be more appropriate
- update download packet tests to CDN
- update data-cy tag on About heading

* Update snapshot
2021-10-05 12:52:03 -07:00
Vim
e47cffc3f9
Update the base URL for the download packet (#775) 2021-10-05 11:34:29 -07:00
Vim
e2f68dc46f
Add sentry monitoring for all runtime errors (#767)
* Add sentry monitoring for all runtime errors

* Modify CDN ID to older CDN

- waiting for access from Zivaro
2021-10-04 10:19:08 -07:00
Vim
72d80a5803
Attempt to merge Lighthouse Fix branch from Nat (#758)
* Add a11y tests in cypress for methodology page

- update cypress to version 8.5
- add HTML lang the <head> element
- change process list headings to h4
- add alt tag to download image icon
- move <GovBanner> into <Header>
- add documentation around a11y testing

* Add cypress a11y tests for cejst page

- add alt icon for mapIntro page
- change legend to be a normal div
- add a class that mimics the h4 styles
- remove superfluous styles

* Add cypress a11y tests for contact and 404 page

* Update snapshots

* Move static text in footer to copy folder

* Add cypress a11y test to About page

- add required h1 tag
- updates snapshot

* Add site_url.xml and modify robots.txt file

- adds plugins for robots.txt and sitemap
- remove env.local and will add env.production
- modifiy all yml files (docker and GHA) to specify new env variables
- refactor env variables to either DATA_SOURCE, SITE_URL or PATH_PREFIX
- set defaults for env variables in gatsby-config
- remove timeline component
- will add blank index page
- update README on info on env variables

* Add plugin to allow custom env vars

- allows system env vars, ie, DATA_SOURCE on client-side application

* Update displayed URLs in GHA to new CDN (d29)

- also updates the blank index.html

* Correct spacing

* Set SITE_URL to new CDN for robots.txt

* Remove SITE_URL as this is set by GHA

* Update README around docker and env vars
2021-10-04 08:43:33 -07:00
Shelby Switzer
52aa0e3123
Update site with latest download file date + size (#766)
Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
2021-10-04 09:14:04 -04:00
Shelby Switzer
d8c73e6a02
Change downloadable file names (#708)
* Change downloadable file names

* Remove constants because we're dynamically creating these
* Update to "communities" for the descriptor word based on team convo
* Add timestamp in 2020-09-20-0930 format because I personally think
this is the best ^.^

* Add a CLI command to run ETL Score Post so that we don't have to
  run the score generation just to get new downloadable files.
* Also make sure the old downloadable files are cleaned up on the
  run of this command.

* Remove unused library, thanks pylint!

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
2021-10-01 15:04:37 -04:00
Vim
bf80863460
Removes GA Gatsby plugin (#759)
- places original GA tag back into head
2021-09-30 15:43:14 -07:00
Vim
ca7d688623
remove GA script tag and use Gatsby plugin (#756) 2021-09-27 13:54:10 -07:00
Vim
5e03ba4fac
Remove ethlink from GA script tag (#755) 2021-09-27 10:01:02 -07:00
Vim
c99677f9b3
Fix copy bugs and update en.json for spanish translators (#746)
* update copy bugs

- updates snapshots

* Update intl en.json

- remove duplicate ids
2021-09-23 13:06:26 -07:00
Jorge Escobar
2f8f2240b4
added new PDF file (#745) 2021-09-23 13:34:50 -04:00
Vim
02ce905261
Update some additional dataset links (#744)
- update snapshots
2021-09-23 10:33:26 -07:00
Vim
94095ff4c2
Change map legend color key (#732)
* Change map legend color key

- make legend key a circle
- remove blue border in legend
- remove blue border in color key of side panel

* Add space in CBG sub-headings

- update snaphots

* Add state to the AreaDetail component

- add useState to track the community of focus
- add useEffect to control rendering
- remove getCategorization()
- clean up all SASS around 'prioritization'
- add snapshots
2021-09-23 08:06:49 -07:00
Vim
77a5f179a9
Open external links in new tabs (#731)
* Open external links in new tabs

- allow contact page mailto link opens in new tab
- allow about page mailto link opens in new tab
- comment against opening external links in same tab

* Update snapshots
2021-09-23 00:22:15 -07:00
Vim
53c2d98eaa
Update version number on frontend (#730)
* Update version number on frontend

- add verion to download packet
- add verison to side panel
- update snaphots
- add version to constant file

* Add minor UI changes from QA

- adjust copy in download package
- update tests

* Refactor all intl code and will add page tests

- remove all copy app wide and place into respective data/copy folder
- adds tests for each page
- allow product to make copy changes in one place
- prepare for spanish language effort
2021-09-22 23:56:23 -07:00
Lucas Merrill Brown
b1a4d26be8
Adding persistent poverty tracts (#738)
* persistent poverty working

* fixing left-padding

* running black and adding persistent poverty to comp tool

* fixing bug

* running black and fixing linter

* fixing linter

* fixing linter error
2021-09-22 17:57:08 -04:00
dependabot[bot]
d1ced6d584
Bump ansi-regex in /infrastructure/functions/detect-changes-for-worker (#733)
Bumps [ansi-regex](https://github.com/chalk/ansi-regex) from 5.0.0 to 5.0.1.
- [Release notes](https://github.com/chalk/ansi-regex/releases)
- [Commits](https://github.com/chalk/ansi-regex/compare/v5.0.0...v5.0.1)

---
updated-dependencies:
- dependency-name: ansi-regex
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-22 13:50:20 -04:00
Shelby Switzer
d3a18352fc
Add pytest to tox run in CI/CD (#713)
* Add pytest to tox run in CI/CD

* Try fixing tox dependencies for pytest

* update poetry to get ci/cd passing

* Run poetry export with --dev flag to include dev dependencies such as pytest

* WIP updating test fixtures to include PDF

* Remove dev dependencies from reqs and add pytest to envlist to make build faster

* passing score_post tests

* Add pytest tox (#729)

* Fix failing pytest

* Fixes failing tox tests and updates requirements.txt to include dev deps

* pickle protocol 4

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
Co-authored-by: Jorge Escobar <jorge.e.escobar@omb.eop.gov>
Co-authored-by: Billy Daly <williamdaly422@gmail.com>
Co-authored-by: Jorge Escobar <83969469+esfoobar-usds@users.noreply.github.com>
2021-09-22 13:47:37 -04:00
Vincent La
7709836a12
Ticket 355: Adding map to Urban vs Rural Census Tracts (#696)
* Adding urban vs rural notebook

* Adding new code

* Adding settings

* Adding usa.csv

* Adding etl

* Adding etl

* Adding to etl_score

* quick changes to notebook

* Ensuring notebook can run

* Adding urban vs rural notebook

* Adding new code

* Adding settings

* Adding usa.csv

* Adding etl

* Adding etl

* Adding to etl_score

* quick changes to notebook

* Ensuring notebook can run

* adding urban to comparison tool

* renaming file

* adding urban rural to more comp tool outputs

* updating requirements and poetry

* Adding ej screen notebook

* removing ej screen notebook since it's in justice40-tool-iss-719

Co-authored-by: La <ryy0@cdc.gov>
Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>
2021-09-22 12:31:03 -04:00
Vim
aaf304fc89
Add analytics script (#707)
* Add analytics script

- also add the geoplatform official site to yml file

* update analytics link
2021-09-20 15:00:50 -07:00
Vim
58f4102d6f
create a LinkTypeWrapper (#709)
- AboutCard requires both internal and external links
- LinkTypeWrapper allows the component to specify link type
- add tests
2021-09-20 06:55:08 -07:00
Vim
a532b652b4
Add env variable to set path prefix (#706)
* Add env variable to set path prefix

- When routing traffic to our new URL, the path prefix needs to be blank
- adding path prefix to be set by env var to yml files

* Update reference to env var in PATH_PREFIX

* Update PR message URL with CDN

- The actual website will point to the base url CDN
2021-09-17 11:52:27 -07:00
Vim
61fc8e6c15
Update copy on site based on living copy document (#697)
* Update copy on site based on living copy document

* Updates copy from living doc v2

- updates shots

* Update styling to sidepanel

- make indicator heading white
- change bg color of add'nl indicators 'FAFAFA'

* Separate dataset cards sections by style

- abstract out additional cards color to utils
- create a baseCard mixin
- add datasetCardAdditional style block
- add additionalIndicator prop to DatasetCard
- lower abstaction of GridContainer from methodology to DatasetContainer
- updates snapshot

* Swap resolution and source in dataset cards

- update snapshots

* Update SVGs on About page

- re-center the SVGs to content vertically
2021-09-17 11:01:15 -07:00