Commit graph

669 commits

Author SHA1 Message Date
Emma Nechamkin
d55b7c016a
Update etl_score_geo.py
Yikes! Fixing merge messup!
2022-08-11 09:50:44 -04:00
Matt Bowen
9635ef5ee2
Refactor DOE Energy Burden and COI to use YAML (#1796)
* added tribalId for Supplemental dataset (#1804)

* Setting zoom levels for tribal map (#1810)

* NRI dataset and initial score YAML configuration (#1534)

* update be staging gha

* NRI dataset and initial score YAML configuration

* checkpoint

* adding data checks for release branch

* passing tests

* adding INPUT_EXTRACTED_FILE_NAME to base class

* lint

* columns to keep and tests

* update be staging gha

* checkpoint

* update be staging gha

* NRI dataset and initial score YAML configuration

* checkpoint

* adding data checks for release branch

* passing tests

* adding INPUT_EXTRACTED_FILE_NAME to base class

* lint

* columns to keep and tests

* checkpoint

* PR Review

* renoving source url

* tests

* stop execution of ETL if there's a YAML schema issue

* update be staging gha

* adding source url as class var again

* clean up

* force cache bust

* gha cache bust

* dynamically set score vars from YAML

* docsctrings

* removing last updated year - optional reverse percentile

* passing tests

* sort order

* column ordening

* PR review

* class level vars

* Updating DatasetsConfig

* fix pylint errors

* moving metadata hint back to code

Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>

* Correct copy typo (#1809)

* Add basic test suite for COI (#1518)

* Update COI to use new yaml (#1518)

* Add tests for DOE energy budren (1518

* Add dataset config for energy budren (1518)

* Refactor ETL to use datasets.yml (#1518)

* Add fake GEOIDs to COI tests (#1518)

* Refactor _setup_etl_instance_and_run_extract to base (#1518)

For the three classes we've done so far, a generic
_setup_etl_instance_and_run_extract will work fine, for the moment we
can reuse the same setup method until we decide future classes need more
flexibility --- but they can also always subclass so...

* Add output-path tests (#1518)

* Update YAML to match constant (#1518)

* Don't blindly set float format (#1518)

* Add defaults for extract (#1518)

* Run YAML load on all subclasses (#1518)

* Update description fields (#1518)

* Update YAML per final format (#1518)

* Update fixture tract IDs (#1518)

* Update base class refactor (#1518)

Now that NRI is final I needed to make a small number of updates to my
refactored code.

* Remove old comment (#1518)

* Fix type signature and return (#1518)

* Update per code review (#1518)

Co-authored-by: Jorge Escobar <83969469+esfoobar-usds@users.noreply.github.com>
Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>
Co-authored-by: Vim <86254807+vim-usds@users.noreply.github.com>
2022-08-10 16:02:59 -04:00
Emma Nechamkin
ed9b7172f7 first run through 2022-08-10 12:18:30 -04:00
Emma Nechamkin
3aa03f1669 added indoor plumbing to score housing burden 2022-08-10 12:18:30 -04:00
Emma Nechamkin
19d3bdee5a added indoor plumbing to score housing burden 2022-08-10 12:18:27 -04:00
Emma Nechamkin
cac1e0406f added indoor plumbing to chas 2022-08-10 12:18:01 -04:00
Emma Nechamkin
bbb5bbc60a Changing LHE in tiles to a boolean (#1767)
also includes merging / clean up of the release
2022-08-10 12:17:58 -04:00
Emma Nechamkin
daf188c1f3 adds UST indicator (#1786)
adds leaky underground storage tanks
2022-08-10 12:15:13 -04:00
Emma Nechamkin
29419dd2fd Rescaling linguistic isolation (#1750)
Rescales linguistic isolation to drop puerto rico
2022-08-10 12:13:51 -04:00
Emma Nechamkin
e98282dcef updating ejscreen data, try two (#1747) 2022-08-10 12:13:48 -04:00
Emma Nechamkin
002cddf68e Emma nechamkin/holc patch (#1742)
Removing HOLC calculation from score narwhal.
2022-08-10 12:13:16 -04:00
Vim
150b793fee
Correct copy typo (#1809) 2022-08-10 09:13:06 -07:00
Shelby Switzer
f8a6567cde Do not drop Guam and USVI from ETL (#1681)
* Remove code that drops Guam and USVI from ETL

* Add back code for dropping rows by FIPS code

We may want this functionality, so let's keep it and just make the constant currently be an empty array.

Co-authored-by: Shelby Switzer <shelbyswitzer@gmail.com>
2022-08-10 12:12:12 -04:00
Emma Nechamkin
92d68ba8be updating 2022-08-10 12:12:12 -04:00
Shelby Switzer
2e38aaa369 Update backend for Puerto Rico (#1686)
* Update PR threshold count to 10

We now show 10 indicators for PR. See the discussion on the github issue for more info: https://github.com/usds/justice40-tool/issues/1621

* Do not use linguistic iso for Puerto Rico

Closes 1350.

Co-authored-by: Shelby Switzer <shelbyswitzer@gmail.com>
2022-08-10 12:12:12 -04:00
Emma Nechamkin
3a960018f9 Adding HOLC indicator (#1579)
Added HOLC indicator (Historic Redlining Score) from NCRC work; included 3.25 cutoff and low income as part of the housing burden category.
2022-08-10 12:11:17 -04:00
Emma Nechamkin
f680d867c7 Imputing income using geographic neighbors (#1559)
Imputes income field with a light refactor. Needs more refactor and more tests (I spotchecked). Next ticket will check and address but a lot of "narwhal" architecture is here.
2022-08-10 12:09:30 -04:00
Emma Nechamkin
218fa48b85 Create deploy_be_staging.yml (#1575) 2022-08-10 12:07:13 -04:00
Jorge Escobar
1c448a77f9
NRI dataset and initial score YAML configuration (#1534)
* update be staging gha

* NRI dataset and initial score YAML configuration

* checkpoint

* adding data checks for release branch

* passing tests

* adding INPUT_EXTRACTED_FILE_NAME to base class

* lint

* columns to keep and tests

* update be staging gha

* checkpoint

* update be staging gha

* NRI dataset and initial score YAML configuration

* checkpoint

* adding data checks for release branch

* passing tests

* adding INPUT_EXTRACTED_FILE_NAME to base class

* lint

* columns to keep and tests

* checkpoint

* PR Review

* renoving source url

* tests

* stop execution of ETL if there's a YAML schema issue

* update be staging gha

* adding source url as class var again

* clean up

* force cache bust

* gha cache bust

* dynamically set score vars from YAML

* docsctrings

* removing last updated year - optional reverse percentile

* passing tests

* sort order

* column ordening

* PR review

* class level vars

* Updating DatasetsConfig

* fix pylint errors

* moving metadata hint back to code

Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>
2022-08-09 16:37:10 -04:00
Jorge Escobar
1833e3e794
Setting zoom levels for tribal map (#1810) 2022-08-09 13:56:03 -04:00
Jorge Escobar
781e08f559
added tribalId for Supplemental dataset (#1804) 2022-08-08 17:42:14 -04:00
Jorge Escobar
8149ac31c5
Starting Tribal Boundaries Work (#1736)
* starting tribal pr

* further pipeline work

* bia merge working

* alaska villages and tribal geo generate

* tribal folders

* adding data full run

* tile generation

* tribal tile deploy
2022-07-30 01:13:10 -04:00
Vim
746d36d4a6
Update Cypress GHA to v4 (#1768)
* Update cypress gha to v4

* Trigger build
2022-07-26 10:59:12 -07:00
Jorge Escobar
237122b2c5
Update CODEOWNERS (#1769) 2022-07-26 11:49:48 -04:00
Vim
70cc0e392e
hotfix for terser dependabot failure (#1766)
- upgrade @sentry
- place sentry dsn in github secrets
2022-07-25 11:18:47 -07:00
dependabot[bot]
a93a5a5928
Bump file-type from 16.5.3 to 16.5.4 in /client (#1751)
Bumps [file-type](https://github.com/sindresorhus/file-type) from 16.5.3 to 16.5.4.
- [Release notes](https://github.com/sindresorhus/file-type/releases)
- [Commits](https://github.com/sindresorhus/file-type/compare/v16.5.3...v16.5.4)

---
updated-dependencies:
- dependency-name: file-type
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-25 09:23:01 -07:00
Vim
e1a61faf5d
Add a react component generator (#1745)
* Add a react component generator

* Update markdown links

* Change commented code to block comment
2022-07-15 09:54:58 -07:00
Vim
eb3004c0d5
Fix on large AK tracts that are off screen (#1740)
* Change low to high transition and global zoom

- change the low to high transition from 7 to 5. This can not go any lower as high tiles on AWS only go to zoom level 5
- reduce the zoom level globally on all census tracts

* Remove geolocation from feature flag

- geolocation is now available to all

* Add python notebook that sorts all tracts by area

- add a column of the required zoom level for the tract to be fully contained in the viewport

* Place geolocation back to behind a feature flag

* Differentiate zoom levels b/w shortcuts and tracts
2022-07-13 19:01:43 -07:00
dependabot[bot]
a5a4c31bb0
Bump moment from 2.29.2 to 2.29.4 in /client (#1731)
Bumps [moment](https://github.com/moment/moment) from 2.29.2 to 2.29.4.
- [Release notes](https://github.com/moment/moment/releases)
- [Changelog](https://github.com/moment/moment/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/moment/moment/compare/2.29.2...2.29.4)

---
updated-dependencies:
- dependency-name: moment
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-12 10:13:58 -07:00
dependabot[bot]
2992f8df0b
Bump notebook from 6.4.10 to 6.4.12 in /data/data-pipeline (#1685)
Bumps [notebook](http://jupyter.org) from 6.4.10 to 6.4.12.

---
updated-dependencies:
- dependency-name: notebook
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-07 17:10:03 -04:00
dependabot[bot]
0555d896fd
Bump lxml from 4.8.0 to 4.9.1 in /data/data-pipeline (#1719)
Bumps [lxml](https://github.com/lxml/lxml) from 4.8.0 to 4.9.1.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](https://github.com/lxml/lxml/compare/lxml-4.8.0...lxml-4.9.1)

---
updated-dependencies:
- dependency-name: lxml
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-07 17:09:49 -04:00
Vim
8e50fa23cb
Update wastewater category to be in Spanish (#1713) 2022-07-07 06:53:27 -07:00
dependabot[bot]
5849c21fa2
Bump parse-url from 6.0.0 to 6.0.2 in /client (#1712)
Bumps [parse-url](https://github.com/IonicaBizau/parse-url) from 6.0.0 to 6.0.2.
- [Release notes](https://github.com/IonicaBizau/parse-url/releases)
- [Commits](https://github.com/IonicaBizau/parse-url/commits)

---
updated-dependencies:
- dependency-name: parse-url
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-06 07:05:41 -07:00
Vim
ed31849158
Align zoom levels (#1703)
- align zoom levels between the transition between low to high zoom with the census tract boundary
2022-07-06 06:46:37 -07:00
Vim
e418ebacf4
Change round to floor for indicator values (#1700)
- update tests to test flooring
2022-06-27 11:44:53 -07:00
Vim
bc31f56225
Add TSD in Spanish (#1677) 2022-06-09 13:56:37 -07:00
Jorge Escobar
5e6d08f62d
Update downloadable assets URL (#1674)
* Update downloadable assets URL

* upside down
2022-06-08 18:33:04 -04:00
Vim
9882e9ba22
Update to Gatsby 4 (#1673)
* Update to Gatsby 4

- remove old/unused packages
- update existing packages

* Roll back Gatsby

* Update README with package version info
2022-06-07 11:50:08 -07:00
dependabot[bot]
88628291e8
Bump devcert from 1.2.0 to 1.2.1 in /client (#1667)
Bumps [devcert](https://github.com/davewasmer/devcert) from 1.2.0 to 1.2.1.
- [Release notes](https://github.com/davewasmer/devcert/releases)
- [Changelog](https://github.com/davewasmer/devcert/blob/master/CHANGELOG.md)
- [Commits](https://github.com/davewasmer/devcert/compare/v1.2.0...v1.2.1)

---
updated-dependencies:
- dependency-name: devcert
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-06 14:14:05 -07:00
Vim
1681a72045
Remove threshold line in side panel (#1666)
* Remove categories

* Remove disadvantaged in sidepanel

* Add comment
2022-06-06 10:52:37 -07:00
Vim
9f0ca1c17d
Add address to search placeholder and add "at or above" to category copy for low income (#1665)
* Add address to search placeholder text

* Adds "at or above" to category copy

* Updates map search placeholder text

- Update es and en.json files
- adds mobile search placeholder text
- udpates desktop search placeholder text

* Update logic to determine mobile for search text

* Update search error message

- update to Spanish text as well

* Adjust spacing between search and territory btns

* Modify mobile detection logic

- remove cypress tests for faster deploys

* Add placeholder text to state variable

- wrap state variable in useEffect()
2022-06-03 09:35:28 -07:00
Vim
fb829a287a
Remove census statement in Meth page. (#1658) 2022-05-31 13:27:19 -07:00
Kameron Kerger
7c808eb2e0
Add files via upload (#1656)
updated TSD (new - naming convention) and new TSD-es
2022-05-31 13:19:01 -04:00
Vim
6ba17b544d
Update documentation from OS contributors (#1657)
* Update documentation from OS contributors

* Disable markdown links checks for certain links

* Disable expired links
2022-05-27 15:17:17 -07:00
Vim
88c86fcf7c
Changes criteria to criterion (#1655)
* Update copy

- update snapshots

* Add period to RFI box body (en and es)

- update snapshots
2022-05-26 15:33:22 -07:00
Vim
226017654a
Implement downloads page and May 25th timed copy changes (#1653)
* Add initial side nav

* Add Download page as a sub-page under Meth&Data

- udpate S3 file path in .envs
- remove the DownloadPacket component
- move download copy from methodology to download
- modify header to use two types of navs:
--  mobile (with sub-pages) and
-- desktop (without subpages)
- create a SubPageNav component
- add SubPagNav to Meth and Download page
- update snapshots
- add global CSS overide to remove minus sign on mobile nav link accordion as it's permanently open

* Remove the update tag above Public eng button

* Make the 3rd bullet on explore page update on 5/25

* Make the RFI box text change after 5/25/22

* Update site with RFI expired copy, remove Alerts

- add Spanish translations
- update snapshots

* Fix typo on XLS file path

* Refactor HowYouCanHelp to standard form

* Add custom download links with icons

- add new DownloadLink compnent
- add Spanish translations

* Update download file sizes

* Allow meth&data nav link to collapse on mobile
2022-05-25 21:01:04 -07:00
Vim
ef46af00f8
Add time to expiration date (#1654)
* Push out expiration by a day for fast fix

* Add timestampt to expiration

- update snapshots

* Remove timed alerts
2022-05-25 09:10:14 -07:00
Vim
c398fe8737
Spanish changes from translation team (#1650)
* Add translation of 'email' on About page

- Email to Correo electrónico

* Add en ingles suffix and Spanish oridinals

* Correct variable name in es.json

* Add missing colon

* Replace brackets with parens when using en ingles
2022-05-18 11:37:36 -07:00
Vim
85ffb1b6b9
Fix typos found in en.json files and copy (#1648) 2022-05-17 10:22:57 -07:00
Vim
90908532fa
Add copy to sidepanel on unselected and correct typo on Traffic data (#1646)
* Add copy to sidepanel

- add copy
- add spanish copy
- update snapshots
- udpate en.json and es.json

* Fix typo on Traffic data

* Reduce sidepanel title font size to x-large
2022-05-16 08:59:09 -07:00