Commit graph

427 commits

Author SHA1 Message Date
Shaun Verch
83d8a9a724 Add enough skeleton for first failing runner test 2021-12-15 13:05:45 -05:00
Shaun Verch
b4702f2f7f Ignore more urls that don't work 2021-12-15 12:17:47 -05:00
Shaun Verch
adb82b728b Fix another broken link 2021-12-15 12:17:47 -05:00
Shaun Verch
44f27cb560 Ignore link that's returning a 403 to the checker
It actually works if you go in a browser.
2021-12-15 12:17:47 -05:00
Shaun Verch
809c1c4edc Fix more links 2021-12-15 12:17:47 -05:00
Shaun Verch
7f3ee6cff4 Fix more broken links 2021-12-15 12:17:47 -05:00
Shaun Verch
839fbfad0b Fix broken links in data roadmap 2021-12-15 12:17:47 -05:00
Shaun Verch
27f7d42d01 Correct handling of repo root relative links 2021-12-15 12:17:47 -05:00
Shaun Verch
5eebfd51e1 Fix some links 2021-12-15 12:17:47 -05:00
Shaun Verch
dd29181cbe Add config for markdown link checker 2021-12-15 12:17:47 -05:00
Shaun Verch
6d8d9c7b0c Move git installation first 2021-12-15 12:17:47 -05:00
Shaun Verch
98011a39c1 Add markdown link check 2021-12-15 12:17:47 -05:00
Shaun Verch
fbef8d3432 Add some docs about the github actions 2021-12-15 12:17:47 -05:00
Shaun Verch
0bb4236aa1 Link installation again from the main README 2021-12-15 12:17:47 -05:00
Shaun Verch
e22329dc29 Make it clear that docker is doing the setup 2021-12-15 12:17:47 -05:00
Shaun Verch
b276f0f003 First pass of updating documentation for new users
Trying to look at this from the perspective of someone new to the
project, and create some pathways to make it easier for people to get to
the content they are looking for.
2021-12-15 12:17:47 -05:00
Saran Ahluwalia
5d2c1ce8d9 add more clarity in comments 2021-12-14 14:26:14 -05:00
Saran Ahluwalia
7e6a836170 remove repetetive assignment and stick with context 2021-12-14 06:32:09 -05:00
Saran Ahluwalia
5ceb7068a6 refactor with more comments 2021-12-13 20:31:55 -05:00
Saran Ahluwalia
306fa204fb refactor into using thread pool executor 2021-12-13 16:35:27 -05:00
Saran Ahluwalia
a1e15b63c2 add time decorator to etl function 2021-12-13 12:29:19 -05:00
Saran Ahluwalia
abbf7771ec create threadpool to execture ETL across all CPUs 2021-12-12 07:32:52 -05:00
Saran Ahluwalia
8ad1f2408f create threadpool to execture ETL across all CPUs 2021-12-12 06:52:58 -05:00
Saran Ahluwalia
2cc1fa6079 Merge branch 'main' of https://github.com/saran-ahluwalia/justice40-tool into main 2021-12-09 12:01:28 -05:00
Vim
1f5742bc5b
Modify copy on About and Explore Tool pages (#974)
* Modify copy

- update snapshots

* Fix failing cypress tests

- commented out lat/lng in URL test as it is intermittent

* Removes test on EO link

* Update copy for launch

- adds 404 page verbiage
- fixes survey button to be bottom sticky

* Update copy
2021-12-08 10:15:31 -08:00
Saran Ahluwalia
df675b231a
Update HUD Housing Burden (#1005)
* update paths

* size information added in extract function

Co-authored-by: Saran Ahluwalia <sarahluw@cisco.com>
2021-12-08 11:57:52 -05:00
Lucas Merrill Brown
524b822651
Issue 1007: remove some recent additions to Definition L (#1008) 2021-12-08 10:26:52 -05:00
Lucas Merrill Brown
1a61026ecf
Issue 967: Calculate urban/rural percentiles (#1006) 2021-12-07 17:28:36 -05:00
Lucas Merrill Brown
780d1126ff
Creating notebook to compare two score files for differences (#984) 2021-12-07 16:20:41 -05:00
Saran Ahluwalia
e30b32fe07
Merge branch 'usds:main' into main 2021-12-07 16:01:52 -05:00
Vim
9d28f5a4c4
Add a case if data is not present in tiles (#998)
- will check each property and display N/A if null
- update snapshot
2021-12-07 09:52:50 -08:00
Lucas Merrill Brown
5706837956
Add NATA cancer risk and respiratory hazard to definition L (#1001) 2021-12-07 12:45:45 -05:00
Lucas Merrill Brown
5a6d6d8557
Issue 954: Add various data sources from Child Opportunity Index (#986)
* Adds four fields:
    * Summer days above 90F
    * Percent low access to healthy food
    * Percent impenetrable surface areas
    * Low third grade reading proficiency

* Each of these four gets added into Definition L in various factors.

* Additionally, I add college attendance fields to the ETL for Census ACS.

* This PR also introduces the notion of "reverse percentiles", relevant to ticket #970.
2021-12-07 11:33:49 -05:00
Vim
df564658a5
Add 4 additional territory buttons (#956)
* Add 4 additional territory buttons

* Fix bug where territories fires multiple times

- move territory handler from J40Map to component

* Update SVGs for all territory buttons
2021-12-06 19:58:04 -08:00
Shelby Switzer
819f3ff478
Update etl constants to use score field_names and put strings around tract IDs in downloadable CSV (#985)
* Update etl constants to use score field_names

Put strings around tract IDs in downloadable CSV

No need to modify the xls file creation because the string type is
preserved and interpreted correctly in Excel already.

One note is that this does cause the ID in the CSV to be have quotes
around it, which might be annoying. Maybe we don't want this behavior?

* Update based on PR feedback and lint needs

* Change field we're using in downloadable

This reverts the downloadable csv field list to use
MEDIAN_INCOME_AS_PERCENT_OF_STATE_FIELD instead of
MEDIAN_INCOME_AS_PERCENT_OF_AMI_FIELD in order to get the test to pass.
The point of this PR is a refactor (and a small change to the CSV
quotations), not to change the output. That will be a different PR
later.

Co-authored-by: Shelby Switzer <shelby.switzer@cms.hhs.gov>
2021-12-06 13:17:17 -05:00
Saran Ahluwalia
e308f0934b
Merge branch 'usds:main' into main 2021-12-05 20:12:20 -05:00
Jorge Escobar
bbc4a4dec0
Fix bug that dropped rows from island territories (#981)
Co-authored-by: lucasmbrown-usds <lucas.m.brown@omb.eop.gov>
2021-12-05 20:00:53 -05:00
Saran Ahluwalia
07ee4165b4
New Create indicators for all thresholds exceeded by a community in Definition L (#980)
* added fieldnames

* todo pollution, water, health & workforce

* workforce

* work in progress

* add utility function to replace duplicate summation logic

* move fpl series into add columns - run black .

* added revisions - still a wip

* added fieldnames

* todo pollution, water, health & workforce

* workforce

* work in progress

* add utility function to replace duplicate summation logic

* move fpl series into add columns - run black .

* added revisions - still a wip

* revise workforce and water

* revise housing and add incremental counter for workforce

* last PR nit

* revise workforce

* more PR feedback in score l

* more PR feedback in score l

* more PR feedback in score l

* addd FPL_SERIES and update references in score 1

* fix bugs

* reparameterize function

* final revisions in fieldnames

* make computations all consistent so we assing with FPL_200_SERIES

* fieldnames refactor after clarification and PR review

* finalize

* finalize with no typos

* fix length

* added median income var

* swap thresholds

* remove iteration

* remove stray '

* address flake 8

* added f string formatting and fixed typos

* added f string formatting and fixed typos

* move up

* remove dupes

* reformat

* fix bugs

* fix bugs

* initialize

Co-authored-by: Saran Ahluwalia <sarahluw@cisco.com>
2021-12-05 19:51:19 -05:00
Lucas Merrill Brown
d705a8244c
adding demographics information to ETL source data (#982) 2021-12-05 17:56:45 -05:00
Saran Ahluwalia
f1df3d3c34
Merge branch 'usds:main' into main 2021-12-05 09:24:42 -05:00
Saran Ahluwalia
610343a1e3
DoE fix to address #975 (#979)
* Fixed input field name

Co-authored-by: Saran Ahluwalia <sarahluw@cisco.com>
2021-12-05 08:26:39 -05:00
Saran Ahluwalia
b6f1f4e92f
Merge branch 'usds:main' into main 2021-12-04 12:42:21 -05:00
Saran Ahluwalia
19efdfeb4a
DoE LEAD References Need to be Updated (#976)
* replace temporary fieldnames that are not found and indexed

* fixed field names

* PR review

* PR review - revert

Co-authored-by: Saran Ahluwalia <sarahluw@cisco.com>
2021-12-04 12:38:50 -05:00
Lucas Merrill Brown
c5dff6e5f7
Issue 242: Add HOLC Grades to data inputs (#978)
* Add mapping inequality data to data inputs

* Add mapping inequality data to comparison tool
2021-12-04 12:23:01 -05:00
Saran Ahluwalia
12456c8dc5
Merge branch 'usds:main' into main 2021-12-03 15:51:43 -05:00
Lucas Merrill Brown
1d101c93d2
Issue 844: Add island areas to Definition L (#957)
This ended up being a pretty large task. Here's what this PR does:

1. Pulls in Vincent's data from island areas into the score ETL. This is from the 2010 decennial census, the last census of any kind in the island areas.
2. Grabs a few new fields from 2010 island areas decennial census.
3. Calculates area median income for island areas.
4. Stops using EJSCREEN as the source of our high school education data and directly pulls that from census (this was related to this project so I went ahead and fixed it).
5. Grabs a bunch of data from the 2010 ACS in the states/Puerto Rico/DC, so that we can create percentiles comparing apples-to-apples (ish) from 2010 island areas decennial census data to 2010 ACS data. This required creating a new class because all the ACS fields are different between 2010 and 2019, so it wasn't as simple as looping over a year parameter.
6. Creates a combined population field of island areas and mainland so we can use those stats in our comparison tool, and updates the comparison tool accordingly.
2021-12-03 15:46:10 -05:00
Saran Ahluwalia
8cb9d197df
updated doe enerygy link and changed fieldnames - removed computation step as BURDEN is already ratio (#963)
Co-authored-by: Saran Ahluwalia <sarahluw@cisco.com>
2021-12-03 13:33:19 -05:00
Saran Ahluwalia
07cf7f3f6b
Merge branch 'usds:main' into main 2021-12-03 13:11:26 -05:00
Saran Ahluwalia
8cb1070d1e
Integrate proximity to waste sites into pollution factors (#959)
* add tsdf proximity into predicate to determine thresholds

* strict inequality --> inclusive

Co-authored-by: Saran Ahluwalia <sarahluw@cisco.com>
2021-12-03 12:43:48 -05:00
Saran Ahluwalia
fdba1eb171
Revisions to FEMA measure and new link for FEMA data (#952)
* per tract collect all diaster total annual expected loss - numerator

* add updated numerators

* EALP columns are missing on tox check - this will ensure only EALP columns that exist are subet on

* EALB columns are missing on tox check - this will ensure only EALP columns that exist are subet on

* reverted to incorporate megatracts

* updated unit tests

* fix tests

* add transform

* remove print statement

* input reflects input from FEMA risks for tracts

* revise tests and update fixtures - clean up tests and main transform function

* added more records

* remove references to Blocks in keyword args in tests

* linting

* addressed latest PR feedback

* remove imports and update arguments to be compatible for 1.1.0

* remove block reference in test

* change precision to 10 digits - refactor tests to accomdate this

Co-authored-by: Saran Ahluwalia <sarahluw@cisco.com>
2021-12-03 12:42:07 -05:00