Commit graph

229 commits

Author SHA1 Message Date
matt bowen
e0a06997e6 Run YAML load on all subclasses (#1518) 2022-08-02 17:16:22 -04:00
matt bowen
bb06628921 Add defaults for extract (#1518) 2022-08-02 17:16:22 -04:00
matt bowen
1bdca27926 Don't blindly set float format (#1518) 2022-08-02 17:16:22 -04:00
matt bowen
d9b61140aa Update YAML to match constant (#1518) 2022-08-02 17:16:22 -04:00
matt bowen
415af5b31e Add output-path tests (#1518) 2022-08-02 17:16:22 -04:00
matt bowen
4e39be6748 Refactor _setup_etl_instance_and_run_extract to base (#1518)
For the three classes we've done so far, a generic
_setup_etl_instance_and_run_extract will work fine, for the moment we
can reuse the same setup method until we decide future classes need more
flexibility --- but they can also always subclass so...
2022-08-02 17:16:22 -04:00
matt bowen
e49cca005a Add fake GEOIDs to COI tests (#1518) 2022-08-02 17:16:22 -04:00
Matthew Bowen
76d4ebe0c3 Refactor ETL to use datasets.yml (#1518) 2022-08-02 17:16:22 -04:00
Matthew Bowen
c68371f051 Add dataset config for energy budren (1518) 2022-08-02 17:16:22 -04:00
Matthew Bowen
12a6b2f10e Add tests for DOE energy budren (1518 2022-08-02 17:16:22 -04:00
Matthew Bowen
e77e7aef2e Update COI to use new yaml (#1518) 2022-08-02 17:16:22 -04:00
Matthew Bowen
073c1fe457 Add basic test suite for COI (#1518) 2022-08-02 17:16:22 -04:00
Jorge Escobar
a6ab3cd883 PR review 2022-08-02 12:33:41 -04:00
Jorge Escobar
3a84fadaf6 Merge branch 'main' into esfoobar-usds/1417-nri-yaml-score 2022-08-02 11:24:21 -04:00
Jorge Escobar
8149ac31c5
Starting Tribal Boundaries Work (#1736)
* starting tribal pr

* further pipeline work

* bia merge working

* alaska villages and tribal geo generate

* tribal folders

* adding data full run

* tile generation

* tribal tile deploy
2022-07-30 01:13:10 -04:00
Vim
e1a61faf5d
Add a react component generator (#1745)
* Add a react component generator

* Update markdown links

* Change commented code to block comment
2022-07-15 09:54:58 -07:00
Vim
eb3004c0d5
Fix on large AK tracts that are off screen (#1740)
* Change low to high transition and global zoom

- change the low to high transition from 7 to 5. This can not go any lower as high tiles on AWS only go to zoom level 5
- reduce the zoom level globally on all census tracts

* Remove geolocation from feature flag

- geolocation is now available to all

* Add python notebook that sorts all tracts by area

- add a column of the required zoom level for the tract to be fully contained in the viewport

* Place geolocation back to behind a feature flag

* Differentiate zoom levels b/w shortcuts and tracts
2022-07-13 19:01:43 -07:00
dependabot[bot]
2992f8df0b
Bump notebook from 6.4.10 to 6.4.12 in /data/data-pipeline (#1685)
Bumps [notebook](http://jupyter.org) from 6.4.10 to 6.4.12.

---
updated-dependencies:
- dependency-name: notebook
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-07 17:10:03 -04:00
dependabot[bot]
0555d896fd
Bump lxml from 4.8.0 to 4.9.1 in /data/data-pipeline (#1719)
Bumps [lxml](https://github.com/lxml/lxml) from 4.8.0 to 4.9.1.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](https://github.com/lxml/lxml/compare/lxml-4.8.0...lxml-4.9.1)

---
updated-dependencies:
- dependency-name: lxml
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-07 17:09:49 -04:00
Jorge Escobar
5ce4a5c1f7 column ordening 2022-07-07 11:47:19 -04:00
Jorge Escobar
0d81480133 sort order 2022-07-06 16:24:23 -04:00
Jorge Escobar
c9632571f3 passing tests 2022-06-27 13:46:09 -04:00
Jorge Escobar
e5b84dc28d removing last updated year - optional reverse percentile 2022-06-27 12:59:17 -04:00
Jorge Escobar
7415a15bc0 docsctrings 2022-06-27 11:19:11 -04:00
Jorge Escobar
158c8bffb2 dynamically set score vars from YAML 2022-06-24 15:18:57 -04:00
Jorge Escobar
34f7ef27ce adding source url as class var again 2022-06-01 17:10:30 -04:00
Jorge Escobar
0460852bf0 Merge branch 'esfoobar-usds/release/yaml-based-score-datasets' into esfoobar-usds/1417-nri-yaml-score 2022-06-01 13:34:58 -04:00
Kameron Kerger
7c808eb2e0
Add files via upload (#1656)
updated TSD (new - naming convention) and new TSD-es
2022-05-31 13:19:01 -04:00
Jorge Escobar
400746f7fb stop execution of ETL if there's a YAML schema issue 2022-05-19 12:29:56 -04:00
Jorge Escobar
38304f846f tests 2022-05-16 15:52:00 -04:00
Jorge Escobar
1db2362426 renoving source url 2022-05-16 15:24:48 -04:00
Jorge Escobar
a127ac2e72 PR Review 2022-05-16 14:47:31 -04:00
Jorge Escobar
105d2cb442 checkpoint 2022-05-16 13:26:07 -04:00
Jorge Escobar
5f2228913b columns to keep and tests 2022-05-16 13:26:05 -04:00
Jorge Escobar
c18e69ef90 lint 2022-05-16 13:23:52 -04:00
Jorge Escobar
27599f2ebc adding INPUT_EXTRACTED_FILE_NAME to base class 2022-05-16 13:23:51 -04:00
Jorge Escobar
f0e8ac40e0 passing tests 2022-05-16 13:23:51 -04:00
Jorge Escobar
0a9c04c501 checkpoint 2022-05-16 13:23:50 -04:00
Jorge Escobar
0ee0a4d15f NRI dataset and initial score YAML configuration 2022-05-16 13:23:49 -04:00
Jorge Escobar
ce89214a60
Adding Technical Training Slides (#1638)
* Adding Technical Training Slides

* small update on CI/CD map staging URL
2022-05-12 15:01:26 -04:00
Jorge Escobar
2af6fca98d
Columnn headers update (#1618)
* Columnn headers update

* passing tests

* updated date stamp

* js tests
2022-05-06 14:10:15 -04:00
Kameron Kerger
303c200fbe
Add files via upload (#1612)
updated pdf
2022-05-04 10:47:54 -04:00
Jorge Escobar
eb1cb8884e
Adding a note about Scipy installation on newer MacOS 2022-05-03 17:26:05 -04:00
Emma Nechamkin
ae725f0a3e
arcgis column name fix (#1581)
eliminates duplicate column and ensures all column names are unique.
2022-04-22 14:09:12 -04:00
Jorge Escobar
fbd56e3bd5
Put the pdf back in the package and add TSD to pipeline (#1580)
* Put the pdf back in the package and add TSD to pipeline

* updated pdf with logo

* wrong path
2022-04-21 13:42:04 -04:00
Kameron Kerger
72e6dbc1dd
/1354-update-pdf (#1568)
updated pdf for the put the pdf back in the package issue
2022-04-19 11:07:31 -04:00
Emma Nechamkin
2ce4cfe80e
updated with codebook (#1573) 2022-04-18 18:12:18 -04:00
Jorge Escobar
859177a877
Marshmallow Schemas for YAML files (#1497)
* Marshmallow Schemas for YAML files

* completed ticket

* passing tests

* lint

* click dep

* staging BE map

* Pr review
2022-03-31 13:56:10 -04:00
Emma Nechamkin
cb963cff5f
Updating comparison tool to be easier for pairwise comparisons (#1400)
Creating pairwise comparison tool to compare two lists of prioritized tracts to each other.
2022-03-30 14:02:06 -04:00
Emma Nechamkin
2628afacf9
Creating a data dictionary for the download packet (#1469)
Adding automated codebook creation. Future ticket to refactor.
2022-03-30 11:01:43 -04:00