publicdata/j40-cejst-2
1
0
Fork 0
mirror of https://github.com/DOI-DO/j40-cejst-2.git synced 2025-08-11 10:14:19 -07:00
Code Issues Projects Releases Packages Wiki Activity Actions

Issue 1075: Add refactored ETL tests to NRI (#1088)

Browse source 
* Adds a substantially refactored ETL test to the National Risk Index, to be used as a model for other tests
This commit is contained in:
Lucas Merrill Brown 2022-02-08 19:05:32 -05:00 • committed by GitHub
commit 43e005cc10
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
41 changed files with 1155 additions and 619 deletions
Download patch file Download diff file Expand all files Collapse all files

16
data/data-pipeline/data_pipeline/tests/sources/example/data/input.csv Normal file
View file

@ -0,0 +1,16 @@
GEOID10_TRACT,Input Field 1
06007040300,2
06001020100,6.1
06007040500,-7.8
15001021010,12
15001021101,12.05524783
15007040603,13.51417578
15007040700,13.11988976
15009030100,13.60946983
15009030201,13.73235164
15001021402,14.73305116
15001021800,16.60833857
15009030402,16.002535
15009030800,15.34818251
15003010201,14.58788769
15007040604,14.27704917
1 GEOID10_TRACT Input Field 1
2 06007040300 2
3 06001020100 6.1
4 06007040500 -7.8
5 15001021010 12
6 15001021101 12.05524783
7 15007040603 13.51417578
8 15007040700 13.11988976
9 15009030100 13.60946983
10 15009030201 13.73235164
11 15001021402 14.73305116
12 15001021800 16.60833857
13 15009030402 16.002535
14 15009030800 15.34818251
15 15003010201 14.58788769
16 15007040604 14.27704917

BIN
data/data-pipeline/data_pipeline/tests/sources/example/data/input.zip Normal file
View file

Binary file not shown.

16
data/data-pipeline/data_pipeline/tests/sources/example/data/output.csv Normal file
View file

@ -0,0 +1,16 @@
GEOID10_TRACT,Example Field 1
06007040300,4.0
06001020100,12.2
06007040500,-15.6
15001021010,24.0
15001021101,24.11049566
15007040603,27.02835156
15007040700,26.23977952
15009030100,27.21893966
15009030201,27.46470328
15001021402,29.46610232
15001021800,33.21667714
15009030402,32.00507
15009030800,30.69636502
15003010201,29.17577538
15007040604,28.55409834
1 GEOID10_TRACT Example Field 1
2 06007040300 4.0
3 06001020100 12.2
4 06007040500 -15.6
5 15001021010 24.0
6 15001021101 24.11049566
7 15007040603 27.02835156
8 15007040700 26.23977952
9 15009030100 27.21893966
10 15009030201 27.46470328
11 15001021402 29.46610232
12 15001021800 33.21667714
13 15009030402 32.00507
14 15009030800 30.69636502
15 15003010201 29.17577538
16 15007040604 28.55409834

16
data/data-pipeline/data_pipeline/tests/sources/example/data/transform.csv Normal file
View file

@ -0,0 +1,16 @@
GEOID10_TRACT,Input Field 1,Example Field 1
06007040300,2.0,4.0
06001020100,6.1,12.2
06007040500,-7.8,-15.6
15001021010,12.0,24.0
15001021101,12.05524783,24.11049566
15007040603,13.51417578,27.02835156
15007040700,13.11988976,26.23977952
15009030100,13.60946983,27.21893966
15009030201,13.73235164,27.46470328
15001021402,14.73305116,29.46610232
15001021800,16.60833857,33.21667714
15009030402,16.002535,32.00507
15009030800,15.34818251,30.69636502
15003010201,14.58788769,29.17577538
15007040604,14.27704917,28.55409834
1 GEOID10_TRACT Input Field 1 Example Field 1
2 06007040300 2.0 4.0
3 06001020100 6.1 12.2
4 06007040500 -7.8 -15.6
5 15001021010 12.0 24.0
6 15001021101 12.05524783 24.11049566
7 15007040603 13.51417578 27.02835156
8 15007040700 13.11988976 26.23977952
9 15009030100 13.60946983 27.21893966
10 15009030201 13.73235164 27.46470328
11 15001021402 14.73305116 29.46610232
12 15001021800 16.60833857 33.21667714
13 15009030402 16.002535 32.00507
14 15009030800 15.34818251 30.69636502
15 15003010201 14.58788769 29.17577538
16 15007040604 14.27704917 28.55409834