publicdata/j40-cejst-2
1
0
Fork 0
mirror of https://github.com/DOI-DO/j40-cejst-2.git synced 2025-02-23 18:14:19 -08:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update file name pattern (#2037) (#2038)

Browse source 
* Update file name pattern (#2037)

* Remove ETL from generation (2037)

I looked more carefully, and this ETL step isn't used in the score, so
there's no need to run it every time. Per previous steps, I removed it
from constants so the code is there it won't run by default.
This commit is contained in:
Matt Bowen 2022-10-26 13:00:24 -04:00 • committed by GitHub
parent dbea3490f2
commit b5cea2751f
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 1 additions and 7 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
data/data-pipeline/data_pipeline/etl/constants.py
View file

@ -29,12 +29,6 @@ DATASET_LIST = [
"class_name": "CensusDecennialETL", "class_name": "CensusDecennialETL",
"is_memory_intensive": False, "is_memory_intensive": False,
}, },
{
"name": "housing_and_transportation",
"module_dir": "housing_and_transportation",
"class_name": "HousingTransportationETL",
"is_memory_intensive": False,
},
{ {
"name": "mapping_for_ej", "name": "mapping_for_ej",
"module_dir": "mapping_for_ej", "module_dir": "mapping_for_ej",

2
data/data-pipeline/data_pipeline/etl/sources/housing_and_transportation/etl.py
View file

@ -35,7 +35,7 @@ class HousingTransportationETL(ExtractTransformLoad):
# New file name: # New file name:
tmp_csv_file_path = ( tmp_csv_file_path = (
zip_file_dir / f"htaindex_data_tracts_{fips}.csv" zip_file_dir / f"htaindex2019_data_tracts_{fips}.csv"
) )
try: try: