publicdata/j40-cejst-2
1
0
Fork 0
mirror of https://github.com/DOI-DO/j40-cejst-2.git synced 2025-02-23 10:04:18 -08:00
Code Issues Projects Releases Packages Wiki Activity Actions
j40-cejst-2/infrastructure/environment.yml

40 lines
2.2 KiB
YAML
Raw Normal View History

Fargate Serverless Workers for Census Data Enrichment and Tile Generation (#230) * add basic infrastructure * add cloudfront distribution * WIP checkpoint * add ecs cluster * add conditions and route53 dns entry to cloudfront * WIP checkin * Added a raw execution mode for demo/testing * Add pre-defined Task for ogr2ogr * Tweak Task Definition name * Mostly working except for logging error * Add additional logging permissions * Succesfully executed ogr2ogr in fargate. S3 permissions needs to be addresses * Add multipart permissions * Add a few more actions * Put IAM Policy on the correct resource * Deploy lambda and update events * fix iam permissions 🤦🏻‍♂️ * Add reference to Tippecanoe container * Clean up to only use named actions * Refactor resources to include support for tippecanoe * Make a more interesting GDAL command * Pull all ECS variables into environment file; successful test of running tippecanoe container * Support pre/post commands * Refactor codebase and enable linting * Implement many-to-many enrichment between USDS CSV files and Census zipped shapefiles * Change the GDAL image to one with the built-in drivers * Add some additional fixes to support the enrichment use case * Clean up old hello-world example * Expand the README to include ways to execute the lambdas * Validate scheduled lambda execution and then comment out Co-authored-by: Tim Zwolak <timothypage@gmail.com>
2021-06-30 08:29:01 -05:00
sit:
DEPLOYMENT_BUCKET_PREFIX: ${self:custom.namespaceShort}
STACK_NAME_PREFIX: "${self:custom.namespaceShort}-"
DATA_BUCKET: ${self:custom.environment.DEPLOYMENT_BUCKET_PREFIX}-${self:provider.stage}-${self:service}-data
SHOULD_CREATE_SSL_CERTIFICATE: true
HOSTED_ZONE_ID_DOMAIN: Z104704314NAAG3GV4SN1
HOSTED_ZONE_SUBDOMAIN: ${self:provider.stage}-${self:service}
HOSTED_ZONE_DOMAIN: geoplatform.info
CLOUDFRONT_CERTIFICATE_ARN: arn:aws:acm:us-east-1:998343784597:certificate/083641d4-9df6-4f89-b79d-6697f428f5b9
GDAL_TASK_DEFINITION_NAME: ${self:provider.stage}-${self:service}-gdal
GDAL_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-osgeo-gdal
TIPPECANOE_TASK_DEFINITION_NAME: ${self:provider.stage}-${self:service}-tippecanoe
TIPPECANOE_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-mgiddens-tippecanoe
stg:
DEPLOYMENT_BUCKET_PREFIX: ${self:custom.namespaceShort}
STACK_NAME_PREFIX: "${self:custom.namespaceShort}-"
DATA_BUCKET: ${self:custom.environment.DEPLOYMENT_BUCKET_PREFIX}-${self:provider.stage}-${self:service}-data
deployment configuration changes to serverless
2021-07-16 09:43:56 -04:00
SHOULD_CREATE_SSL_CERTIFICATE: true
Fargate Serverless Workers for Census Data Enrichment and Tile Generation (#230) * add basic infrastructure * add cloudfront distribution * WIP checkpoint * add ecs cluster * add conditions and route53 dns entry to cloudfront * WIP checkin * Added a raw execution mode for demo/testing * Add pre-defined Task for ogr2ogr * Tweak Task Definition name * Mostly working except for logging error * Add additional logging permissions * Succesfully executed ogr2ogr in fargate. S3 permissions needs to be addresses * Add multipart permissions * Add a few more actions * Put IAM Policy on the correct resource * Deploy lambda and update events * fix iam permissions 🤦🏻‍♂️ * Add reference to Tippecanoe container * Clean up to only use named actions * Refactor resources to include support for tippecanoe * Make a more interesting GDAL command * Pull all ECS variables into environment file; successful test of running tippecanoe container * Support pre/post commands * Refactor codebase and enable linting * Implement many-to-many enrichment between USDS CSV files and Census zipped shapefiles * Change the GDAL image to one with the built-in drivers * Add some additional fixes to support the enrichment use case * Clean up old hello-world example * Expand the README to include ways to execute the lambdas * Validate scheduled lambda execution and then comment out Co-authored-by: Tim Zwolak <timothypage@gmail.com>
2021-06-30 08:29:01 -05:00
HOSTED_ZONE_ID_DOMAIN: TBD
HOSTED_ZONE_SUBDOMAIN: ${self:provider.stage}-${self:service}
HOSTED_ZONE_DOMAIN: TBD
CLOUDFRONT_CERTIFICATE_ARN: TBD
deployment configuration changes to serverless
2021-07-16 09:43:56 -04:00
GDAL_TASK_DEFINITION_NAME: ${self:provider.stage}-${self:service}-gdal
Fargate Serverless Workers for Census Data Enrichment and Tile Generation (#230) * add basic infrastructure * add cloudfront distribution * WIP checkpoint * add ecs cluster * add conditions and route53 dns entry to cloudfront * WIP checkin * Added a raw execution mode for demo/testing * Add pre-defined Task for ogr2ogr * Tweak Task Definition name * Mostly working except for logging error * Add additional logging permissions * Succesfully executed ogr2ogr in fargate. S3 permissions needs to be addresses * Add multipart permissions * Add a few more actions * Put IAM Policy on the correct resource * Deploy lambda and update events * fix iam permissions 🤦🏻‍♂️ * Add reference to Tippecanoe container * Clean up to only use named actions * Refactor resources to include support for tippecanoe * Make a more interesting GDAL command * Pull all ECS variables into environment file; successful test of running tippecanoe container * Support pre/post commands * Refactor codebase and enable linting * Implement many-to-many enrichment between USDS CSV files and Census zipped shapefiles * Change the GDAL image to one with the built-in drivers * Add some additional fixes to support the enrichment use case * Clean up old hello-world example * Expand the README to include ways to execute the lambdas * Validate scheduled lambda execution and then comment out Co-authored-by: Tim Zwolak <timothypage@gmail.com>
2021-06-30 08:29:01 -05:00
GDAL_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-osgeo-gdal
deployment configuration changes to serverless
2021-07-16 09:43:56 -04:00
TIPPECANOE_TASK_DEFINITION_NAME: ${self:provider.stage}-${self:service}-tippecanoe
TIPPECANOE_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-mgiddens-tippecanoe
Fargate Serverless Workers for Census Data Enrichment and Tile Generation (#230) * add basic infrastructure * add cloudfront distribution * WIP checkpoint * add ecs cluster * add conditions and route53 dns entry to cloudfront * WIP checkin * Added a raw execution mode for demo/testing * Add pre-defined Task for ogr2ogr * Tweak Task Definition name * Mostly working except for logging error * Add additional logging permissions * Succesfully executed ogr2ogr in fargate. S3 permissions needs to be addresses * Add multipart permissions * Add a few more actions * Put IAM Policy on the correct resource * Deploy lambda and update events * fix iam permissions 🤦🏻‍♂️ * Add reference to Tippecanoe container * Clean up to only use named actions * Refactor resources to include support for tippecanoe * Make a more interesting GDAL command * Pull all ECS variables into environment file; successful test of running tippecanoe container * Support pre/post commands * Refactor codebase and enable linting * Implement many-to-many enrichment between USDS CSV files and Census zipped shapefiles * Change the GDAL image to one with the built-in drivers * Add some additional fixes to support the enrichment use case * Clean up old hello-world example * Expand the README to include ways to execute the lambdas * Validate scheduled lambda execution and then comment out Co-authored-by: Tim Zwolak <timothypage@gmail.com>
2021-06-30 08:29:01 -05:00
prd:
DEPLOYMENT_BUCKET_PREFIX: ${self:custom.namespaceShort}
STACK_NAME_PREFIX: "${self:custom.namespaceShort}-"
DATA_BUCKET: ${self:custom.environment.DEPLOYMENT_BUCKET_PREFIX}-${self:provider.stage}-${self:service}-data
SHOULD_CREATE_SSL_CERTIFICATE: false
HOSTED_ZONE_ID_DOMAIN: TBD
HOSTED_ZONE_SUBDOMAIN: ${self:service}
HOSTED_ZONE_DOMAIN: TBD
CLOUDFRONT_CERTIFICATE_ARN: TBD
GDAL_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-osgeo-gdal
TIPPECANOE_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-tippecanoe
Reference in a new issue Copy permalink