j40-cejst-2/infrastructure/environment.yml
Lucas Scharenbroich 38fff9cea8
Fargate Serverless Workers for Census Data Enrichment and Tile Generation (#230)
* add basic infrastructure

* add cloudfront distribution

* WIP checkpoint

* add ecs cluster

* add conditions and route53 dns entry to cloudfront

* WIP checkin

* Added a raw execution mode for demo/testing

* Add pre-defined Task for ogr2ogr

* Tweak Task Definition name

* Mostly working except for logging error

* Add additional logging permissions

* Succesfully executed ogr2ogr in fargate.  S3 permissions needs to be addresses

* Add multipart permissions

* Add a few more actions

* Put IAM Policy on the correct resource

* Deploy lambda and update events

* fix iam permissions 🤦🏻‍♂️

* Add reference to Tippecanoe container

* Clean up to only use named actions

* Refactor resources to include support for tippecanoe

* Make a more interesting GDAL command

* Pull all ECS variables into environment file; successful test of running tippecanoe container

* Support pre/post commands

* Refactor codebase and enable linting

* Implement many-to-many enrichment between USDS CSV files and Census zipped shapefiles

* Change the GDAL image to one with the built-in drivers

* Add some additional fixes to support the enrichment use case

* Clean up old hello-world example

* Expand the README to include ways to execute the lambdas

* Validate scheduled lambda execution and then comment out

Co-authored-by: Tim Zwolak <timothypage@gmail.com>
2021-06-30 09:29:01 -04:00

37 lines
2 KiB
YAML

sit:
DEPLOYMENT_BUCKET_PREFIX: ${self:custom.namespaceShort}
STACK_NAME_PREFIX: "${self:custom.namespaceShort}-"
DATA_BUCKET: ${self:custom.environment.DEPLOYMENT_BUCKET_PREFIX}-${self:provider.stage}-${self:service}-data
SHOULD_CREATE_SSL_CERTIFICATE: true
HOSTED_ZONE_ID_DOMAIN: Z104704314NAAG3GV4SN1
HOSTED_ZONE_SUBDOMAIN: ${self:provider.stage}-${self:service}
HOSTED_ZONE_DOMAIN: geoplatform.info
CLOUDFRONT_CERTIFICATE_ARN: arn:aws:acm:us-east-1:998343784597:certificate/083641d4-9df6-4f89-b79d-6697f428f5b9
GDAL_TASK_DEFINITION_NAME: ${self:provider.stage}-${self:service}-gdal
GDAL_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-osgeo-gdal
TIPPECANOE_TASK_DEFINITION_NAME: ${self:provider.stage}-${self:service}-tippecanoe
TIPPECANOE_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-mgiddens-tippecanoe
stg:
DEPLOYMENT_BUCKET_PREFIX: ${self:custom.namespaceShort}
STACK_NAME_PREFIX: "${self:custom.namespaceShort}-"
DATA_BUCKET: ${self:custom.environment.DEPLOYMENT_BUCKET_PREFIX}-${self:provider.stage}-${self:service}-data
SHOULD_CREATE_SSL_CERTIFICATE: false
HOSTED_ZONE_ID_DOMAIN: TBD
HOSTED_ZONE_SUBDOMAIN: ${self:provider.stage}-${self:service}
HOSTED_ZONE_DOMAIN: TBD
CLOUDFRONT_CERTIFICATE_ARN: TBD
GDAL_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-osgeo-gdal
TIPPECANOE_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-tippecanoe
prd:
DEPLOYMENT_BUCKET_PREFIX: ${self:custom.namespaceShort}
STACK_NAME_PREFIX: "${self:custom.namespaceShort}-"
DATA_BUCKET: ${self:custom.environment.DEPLOYMENT_BUCKET_PREFIX}-${self:provider.stage}-${self:service}-data
SHOULD_CREATE_SSL_CERTIFICATE: false
HOSTED_ZONE_ID_DOMAIN: TBD
HOSTED_ZONE_SUBDOMAIN: ${self:service}
HOSTED_ZONE_DOMAIN: TBD
CLOUDFRONT_CERTIFICATE_ARN: TBD
GDAL_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-osgeo-gdal
TIPPECANOE_CONTAINER_DEFINITION_NAME: ${self:provider.stage}-${self:service}-tippecanoe