Skip to content
upload-and-deploy

Decouple S3 to JSON workflow from JSON to Parquet workflow #408

Sign in to view logs

Decouple S3 to JSON workflow from JSON to Parquet workflow

Decouple S3 to JSON workflow from JSON to Parquet workflow #408

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Run pre-commit hooks against all files
14s
Upload files to S3 bucket in development
1m 45s
Runs unit tests that are not dependent on aws-glue package resources
16m 43s
Build and push testing docker images to the pytest ECR repository. (aws_glue_3, tests/Dockerfile....
2m 29s
Build and push testing docker images to the pytest ECR repository. (aws_glue_4, tests/Dockerfile....
4m 33s
Run Pytest unit tests for AWS glue (aws_glue_3)
2m 8s
Run Pytest unit tests for AWS glue (aws_glue_4)
7m 29s
Deploys branch using sceptre
1m 49s
Triggers ETL workflow with S3 test files
0s
Deploys to staging of prod using sceptre
0s
Triggers staging workflow with production data
0s
37m 10s