CI: Add Infracost to GHA CI for infra cost tracking

[HarshCasper]

Partially-resolves #1315

Changes introduced in this PR:

• Adds Infracost CI integration for QHub

Types of changes

What types of changes does your PR introduce?

Put an x in the boxes that apply

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds a feature)
• Breaking change (fix or feature that would cause existing features to not work as expected)
• Documentation Update
• Code style update (formatting, renaming)
• Refactoring (no functional changes, no API changes)
• Build related changes
• Other (please describe):

Testing

Requires testing

• Yes
• No

In case you checked yes, did you write tests?

• Yes
• No

[iameskild]

Thanks a lot for working on this @HarshCasper! I appreciate the comments you left as well :)

I raised a few items that we might want to discuss before merging though, let me know what you think!

[github-actions]

💰 Infracost estimate: monthly cost will decrease by $0.57 (-1%) 📉

Project	Previous	New	Diff
Quansight/qhub/data/stages/01-terraform-state/aws	$0.57	$0	-$0.57
All projects	$73.57	$73.00	-$0.57 (-1%)

7 projects have no cost estimate changes.

Infracost output

Project: Quansight/qhub/data/stages/01-terraform-state/aws

- module.terraform-state.aws_dynamodb_table.terraform-state-lock
  -$0.57

    - Write capacity unit (WCU)
      -$0.47

    - Read capacity unit (RCU)
      -$0.09

    - Data storage
      Monthly cost depends on usage
        -$0.25 per GB

    - Point-In-Time Recovery (PITR) backup storage
      Monthly cost depends on usage
        -$0.20 per GB

    - On-demand backup storage
      Monthly cost depends on usage
        -$0.10 per GB

    - Table data restored
      Monthly cost depends on usage
        -$0.15 per GB

    - Streams read request unit (sRRU)
      Monthly cost depends on usage
        -$0.0000002 per sRRUs

- module.terraform-state.aws_s3_bucket.terraform-state
  Monthly cost depends on usage

    - Standard
    
        - Storage
          Monthly cost depends on usage
            -$0.023 per GB
    
        - PUT, COPY, POST, LIST requests
          Monthly cost depends on usage
            -$0.005 per 1k requests
    
        - GET, SELECT, and all other requests
          Monthly cost depends on usage
            -$0.0004 per 1k requests
    
        - Select data scanned
          Monthly cost depends on usage
            -$0.002 per GB
    
        - Select data returned
          Monthly cost depends on usage
            -$0.0007 per GB

Monthly cost change for Quansight/qhub/data/stages/01-terraform-state/aws
Amount:  -$0.57 ($0.57 → $0.00)

──────────────────────────────────

The following projects have no cost estimate changes: Quansight/qhub/data/stages/02-infrastructure/aws, Quansight/qhub/data/stages/03-kubernetes-initialize, Quansight/qhub/data/stages/04-kubernetes-ingress, Quansight/qhub/data/stages/05-kubernetes-keycloak, Quansight/qhub/data/stages/06-kubernetes-keycloak-configuration, Quansight/qhub/data/stages/07-kubernetes-services, Quansight/qhub/data/stages/08-qhub-tf-extensions
Run the following command to see their breakdown: infracost breakdown --path=/path/to/code

──────────────────────────────────
Key: ~ changed, + added, - removed

4 cloud resources were detected:
∙ 4 were estimated, 3 of which include usage-based costs, see https://infracost.io/usage-file

This comment will be updated when the cost estimate changes.

_{Is this comment useful? Yes, No}

[viniciusdc]

Why are we targetting only the 02-infrastructure stage here?

[HarshCasper]

there are some resources created during other stages (such as the loadbalancer), does infracost run over all the stages or only the initial 01 and 02?

It runs over all the stages, not just the initial 01 and 02. However, the workflow doesn't detect changes in the infrastructure not mentioned on the filters. Can you just let me know about them so that I can add them?

[HarshCasper]

Why are we targetting only the 02-infrastructure stage here?

It's as per the comment by @costrouc. If you want, I can direct it to target changes made on any change in the infrastructure.

[viniciusdc]

I see it's okay for me. Could you point me out to this comment as well? no need to change the config. Thanks @HarshCasper

[HarshCasper]

@viniciusdc It was over a private message. @costrouc can verify that.

[iameskild]

💰 Infracost estimate: monthly cost will decrease by $0.57 (-1%) 📉

Project Previous New Diff
Quansight/qhub/data/stages/01-terraform-state/aws $0.57 $0 -$0.57
All projects $73.57 $73.00 -$0.57 (-1%)
7 projects have no cost estimate changes.

Infracost output
This comment will be updated when the cost estimate changes.

Is this comment useful? Yes, No

Thanks for all the updates @HarshCasper! This is looking real sweet 😎

Let me just verify I understand these changes too:

• the above Infracost output whenever we make changes (PR) to stages 01-02 (see filter)
• and CI outputs these costs as an artifact

LGTM!

[HarshCasper]

the above Infracost output whenever we make changes (PR) to stages 01-02 (see filter)

Yes! Whenever the infrastructure is changed for either cloud service provider, the Infracost PR report is generated.

and CI outputs these costs as an artifact

Yes! It is also posted as a PR comment (for the particular cloud service provider).

[viniciusdc]

As @iameskild commented, this LGTM as well. If anything we can update this later if needed.