[ENH] - Explore automatic update of Terraform providers

[marcelovilla]

Feature description

We are currently depending on ~10 different Terraform providers, many of which are outdated. Furthermore, they can be found across all different stages rather than in a centralized location, making them harder to track.

Renovate, a tool for automated dependency updates, seems to have an option to automate Terraform dependencies. We should explore the feasibility of incorporating it in the Nebari repo, so PRs with updates to the Terraform providers get automatically opened when new versions become available.

Value and/or benefit

Having a tool that suggests automatic updates to the Terraform providers will make their maintenance much easier, while still allowing us to decide and review whether an update is needed/feasible.

Anything else?

No response

[smokestacklightnin]

This seems like it would also address #2614, and, incidentally, I had also come across this tool when researching #2614.

[smokestacklightnin]

I have an almost complete proof of concept for renovate. Once complete, we can have a discussion about incorporating it, which will also address #2614.

@dcmcand can you please assign me to this issue, or preferably give me the permissions so that I can assign myself?

[dcmcand]

@smokestacklightnin please see my comments on #2614

[marcelovilla]

@smokestacklightnin I appreciate the enthusiasm here but before implementing this, I suggest you:

1. Work on [BUG] - Terraform provider version inconsistency within stages #2614
2. Explore and outline/propose how Renovate could be potentially used within Nebari to update the Terraform providers. Having the context of the previous issue is important because depending on the way we solve it, it might have different implications on how we implement Renovate.