Skip to content

Commit

Permalink
chore: new documentation on how to manage blue-green deployments with…
Browse files Browse the repository at this point in the history
… AWS RDS (#469)
  • Loading branch information
acarranoqovery authored Sep 18, 2024
1 parent 943ee09 commit 7d05ba2
Show file tree
Hide file tree
Showing 6 changed files with 205 additions and 0 deletions.
104 changes: 104 additions & 0 deletions website/guides/advanced/upgrading-rds-instance.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,104 @@
---
last_modified_on: "2024-09-18"
$schema: "/.meta/.schemas/guides.json"
title: Minimize downtime while upgrading RDS instances
description: Learn how to upgrade your RDS instance (PostgreSQL, MySql) minimizing your downtime with Qovery and Blue Green deployments
author_github: https://github.com/acarranoqovery
tags: ["type: guide", "technology: qovery"]
---
import Steps from '@site/src/components/Steps';
import Assumptions from '@site/src/components/Assumptions';
import Alert from '@site/src/components/Alert';

Managed RDS instances deployed with Qovery have by defualt a maintenance window configured, applying database updates only during the specifyied timeframe (see more [information here][docs.using-qovery.configuration.database#applying-changes-to-a-managed-database]).

During the maintenance window, a downtime has to be expected on your service since the upgrade might takes a few minutes to take effect.

If this is not acceptable for your business, AWS allows you to deploy changes via the [Blue/Green Deployments](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/blue-green-deployments.html).

This basically allows you to create a copy of your database with the new configuration (called "Green group") and then switch over to the new database by removing the old instance ("Blue group").

Blue/Green deployments on RDS are not natively supported by Qovery but you can follow this guide to upgrade your RDS instances.

# How to configure

To better explain the process, we will try to upgrade an RDS PostgreSQL instance from the version 14 to the version 15.

<!--
THIS FILE IS AUTOGENERATED!
To make changes please edit the template located at:
website/guides/advanced/upgrading-rds-instance.md.erb
-->

## Activate the logical replication

<Alert type="info">

This part has to be done only once for each database. If you have already activated the logical replication, go to the next section.

</Alert>

Logical replication is necessary to use the RDS Blue/Green deployment feature.

To enable the logical replication you have to:

1. Create a Custom DB Parameter group. Make sure it targets your current engine type (PostgreSQL) and version (Parameter group family = postgres14), let's call it `parameter-group-14`. (Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithParamGroups.Creating.html))
2. Edit the DB parameter group `parameter-group-14` and activate the logical replication by setting `rds.logical_replication` to `1` (Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_MultiAZDBCluster_LogicalRepl.html#multi-az-db-clusters-logical-replication))
3. Associate the DB Parameter group `parameter-group-14` to your database. If you have read replicas, associate the parameter group to the replicas as well. (Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithParamGroups.Associating.html))
4. Reboot your database to apply the changes or wait for the next maintenance window for applying these changes.


## Enable logical replication for the "Green" database

We will create a separate DB Parameter group for our "Green group" so that we will ensure that the you won't have to do the previous step the next time.

1. Create a Custom DB Parameter group. Make sure it targets your **next** engine type and version (Parameter group family), let's call it `parameter-group-15` Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithParamGroups.Creating.html))
2. Edit the DB parameter group `parameter-group-15` and activate the logical replication by setting `rds.logical_replication` to `1` (Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_MultiAZDBCluster_LogicalRepl.html#multi-az-db-clusters-logical-replication))

## Launch the Blue/Green deployment

### Create the Blue/Green Deployment

1. Go on the Database list on the AWS console, select the database and press the "Create new Blue/Green Deployment" button.
2. Define a name for the deployment (blue-green-upgrade), ensure you select the right engine version (PostgreSQL 15) and the right DB parameter group (parameter-group-15) and create the Blue/Green deployment.
3. Wait for all the instances to be `Available`.

AWS Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/blue-green-deployments-creating.html)

### Apply the switch over

1. From the Database list on the AWS console, select the Blue/Green deployment `blue-green-upgrade`
2. From the action list, select "Switch over"
3. Verify that everything is fine on the configuration and confirm the switch over. This will make the "Green group" the new production environment.

<p align="center">
<img src="/img/blue-green-rds/switch-over.png" alt="Switch over" />
</p>

4. Wait for the switch over to be completed.

<p align="center">
<img src="/img/blue-green-rds/switch-done.png" alt="Switch over completed" />
</p>

### Delete the blue/green deployment
1. From the Database list on the AWS console, select the Blue/Green deployment `blue-green-upgrade`
2. From the action list, select "Delete"
3. Once completed, from the Database list on the AWS console, select the database in version 14 (not it should be renamed with a suffix `old`)
4. From the action list, select "Delete"
5. wait for the delete operation to be completed

This comment has been minimized.

Copy link
@benjaminch

benjaminch Sep 18, 2024

Contributor

suggestion: I would just emphasis to wait until the old db is totally deleted prior to flip the config on Qovery side and explain until this DB is fully deleted, requests will hit this DB and not the new one


## Align the configuration on Qovery

1. Go on the Qovery console and align the database configuration by setting the version to `15`

<p align="center">
<img src="/img/blue-green-rds/update-version.png" alt="Update the database version" />
</p>

2. Re-deploy your database.


[docs.using-qovery.configuration.database#applying-changes-to-a-managed-database]: /docs/using-qovery/configuration/database/#applying-changes-to-a-managed-database
92 changes: 92 additions & 0 deletions website/guides/advanced/upgrading-rds-instance.md.erb
Original file line number Diff line number Diff line change
@@ -0,0 +1,92 @@
---
$schema: "/.meta/.schemas/guides.json"
title: Minimize downtime while upgrading RDS instances
description: Learn how to upgrade your RDS instance (PostgreSQL, MySql) minimizing your downtime with Qovery and Blue Green deployments
author_github: https://github.com/acarranoqovery
tags: ["type: guide", "technology: qovery"]
---
import Steps from '@site/src/components/Steps';
import Assumptions from '@site/src/components/Assumptions';
import Alert from '@site/src/components/Alert';

Managed RDS instances deployed with Qovery have by defualt a maintenance window configured, applying database updates only during the specifyied timeframe (see more [information here][docs.using-qovery.configuration.database#applying-changes-to-a-managed-database]).

During the maintenance window, a downtime has to be expected on your service since the upgrade might takes a few minutes to take effect.

If this is not acceptable for your business, AWS allows you to deploy changes via the [Blue/Green Deployments](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/blue-green-deployments.html).

This basically allows you to create a copy of your database with the new configuration (called "Green group") and then switch over to the new database by removing the old instance ("Blue group").

Blue/Green deployments on RDS are not natively supported by Qovery but you can follow this guide to upgrade your RDS instances.

# How to configure

To better explain the process, we will try to upgrade an RDS PostgreSQL instance from the version 14 to the version 15.

## Activate the logical replication

<Alert type="info">

This part has to be done only once for each database. If you have already activated the logical replication, go to the next section.

</Alert>

Logical replication is necessary to use the RDS Blue/Green deployment feature.

To enable the logical replication you have to:

1. Create a Custom DB Parameter group. Make sure it targets your current engine type (PostgreSQL) and version (Parameter group family = postgres14), let's call it `parameter-group-14`. (Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithParamGroups.Creating.html))
2. Edit the DB parameter group `parameter-group-14` and activate the logical replication by setting `rds.logical_replication` to `1` (Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_MultiAZDBCluster_LogicalRepl.html#multi-az-db-clusters-logical-replication))
3. Associate the DB Parameter group `parameter-group-14` to your database. If you have read replicas, associate the parameter group to the replicas as well. (Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithParamGroups.Associating.html))
4. Reboot your database to apply the changes or wait for the next maintenance window for applying these changes.


## Enable logical replication for the "Green" database

We will create a separate DB Parameter group for our "Green group" so that we will ensure that the you won't have to do the previous step the next time.

1. Create a Custom DB Parameter group. Make sure it targets your **next** engine type and version (Parameter group family), let's call it `parameter-group-15` Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithParamGroups.Creating.html))
2. Edit the DB parameter group `parameter-group-15` and activate the logical replication by setting `rds.logical_replication` to `1` (Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_MultiAZDBCluster_LogicalRepl.html#multi-az-db-clusters-logical-replication))

## Launch the Blue/Green deployment

### Create the Blue/Green Deployment

1. Go on the Database list on the AWS console, select the database and press the "Create new Blue/Green Deployment" button.
2. Define a name for the deployment (blue-green-upgrade), ensure you select the right engine version (PostgreSQL 15) and the right DB parameter group (parameter-group-15) and create the Blue/Green deployment.
3. Wait for all the instances to be `Available`.

AWS Documentation [here](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/blue-green-deployments-creating.html)

### Apply the switch over

1. From the Database list on the AWS console, select the Blue/Green deployment `blue-green-upgrade`
2. From the action list, select "Switch over"
3. Verify that everything is fine on the configuration and confirm the switch over. This will make the "Green group" the new production environment.

<p align="center">
<img src="/img/blue-green-rds/switch-over.png" alt="Switch over" />
</p>

4. Wait for the switch over to be completed.

<p align="center">
<img src="/img/blue-green-rds/switch-done.png" alt="Switch over completed" />
</p>

### Delete the blue/green deployment
1. From the Database list on the AWS console, select the Blue/Green deployment `blue-green-upgrade`
2. From the action list, select "Delete"
3. Once completed, from the Database list on the AWS console, select the database in version 14 (not it should be renamed with a suffix `old`)
4. From the action list, select "Delete"
5. wait for the delete operation to be completed

## Align the configuration on Qovery

1. Go on the Qovery console and align the database configuration by setting the version to `15`

<p align="center">
<img src="/img/blue-green-rds/update-version.png" alt="Update the database version" />
</p>

2. Re-deploy your database.
9 changes: 9 additions & 0 deletions website/metadata.js
Original file line number Diff line number Diff line change
Expand Up @@ -297,6 +297,15 @@ module.exports = {
"series_position": null,
"title": "Migration"
},
{
"author_github": "https://github.com/acarranoqovery",
"description": null,
"id": "/advanced/upgrading-rds-instance",
"last_modified_on": null,
"path": "website/guides/advanced/upgrading-rds-instance.md",
"series_position": null,
"title": "Minimize downtime while upgrading RDS instances"
},
{
"author_github": "https://github.com/evoxmusic",
"description": null,
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 7d05ba2

Please sign in to comment.