Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,183 @@
# Create a Migrator Configuration File

## Introduction

A configuration file defines all the parameters required for the migration activity. You pass this configuration file as a single parameter to the **runMigrator** command from the Cloud Shell.

This lab walks you through the steps to identify important source and sink parameters. You will create an Oracle NoSQL Migrator configuration file in the Cloud Shell to migrate data from an Oracle NoSQL Database Cloud Service table to an OCI Object Storage bucket.

Estimated Lab Time: 10 minutes

### Objectives

In this lab you will:
* Identify the source and sink for migrating data.
* Create a migrator configuration file.

### Prerequisites

* An Oracle Free Tier, Always Free, Paid or LiveLabs Cloud Account.
* Oracle NoSQL Database Cloud Service table in the subscribed region as the source for data migration.
* OCI Object Storage bucket in the subscribed region as the sink to store the migrated data.
* Privileges to write objects in the Object Storage Bucket. For more details on setting the policies, see **[Let users write objects to Object Storage buckets](https://docs.oracle.com/en-us/iaas/Content/Identity/policiescommon/commonpolicies.htm#write-objects-to-buckets)**.

## Task 1: Identify the Source Parameters

To configure the Migrator utility to copy data from an Oracle NoSQL Database Cloud Service table, you need the following source parameters: **table, compartment, endpoint**.

1. From your Oracle Cloud console's navigation menu, select **Databases** and then select **Tables** under **Oracle NoSQL Database**. See **Get Started** lab for detailed steps to access the Oracle Cloud Console.

2. Select your compartment from the drop-down menu to view the tables.

3. Identify the Oracle NoSQL Database Cloud Service table whose data you want to migrate and note down the table name.

Here, you will use the **NDCSupload** table from the **Training_NoSQL** compartment in the **Ashburn** region with following sample data:

```
<copy>
{"id":1,"name":"Tracy","email":"Tracy@mymail.com","age":20,"income":1000}
{"id":2,"name":"Benita","email":"Benita@mymail.com","age":22,"income":22000}
{"id":3,"name":"John","email":"John@mymail.com","age":24,"income":24000}
{"id":4,"name":"Adam","email":"Adam@mymail.com","age":26,"income":26000}
...
</copy>
```

4. Select the **NDCSupload** table. From the *Table details* page, hover over the Compartment OCID field and select the copy option. This copies the compartment OCID of your source table to the clipboard. Save the compartment OCID value.

Note down the endpoint for your source table. You can locate your subscribed region at the upper right corner of the console. For the details on the end points for your subscribed region, see **[Data Regions and Associated Service URLs](https://docs.oracle.com/en/cloud/paas/nosql-cloud/fnsxl/index.html#FNSXL-GUID-D89BB422-A394-404E-8759-1A620C7D8125)**.

![NoSQL table details](images/console-tabledetails.png)

At the end of this step, you will have values for the following parameters:

```
<copy>
endpoint: "<endpoint for your subscribed region>"
compartment: "<Compartment OCID>"
table: "NDCSupload"
</copy>
```

For example,

```
<copy>
endpoint: "us-ashburn-1"
compartment: "ocid1.compartment.oc1..aaaaaaaahcrgrgptoaq4cgpoymd32ti2ql4sdpu5puroausdf4og55z4tnya"
table: "NDCSupload"
</copy>
```

The **endpoint** and **compartment** parameter values differ based on your tenancy.

## Task 2: Identify the Sink Parameters

To configure the Migrator utility to copy data into the Object Storage bucket, you need the following sink parameters: **endpoint, prefix, bucket, namespace**.

1. From the Oracle Cloud console navigation menu, select **Storage** and then select **Buckets**.

2. Select your compartment and then select the bucket.

Here, you will use the **Migrate\_oci** bucket from the **Training_NoSQL** compartment in the **Ashburn** region.

From the bucket details page, copy the **Namespace** name to use in sink configuration parameters.

![Bucket details](images/objectstorage_latest.png)

3. Identify the endpoint of the OCI Object Storage bucket. You can locate your subscribed region at the upper right corner of the console. For the details on the OCI Object Storage service endpoints for your subscribed region, see **[Object Storage Endpoints](https://docs.oracle.com/en-us/iaas/api/#/en/objectstorage/20160918/)**.
4. Decide a prefix, which serves as the directory to store the migrated data within the OCI Object Storage bucket. Oracle NoSQL Migrator copies data to the supplied directory in the OCI Object Storage bucket.

Here, you will use **Delegation** as the prefix.

At the end of this step, you will have values for the following parameters:

```
<copy>
endpoint: "<endpoint for your subscribed region>"
bucket: "Migrate_oci"
prefix: "Delegation"
namespace: "<namespace name>"
</copy>
```

For example,

```
<copy>
endpoint: "us-ashburn-1"
bucket: "Migrate_oci"
prefix: "Delegation"
namespace: "oradbclouducm"
</copy>
```

The **endpoint** and **namespace** parameter values differ based on your tenancy.

## Task 3: Create a Configuration File

1. Launch the Cloud Shell from the **Developer tools** menu on your Oracle Cloud console. The web browser opens your home directory.
2. Navigate to the directory where you extracted the NoSQL Database Migrator utility. See **Lab - Download Migrator Utility and Upload to Cloud Shell**.

```
<copy>cd V1048015-01/nosql-migrator-1.7.0</copy>
```

3. Create the configuration file template in a notepad as follows. Update the source and sink parameters with the values that you noted in Task 1 and Task 2 of this lab.

*Note: The endpoints, compartment, and namespace values will differ based on your tenancy.*

```
<copy>
{
"source" : {
"type" : "nosqldb_cloud",
"endpoint" : "us-ashburn-1",
"table" : "NDCSupload",
"compartment" : "ocid1.compartment.oc1.. aaaaaaaahcrgrgptoaq4cgpoymd32ti2ql4sdpu5puroausdf4og55z4tnya",
"useDelegationToken" : true,
"readUnitsPercent" : 90,
"includeTTL" : true,
"requestTimeoutMs" : 5000
},
"sink" : {
"type" : "object_storage_oci",
"format" : "json",
"endpoint" : "us-ashburn-1",
"namespace" : "oradbclouducm",
"bucket" : "Migrate_oci",
"prefix" : "Delegation",
"chunkSize" : 32,
"compression" : "",
"useDelegationToken" : true
},
"abortOnError" : true,
"migratorVersion" : "1.7.0"
}
</copy>
```

To run the Migrator utility from the Cloud Shell, you must use the delegation token authentication. Therefore, set the **useDelegationToken** parameter to true. For a list of all the supported parameters, see **[Oracle NoSQL Database Cloud Service](https://docs.oracle.com/en/cloud/paas/nosql-cloud/onscl/#GUID-5A70801B-F281-4FA2-91A9-77CCCC3C3098)** source and **[OCI Object Storage bucket](https://docs.oracle.com/en/cloud/paas/nosql-cloud/onscl/#GUID-B79ED267-0F42-40CE-B672-9F7AB65BDA1D)** sink.

*Note: The Oracle NoSQL Migrator utility also provides an option to create the configuration file interactively when you run the utility from the Cloud Shell's CLI.*

4. Use the vi editor to create the **migrator-config.json** configuration file.

Copy the configuration file template from the notepad to the configuration file and save it.

```
<copy>vi migrator-config.json</copy>
```

You may proceed to the next lab.

## Learn More

* **[Using Console to Create Tables in Oracle NoSQL Database Cloud Service](https://docs.oracle.com/en/cloud/paas/nosql-cloud/wqqvo/index.html#articletitle)**
* **[Terminology used with Oracle NoSQL Database Migrator](https://docs.oracle.com/en/cloud/paas/nosql-cloud/cjphq/index.html#GUID-3F02818F-0589-4366-9D1E-8230FADFDFE8)**
* **[Source Configuration Templates](https://docs.oracle.com/en/cloud/paas/nosql-cloud/onscl/index.html#ONSCL-GUID-FF56A474-C6EC-40DA-8AAA-9EBA6B616630)**
* **[Sink Configuration Templates](https://docs.oracle.com/en/cloud/paas/nosql-cloud/onscl/index.html#ONSCL-GUID-832FE48D-2A90-4DCA-95A6-40687CA7F39B)**

## Acknowledgements
* **Author** - Ramya Umesh, Principal UA Developer, DB OnPrem Tech Svcs & User Assistance
* **Last Updated By/Date** - Ramya Umesh, Principal UA Developer, DB OnPrem Tech Svcs & User Assistance, August 2025
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
@@ -0,0 +1,104 @@
# Create Oracle NoSQL table and OCI Object Storage Bucket

## Introduction

Oracle NoSQL Database Cloud Service is a fully managed database cloud service designed for database operations that require predictable, single digit millisecond latency responses to simple queries.

Object Storage service offers a high-performance storage platform to store data of any content type. You can access the OCI Object Storage buckets through the Object Storage endpoints.

This lab walks you through the steps to create an Oracle NoSQL Database Cloud Service table and an OCI Object Storage bucket. The Oracle NoSQL Database Cloud Service table serves as the source for data migration, while OCI Object Storage bucket serves as the target for the migrated data.

Estimated Lab Time: 10 Minutes

### Objectives

In this lab you will:
* Access the Oracle Cloud Console.
* Create an Oracle NoSQL Database Cloud Service table with 50 rows of user data.
* Create an OCI Object Storage bucket.

### Prerequisites

* An Oracle Free Tier, Always Free, Paid or LiveLabs Cloud Account
* Download the **[NDCSupload_rows.json](https://c4u04.objectstorage.us-ashburn-1.oci.customer-oci.com/p/EcTjWk2IuZPZeNnD_fYMcgUhdNDIDA6rt9gaFj_WZMiL7VvxPBNMY60837hu5hga/n/c4u04/b/livelabsfiles/o/labfiles%2FNDCSupload_rows.json)** file to your system.

## Task 1: Create an Oracle NoSQL Database Cloud Service table and upload data

1. Open the Oracle Cloud Console. See **Get Started** lab for detailed steps to access the Oracle Cloud Console.
2. From the navigation menu, select **Databases** and then select **Tables** under **Oracle NoSQL Database**.

![Databases menu](images/console-Nosqlmenu.png)

3. Select your compartment from the drop-down menu and then select **Create table**.

*Note: Oracle NoSQL Database Cloud Service resources are created in a compartment and are scoped to that compartment. It is recommended not to create the Oracle NoSQL Database Cloud Service table in the "root" compartment, but to create them in your own compartment created under "root".*

![Create NoSQL tables](images/console-createtable.png)

4. In the **Create Table** dialog, select **Simple input** for *Table Creation Mode*. Retain the default capacity mode to **Provisioned Capacity**. Enter the capacity values for the table. In the **Name** field, enter a table name that is unique to your tenancy. In this lab, you will create **NDCSupload** table.

![Create table dialog](images/console-createtable-name.png)

5. In the *Primary Key Columns* section, enter primary key details.

![Primary key](images/console-createtable-PK.png)

6. In the *Columns* section, enter non-primary column details and select **Create Table**.

![Columns](images/console-createtable-columns.png)

This creates the **NDCSupload** table.

*Note: You can see the **[Creating Singleton Tables](https://docs.oracle.com/en/cloud/paas/nosql-cloud/wqqvo/#GUID-1E86F6AE-6F02-478D-BB71-6088330FE838)** topic to understand the various other options available while creating an Oracle NoSQL Database Cloud Service table.*

7. To add data to the table, select the **NDCSupload** table. On the *Table details* page, select **Upload data** to bulk upload data from a local file into the table.

![Upload dialog](images/console-table-upload.png)

8. Select the **NDCSupload_rows.json** that you downloaded as a pre-requisite. The upload begins immediately and the progress is displayed on the page.

After uploading successfully, the console displays the total number of rows that were inserted. You can close the window.

![Upload rows](images/console-table-uploadrows.png)

9. To verify, you can scroll down to **Explore data**. The SQL query to fetch all the table rows is displayed by default.

Select **Execute** to view the table rows.


## Task 2: Create an OCI Object Storage bucket

1. Open the Oracle Cloud Console. See **Get Started** lab for detailed steps to access the Oracle Cloud Console.
2. From the navigation menu, select **Storage** and then select **Object Storage & Archive Storage**.

![Storage menu](images/select-object-storage.png)

3. Select your compartment to create the bucket and then select **Create bucket**.

*Note: It is recommended not to create the Object Storage bucket in the "root" compartment, but to create them in your own compartment created under "root".*

![Object Storage & Archive Storage page](images/object-storage-create.png)

4. Supply a descriptive name for the bucket. Here, we will use **Migrate_oci**.
5. Under the Default storage tier, select **Standard**.

![Create Bucket page](images/object-storage-create-bucket-name.png)

6. Scroll down and select your desired encryption. Here, we will use the default value **Encrypt using Oracle managed keys**.
7. Select **Create bucket**.

![Create Bucket](images/object-storage-create-bucket-encryption.png)

This creates **Migrate_oci** bucket in your subscribed region.

You may proceed to the next lab.

## Learn More

* [Using Console to Create Tables in Oracle NoSQL Database Cloud Service](https://docs.oracle.com/en/cloud/paas/nosql-cloud/wqqvo/#GUID-1E86F6AE-6F02-478D-BB71-6088330FE838)
* [OCI Object Storage bucket](https://docs.oracle.com/en-us/iaas/Content/Object/Tasks/managingbuckets.htm)


## Acknowledgements
* **Author** - Ramya Umesh, Principal UA Developer, DB OnPrem Tech Svcs & User Assistance
* **Last Updated By/Date** - Ramya Umesh, Principal UA Developer, DB OnPrem Tech Svcs & User Assistance, August 2025
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
@@ -0,0 +1,62 @@
# Download Migrator Utility and Upload to Cloud Shell

## Introduction

This lab walks you through the steps to download Oracle NoSQL Migrator utility, launch a Cloud Shell for an Oracle Cloud user account, and upload the Migrator utility to Cloud Shell.

Estimated Lab Time: 5 minutes

### Objectives

In this lab you will:
* Download Oracle NoSQL Migrator utility.
* Launch the Cloud Shell for an Oracle Cloud user account.
* Upload the Oracle NoSQL Migrator utility to the Cloud Shell.

### Prerequisites

* An Oracle Free Tier, Always Free, Paid or LiveLabs Cloud Account

## Task 1: Download the Oracle NoSQL Migrator Utility

1. Open the **[Oracle NoSQL Downloads page](https://www.oracle.com/database/technologies/nosql-database-server-downloads.html)** and scroll down to Oracle NoSQL Database Migrator and Analytics Integrator section.

![Oracle NoSQL Downloads page](images/otn-migrator-download.png)

2. Click the latest Oracle NoSQL Migrator package. Here, you will use **nosql-migrator-1.7.0**. This will navigate to Oracle Software Delivery Cloud page.

3. Accept the terms and conditions.

4. Download the Oracle NoSQL Migrator package to your local machine. Here you will use **V1048015-01.zip**.

## Task 2: Upload Oracle NoSQL Migrator Utility to the Cloud Shell

1. Launch the Cloud Shell from the **Developer tools** menu on your Oracle Cloud console. The web browser opens your home directory. See **Get Started** lab for detailed steps to access the Oracle Cloud Console.

![Developer tools menu](images/otn-developers-tools.png)

2. Click the menu option on the upper right corner of the Cloud Shell window and select the **upload** option from the drop-down menu.

![Menu option](images/otn-cloudshell-upload-option.png)

3. In the pop-up window, either drag and drop the Oracle NoSQL Database Migrator package from your local machine, or click the *Select from your computer* option, select the package from your local machine, and click the **Upload** button.

![Upload](images/otn-cloudshell-upload.png)

4. Extract the contents of the package using the appropriate command. For example,

```
<copy>unzip -q V1048015-01.zip</copy>
```

9. The resulting folder contains the Oracle NoSQL Migrator utility.

You may proceed to the next lab.

## Learn More

* [Cloud Shell](https://docs.oracle.com/en-us/iaas/Content/API/Concepts/cloudshellintro.htm)

## Acknowledgements
* **Author** - Ramya Umesh, Principal UA Developer, DB OnPrem Tech Svcs & User Assistance
* **Last Updated By/Date** - Ramya Umesh, Principal UA Developer, DB OnPrem Tech Svcs & User Assistance, August 2025
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading