diff --git a/shared/adw-data-lake/build-data-lake/adw-aws-integrate/adw-aws-integrate.md b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/adw-aws-integrate.md index 0e307cc8..69525431 100644 --- a/shared/adw-data-lake/build-data-lake/adw-aws-integrate/adw-aws-integrate.md +++ b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/adw-aws-integrate.md @@ -76,8 +76,13 @@ In this task, you will navigate to an AWS Glue Data Catalog instance and explore 2. Open the **Navigation** menu and click **Oracle Database**. Under **Oracle Database**, click **Autonomous Database**. + +3. On the **Autonomous Databases** page, click your **DB-DCAT** ADB instance. + + + 3. On the **Autonomous Databases** page, click your **ADW-Data-Lake** ADB instance. - ![The Autonomous Database is displayed and highlighted.](./images/adb-page.png " ") + 4. On the **Autonomous Database details** page, click the **Database actions** drop-down list, and then click **SQL**. @@ -193,7 +198,7 @@ In this task, you will create the required credentials in Autonomous Database th 2. Inspect the new protected schema in Autonomous Database that was created by the sync operation and the two external tables in that schema that were created on top of the two tables in the AWS S3 bucket. In the **Navigator** tab on the left, search for the schema with a name that starts with **`GLUE`**, **`$`**, the AWS Glue connection name, **`AWS_GLUE_CONN`**, the AWS Glue database name, **`PARQ`**, followed by other strings. The generated schema name in this example is **`GLUE$AWS_GLUE_CONN_PARQ_TPCDS_ORACLE_PARQ`**. This schema contains the **`ITEM`** and **`STORE`** external tables. - >**Note:** You might have to click the **Refresh** icon in the **Navigator** tab before you can see the newly created protected schema. If the Refresh doesn't work, select **Sign Out** from the **`ADMIN`** drop-down list, and then click **Leave**. Next, on the **Sign-in** page, sign in as the **admin** user. On the **Launchpad**, in the **Development** section, click the **SQL** card. + >**Note:** You might have to click the **Refresh** icon in the **Navigator** tab before you can see the newly created protected schema. If the Refresh doesn't work, select **Sign Out** from the **`ADMIN`** drop-down list, and then click **Leave**. Next, on the **Sign-in** page, sign in as the **admin** user. On the **Launchpad** page, click the **Development** tab, and then click the **SQL** tab to display the SQL Worksheet. ![Explore protected schema](images/explore-protected-schema.png) @@ -209,15 +214,11 @@ In this task, you will create the required credentials in Autonomous Database th ![Run store query](images/run-store-query.png) -6. Let's examine the Data Definition Language (DDL) code for the **`Store`** external table. In the **Navigator** tab, make sure that the newly created schema is selected. Next, right-click **`STORE`**, and then select **Edit** from the context menu. - - ![Examine the Store external table](images/edit-store.png) - -7. In the **Table Properties** panel, in the **External Table** tab, click the **DDL** category. +6. Let's examine the Data Definition Language (DDL) code for the **`Store`** external table. In the **Navigator** tab, make sure that the newly created schema is selected. Next, right-click **`STORE`**, and then select **Quick DDL > Save to File** from the context menu. - ![Click DDL](images/click-ddl.png) + ![Examine the Store external table](images/ddl-file.png =60%x*) -8. Click the **Create** tab, and then scroll-down to the bottom of the **`CREATE TABLE`** command. The **`Location`** parameter indicates that the source data for the **`store`** external table is in AWS S3. +7. Open the download text file, and then scroll-down to the bottom of the **`CREATE TABLE`** command. The **`Location`** parameter indicates that the source data for the **`store`** external table is in AWS S3. ![Location of the data](images/store-location.png) @@ -232,15 +233,13 @@ You may now proceed to the next lab. ## Acknowledgements -* **Author:** - * Lauran K. Serhal, Consulting User Assistance Developer -* **Contributor:** - + Alexey Filanovskiy, Senior Principal Product Manager -* **Last Updated By/Date:** Lauran K. Serhal, November 2023 +* **Author:** Lauran K. Serhal, Consulting User Assistance Developer +* **Contributor:** Alexey Filanovskiy, Senior Principal Product Manager +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/ddl-file.png b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/ddl-file.png new file mode 100644 index 00000000..0b9a80c5 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/ddl-file.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/open-store.png b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/open-store.png new file mode 100644 index 00000000..419a4934 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/open-store.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/store-location.png b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/store-location.png index 9cc0b701..4a910607 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/store-location.png and b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/images/store-location.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-aws-integrate/open-store.png b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/open-store.png new file mode 100644 index 00000000..b1ab3a35 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/adw-aws-integrate/open-store.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/adw-dcat-integrate.md b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/adw-dcat-integrate.md index e6b15a66..85136525 100644 --- a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/adw-dcat-integrate.md +++ b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/adw-dcat-integrate.md @@ -65,6 +65,10 @@ This is not a hands-on task. In this task, you will navigate to an OCI Data Cata In this task, you will learn how to register an OCI Data Catalog instance in ADW in order to connect to that instance and link to the data asset's entities to create external tables in ADW. +If you already accessed the SQL Worksheet in the previous lab, click **Database Actions | SQL** in the banner to display the **Launchpad** page. Click the **Data Studio** tab, and then click the **Data Load** tab to display the **Data Load Dashboard**. You can now skip over to **Step 5**. + +If you closed the Web browser tab where the SQL Worksheet was displayed, navigate to the **Data Load** page as follows: + 1. Log in to the **Oracle Cloud Console**, if you are not already logged as the Cloud Administrator. 2. Open the **Navigation** menu and click **Oracle Database**. Under **Oracle Database**, click **Autonomous Database**. @@ -81,7 +85,7 @@ In this task, you will learn how to register an OCI Data Catalog instance in ADW 4. On the **Autonomous Database details** page, click the **Database actions** drop-down list, and then select **Data Load**. -5. In the **Administration** section, click **CONNECTIONS** to display the **Connections** page. +5. Click the **CONNECTIONS** tile. ![Click the Connections card.](./images/click-connections.png " ") @@ -93,10 +97,11 @@ In this task, you will learn how to register an OCI Data Catalog instance in ADW * **Catalog Name:** Enter a meaningful name. **Note:** The name must conform to the Oracle object naming conventions, which do not allow spaces or **hyphens**. * **Description:** Enter an optional description. - * **Register Data Catalog Connection:** Select this checkbox. - * **Select Credential:** Select your **`OBJ_STORAGE_CRED`** credential that you created in **Lab 5 > Task 6** from the drop-down list. This could take a minute. + ** **Catalog Type:** Accept the default **OCI Data Catalog** from the drop-down list. + * **Credential for Data Catalog Connection:** Select your **`OBJ_STORAGE_CRED`** credential that you created in **Lab 5 > Task 6** from the drop-down list. This could take a minute. * **Region:** Your region should be already selected after you chose your credential. - * **Data Catalog ID:** If you have several Data Catalog instances, select the Data Catalog instance that you want to register from the drop-down list. + * **Data Catalog ID:** If you have several Data Catalog instances, select the Data Catalog instance that you want to register from the drop-down list. In this workshop, you only have one credential. + * **Register Data Catalog Connection:** Click this field to enable it. ![The completed Register Data Catalog panel is displayed.](./images/register-data-catalog-panel.png " ") @@ -116,43 +121,43 @@ In this task, you will learn how to register an OCI Data Catalog instance in ADW In this task, you will link to data assets from the registered Data Catalog and create two external tables in your Autonomous Database instance based on those data assets. -1. Click **Oracle Database Actions** in the banner to display the Launchpad landing page. +1. Click the **Data Load** link in the breadcrumbs to display the Data Load page. -2. In the **Data Studio**, click **DATA LOAD**. +2. Click the **LINK DATA** tile. -3. In the **What do you want to do with your data?** section, click **LINK DATA**. + ![Click Connections.](./images/click-link-data.png " ") -4. In the **Where is your data?** section, select **CLOUD STORE**, and then click **Next**. +3. The **Link Data** page is displayed. You will use this page to drag and drop tables from the registered Data Catalog instance to the data linking job area. Click the **Data Catalog** tab. Next, select the **`REGISTER_DCAT_INSTANCE`** connection that you created from the **Select Cloud Store Location or enter public URL** drop-down list. -5. The **Link Cloud Object** page is displayed. You will use this page to drag and drop tables from the registered Data Catalog instance to the data linking job area. Click the drop-down list. Under the **Catalog Locations** category, select the **`REGISTER_DCAT_INSTANCE`** that you created. + ![Drag the data assets from the Data Catalog bucket onto the linking job section.](images/click-data-catalog-tab.png) - ![Drag the data assets from the Data Catalog bucket onto the linking job section.](images/drag-and-drop-assets.png) - -6. Drag the **`customer_promotions`** and **`moviestream_churn`** data assets from the **moviestream\_sandbox** bucket in our Data Catalog instance, and drop them onto the data linking job section. +4. Drag the **`customer_promotions`** and **`moviestream_churn`** data assets from the **moviestream\_sandbox** bucket in our Data Catalog instance, and drop them onto the data linking job section. ![Click the pencil icon to open settings viewer for customer_contact load task](images/customer-promotions-settings.png) -7. Let's change the default name for the **`customer_promotions`** external table that will be created. Click the **Actions** icon (3-dot vertical ellipsis) for the **`customer_promotions`** link task, and then select **Settings** from the context menu. The **Link Data from Cloud Store Location customer\_promotions** settings panel is displayed. Change the external table name to **`CUSTOMER_PROMOTIONS_DCAT`**, and then click **Close**. +5. Let's change the default name for the **`customer_promotions`** external table that will be created. Click the **Settings** icon (pencil) for the **`customer_promotions`** link task. The **Link Data from Cloud Store Location customer\_promotions** settings panel is displayed. Change the external table name to **`CUSTOMER_PROMOTIONS_DCAT`**, and then click **Close**. + + ![Change name of the external table.](images/customer-promotions-dcat.png =65%x*) - ![Change name of the external table.](images/customer-promotions-dcat.png) +6. Let's change the default name for the **`moviestream_churn`** external table that will be created. Click the **Settings** icon (pencil) for the **`moviestream_churn`** link task. The **Link Data from Cloud Store Location moviestream\_churn** settings panel is displayed. Change the name of the external table to **`MOVIESTREAM_CHURN_DCAT`**, and then click **Close**. -8. Let's change the default name for the **`moviestream_churn`** external table that will be created. Click the **Actions** icon (3-dot vertical ellipsis) for the **`moviestream_churn`** link task, and then select **Settings** from the context menu to view the settings for this task. The **Link Data from Cloud Store Location moviestream\_churn** settings panel is displayed. Change the name of the external table name to **`MOVIESTREAM_CHURN_DCAT`**, and then click **Close**. + ![Change name of the external table.](images/moviestream-churn-dcat.png =65%x*) -9. Click **Start** to run the data link job. In the **Run Data Load Job** dialog box, click **Run**. +7. Click **Start** to run the data link job. In the **Run Data Load Job** dialog box, click **Run**. - ![Run the data link job](images/run-data-link.png) + ![Run the data link job](images/run-data-link.png =65%x*) -10. After the load job is completed, make sure that all of the data link cards have green check marks next to them. This indicates that your data link tasks have completed successfully. +8. After the load job is completed, make sure that the two data link cards have the link icon next to them. This indicates that your data link tasks have completed successfully. ![The Link job tasks completed.](images/link-completed.png) -11. Click **Oracle Database Actions** in the banner to display the Launchpad landing page. In the **Development** section, click **SQL** to display your SQL Worksheet. +9. Click **Database Actions | Data Load** in the banner to display the **Launchpad** page. Click the **Development** tab, and then click the **SQL** tab to display your SQL Worksheet. -12. From the **Navigator** pane, drag and drop the newly created **`CUSTOMERS_PROMOTIONS_DCAT`** external table onto the Worksheet. In the **Choose Type of insertion**, click **Select**, and then click **Apply**. +10. From the **Navigator** pane, drag and drop the newly created **`CUSTOMERS_PROMOTIONS_DCAT`** external table onto the Worksheet. In the **Choose Type of insertion**, click **Select**, and then click **Apply**. ![Drag and drop the external table onto the worksheet.](images/drag-drop-external-table.png) -13. The auto generated query is displayed in the worksheet. Click the **Run Statement** icon to run the query. The results are displayed. You just accessed the data in the registered Data Catalog instance! +11. The auto generated query is displayed in the worksheet. Click the **Run Statement** icon to run the query. The results are displayed. You just accessed the data in the registered Data Catalog instance! ![Run the query.](images/run-query.png) @@ -172,15 +177,13 @@ You may now proceed to the next lab. ## Acknowledgements -* **Author:** - * Lauran K. Serhal, Consulting User Assistance Developer -* **Contributor:** - + Alexey Filanovskiy, Senior Principal Product Manager -* **Last Updated By/Date:** Lauran K. Serhal, January 2024 +* **Author:** Lauran K. Serhal, Consulting User Assistance Developer +* **Contributor:** Alexey Filanovskiy, Senior Principal Product Manager +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-connections.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-connections.png index 9d05a8bb..3090c4d3 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-connections.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-connections.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-create.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-create.png index f44489f5..70934580 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-create.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-create.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-data-catalog-tab.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-data-catalog-tab.png new file mode 100644 index 00000000..288f5c1d Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-data-catalog-tab.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-link-data.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-link-data.png new file mode 100644 index 00000000..88d4f1b1 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-link-data.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-register-data-catalog.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-register-data-catalog.png index 899e5f8b..ad985357 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-register-data-catalog.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/click-register-data-catalog.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/customer-promotions-dcat.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/customer-promotions-dcat.png index 02ef6c77..5de79b29 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/customer-promotions-dcat.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/customer-promotions-dcat.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/customer-promotions-settings.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/customer-promotions-settings.png index 659ccf4f..fc7cc970 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/customer-promotions-settings.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/customer-promotions-settings.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/data-catalog-registered.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/data-catalog-registered.png index bf3c094e..bd85ea41 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/data-catalog-registered.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/data-catalog-registered.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/data-catalog.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/data-catalog.png new file mode 100644 index 00000000..8e6b3e7d Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/data-catalog.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/link-completed.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/link-completed.png index 41ca045e..61498d28 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/link-completed.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/link-completed.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/moviestream-churn-dcat.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/moviestream-churn-dcat.png new file mode 100644 index 00000000..b46a898d Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/moviestream-churn-dcat.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/open-store.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/open-store.png new file mode 100644 index 00000000..e2d13fde Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/open-store.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/register-assets-panel.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/register-assets-panel.png index f4dacb18..396a4109 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/register-assets-panel.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/register-assets-panel.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/register-data-catalog-panel.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/register-data-catalog-panel.png index 5ea4b6b9..a5414546 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/register-data-catalog-panel.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/register-data-catalog-panel.png differ diff --git a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/run-data-link.png b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/run-data-link.png index 13e232a3..0da69552 100644 Binary files a/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/run-data-link.png and b/shared/adw-data-lake/build-data-lake/adw-dcat-integrate/images/run-data-link.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-banner.png b/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-banner.png index cce03a2d..8bf00e10 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-banner.png and b/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-banner.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-data-load-tab.png b/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-data-load-tab.png new file mode 100644 index 00000000..02232c6e Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-data-load-tab.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-development-sql-tabs.png b/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-development-sql-tabs.png new file mode 100644 index 00000000..06d40e43 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-analyze-json/images/click-development-sql-tabs.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-analyze-json/load-analyze-json.md b/shared/adw-data-lake/build-data-lake/load-analyze-json/load-analyze-json.md index 8a120c25..6f5b7d91 100644 --- a/shared/adw-data-lake/build-data-lake/load-analyze-json/load-analyze-json.md +++ b/shared/adw-data-lake/build-data-lake/load-analyze-json/load-analyze-json.md @@ -39,35 +39,15 @@ Our movie data set has a series of columns that contain different types of detai JSON data is organized very differently than typical warehouse data. There is a single entry for **producer** but the corresponding key **names** actually has multiple values. This is referred to as an **array** - specifically a JSON array. ->**Note:** -If you already have the **Oracle Database Actions** browser tab open from the previous lab, click the **Database Actions | Launchpad** banner to display the **Database Actions | Launchpad** Home page. In the **Development** section, click the **SQL** card to display the SQL Worksheet. Next, skip to **step 6**; otherwise, start with **step 1** below. +1. You should be already on the **Data Load Dashboard** page from the previous lab. Click **Database Actions | Data Load** in the banner. -![Click the banner.](./images/click-banner.png " ") + ![Click the banner.](./images/click-banner.png " ") -1. Log in to the **Oracle Cloud Console**, if you are not already logged as the Cloud Administrator. +2. On the **Database Actions | Launchpad** page, click the **Development** tab, and then click the **SQL** tab. -2. Open the **Navigation** menu and click **Oracle Database**. Under **Oracle Database**, click **Autonomous Database**. - - -3. On the **Autonomous Databases** page, click your **DB-DCAT** ADB instance. - ![On the Autonomous Databases page, the Autonomous Database that is assigned to your LiveLabs workshop reservation is displayed.](./images/ll-adb-page.png " ") - - - -3. On the **Autonomous Databases** page, click your **ADW-Data-Lake** ADB instance. - ![On the Autonomous Databases page, the Autonomous Database that you provisioned is displayed and highlighted.](./images/adb-page.png " ") - - -4. On the **Autonomous Database details** page, click the **Database actions** drop-down list, and then click **SQL**. - - - ![The Database Actions button is highlighted.](./images/click-db-actions.png " ") - - -5. The SQL Worksheet is displayed. - - ![The SQL worksheet is displayed.](./images/sql-worksheet-displayed.png " ") + ![The SQL worksheet is displayed.](./images/click-development-sql-tabs.png " ") + The SQL Worksheet is displayed. 6. Use the Autonomous Database ``DBMS_CLOUD.COPY_COLLECTION`` procedure to create and load the movie collection from object storage. Copy and paste the following script into your SQL Worksheet, and then click the **Run Script (F5)** icon in the Worksheet toolbar. ``` @@ -272,4 +252,4 @@ You may now proceed to the next lab. * **Author** - Marty Gubar, Autonomous Database Product Management * **Contributor:** Lauran K. Serhal, Consulting User Assistance Developer -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 diff --git a/shared/adw-data-lake/build-data-lake/load-analyze-rest/images/click-data-load-banner.png b/shared/adw-data-lake/build-data-lake/load-analyze-rest/images/click-data-load-banner.png new file mode 100644 index 00000000..00c3a602 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-analyze-rest/images/click-data-load-banner.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-analyze-rest/images/click-development-sql-tabs.png b/shared/adw-data-lake/build-data-lake/load-analyze-rest/images/click-development-sql-tabs.png new file mode 100644 index 00000000..d4999d3b Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-analyze-rest/images/click-development-sql-tabs.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-analyze-rest/load-analyze-rest.md b/shared/adw-data-lake/build-data-lake/load-analyze-rest/load-analyze-rest.md index ce28b12a..d878e5aa 100644 --- a/shared/adw-data-lake/build-data-lake/load-analyze-rest/load-analyze-rest.md +++ b/shared/adw-data-lake/build-data-lake/load-analyze-rest/load-analyze-rest.md @@ -83,21 +83,15 @@ Create a **News API** account as follows: Now that you have the API key, create a PL/SQL function that queries the REST endpoint using the parameters above. -1. Log in to the **Oracle Cloud Console**, if you are not already logged as the Cloud Administrator. +1. Navigate to the SQL Worksheet. Click the **Database Actions | Data Load** in the banner. -2. Open the **Navigation** menu and click **Oracle Database**. Under **Oracle Database**, click **Autonomous Database**. + ![Click Data Load in the banner.](./images/click-data-load-banner.png " ") - -3. On the **Autonomous Databases** page, click your **DB-DCAT** ADB instance. - +2. On the **Launchpad** page, click the **Development** tab, and then click the **SQL** tab. - -3. On the **Autonomous Databases** page, click your **ADW-Data-Lake** ADB instance. - + ![Click Development > SQL tabs.](./images/click-development-sql-tabs.png " ") -4. On the **Autonomous Database details** page, click the **Database actions** drop-down list, and then click **SQL**. - -5. The SQL Worksheet is displayed. + The SQL Worksheet is displayed. ![The SQL worksheet is displayed.](./images/sql-worksheet-displayed.png " ") @@ -351,4 +345,4 @@ You may now proceed to the next lab. * **Authors:** * Marty Gubar, Autonomous Database Product Management * Lauran K. Serhal, Consulting User Assistance Developer -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/change-table-name.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/change-table-name.png index eacc6132..90616512 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-local-data/images/change-table-name.png and b/shared/adw-data-lake/build-data-lake/load-local-data/images/change-table-name.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/click-banner.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/click-banner.png new file mode 100644 index 00000000..777c866a Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-local-data/images/click-banner.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/click-settings.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/click-settings.png index 6a2c3ca7..1041f1b4 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-local-data/images/click-settings.png and b/shared/adw-data-lake/build-data-lake/load-local-data/images/click-settings.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/customer-segment-data.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/customer-segment-data.png index cac4ed0b..7b335293 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-local-data/images/customer-segment-data.png and b/shared/adw-data-lake/build-data-lake/load-local-data/images/customer-segment-data.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/customer-segment.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/customer-segment.png new file mode 100644 index 00000000..2b548235 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-local-data/images/customer-segment.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/data-load-dashboard.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/data-load-dashboard.png new file mode 100644 index 00000000..37acec30 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-local-data/images/data-load-dashboard.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/data-load-home.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/data-load-home.png index f2bfdfc5..35575056 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-local-data/images/data-load-home.png and b/shared/adw-data-lake/build-data-lake/load-local-data/images/data-load-home.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/load-successful.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/load-successful.png new file mode 100644 index 00000000..cd24f60d Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-local-data/images/load-successful.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/preview-customer-segment.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/preview-customer-segment.png new file mode 100644 index 00000000..1fb34fd2 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-local-data/images/preview-customer-segment.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/preview-table.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/preview-table.png index eb54be8a..7f8ec38d 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-local-data/images/preview-table.png and b/shared/adw-data-lake/build-data-lake/load-local-data/images/preview-table.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/select-load-data-and-local-file.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/select-load-data-and-local-file.png index 6bd5e833..acd32651 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-local-data/images/select-load-data-and-local-file.png and b/shared/adw-data-lake/build-data-lake/load-local-data/images/select-load-data-and-local-file.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/images/select-second-file.png b/shared/adw-data-lake/build-data-lake/load-local-data/images/select-second-file.png index 3d668f32..bd9fca6a 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-local-data/images/select-second-file.png and b/shared/adw-data-lake/build-data-lake/load-local-data/images/select-second-file.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-local-data/load-local-data.md b/shared/adw-data-lake/build-data-lake/load-local-data/load-local-data.md index 5bcf6ab7..a5677dd1 100644 --- a/shared/adw-data-lake/build-data-lake/load-local-data/load-local-data.md +++ b/shared/adw-data-lake/build-data-lake/load-local-data/load-local-data.md @@ -147,7 +147,7 @@ In this task you will load the two .csv files that you downloaded earlier into t ![Select the one file at a time.](./images/select-second-file.png " ") -4. When the upload is complete, you will make a small change to the default table name that will be created for the *customer-extension.csv* file. Click the **Settings** (pencil) icon to the right of *customer-extension.csv*. +4. When the upload is complete, you will make a small change to the default table name that will be created for the **`customer-extension.csv`** file. Click the **Settings** (pencil) icon to the right of **`customer-extension.csv`**. ![Update the data load job settings.](./images/click-settings.png " ") @@ -155,35 +155,29 @@ In this task you will load the two .csv files that you downloaded earlier into t ![Examine the editor of the data load job.](./images/preview-table.png " ") -7. In the **Name** field, change the table name that will be created from **CUSTOMEREXTENSION** to **CUSTOMER\_EXTENSION**. Click **Close** in the lower right corner of the page. +6. In the **Name** field, change the table name that will be created from **`CUSTOMEREXTENSION`** to **`CUSTOMER_EXTENSION`**. Click **Close** in the lower right corner of the page. ![Examine the editor of the data load job.](./images/change-table-name.png " ") -8. Click **Start**. A **Start Load from Local Files** confirmation dialog box is displayed. Click **Run**. +7. Click **Start**. A **Start Load from Local Files** confirmation dialog box is displayed. Click **Run**. ![Run the data load.](./images/click-start.png " ") -9. When the load job is complete, a green check mark appears next to each table. Click **Catalog** in the menu on the left. +8. After the load job is completed, make sure that the data load card has the copy icon next to it. You can click the **Report** button for the load job to view a report of total rows processed successfully and failed for the selected table. - ![Click Catalog in the menu on the left.](./images/click-catalog.png " ") + ![The data load icons are displayed.](./images/load-successful.png " ") - > **Note:** If the menu on the left is collapsed, click the double arrows icon to expand it so that the label for each icon is displayed. +9. You can click a table name to display its data. In this example, click the **ellipsis** icon for the **`CUSTOMER_SEGMENT`** load task to view its settings among other things. Next, click **Table > View Details** from the context menu. - ![Click Expand to expand the menu on the lef.](./images/expand-menu.png " ") + ![Click customer_segment to display its data.](./images/preview-customer-segment.png " ") -10. The Catalog displays the two newly created tables: *CUSTOMER\_SEGMENT* and *CUSTOMER\_EXTENSION*. +10. The **Preview** tab is selected by default. This shows the **`CUSTOMER_SEGMENT`** data. - ![View the new table in the Catalog.](./images/display-new-tables.png " ") + ![The customer_segment data.](./images/customer-segment-data.png " ") - You can click a table name to display its data. Click the *CUSTOMER\_SEGMENT* table to view the data. +10. When finished, click **Close** to return to the Data Load Dashboard. - ![Click customer_segment to display its data.](./images/customer-segment-data.png " ") - -11. When finished, click **Close**, and then click the **Data Load** in the menu on the left. Click **Done**. - - ![Click Done.](./images/click-done.png " ") - - The **Data Load** page is re-displayed. + ![Click Close.](./images/data-load-dashboard.png " ") This completes the lab on loading .csv files from your local computer to new tables in your ADB instance. @@ -200,11 +194,11 @@ You may now proceed to the next lab. * **Contributors:** * Mike Matthews, Autonomous Database Product Management * Marty Gubar, Autonomous Database Product Management -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-data-studio-data-load.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-data-studio-data-load.png new file mode 100644 index 00000000..42119467 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-data-studio-data-load.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-data-studio.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-data-studio.png new file mode 100644 index 00000000..b9dd3dbc Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-data-studio.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-link-data.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-link-data.png index f08b0270..499331df 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-link-data.png and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-link-data.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-report.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-report.png new file mode 100644 index 00000000..58fcfd8c Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/click-report.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/cloud-locations-buckets.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/cloud-locations-buckets.png index 4095184f..89dd8b89 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/cloud-locations-buckets.png and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/cloud-locations-buckets.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/drag-drop-potential-churners.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/drag-drop-potential-churners.png index 19759a3b..5ba78062 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/drag-drop-potential-churners.png and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/drag-drop-potential-churners.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/link-job-complete.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/link-job-complete.png index e8b87b60..c36103dd 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/link-job-complete.png and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/link-job-complete.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/save-preferences.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/save-preferences.png index 62ea98f5..1c71d97e 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/save-preferences.png and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/save-preferences.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/selected-bucket.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/selected-bucket.png index 75f5a95a..b8d4ff1c 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/selected-bucket.png and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/selected-bucket.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/images/sql-worksheet.png b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/sql-worksheet.png new file mode 100644 index 00000000..2ae456eb Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-private/images/sql-worksheet.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-private/load-os-data-private.md b/shared/adw-data-lake/build-data-lake/load-os-data-private/load-os-data-private.md index 338bc9d6..49430602 100644 --- a/shared/adw-data-lake/build-data-lake/load-os-data-private/load-os-data-private.md +++ b/shared/adw-data-lake/build-data-lake/load-os-data-private/load-os-data-private.md @@ -195,23 +195,15 @@ In this task, you will get the following items that are required to create a Clo ## Task 6: Create a Native OCI Credential -You will load data from the `potential_churners.csv` file you uploaded to your private Oracle Object Store in an earlier task using the `DBMS_CLOUD` PL/SQL package. First, you will create a credential in order to access your Oracle Object Storage. You perform this step only once. +You will load data from the **`potential_churners.csv`** file you uploaded to your private Oracle Object Store in an earlier task using the **`DBMS_CLOUD`** PL/SQL package. First, you will create a credential in order to access your Oracle Object Storage. You perform this step only once. -In this task, you create a credential to connect to an Oracle Object Storage bucket. To begin this process, you need to navigate back to the **DATA LOAD** page of **Database Actions**. +In this task, you create a credential to connect to an Oracle Object Storage bucket. -1. On the **Oracle Cloud Console** Home page, open the **Navigation** menu and click **Oracle Database**. Under **Oracle Database**, click **Autonomous Database**. +1. Navigate back to the **SQL Worksheet** in the **SQL | Oracle Database Actions** browser tab that you used in a previous lab. - -2. On the **Autonomous Databases** page, click your **DB-DCAT** ADB instance. - - - -2. On the **Autonomous Databases** page, click your **ADW-Data-Lake** ADB instance. - - -3. On the **Autonomous Database details** page, click the **Database actions** drop-down list, and then select **SQL**. + ![Navigate back to the SQL Worksheet.](./images/sql-worksheet.png =60%x*) -4. Create an OCI native credential to access your Object Store. Copy and paste the following script into your SQL Worksheet. Substitute the placeholders values for the `user_ocid`, `tenancy_ocid`, `private_key`, and `fingerprint` in the following code with the respective values that you saved from the **Configuration File Preview** dialog box from the previous task. +2. Create an OCI native credential to access your Object Store. Copy and paste the following script into your SQL Worksheet. Substitute the placeholders values for the **`user_ocid`**, **`tenancy_ocid`**, **`private_key`**, and **`fingerprint`** in the following code with the respective values that you saved from the **Configuration File Preview** dialog box from the previous task. >**Note:** To find your unencrypted **private_key** value that you downloaded in the previous task: Open the private key file in a text editor, and then copy the entire key value but don't include the **-----BEGIN PRIVATE KEY-----** and **-----END PRIVATE KEY-----** lines. Next, paste the copied value in the following code. @@ -237,13 +229,15 @@ In this task, you create a credential to connect to an Oracle Object Storage buc ## Task 7: Link to Data in the Bucket -1. Click the **Database Actions | SQL** banner to display the **Database Actions | Launchpad** Home page. In the **Data Studio** section, click the **DATA LOAD** card. +1. Click **Database Actions | SQL** in the banner to display the **Launchpad** page. Click the **Data Studio** tab, and then click the **Data Load** tab. -2. In the **Data Load** section, click the **LINK DATA** card. + ![Navigate to Data Load page.](images/click-data-studio-data-load.png) + +2. On the **Data Load** page, click the **LINK DATA** tile. ![Click link data.](images/click-link-data.png) - The **Link Data** page is displayed. The **Cloud Store** tab is already selected. Click the **Select Cloud Store Location or enter public URL** drop-down list to see the buckets and/or Cloud Locations to which you have access. In this workshop, you already have access to the `TRAINING-DATA-LAKE` private bucket in your compartment after your created the OCI credential. Select this bucket. + The **Link Data** page is displayed. The **Cloud Store** tab is already selected. Click the **Select Cloud Store Location or enter public URL** drop-down list to see the buckets and/or Cloud Locations to which you have access. In this workshop, you already have access to the **`TRAINING-DATA-LAKE`** private bucket in your compartment after your created the OCI credential. Select this bucket. ![Click drop-down list on link data page.](images/click-drop-down-list.png) @@ -255,19 +249,26 @@ In this task, you create a credential to connect to an Oracle Object Storage buc ![Drag the potential_churners.csv file.](images/drag-drop-potential-churners.png) -5. Click **Start**. A **Start Link From Cloud Store** dialog box is displayed. Click **Run**. When the link job is completed successfully, a green check mark appears. Click **Done**. +5. Click **Start**. A **Start Link From Cloud Store** dialog box is displayed. Click **Run**. When the link job is completed successfully (external table created), the data link card has the link icon next to it. ![The link job is completed successfully.](images/link-job-complete.png) - >**Note:** To view buckets and Cloud Locations in other compartments or in the root tenancy, click the **Data Studio Preferences** icon. You can use the panel to select a different credential, compartment, and AI profile. Click the **Data Studio Preferences** icon. In the **Data Studio Preferences** panel, you can select a different compartment, and then click **Save**. +6. Click the **Report** button for the link job to view a report of total rows inserted successfully and failed for the selected table. + + ![Click Report.](images/click-report.png " ") + +7. To view buckets and Cloud Locations in other compartments or in the root tenancy, click the **Data Studio Preferences** icon. - ![Click the Data Studio Preferences icon.](images/save-preferences.png) + ![Click the Data Studio Preferences icon.](images/click-data-studio.png) + +8. You can use the panel to select a different credential, compartment, and AI profile. Click the **Data Studio Preferences** icon. In the **Data Studio Preferences** panel, you can select a different compartment, and then click **Save**. + + ![Change preferences.](images/save-preferences.png =50%x*) The Cloud Locations and buckets that are available in the selected compartment are displayed. ![The cloud locations and buckets in the selected compartment.](images/cloud-locations-buckets.png) - ## Learn more * [Load Data from Files in the Cloud](https://www.oracle.com/pls/topic/lookup?ctx=en/cloud/paas/autonomous-data-warehouse-cloud&id=CSWHU-GUID-07900054-CB65-490A-AF3C-39EF45505802). @@ -277,15 +278,13 @@ You may now proceed to the next lab. ## Acknowledgements -* **Author:** - * Lauran K. Serhal, Consulting User Assistance Developer -* **Contributors:** - + Alexey Filanovskiy, Senior Principal Product Manager -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Author:** Lauran K. Serhal, Consulting User Assistance Developer +* **Contributor:** Alexey Filanovskiy, Senior Principal Product Manager +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/bucket-folders-displayed.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/bucket-folders-displayed.png index 79ab7947..d8b5fd65 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/bucket-folders-displayed.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/bucket-folders-displayed.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/change-target-table-name.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/change-target-table-name.png index d7279564..e787c72c 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/change-target-table-name.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/change-target-table-name.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-customer-contact-settings.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-customer-contact-settings.png index e0d8ad47..0584c22c 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-customer-contact-settings.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-customer-contact-settings.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-data-load-banner.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-data-load-banner.png new file mode 100644 index 00000000..6e8af18b Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-data-load-banner.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-data-load-tab.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-data-load-tab.png new file mode 100644 index 00000000..e09d3b2a Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-data-load-tab.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-link-data.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-link-data.png index 99461811..c33f8294 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-link-data.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-link-data.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-sql-tab.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-sql-tab.png new file mode 100644 index 00000000..13999147 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/click-sql-tab.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/customer-contact-settings.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/customer-contact-settings.png index 2589567d..2afbf950 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/customer-contact-settings.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/customer-contact-settings.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/customer_contact-target-table.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/customer_contact-target-table.png index c9b25a2e..ce642708 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/customer_contact-target-table.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/customer_contact-target-table.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/data-load-dashboard.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/data-load-dashboard.png new file mode 100644 index 00000000..6e7af34a Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/data-load-dashboard.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/drag-drop-3-folders.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/drag-drop-3-folders.png index 0fbc84d0..730ec540 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/drag-drop-3-folders.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/drag-drop-3-folders.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/drag-drop-customer-contact.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/drag-drop-customer-contact.png index 6a2673de..d65054f8 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/drag-drop-customer-contact.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/drag-drop-customer-contact.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-completed.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-completed.png index 061b2def..f741d13b 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-completed.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-completed.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-data-page.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-data-page.png index 52a408fa..7fe6b828 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-data-page.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-data-page.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-to-single-table.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-to-single-table.png index 3b15bcbd..a201b251 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-to-single-table.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/link-to-single-table.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/preview-genre-table.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/preview-genre-table.png index b7c8b5d8..1ab4cbbc 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/preview-genre-table.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/preview-genre-table.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/public-bucket-url.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/public-bucket-url.png index 2f2dda39..112a810e 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/public-bucket-url.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/public-bucket-url.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/redisplay-data-load-dashboard.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/redisplay-data-load-dashboard.png new file mode 100644 index 00000000..89df086a Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/redisplay-data-load-dashboard.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/run-data-link.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/run-data-link.png index 6d818522..b1933a04 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/run-data-link.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/run-data-link.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/sales-sample-preview.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/sales-sample-preview.png index 3d183724..e9dd45af 100644 Binary files a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/sales-sample-preview.png and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/sales-sample-preview.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/sql-worksheet.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/sql-worksheet.png new file mode 100644 index 00000000..c0e23245 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/sql-worksheet.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/images/view-genre-details.png b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/view-genre-details.png new file mode 100644 index 00000000..938e0803 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/load-os-data-public/images/view-genre-details.png differ diff --git a/shared/adw-data-lake/build-data-lake/load-os-data-public/load-os-data-public.md b/shared/adw-data-lake/build-data-lake/load-os-data-public/load-os-data-public.md index a7014514..44aa1c99 100644 --- a/shared/adw-data-lake/build-data-lake/load-os-data-public/load-os-data-public.md +++ b/shared/adw-data-lake/build-data-lake/load-os-data-public/load-os-data-public.md @@ -34,35 +34,23 @@ This lab requires completion of **Lab 1: Set up the Workshop Environment > Task ## Task 1: Navigate to the Data Load Page -If you already have the **Oracle Database Actions** browser tab open from the previous lab, click the **Database Actions | SQL** banner to display the **Database Actions | Launchpad** Home page. In the **Data Studio** section, click the **DATA LOAD** card. Next, skip to **Task 2**; otherwise, start with **step 1** below. +1. Click **Database Actions | SQL** in the banner to display the **Database Actions | Launchpad** page. -![Click the banner.](./images/click-banner.png " ") + ![Click the banner.](./images/click-banner.png " ") -1. Log in to the **Oracle Cloud Console**, if you are not already logged as the Cloud Administrator. You will complete all the labs in this workshop using this Cloud Administrator, `ADMIN`. On the **Sign In** page, select your tenancy, enter your username and password, and then click **Sign In**. The **Oracle Cloud Console** Home page is displayed. +2. Click the **Data Studio** tab, and then click the **Data Load** tab. -2. Open the **Navigation** menu and click **Oracle Database**. Under **Oracle Database**, click **Autonomous Database**. + ![Click Data Studio > Data Load tabs.](./images/click-data-load-tab.png " ") - -3. On the **Autonomous Databases** page, click your **DB-DCAT** ADB instance. - + The **Data Load Dashboard** page is displayed. - -3. On the **Autonomous Databases** page, click your **ADW-Data-Lake** ADB instance. - - -4. Click the **Database Actions** drop-down list, and then select **View all database actions**. - -5. The **Database Actions | Launchpad** Home page is displayed in a _**new tab**_ in your browser. In the **Data Studio** section, click the **DATA LOAD** card. - - ![The Database Actions Launchpad Home page is displayed. The Data Load card in the Data Studio section is highlighted.](./images/click-data-load.png " ") - - The **Data Load** page is displayed. + ![The Data Load Dashboard is displayed.](./images/data-load-dashboard.png " ") ## Task 2: Link to Data in Public Object Storage Buckets and Create External Tables -In this task, you will link to data and create the following external tables in your Autonomous Database instance: **customer\_contact**, **genre**, **pizza\_locations**, and **sales\_sample**. +In this task, you will link to data and create the following external tables in your Autonomous Database instance: **`customer_contact`**, **`genre`**, **`pizza_locations`**, and **`sales_sample`**. -1. On the **Data Load** page, click the **LINK DATA** card. +1. On the **Data Load Dashboard**, click the **LINK DATA** tile. ![Click Link Data.](images/click-link-data.png) @@ -70,7 +58,7 @@ In this task, you will link to data and create the following external tables in ![Select Link Data and Cloud Store.](images/link-data-page.png) -3. Copy the following object storage URL and paste it in the **Select Cloud Store Location or enter public URL** field. The **moviestream\_landing** Oracle Object Storage bucket that contains the data is located in a different tenancy than yours, **c4u04**; therefore, you will use the following URL. +3. Copy the following object storage URL and paste it in the **Select Cloud Store Location or enter public URL** field. The **`moviestream_landing`** Oracle Object Storage bucket that contains the data is located in a different tenancy than yours, **c4u04**; therefore, you will use the following URL. ``` @@ -84,35 +72,35 @@ In this task, you will link to data and create the following external tables in ![The Load Cloud Object page appears](images/bucket-folders-displayed.png) -5. Drag the **customer\_contact** folder and drop it onto the data linking job section. +5. Drag the **`customer_contact`** folder and drop it onto the data linking job section. ![Drag the customer_contact folder](images/drag-drop-customer-contact.png) 6. A **Link to Single Target Table** dialog box is displayed to prompt you whether or not you want to link all objects in this folder matching **.csv** to a single target table. This folder contains a single file, `customer-contact.csv`. In general, data lake folders contain many files of the same type, as you will see with sales data. Click **Yes**. - ![Click yes to load objects to a single table.](images/link-to-single-table.png) + ![Click yes to load objects to a single table.](images/link-to-single-table.png =60%x*) - The **customer\_contact** target table to be created for the selected `.csv` file is displayed in the data linking job section. + The **`customer_contact`** target table to be created for the selected `.csv` file is displayed in the data linking job section. ![The customer_contact target table is displayed.](images/customer_contact-target-table.png) -7. Drag and drop the **genre**, **sales\_sample**, and **pizza\_location** folders onto the data linking job section. Click **Yes** when prompted for each target table. +7. Drag and drop the **`genre`**, **`sales_sample`**, and **`pizza_location`** folders onto the data linking job section. Click **Yes** when prompted for each target table. ![Drag and drop three more folders.](images/drag-drop-3-folders.png) -8. Click the **Settings** icon (pencil) for the **customer\_contact** link task to view its settings. +8. Click the **Settings** icon (pencil) for the **`customer_contact`** link task to view its settings. ![Click the pencil icon to open settings viewer for customer_contact load task](images/click-customer-contact-settings.png) The **Link Data from Cloud Store Location customer_contact** settings panel is displayed. -9. The **Database Actions** link job will create a **CUSTOMER_CONTACT** table with the listed columns and data types that are based on the selected *.csv file. Review the information and the loading options. In the **Mapping** section, notice that you can change the target column names, data types, and length/precision. Click **Close** to close the settings viewer panel. +9. The **Database Actions** link job will create a **`CUSTOMER_CONTACT`** table with the listed columns and data types that are based on the selected *.csv file. Review the information and the loading options. In the **Mapping** section, notice that you can change the target column names, data types, and length/precision. Click **Close** to close the settings viewer panel. ![View the settings for customer_contact load task](images/customer-contact-settings.png) -10. Click the **Settings** icon (pencil) for the **sales\_sample** link task to view its settings. +10. Click the **Settings** icon (pencil) for the **`sales_sample`** link task to view its settings. - ![View the sales-sample load task settings.](images/sales-sample-preview.png) + ![View the sales-sample load task settings.](images/sales-sample-preview.png =60%x*) 11. The Load tool makes intelligent choices for the target table name and properties. Since this is an initial load, accept the default option of **Create Table**, which conveniently creates the target table in the Autonomous Database instance, without the need to predefine the table in SQL. Change the name of the target table to be created from **SALES_SAMPLE** to **CUSTSALES**. Next, click **Close**. @@ -122,25 +110,23 @@ In this task, you will link to data and create the following external tables in ![Run the data load job](images/run-data-link.png) - > **Note:** The load job can take about 2 minutes to complete. + > **Note:** The link job can take about 2 minutes to complete. -13. After the load job is completed, make sure that all of the data link cards have green check marks next to them. This indicates that your data link tasks have completed successfully. +13. After the link job is completed, make sure that all of the data link cards have the link icons next to them. You can click the **Report** button for a link job to view a report of total rows processed successfully and failed for the selected table. ![Load job tasks completed. View the genre load task settings.](images/link-completed.png) -14. Click the **Settings** icon (pencil) for the **genre** load task to view its settings. +14. Click the **Settings** icon (pencil) for the **`genre`** load task to view its settings. Next, select **Table > View Details**. -15. Review some of the linked data. Click the **Table** tab to view the **genre** data. + ![View genre details](images/view-genre-details.png) - ![View genre data](images/preview-genre-table.png) - -16. Click **Close** to exit the **genre** task preview. +15. The **Preview** tab is selected by default. This shows the **`genre`** data. - ![Click Done.](images/click-done.png) + ![View genre data](images/preview-genre-table.png) -17. Click **Done** to exit the **Link Data** page and return to the **Data Load** page. +16. Click **Close** to exit the **genre** task preview and to return to the Data Load Dashboard. - ![Data Load page.](images/data-load-page.png) + ![Return to Data Load Dashboard.](images/redisplay-data-load-dashboard.png) ## Task 3: Create and Populate an External Table Using the DBMS_CLOUD Package @@ -155,13 +141,13 @@ The `DBMS_CLOUD` package supports loading data files from the following Cloud so Use the `DBMS_CLOUD` package to create an external table and to also load it with the public Object Storage Parquet file data. -1. Click the **Database Actions | Launchpad** banner to display the Home page. +1. Click **Database Actions | Data Load** in the banner to display the **Launchpad** page. - ![Click the banner.](./images/click-banner-3.png " ") + ![Click the banner.](./images/click-data-load-banner.png " ") -2. In the **Development** section, click the **SQL** card. +2. Click the **Development** tab, and then click the **SQL** tab. - ![Click the SQL card.](./images/click-sql-card.png " ") + ![Click the SQL card.](./images/click-sql-tab.png " ") 3. Create an external table and load it with data from a Parquet file in a _public_ OCI Object Storage bucket. Use the **`EXTERNAL_TABLE`** procedure in the **`DBMS_CLOUD`** package to create and populate the external table. You can access the Object Storage Parquet file using the OCI Object Storage Native URI format as follows: @@ -221,11 +207,11 @@ You may now proceed to the next lab. * Mike Matthews, Autonomous Database Product Management * Marty Gubar, Autonomous Database Product Management * Rick Green, Principal Developer, Database User Assistance -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/oracle-data-provider/oracle-data-provider.md b/shared/adw-data-lake/build-data-lake/oracle-data-provider/oracle-data-provider.md index 6144d690..338dffc2 100644 --- a/shared/adw-data-lake/build-data-lake/oracle-data-provider/oracle-data-provider.md +++ b/shared/adw-data-lake/build-data-lake/oracle-data-provider/oracle-data-provider.md @@ -24,7 +24,7 @@ This lab requires the completion of the following labs/tasks from the **Contents ## Task 1: Navigate to the SQL Worksheet -If your SQL Worksheet is still displayed from the previous task, skip over to **Task 2**. +If your SQL Worksheet is still displayed from the previous task, skip over to **Task 2**. If you closed the Web browser tab where the SQL Worksheet was displayed, navigate to the SQL Worksheet as follows: 1. Log in to the **Oracle Cloud Console**. @@ -102,15 +102,13 @@ You may now proceed to the next lab. ## Acknowledgements -* **Author:** - * Lauran K. Serhal, Consulting User Assistance Developer -* **Contributor:** - + Alexey Filanovskiy, Senior Principal Product Manager -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Author:** Lauran K. Serhal, Consulting User Assistance Developer +* **Contributor:** Alexey Filanovskiy, Senior Principal Product Manager +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/aws-connection-created.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/aws-connection-created.png index bd285dcc..965e48c2 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/aws-connection-created.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/aws-connection-created.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-connections-oci.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-connections-oci.png index 50dbf710..dfc53564 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-connections-oci.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-connections-oci.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-connections.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-connections.png new file mode 100644 index 00000000..ccb6c820 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-connections.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-load-data.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-load-data.png index 136d1c85..733108d7 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-load-data.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-load-data.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-new-cloud-store-location.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-new-cloud-store-location.png index eb9fd25d..630faa0b 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-new-cloud-store-location.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-new-cloud-store-location.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-run.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-run.png index 1c85b247..cda5b3d5 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-run.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/click-run.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/create-aws-s3-location.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/create-aws-s3-location.png index ee360b88..07a4db22 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/create-aws-s3-location.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/create-aws-s3-location.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/customer-contact-1-created.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/customer-contact-1-created.png index 93c397ce..2b2f4830 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/customer-contact-1-created.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/customer-contact-1-created.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/customer-contact-created.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/customer-contact-created.png index e0c98e60..50a6d377 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/customer-contact-created.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/customer-contact-created.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/drag-drop-customer-contact.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/drag-drop-customer-contact.png index 30428df4..edbe4dab 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/drag-drop-customer-contact.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/drag-drop-customer-contact.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/drag-drop-potential-churners.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/drag-drop-potential-churners.png index 446f4c46..638dacd5 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/drag-drop-potential-churners.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/drag-drop-potential-churners.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/link-job-completed.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/link-job-completed.png index 1bc76f00..963f6305 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/link-job-completed.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/link-job-completed.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/load-data-page.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/load-data-page.png index 9f2f2943..a4372ec3 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/load-data-page.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/load-data-page.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/load-to-single-table.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/load-to-single-table.png index 7acb8f26..44e1c652 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/load-to-single-table.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/load-to-single-table.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/navigate-sql-worksheet.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/navigate-sql-worksheet.png new file mode 100644 index 00000000..de16f03d Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/navigate-sql-worksheet.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-cloud-data.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-cloud-data.png index e69985c9..c71ff2cf 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-cloud-data.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-cloud-data.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-cloud-settings.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-cloud-settings.png index 717b2fec..a02f8307 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-cloud-settings.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-cloud-settings.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-connection-created.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-connection-created.png index a274ab0e..1d0899c3 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-connection-created.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/oci-connection-created.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/select-aws-s3.png b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/select-aws-s3.png index 74e14c15..c7760bd5 100644 Binary files a/shared/adw-data-lake/build-data-lake/query-data-lakes/images/select-aws-s3.png and b/shared/adw-data-lake/build-data-lake/query-data-lakes/images/select-aws-s3.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-data-lakes/query-data-lakes.md b/shared/adw-data-lake/build-data-lake/query-data-lakes/query-data-lakes.md index e6c67758..ff7bc149 100644 --- a/shared/adw-data-lake/build-data-lake/query-data-lakes/query-data-lakes.md +++ b/shared/adw-data-lake/build-data-lake/query-data-lakes/query-data-lakes.md @@ -24,6 +24,10 @@ _**This is not a hands-on lab; instead, it is a demo of how to query data from d ## Task 1: Navigate to the Data Load Page +If you already accessed the SQL Worksheet in the previous lab, click **Database Actions | SQL** in the banner to display the **Launchpad** page. Click the **Data Studio** tab, and then click the **Data Load** tab to display the **Data Load Dashboard**. You can now skip over to **Task 2**. + +If you closed the Web browser tab where the SQL Worksheet was displayed, navigate to the **Data Load** page as follows: + 1. Log in to the **Oracle Cloud Console**. 2. Open the **Navigation** menu and click **Oracle Database**. Under **Oracle Database**, click **Autonomous Database**. @@ -44,7 +48,7 @@ In this task, we will get some customers information from a public OCI Object St In this task, we define a **Connection** to connect to a public Oracle Object Storage bucket in order to load data from the **`customer-contact.csv`** and **`customer-extension.csv`** files to create detailed customers tables. -1. On the **Data Load** page, in the **Administration** section, click **CONNECTIONS**. +1. On the **Data Load** page, click the **CONNECTIONS** tile. ![Click the Cloud Locations card.](./images/click-connections-oci.png " ") @@ -52,11 +56,11 @@ In this task, we define a **Connection** to connect to a public Oracle Object St ![Click Add Cloud Storage.](./images/click-new-cloud-store-location.png " ") -3. Specify the following in the **Add Cloud Store Location** panel. +3. Specify the following in the **Storage Settings** page 1 of the **Add Cloud Store Location** wizard: + **Name:** Enter **`oci-data-lake`**. + **Description:** Enter an optional description. + Select the **Public Bucket** option. - + The **Bucket URI** option is selected. + + Accept the selected **Bucket URI** option. + **Bucket URI:** Enter the URI for the public Object Storage bucket. ``` @@ -65,15 +69,15 @@ In this task, we define a **Connection** to connect to a public Oracle Object St ``` - ![Complete the Add Cloud Store Location.](./images/oci-cloud-settings.png " ") + ![Complete the Add Cloud Store Location.](./images/oci-cloud-settings.png =65%x*) -4. Click **Next** to see the available objects in the selected bucket. This bucket contains several folders. We will load the **`customer-contact.csv`** and **`customer-extension.csv`** files from their respective folders into our ADB instance and use them to create tables that will help us identify the potential customers churners. +4. Click **Next** to see the available objects in the selected bucket in the **Cloud Data** page 2 of the wizard. This bucket contains several folders. We will load the **`customer-contact.csv`** and **`customer-extension.csv`** files from their respective folders into our ADB instance and use them to create tables that will help us identify the potential customers churners. - ![Click Next to see the objects in the bucket.](./images/oci-cloud-data.png " ") + ![Click Next to see the objects in the bucket.](./images/oci-cloud-data.png =65%x*) 5. Click **Create**. The new **oci-data-lake** cloud location is displayed in the **Connections** page. - ![The cloud store location is created.](./images/oci-connection-created.png " ") + ![The cloud store location is created.](./images/oci-connection-created.png =65%x*) 6. Click on the **Data Load** link in the breadcrumbs to return to the **Data Load** page. @@ -83,7 +87,7 @@ In this task, we will load data and create the **customer\_contact** table in yo >**Note:** In **Lab 3: Load Data from Local Files**, we already loaded the **customer-extension.csv** file into our ADB instance; therefore, we won't perform this step. In addition, in **Lab 4: Link to Data in Public Object Storage Buckets**, we already linked to the **`customer_contact`** file and created the external table; however, in this task, we will load the same **`customer_contact`** data into our ADB instance and create a new database table under a new name. Querying data stored inside the database is much faster than querying data that is stored in external tables outside the database. -1. In the **Data Load** section, click **LOAD DATA**. +1. On the **Data Load Dashboard**, click the **LOAD DATA** tile. ![Click Load Data.](./images/click-load-data.png " ") @@ -97,9 +101,9 @@ In this task, we will load data and create the **customer\_contact** table in yo 4. A dialog box is displayed to prompt you whether or not if you want to load all objects in this folder matching **.csv** to a single target table. This folder contains a single file, **`customer_contact.csv`**. In general, data lake folders contain many files of the same type, as you will see with sales data. Click **Yes**. - ![Click yes to load objects to a single table.](images/load-to-single-table.png) + ![Click yes to load objects to a single table.](images/load-to-single-table.png =60%x*) - The **`customer_contact`** target table to be created for the selected **`.csv`** file is displayed in the data loading job section. Again, since we already have linked to the **`customer_contact`** file in a previous lab, the data load utility changed the name of the newly created external table to **`customer_contact_1`**. + The **`customer_contact`** target table to be created for the selected **`.csv`** file is displayed in the data loading job section. If a warning message box is displayed, close it. Again, since we already have linked to the **`customer_contact`** file in a previous lab, the data load utility changed the name of the newly created external table to **`customer_contact_1`**. >**Note:** You can click the **`customer_contact (23 MB)`** link to display the settings for the table that will be created. You can preview the external table and change its name, data type, and so on. @@ -109,13 +113,15 @@ In this task, we will load data and create the **customer\_contact** table in yo ![Run the load job.](images/click-run.png) - If the load job completes successfully, a green checkmark with the status **Complete** is displayed next to the file's name. + If the load job is completed successfully, the data load card has a copy icon next to it. You can click the **Report** button for the load job to view a report of total rows processed successfully and failed for the selected table. ![Load job completed.](images/customer-contact-created.png) -6. Navigate to the SQL Worksheet. Click **Oracle Database Actions** in the banner to display the **Launchpad** landing page. +6. Navigate to the SQL Worksheet. Click **Database Actions | Data Load** in the banner to display the **Launchpad** page. + +7. Click the **Development** tab, and then click the **SQL** tab to display the SQL Worksheet. -7. In the **Development** section, click the **SQL** card to display the SQL Worksheet. + ![Navigate to SQL Worksheet.](images/navigate-sql-worksheet.png) The two tables that we created and will use in this demo are displayed in the **Navigator** tab, namely, **`CUSTOMER_CONTACT_1`** and **`CUSTOMER_EXTENSION`**. @@ -129,7 +135,11 @@ In this task, we define a **Connection** to connect to our **`moviestream-churn` ![The potential_churners.csv file in the S3 bucket.](images/aws-s3-bucket.png) -1. Click **Oracle Database Actions** in the banner to display the Launchpad landing page. In the **Data Studio** section, click the **DATA LOAD** card. On the **Data Load** page, in the **Administration** section, click **CONNECTIONS**. +1. Navigate to the **Data Load Dashboard**. Click **Database Actions | SQL** in the banner to display the **Launchpad** page. Click the **Data Studio** tab, and then click the **Data Load** tab. + +2. Click the **CONNECTIONS** tile. + + ![Click Connections.](images/click-connections.png) 2. On the **Connections** page, click the **Create** drop-down list, and then select **New Cloud Store Location**. @@ -162,7 +172,7 @@ In this task, we define a **Connection** to connect to our **`moviestream-churn` ![Click Next to see the objects in the bucket.](./images/cloud-data.png " ") -5. Click **Create**. The **aws-s3-data-lake** cloud location is displayed in the **Manage Cloud Store** page. +5. Click **Create**. The **aws-s3-data-lake** cloud location is displayed in the **Connections** page. ![The cloud store location is created.](./images/aws-connection-created.png " ") @@ -172,7 +182,7 @@ In this task, we define a **Connection** to connect to our **`moviestream-churn` In this task, we will link to the `potential_churners.csv` data from the AWS S3 cloud location that we created. A link is preferred so that if the data changes, we don't have to re-load the data. We are always looking at up-to-date data. -1. On the **Data Load** page, click **LINK DATA**. +1. On the **Data Load** page, click the **LINK DATA** tile. 2. The **Link Data** page is displayed and the **CLOUD STORE** tab is selected. Select the **`aws-s3-data-lake`** from the **Select Cloud Store Location or enter public URL** drop-down list. @@ -182,7 +192,7 @@ In this task, we will link to the `potential_churners.csv` data from the AWS S3 ![Drag and drop the potential_churners folder](images/drag-drop-potential-churners.png) -4. Click **Start** and then click **Run**. If the **`potential_churners`** link job completes successfully, a green checkmark with the status **Complete** is displayed next to the file's name. +4. Click **Start** and then click **Run**. If the **`potential_churners`** link job completes successfully, the data link card has the link icon next to it. You can click the Report button for the link job to view a report of total rows processed successfully and failed for the selected table. ![The potential_churners target table is displayed.](images/link-job-completed.png) @@ -190,11 +200,9 @@ In this task, we will link to the `potential_churners.csv` data from the AWS S3 We now have the needed tables to analyze the data and identify the potential customers that might churn. -1. Click **Oracle Database Actions** in the banner to display the **Launchpad** landing page. - -2. In the **Development** section, click the **SQL** card to display the SQL Worksheet. +1. Click **Database Actions | Data Load** in the banner to display the **Launchpad** page. Click the **Development** tab, and then click the **SQL** tab to display the SQL Worksheet. -3. Let's query the **`POTENTIAL_CHURNERS`** table. Copy and paste the following code into your SQL Worksheet, and then click the **Run Statement** icon in the Worksheet toolbar. +2. Let's query the **`POTENTIAL_CHURNERS`** table. Copy and paste the following code into your SQL Worksheet, and then click the **Run Statement** icon in the Worksheet toolbar. ``` @@ -282,22 +290,19 @@ We now have the needed tables to analyze the data and identify the potential cus ## Learn more -* [Load Data from Files in the Cloud](https://www.oracle.com/pls/topic/lookup?ctx=en/cloud/paas/autonomous-data-warehouse-cloud&id=CSWHU-GUID-07900054-CB65-490A-AF3C-39EF45505802). * [Load Data with Autonomous Database](https://docs.oracle.com/en/cloud/paas/autonomous-data-warehouse-cloud/user/load-data.html#GUID-1351807C-E3F7-4C6D-AF83-2AEEADE2F83E) You may now proceed to the next lab. ## Acknowledgements -* **Author:** - * Lauran K. Serhal, Consulting User Assistance Developer -* **Contributor:** - + Alexey Filanovskiy, Senior Principal Product Manager -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Author:** Lauran K. Serhal, Consulting User Assistance Developer +* **Contributor:** Alexey Filanovskiy, Senior Principal Product Manager +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/query-performance/images/performance-hub-tab.png b/shared/adw-data-lake/build-data-lake/query-performance/images/performance-hub-tab.png new file mode 100644 index 00000000..80294384 Binary files /dev/null and b/shared/adw-data-lake/build-data-lake/query-performance/images/performance-hub-tab.png differ diff --git a/shared/adw-data-lake/build-data-lake/query-performance/query-performance.md b/shared/adw-data-lake/build-data-lake/query-performance/query-performance.md index d273333f..05a45995 100644 --- a/shared/adw-data-lake/build-data-lake/query-performance/query-performance.md +++ b/shared/adw-data-lake/build-data-lake/query-performance/query-performance.md @@ -24,23 +24,7 @@ This lab requires the completion of the following labs/task from the **Contents* * **Lab 1: Set up the Workshop Environment > Task 3: Create an Autonomous Data Warehouse Instance**. * **Lab 5: Link Data from Private Object Storage Buckets > Task 6: Define a Cloud Location and Create a Credential**. -## Task 1: Navigate to the SQL Worksheet - -1. Log in to the **Oracle Cloud Console**. - -2. Open the **Navigation** menu and click **Oracle Database**. Under **Oracle Database**, click **Autonomous Database**. - - -3. On the **Autonomous Databases** page, click your **DB-DCAT** ADB instance. - - - -3. On the **Autonomous Databases** page, click your **ADW-Data-Lake** ADB instance. - - -4. On the **Autonomous Database details** page, click the **Database actions** drop-down list, and then select **SQL**. The SQL Worksheet is displayed. - -## Task 2: Create a Materialized View for an External Table +## Task 1: Create a Materialized View for an External Table In this task, you will create a materialized view on top of the **custsales** external table that you created in **Lab 4: Task 2** based on **sales\_sample** to improve the query response time. @@ -167,23 +151,19 @@ In this task, you will create a materialized view on top of the **custsales** ex ![Run query with materialized view.](./images/monitor-query.png " ") -8. Click **Oracle Database Actions** in the banner to display the **Launchpad** landing page. - - ![Click Database Actions in the banner.](images/click-database-actions.png) - -9. Scroll-down the page to the **Monitoring** section, and then click **PERFORMANCE HUB**. +8. Click **Database Actions | SQL** in the banner to display the **Launchpad** page. Click the **Monitoring** tab, and then click the **Performance Hub** tab. - ![Click Performance hub.](images/click-performance-hub.png) + ![Click Database Actions in the banner.](images/performance-hub-tab.png) -10. Click the **SQL Monitoring** tab. Re-size the timeline border as needed to show the queries you ran. Click the link for the latest monitoring query that you ran. +9. Click the **SQL Monitoring** tab. Re-size the timeline border as needed to show the queries you ran. Click the link for the latest monitoring query that you ran. ![Click the SQL Monitoring tab.](images/click-sql-monitoring-tab.png) -11. In the **Real-time SQL Monitoring for SQL** page for the selected query, the execution plan shows that the query was re-written to use the materialized view. The data was obtained using the **`sales_summary_mv`** materialized view and not the **`custsales`** detailed table. +10. In the **Real-time SQL Monitoring for SQL** page for the selected query, the execution plan shows that the query was re-written to use the materialized view. The data was obtained using the **`sales_summary_mv`** materialized view and not the **`custsales`** detailed table. ![The query is re-written.](images/query-rewrite.png) -## Task 3: Create and Manage Partitioned External Tables +## Task 2: Create and Manage Partitioned External Tables Partitioning is a well-established technique to improve the performance and manageability of database systems by dividing large objects into smaller partitions; any large data warehouse takes advantage of it. This is true for large objects inside the database and objects outside the database, such as data lakes in Object Stores. @@ -205,7 +185,7 @@ Let's just have a quick look at what all of this means for a relatively small pa A bunch of sales data-related files landed in our Oracle Object Storage bucket, ready to be analyzed in Autonomous Database. The data is transactional in nature and represents sales data for two years. The data is in the **sales\_sample** folder in the **moviestream\_landing** Object Storage bucket that you used in the previous task. There are **24** `parquet` data files in this folder. Each file represents a month's worth of data for the years **2019** and **2020**. -1. Click **Oracle Database Actions** in the banner to display the Launchpad landing page. In the **Development** section, click the **SQL** card. +1. Click **Database Actions | Performance Hub** in the banner to display the **Launchpad** page. Click the **Development** tab, and then click the **SQL** tab. 2. Let's create a monthly partitioned external table on top of these `parquet` files, using the traditional **DBMS\_CLOUD** PL/SQL package and the **CREATE\_EXTERNAL\_PART\_TABLE** procedure. Copy and paste the following code into your SQL Worksheet, and then click the **Run Script (F5)** icon in the Worksheet toolbar. @@ -392,11 +372,11 @@ A bunch of sales data-related files landed in our Oracle Object Storage bucket, * Lauran K. Serhal, Consulting User Assistance Developer * **Contributor:** + Alexey Filanovskiy, Senior Principal Product Manager -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/setup-workshop-environment/setup-workshop-environment.md b/shared/adw-data-lake/build-data-lake/setup-workshop-environment/setup-workshop-environment.md index cacb677f..b1a6e547 100644 --- a/shared/adw-data-lake/build-data-lake/setup-workshop-environment/setup-workshop-environment.md +++ b/shared/adw-data-lake/build-data-lake/setup-workshop-environment/setup-workshop-environment.md @@ -212,10 +212,10 @@ You may now proceed to the next lab. ## Acknowledgements * **Author:** Lauran K. Serhal, Consulting User Assistance Developer -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled [GNU Free Documentation License](https://oracle-livelabs.github.io/adb/shared/adb-15-minutes/introduction/files/gnu-free-documentation-license.txt) diff --git a/shared/adw-data-lake/build-data-lake/use-delta-sharing/use-delta-sharing.md b/shared/adw-data-lake/build-data-lake/use-delta-sharing/use-delta-sharing.md index 4908b6cb..20c84a0a 100644 --- a/shared/adw-data-lake/build-data-lake/use-delta-sharing/use-delta-sharing.md +++ b/shared/adw-data-lake/build-data-lake/use-delta-sharing/use-delta-sharing.md @@ -49,7 +49,7 @@ This lab requires the completion of **Lab 1**: Set up the Workshop Environment > ## Task 2: Navigate to the SQL Worksheet -If you already accessed the SQL Worksheet from the previous lab, you can skip over to **Task 3**; otherwise, navigate to SQL Worksheet as follows: +If you already accessed the SQL Worksheet in the previous lab, you can skip over to **Task 3**; otherwise, navigate to SQL Worksheet as follows: 1. Log in to the **Oracle Cloud Console**. @@ -173,15 +173,13 @@ You may now proceed to the next lab. ## Acknowledgements -* **Author:** - * Lauran K. Serhal, Consulting User Assistance Developer -* **Contributor:** - + Alexey Filanovskiy, Senior Principal Product Manager -* **Last Updated By/Date:** Lauran K. Serhal, February 2024 +* **Author:** Lauran K. Serhal, Consulting User Assistance Developer +* **Contributor:** Alexey Filanovskiy, Senior Principal Product Manager +* **Last Updated By/Date:** Lauran K. Serhal, April 2024 Data about movies in this workshop were sourced from Wikipedia. -Copyright (C) Oracle Corporation. +Copyright (C) 2024 Oracle Corporation. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 diff --git a/shared/adw-data-lake/build-data-lake/workshops/livelabs/manifest.json b/shared/adw-data-lake/build-data-lake/workshops/livelabs/manifest.json index 16ec951e..7105c362 100644 --- a/shared/adw-data-lake/build-data-lake/workshops/livelabs/manifest.json +++ b/shared/adw-data-lake/build-data-lake/workshops/livelabs/manifest.json @@ -74,7 +74,7 @@ }, { "title": "Lab 11: Integrate ADW with AWS Glue Data Catalogs", - "type":"freetier", + "type":"livelabs", "description": "This lab shows ADW integration with AWS Data Catalogs.", "filename": "./../../adw-aws-integrate/adw-aws-integrate.md" },