Skip to content

Commit

Permalink
Updated: Access the Data Lake using Autonomous Database and Data Cata…
Browse files Browse the repository at this point in the history
…log workshop (#330)

* update shared to serverless

* update adb-dcat workshop

* added new lab 12

* Update manifest.json

* added new folder with an .md file in it

Please work!

* more testing

* Delete introduction.md

* new workshop and labs wip

* update labs

* more updates

* more updates

* more updates

* updates

* more updates

* updates before review cycle

* Update endpoint.png

* Update setup-workshop-environment.md

* Update setup-workshop-environment.md

* more updates

* final update before review

* updates

* replacement code

* Update create-share-recipients.md

* Update create-share-recipients.md

* Update create-share-recipients.md

* Update create-share-recipients.md

* Update create-share-recipients.md

* Update create-share-recipients.md

* updates

* Update manifest.json

* folder rename

* added content to data studio folder

* Delete user-bucket-credential-diagram.png

* updates self-qa

* Update introduction.md

* remove extra text files

* Update introduction.md

* Update setup-workshop-environment.md

* Data Studio Workshop Changes

* changes to data studio workshop

* Update setup-workshop-environment.md

* adb changes

* Update recipient-diagram.png

* diagram change

* Update user-bucket-credential-diagram.png

* SME feedback

* Update create-share.md

* Nilay changes

* changes

* Update consume-share.md

* Anoosha's feedback

* Update consume-share.md

* updated 2 screens and a sentence

* minor changes

* deleted extra images and added doc references

* new ECPU changes

* more changes to data sharing workshops

* more changes to fork (data studio)

* more changes

* Marty's feedback

* Marty's feedback to plsql workshop too

* Update setup-workshop-environment.md

* Delete 7381.png

* workshop # 3 ADB set up

and a couple of minor typos in workshops 1 and 2

* changes to adb-dcat workshop

* more changes

* minor typos in all 4 workshops

* quarterly qa build data lake

* new lab 11 in build DL with ADW

* minor changes database actions drop-down list

* final changes to build data lake workshop

* AI updates

AI workshop updates

* ai workshop updates

* Update query-using-select-ai.md

* Update query-using-select-ai.md

* updates

* more updates

* Update query-using-select-ai.md

* more new updates to ai workshop

* Update query-using-select-ai.md

* a new screen capture

* push Marty's feedback to fork

Final changes.

* updates sandbox manifest

* updates

* restored sandbox manifest

* Update setup-environment.md

* updates after CloudWorld

* final updates to ai workshop (also new labs 4 and 5)

* marty's feedback

* incorporated feedback

* minor PR edits by Sarah

* removed steps 7 & 8 Lab 2 > Task 3 per Alexey

The customer asked to remove this as it's not a requirement for the bucket to be public.

* more changes

* more changes per Alexey

* Update load-os-data-public.md

* Quarterly QA

I added a new step per the PM's request in the Data Sharing PL/SQL workshop. I also made a minor edit (removed space) in the Data Lake workshop.

* more updates

* Quarterly QA changes

* Update consume-share.md

* minor edit based on workshop user

* quarterly qa November 2023

* Added new videos to the workshop

Replaced 3 old silent videos with new ones. Added two new videos.

* Adding important notes to the two data sharing workshops

Per the PM's request.

* folder structure only  push to production

This push and the PR later is to make sure the folder structure is in the production repo before I start development. Only 1 .md file and the workshops folder.

* typos

* cloud links workshop

* UPDATES

* Update query-view.png

* update

* minor updates to chat ai workshop (Fork)

* test clones

* test pr

* Alexey's feedback

* Update data-sharing-diagram.png

* sarah's edits

* changes to Data Load UI

* removed script causing ML issue

* Update load-local-data.md

* updates: deprecated procedure and new code

* updates and test

* more updates

* minor update

* testing using a building block in a workshop

* updates

* building blocks debugging

* Update manifest.json

* fixing issues

* Update manifest.json

* delete cleanup.md from workshop folder (use common file)

* use common cleanup.md instead of local cleanup.md

* test common tasks

* update data sharing data studio workshop

* Update create-recipient.png

* PM's 1 feedback

* quarterly qa

* missing "Lab 2" from Manifest

* always free note addition

added a note

* always free change

* Update setup-environment.md

* update manage and monitor workshop

* Folder structure for new data share workshop (plus introduction.md)

* Updated Load and Analyze from clone

* Data Lake minor changes from clone

* manage and monitor workshop

* Remove the lab from the workshop per Marty's request

* mark-hornick-feedback

* used marty's setup file

* replaced notebook with a new one

* updates to lab 6 of manage and monitor

* Update adb-auto-scaling.md

* Nilay's feedback

* Update adb-auto-scaling.md

* updates to second ai workshop

* note change

* Changes to Load and Analyze workshop (other minor changes too)

* quarterly qa

* Update diagrams per Alexey (remove delta share icon)

* updated the 15-minutes workshop

* Update analyzing-movie-sales-data.md

* ords updates and misc

* updated data studio workshop

* ORDS and Misc updates

* updated freetier version

* updated livelabs version

* updating the manage and monitor workshop

* more updates

* lab 11 updates

* updated lab 14

* updated freetier

* more updates

* Update adw-connection-wallet.md

* update

* Create purge-scn.png

* livelabs updates

* Update adb-flashback.md

* final updates

* updated screens Ramona's review

* Update click-add-peer-database-second-time.png

* update the adb-dcat workshop

1. New ord 24.1.0 launchpad.
2. New navigation path to create dynamic groups
3. Updated OML UI

* Update see-clone-information-in-details-page-2.png

---------

Co-authored-by: Michelle Malcher <[email protected]>
Co-authored-by: Sarah Hirschfeld <[email protected]>
  • Loading branch information
3 people authored May 22, 2024
1 parent 78e5ac6 commit 7d48989
Show file tree
Hide file tree
Showing 33 changed files with 650 additions and 59 deletions.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@
"msg": [
{
"type": "HTML",
"data": "<p><img src=\"https://oracle-livelabs.github.io/adb/shared/movie-stream-story/introduction/images/moviestream.jpeg\" alt=\"MovieStream Logo\" /></p>\n"
"data": "<p><img src=\"https://oracle-livelabs.github.io/adb/movie-stream-story-lite/introduction/images/moviestream.jpeg\" alt=\"MovieStream Logo\" /></p>\n"
}
]
}
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
67 changes: 35 additions & 32 deletions shared/data-catalog/dcat-adb-integrate/query-data/query-data.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,56 +34,60 @@ You can import, create, and work with notebooks in Oracle Machine Learning Noteb
</if>

<if type="freetier">
5. On the **Autonomous Database Details** page, click the **Database Actions** button. A **Launch DB Actions** message box is displayed.
![The Service Console button is highlighted.](./images/database-actions-new.png " ")
5. On the **Autonomous Database Details** page, click the **Database actions** drop-down list, and then select **View all database actions**.

![The Service Console button is highlighted.](./images/view-all-db-actions.png " ")
</if>

<if type="livelabs">
5. On the **Autonomous Database Details** page, click the **Database Actions** button. A **Launch DB Actions** message box is displayed.
5. On the **Autonomous Database Details** page, click the **Database actions** drop-down list, and then select **View all database actions**.

![The Service Console button is highlighted.](./images/ll-db-actions-new.png " ")
![The Service Console button is highlighted.](./images/view-all-db-actions.png " ")
</if>

6. On the **Database Actions | Launchpad** Home page, in the **Development** section, click the **ORACLE MACHINE LEARNING** card.
6. On the **Database Actions | Launchpad** Home page, click the **Development** tab, and then click the **Oracle Machine Learning** tab.

![From the partial list of displayed cards, the Oracle Machine Learning card is highlighted.](./images/oml-card.png " ")
![From the partial list of displayed cards, the Oracle Machine Learning card is highlighted.](./images/oml-tab.png " ")

7. On the **SIGN IN** page, enter **`moviestream`** in the **Username** field, your password that you chose in **Lab 3 > Task 2** such as **`Training4ADB`** in the **Password** field, and then click **Sign In**.

>**Note:** You specified the password for the `moviestream` user that was created when you ran the PL/SQL script in **Lab 3**, **Task 2: Initialize the Lab**.
![On the Oracle Cloud Infrastructure Sign In page, the database name is blurred. The username (moviestream) and password fields are populated. The Sign In button is highlighted.](./images/login-moviestream.png " ")
![Enter your credentials on the Sign In page.](./images/login-moviestream.png " ")

The **Oracle Machine Learning** Home page is displayed.

![The MOVIESTREAM username is displayed and highlighted in the Oracle ML banner. The How Do I section contains several clickable help topics. The Quick Actions section is highlighted and it contains several clickable icons including the highlighted Notebooks icon.](./images/oml-home.png " ")


## Task 2: Import a Notebook

You can import a notebook from a local disk or from a remote location if you provide the URL. In this task, you will first download an OML notebook to your local machine, and then import this notebook into OML.

1. Click the following link to download the [workshop-data-lake-accelerator.json](files/workshop-data-lake-accelerator.json?download=1) OML Notebook.
1. Click the following link to download the [workshop-data-lake-accelerator.dsnb](files/workshop-data-lake-accelerator.dsnb?download=1) OML Notebook.

2. On the **Oracle Machine Learning** Home page, in the **Quick Actions** section, click the **Notebooks** button. The **Notebooks** page is displayed.
2. On the **Oracle Machine Learning** Home page, in the **Quick Actions** section, click the **Notebooks** icon. The **OML Notebooks EA (Early Adopter)** page is displayed.

![On the Notebooks page, the Import button is highlighted.](./images/notebooks-page.png " ")

3. Click **Import**. The **Open** dialog box is displayed.

4. Navigate to your local folder where you downloaded the OML notebook, and select the **`workshop-notebook-data-lake-accelerator.json`** notebook file. The file is displayed in the **File name** field. Make sure that the **Custom Files (*.json;\*.ipynb)** type is selected in the second drop-down field, and then click **Open**.


![On the Open dialog box in MS-Windows, the local Downloads folder is highlighted. The Filename field shows the selected .json notebook file in this folder. The Open button is highlighted.](./images/open-dialog.png " ")

If the import is successful, a notification is displayed at the top of the page and the **`Workshop Notebook - Data Lake Accelerator`** notebook is displayed in the list of available notebooks on **Notebooks** page.

![The 1 out of 1 notebooks imported successfully message is displayed. The newly imported notebook name link is displayed and highlighted on the page.](./images/notebook-imported.png " ")

5. Open the imported notebook. Click the **Workshop - Data Lake Accelerator** notebook link. The notebook is displayed in the Notebook **Editor**.
5. Open the imported notebook. Click the **Workshop - Data Lake Accelerator** notebook link.

![The notebook and the paragraphs it contains is displayed in the Notebook Editor.](./images/notebook-displayed.png " ")
6. The **User Action Required** dialog box is displayed. Click **Allow Run**.

![The User Action Required dialog box is displayed.](./images/allow-run.png " ")

The notebook is displayed in the Notebook **Editor**.

![The notebook and the paragraphs it contains is displayed in the Notebook Editor.](./images/notebook-displayed.png " ")

## Task 3: Set the Interpreter Bindings for the Imported Notebook

Expand All @@ -106,7 +110,7 @@ An interpreter is a plug-in that allows you to use a specific data processing la

In this task, you'll review the UI and some of the basic functionality of OML Notebooks. See [Explore Apache Zeppelin UI](https://zeppelin.apache.org/docs/0.10.0/quickstart/explore_ui.html).

>**Note:** If you are already familiar with OML or Zeppelin Notebooks, you may skip this task.
>**Note:** If you are already familiar with OML or Zeppelin Notebooks, you may skip this task.
Oracle Machine Learning Notebooks is a web-based interface for data analysis, data discovery, and data visualization. A notebook is made up of one or more paragraphs. A paragraph is a notebook component where you can write SQL statements, run PL/SQL scripts, and run Python commands. A paragraph has an **code** (input) section and an **output** (result) section. In the input section, specify the interpreter to run along with the text and/or code. This information is sent to the interpreter to be run. In the output section, the results of the interpreter are displayed.
When you create a new notebook, it opens automatically and it contains a single paragraph using the default **`%sql`** interpreter. You can change the interpreter by explicitly specifying other interpreters such as **`%script`**, **`%python`**, or **`%md`** (Markdown).
Expand Down Expand Up @@ -209,47 +213,47 @@ You can use this drop-down list to do the following:

![The Show/hide the code on the notebook toolbar is shown as clicked.](./images/show-code.png " ")

The code section of each paragraph is displayed. For example, paragraphs 1, 2, and 3 in the notebook use the **`%md`** (Markdown) interpreter while paragraphs 4 and 5 use the **`%sql`** interpreter.
The code section of each paragraph is displayed. For example, paragraphs 1, 2, and 5 in the notebook use the **`%md`** (Markdown) interpreter while paragraphs 3 and 4 use the **`%sql`** interpreter.

![The first five paragraphs in the notebook are shown with a numbered callout next to each one (1 to 5). The interpreter type at the beginning of each paragraph is highlighted.](./images/code-displayed.png " ")
![The first five paragraphs in the notebook are shown with a numbered callout next to each one](./images/code-displayed.png " ")

In this notebook, the **`%md`** (Markdown) paragraphs provide useful information about the paragraphs. The **`%md`** Markdown interpreter generates static html from plain Markdown text. In this lab, you will review the code in each paragraph one at a time, run that paragraph, and review the results as desired.

>**Note:** To hide the code sections of all paragraphs, click the **Show/hide the code** toggle icon again. Keep the code sections displayed in this lab.
![The Show/hide the output icon on the notebook toolbar is highlighted.](./images/hide-code.png " ")

2. Display the result (output) sections of all paragraphs in the notebook. On the notebook toolbar, click the **Show/hide the output** icon to show the output sections of the paragraphs where the output section is not shown by default. By default, the Markdown paragraphs had their output sections displayed; therefore, click the **Show/hide the output** icon again to show the output sections of all paragraphs including the Markdown paragraphs.

![The Show/hide the output icon on the notebook toolbar is shown as clicked.](./images/show-output.png " ")

The output section of each paragraph is displayed.

![The code and output sections for the first four paragraphs are shown. The output sections of each paragraph are highlighted and labeled as Output sections. The code section of the Top Sales by City paragraph is highlighted and labeled as Code section.](./images/output-displayed.png " ")

3. Hide the code sections for the first three **`%md`** paragraphs. Click **Hide editor** in each paragraph.
3. Hide the code sections for the first three **`%md`** paragraphs. Click the **Visibility** (eye) icon in each paragraph's toolbar. From the Visibility list, uncheck the **Code** checkbox.

![The Hide editor icon of the first paragraph is shown as clicked.](./images/hide-editor.png " ")
![The Hide editor icon of the first paragraph is shown as clicked.](./images/hide-code-paragraph.png " ")

The code sections are hidden. It is a good practice to hide the code section of a **`%md`** paragraph since you are only interested in looking at the formatted output.

![The code sections of the first three Markdown paragraphs are hidden.](./images/editor-hidden.png " ")

4. Run the **Top Sales by City** paragraph. Click **Run this paragraph**.
4. Run the **Top Sales by City** paragraph. Click the **Run Paragraph** icon.

![The Run this paragraph icon of the Top Sales by City %sql paragraph is highlighted.](./images/run-top-sales.png " ")

The status of the paragraph goes from `READY` to `PENDING` to `RUNNING` to `FINISHED`. The output is displayed in the result section of the paragraph using the **Area Chart** graph format. You can change the output display format to **Table**, **Bar Chart**, **Pie Chart**, **Line Chart**, **Scatter Chart** formats. You can also use the **Download Data** command icon to download the output using **CSV** and **TSV** formats. Finally, you can use the **settings** link to change the layout of the displayed output.
The status of the paragraph goes from `READY` to `PENDING` to `RUNNING` to `FINISHED`. The output is displayed in the result section of the paragraph using the **Table** format. You can change the output display format to **Area Chart**, **Bar Chart**, **Pie Chart**, **Line Chart**, **Scatter Chart** formats. You can also use the **Download Data** command icon to download the output using **CSV** and **TSV** formats. Finally, you can use the **settings** link to change the layout of the displayed output.

![The output is displayed in the result section of the paragraph using the **Area Chart** graph format. The output toolbar that enables you to select a different output format is highlighted.](./images/top-sales-output.png " ")

>**Note:** If the status of one or more paragraphs shows **ERROR**, reset your notebook connection as follows: Click the **Navigation** menu on the Notebook banner, and then select **Notebook Sessions**. On the **Notebook Sessions** page, select your notebook, and then click **Stop**. Next, re-run the notebook.
5. Click **Bar Chart** on the toolbar to change the output display format.

![The Bar Chart icon is shown as clicked and the bar chart output is displayed.](./images/top-sales-bar-chart.png " ")

6. Examine, run, and review the output of the remaining paragraphs, as desired. To run the entire notebook, click the **Run all paragraphs** icon on the notebook toolbar. A **Run all** confirmation message box is displayed. Click **OK**.
6. Examine, run, and review the output of the remaining paragraphs, as desired. To run the entire notebook, click the **Run Paragraphs** icon on the notebook toolbar. A **Run all paragraphs** confirmation message box is displayed. Click **Confirm**.

![The code and result sections of all paragraphs are displayed.](./images/run-notebook.png " ")
![Click run notebook.](./images/run-notebook.png " ")

The result of each paragraph in the notebook is displayed.

![The code and result sections of all paragraphs are displayed.](./images/output-all-displayed.png " ")

<if type="freetier">
You may now proceed to the next lab.
Expand All @@ -267,15 +271,14 @@ You can use this drop-down list to do the following:
* [Oracle Cloud Infrastructure Documentation](https://docs.cloud.oracle.com/en-us/iaas/Content/GSG/Concepts/baremetalintro.htm)
* [Using Oracle Autonomous Database Serverless](https://docs.oracle.com/en/cloud/paas/autonomous-database/adbsa/index.html)


## Acknowledgements

* **Author:** Lauran Serhal, Consulting User Assistance Developer, Oracle Autonomous Database and Big Data
* **Author:** Lauran K. Serhal, Consulting User Assistance Developer
* **Contributor:** Marty Gubar, Product Manager, Server Technologies
* **Last Updated By/Date:** Lauran Serhal, March 2023
* **Last Updated By/Date:** Lauran Serhal, May 2024

Data about movies in this workshop were sourced from Wikipedia.

Copyright (C) Oracle Corporation.
Copyright (C) 2024, Oracle Corporation.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled [GNU Free Documentation License](https://oracle-livelabs.github.io/adb/shared/adb-15-minutes/introduction/files/gnu-free-documentation-license.txt)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 7d48989

Please sign in to comment.