Sadhbh a/gcp guide - WIP #25708

sadhbh-a · 2024-10-11T14:21:28Z

What does this PR do? What is the motivation?

Merge instructions

Please merge after reviewing

Additional notes

github-actions · 2024-10-11T14:24:09Z

Preview links (active after the `build_preview` check completes)

New or renamed files

https://docs-staging.datadoghq.com/sadhbh-a/gcp_guide/getting_started/integrations/google_cloud

content/en/getting_started/integrations/google_cloud.md

Co-authored-by: Ursula Chen <[email protected]>

… into sadhbh-a/gcp_guide

dtru-ddog

Did a first pass with a few comments, let me know if you want to review

dtru-ddog · 2024-10-18T14:19:12Z

static/images/integrations/google_cloud_platform/gcp_resource_collection.png

This image is going to change relatively soon with the Resource Change input modification cc @sriramkraman

content/en/getting_started/integrations/google_cloud.md

Co-authored-by: Dan T <[email protected]>

sriramkraman · 2024-10-23T14:49:04Z

content/en/getting_started/integrations/google_cloud.md

+- If your organization restricts identities by domain, you must add Datadog's customer identity `C0147pk0i` as an allowed value in your policy.
+{{% /site-region %}}
+
+- Ensure that any projects being monitored are **not** configured as [scoping projects][42] that pull in metrics from multiple other projects.


I would like to say to customers we don't support scoping projects as we are rolling out this change. How do we change this framing so it doesn't sound like they (customers) have to take some action to confirm (which is the current status quo) to the future model of scoping projects simply aren't supported. (i.e that we will only pull metrics from the project itself and not any metric scopes)

cc @dtru-ddog

Would something like this work?

Datadog does not support scoping projects that pull in metrics from multiple other projects. Only metrics from the project itself will be ingested

sriramkraman · 2024-10-23T14:49:29Z

content/en/getting_started/integrations/google_cloud.md

+[Google Cloud Billing API][12] 
+: Enables accurate billing for API calls.


@dtru-ddog what do we use this for?

We need to have a customer to enable that so that Google can bill the customer for the API calls we'll be making

sriramkraman · 2024-10-23T14:57:06Z

content/en/getting_started/integrations/google_cloud.md

+
+## Setup 
+
+Integrate Datadog with [Google Cloud][4] using [service account impersonation][5] and project discovery. This enables Datadog to automatically discover and monitor new projects as they are created within the assigned scope, providing seamless monitoring as your Google Cloud environment grows.


I like the organization here but it's essentially a copy of the setup instructions in Google Cloud setup page. That's not useful as an opinionated Getting Started guide. Consider instead telling customers how they can give Datadog broad access to their entire Google Cloud environment.

Updated in e66f3b8, but I don't have a sandbox organization to confirm the steps. Is there one available for testing?

content/en/getting_started/integrations/google_cloud.md

sriramkraman · 2024-10-23T17:46:22Z

content/en/getting_started/integrations/google_cloud.md

+
+## Metric collection
+
+The Google Cloud integration collects [**all GA Google Cloud metrics**][17] from your projects through the Google Cloud Monitoring API.


it turns out we do collect all Beta metrics that are available. Do we still want to say we collect "GA" metrics?

How does "The Google Cloud integration collects all available Google Cloud metrics from your projects through the Google Cloud Monitoring API." sound to you?

sriramkraman · 2024-10-23T17:56:13Z

content/en/getting_started/integrations/google_cloud.md

+The [Integrations page][26] provides a full listing of the available sub-integrations for Google Cloud. 
+Many of these integrations are installed by default when Datadog recognizes data being ingested in from your Google Cloud account.
+


Please don't call them "sub-" integrations. They are integrations for Google Cloud services. I would recommend saying we have 35+ integrations for Google Cloud services including BigQuery, ... (and link to blogs)

Updated in e66f3b8, thanks in advance for any additional feedback

sriramkraman · 2024-10-23T17:57:48Z

content/en/getting_started/integrations/google_cloud.md

+Forward logs from your Google Cloud services to Datadog using [Google Cloud Dataflow][21] and the [Datadog template][22]. This method provides both compression and batching of events before they are forwarded to Datadog. 
+


Start each section with a brief "why". Let me know if I can help point to feature blogs that speak to the value proposition.

https://www.datadoghq.com/blog/stream-logs-datadog-dataflow-template/

A link to the blog would be helpful @sriramkraman

Updated in e66f3b8, thanks in advance for any additional feedback

content/en/getting_started/integrations/google_cloud.md

dtru-ddog · 2024-11-20T21:37:56Z

static/images/integrations/google_cloud_platform/gcp_resource_collection.png

We'll be changing this later this week, may want an updated snapshot

dtru-ddog

Second pass of feedback

content/en/getting_started/integrations/google_cloud.md

dtru-ddog · 2024-11-20T21:40:14Z

content/en/getting_started/integrations/google_cloud.md

+2) Set up a [Service Account][2] in any of your Google Cloud projects
+3) Review these Google Cloud Prerequisites:
+
+{{% site-region region="us,us3,us5,eu,ap1" %}}


dtru-ddog · 2024-11-20T21:41:36Z

content/en/getting_started/integrations/google_cloud.md

+
+## Setup 
+
+For simplicity of setup, and to ensure there are no gaps in your monitoring, integrate Datadog with [Google Cloud][4] using [service account impersonation][5] at the organization or folder level. 


nit: sentence seems a bit wordy

Updated in 0493d54

dtru-ddog · 2024-11-20T21:43:38Z

content/en/getting_started/integrations/google_cloud.md

+
+The Google Cloud integration collects all available [Google Cloud metrics][17] from your projects through the Google Cloud Monitoring API.
+
+{{% collapse-content title="Click here for a sample of the Google Cloud metrics Datadog collects" level="h5" %}}


Is there a way to have this table be centralized since we have the same content on the README md and I can see opportunities for this to get out of sync

Good idea, added a shortcode in bb8b1cf that we can use to render this table on multiple pages

dtru-ddog · 2024-11-20T21:44:40Z

content/en/getting_started/integrations/google_cloud.md

+
+### Limit metric collection filters
+
+Limit the GCE/GKE instances and Cloud Run revisions that are pulled into Datadog by entering tags in the **Limit Metric Collection Filters** text boxes under the **General** tab of the Google Cloud Integration tile.


@sriramkraman per our recent Metric Collection configuration convo we may want to update this, also this has been moved to the Metric Collection tab

Co-authored-by: Dan T <[email protected]>

sriramkraman · 2024-12-06T19:39:37Z

content/en/getting_started/integrations/google_cloud.md

+3) Review these Google Cloud Prerequisites:
+
+{{% site-region region="us,us3,us5,eu,ap1" %}}
+- If your organization restricts identities by domain, you must add Datadog's customer identity `C0147pk0i` as an allowed value in your policy.


nit: can we update these dashes to be bullets?

sriramkraman · 2024-12-06T19:40:02Z

content/en/getting_started/integrations/google_cloud.md

+{{% site-region region="us,us3,us5,eu,ap1" %}}
+- If your organization restricts identities by domain, you must add Datadog's customer identity `C0147pk0i` as an allowed value in your policy.
+{{% /site-region %}}
+- Datadog does not support [scoping projects][42] that pull in metrics from multiple other projects.


This is not a "prerequisite". We should instead note it as a warning.

sriramkraman · 2024-12-06T19:43:04Z

content/en/getting_started/integrations/google_cloud.md

+
+For the most comprehensive level of monitoring in your Google Cloud environment, integrate Datadog with [Google Cloud][4] using [service account impersonation][5] at the organization or folder level.
+
+After reviewing the above [Prerequisites][3], follow these step-by-step instructions to set up the Google Cloud integration:


why do we need this?

sriramkraman · 2024-12-06T19:43:47Z

content/en/getting_started/integrations/google_cloud.md

+- Compute Viewer
+- Monitoring Viewer
+- Cloud Asset Viewer
+- Browser


Yes true but why?

sriramkraman · 2024-12-06T19:44:16Z

content/en/getting_started/integrations/google_cloud.md

+**Note**: The `Browser` role is only required in the default project of the service account. Other projects require only the other listed roles.
+{{% /collapse-content %}}


What is "default" project here? (Would a customer know?)

sadhbh-a added 3 commits October 7, 2024 16:16

Work in progress for GCP Guide

41ba832

Take 2 of GCP Guide attempt.1

55fb9b4

Images & Nav for GCP file

355ae00

sadhbh-a added the WORK IN PROGRESS No review needed, it's a wip ;) label Oct 11, 2024

sadhbh-a requested review from a team as code owners October 11, 2024 14:21

github-actions bot added Architecture Everything related to the Doc backend Images Images are added/removed with this PR labels Oct 11, 2024

added changes to installation

a0f5e99

urseberry reviewed Oct 15, 2024

View reviewed changes

sadhbh-a and others added 19 commits October 15, 2024 12:37

Update content/en/getting_started/integrations/google_cloud.md

1c3d0d0

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

de056a8

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

2cbb9c5

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

c8f7a02

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

629114b

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

ee26945

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

af6289a

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

77e034a

Co-authored-by: Ursula Chen <[email protected]>

Removing tabs

933cdd2

Update google_cloud.md

81251d2

Update google_cloud.md

e9d0f9a

Update logs.md

acefd72

Update content/en/getting_started/integrations/google_cloud.md

8008daf

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

636218a

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

8e641ce

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

c2d15d3

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

4465941

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

81f326a

Co-authored-by: Ursula Chen <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

c0e8656

Co-authored-by: Ursula Chen <[email protected]>

sadhbh-a and others added 3 commits October 16, 2024 16:08

Merge branch 'sadhbh-a/gcp_guide' of github.com:DataDog/documentation…

5ba16f9

… into sadhbh-a/gcp_guide

Adding further reading section

7f50f03

Removing Billing link

55c629d

dtru-ddog requested review from sriramkraman and dtru-ddog October 18, 2024 14:17

dtru-ddog reviewed Oct 18, 2024

View reviewed changes

sadhbh-a and others added 6 commits October 21, 2024 13:41

Update content/en/getting_started/integrations/google_cloud.md

b4edf4c

Co-authored-by: Dan T <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

b51495c

Co-authored-by: Dan T <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

8acefd2

Co-authored-by: Dan T <[email protected]>

Update content/en/getting_started/integrations/google_cloud.md

50d2b1e

Co-authored-by: Dan T <[email protected]>

Update google_cloud.md

80a5c50

Adding region condition & removing 'z' typo

fb696c9

sriramkraman reviewed Oct 23, 2024

View reviewed changes

sriramkraman requested changes Oct 23, 2024

View reviewed changes

buraizu added 2 commits November 11, 2024 15:39

(DOCS-8956) Incorporate feedback

e66f3b8

(DOCS-8956) Move step

99cb3f0

buraizu requested review from sriramkraman and dtru-ddog November 12, 2024 00:00

(DOCS-8956) Remove duplicated image

ef7e4b7

dtru-ddog reviewed Nov 20, 2024

View reviewed changes

dtru-ddog requested changes Nov 20, 2024

View reviewed changes

buraizu and others added 4 commits November 20, 2024 17:38

(DOCS-8956) Add Google Cloud integrations shortcode

bb8b1cf

(DOCS-8956) Add integrations shortcode

6e10828

(DOCS-8956) Reword sentence

0493d54

Update content/en/getting_started/integrations/google_cloud.md

795aca7

Co-authored-by: Dan T <[email protected]>

buraizu requested a review from dtru-ddog November 21, 2024 17:02

(DOCS-8956) Update step order

dfab8bd

sriramkraman reviewed Dec 6, 2024

View reviewed changes

Merge branch 'master' into sadhbh-a/gcp_guide

d806f2d

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sadhbh a/gcp guide - WIP #25708

Sadhbh a/gcp guide - WIP #25708

sadhbh-a commented Oct 11, 2024

github-actions bot commented Oct 11, 2024 •

edited

Loading

dtru-ddog left a comment

dtru-ddog Oct 18, 2024

sriramkraman Oct 23, 2024

sadhbh-a Oct 24, 2024

sriramkraman Oct 23, 2024

dtru-ddog Nov 20, 2024

sriramkraman Oct 23, 2024

buraizu Nov 11, 2024

sriramkraman Oct 23, 2024

sadhbh-a Oct 24, 2024

sriramkraman Oct 23, 2024

buraizu Nov 11, 2024

sriramkraman Oct 23, 2024

Scott-Mabe Oct 25, 2024

buraizu Nov 11, 2024

dtru-ddog Nov 20, 2024

dtru-ddog left a comment

dtru-ddog Nov 20, 2024

dtru-ddog Nov 20, 2024

buraizu Nov 21, 2024

dtru-ddog Nov 20, 2024

buraizu Nov 21, 2024

dtru-ddog Nov 20, 2024

sriramkraman Dec 6, 2024

sriramkraman Dec 6, 2024

sriramkraman Dec 6, 2024

sriramkraman Dec 6, 2024

sriramkraman Dec 6, 2024

		[Google Cloud Billing API][12]
		: Enables accurate billing for API calls.


		## Setup

		Integrate Datadog with [Google Cloud][4] using [service account impersonation][5] and project discovery. This enables Datadog to automatically discover and monitor new projects as they are created within the assigned scope, providing seamless monitoring as your Google Cloud environment grows.


		## Metric collection

		The Google Cloud integration collects [all GA Google Cloud metrics][17] from your projects through the Google Cloud Monitoring API.

		The [Integrations page][26] provides a full listing of the available sub-integrations for Google Cloud.
		Many of these integrations are installed by default when Datadog recognizes data being ingested in from your Google Cloud account.

		Forward logs from your Google Cloud services to Datadog using [Google Cloud Dataflow][21] and the [Datadog template][22]. This method provides both compression and batching of events before they are forwarded to Datadog.


		## Setup

		For simplicity of setup, and to ensure there are no gaps in your monitoring, integrate Datadog with [Google Cloud][4] using [service account impersonation][5] at the organization or folder level.


		The Google Cloud integration collects all available [Google Cloud metrics][17] from your projects through the Google Cloud Monitoring API.

		{{% collapse-content title="Click here for a sample of the Google Cloud metrics Datadog collects" level="h5" %}}


		### Limit metric collection filters

		Limit the GCE/GKE instances and Cloud Run revisions that are pulled into Datadog by entering tags in the Limit Metric Collection Filters text boxes under the General tab of the Google Cloud Integration tile.


		For the most comprehensive level of monitoring in your Google Cloud environment, integrate Datadog with [Google Cloud][4] using [service account impersonation][5] at the organization or folder level.

		After reviewing the above [Prerequisites][3], follow these step-by-step instructions to set up the Google Cloud integration:

		Note: The `Browser` role is only required in the default project of the service account. Other projects require only the other listed roles.
		{{% /collapse-content %}}

Sadhbh a/gcp guide - WIP #25708

Are you sure you want to change the base?

Sadhbh a/gcp guide - WIP #25708

Conversation

sadhbh-a commented Oct 11, 2024

What does this PR do? What is the motivation?

Merge instructions

Additional notes

github-actions bot commented Oct 11, 2024 • edited Loading

Preview links (active after the build_preview check completes)

New or renamed files

dtru-ddog left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

dtru-ddog left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

github-actions bot commented Oct 11, 2024 •

edited

Loading

Preview links (active after the `build_preview` check completes)