Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: guide to set up custom logging in Dagster #24102

Merged
merged 1 commit into from
Sep 4, 2024

Conversation

mlarose
Copy link
Contributor

@mlarose mlarose commented Aug 30, 2024

Summary & Motivation

Provide an updated guide in how to customize logging of jobs in Dagster.

How I Tested These Changes

  • Manual testing in Dagster+ dogfood + dagster dev locally
  • BK

Changelog [New | Bug | Docs]

NOCHANGELOG

Copy link
Contributor Author

mlarose commented Aug 30, 2024

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @mlarose and the rest of your teammates on Graphite Graphite

@mlarose mlarose force-pushed the mlarose/doc-351-write-setting-up-custom-logging branch from 994c82f to ddac10e Compare August 30, 2024 15:25
Copy link

github-actions bot commented Aug 30, 2024

Deploy preview for dagster-docs-beta ready!

Preview available at https://dagster-docs-beta-gcne3vg83-elementl.vercel.app

Direct link to changed pages:

@mlarose mlarose marked this pull request as ready for review August 30, 2024 15:40
@graphite-app graphite-app bot requested a review from cmpadden August 30, 2024 15:41
@graphite-app graphite-app bot added docathon area: docs Related to documentation in general labels Aug 30, 2024
@graphite-app graphite-app bot requested review from PedramNavid and removed request for cmpadden August 30, 2024 15:41
Copy link

graphite-app bot commented Aug 30, 2024

Graphite Automations

"docs-beta - Assign Reviewers" took an action on this PR • (08/30/24)

1 label was added and 2 reviewers were added to this PR based on Pedram Navid's automation.

Copy link
Contributor

@cmpadden cmpadden left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is super handy, @mlarose.

My primary question is around if this also applies to custom log solutions like Datadog and Sentry, see comments. Thanks!

Copy link
Contributor

@OwenKephart OwenKephart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall this looks good! I agree with @cmpadden 's sense that we should get rid of the "with_default_logger" thing, and just had some minor other comments

@mlarose mlarose force-pushed the mlarose/doc-351-write-setting-up-custom-logging branch 4 times, most recently from b3577aa to 10e1104 Compare September 4, 2024 13:36
@mlarose
Copy link
Contributor Author

mlarose commented Sep 4, 2024

This is super handy, @mlarose.

My primary question is around if this also applies to custom log solutions like Datadog and Sentry, see comments. Thanks!

I thought I had answered this but I don't see the comment, so risking sounding like a broken record, this only applies to how logs are formatted to either stdout or stderr. Log collectors that obtain logs from the stdout would see the change, but to my best knowledge, sentry is something that needs to be instrumented within the app and would require a different treatment.

@mlarose
Copy link
Contributor Author

mlarose commented Sep 4, 2024

@cmpadden @OwenKephart - thanks for your comments. I believe I have addressed everything.

@mlarose mlarose force-pushed the mlarose/doc-351-write-setting-up-custom-logging branch from 10e1104 to 5eb5d49 Compare September 4, 2024 13:40
Copy link
Contributor

@cmpadden cmpadden left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work. Thanks, @mlarose !

@cmpadden cmpadden merged commit 859f7b2 into master Sep 4, 2024
3 checks passed
@cmpadden cmpadden deleted the mlarose/doc-351-write-setting-up-custom-logging branch September 4, 2024 14:34
izzye84 pushed a commit that referenced this pull request Sep 4, 2024
## Summary & Motivation

Provide an updated guide in how to customize logging of jobs in Dagster.

## How I Tested These Changes

- Manual testing in Dagster+ dogfood + dagster dev locally
- BK


## Changelog [New | Bug | Docs]

NOCHANGELOG
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: docs Related to documentation in general docathon
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants