Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cloud cost when using spark bq connector #1274

Open
kaiseu opened this issue Aug 2, 2024 · 0 comments
Open

cloud cost when using spark bq connector #1274

kaiseu opened this issue Aug 2, 2024 · 0 comments
Assignees

Comments

@kaiseu
Copy link

kaiseu commented Aug 2, 2024

Hi team,

we're running the dataproc job by using the spark-bigquery-connector to interact with bigquery and gcs, while the cloud cost seems a black box to us, do you know how the cost was calculated when using this lib to interact with dataproc/bigquery/gcs? any benchmark results on the cost compared with directly using bigquery sql? and is there any optimization suggestions? thanks

@isha97 isha97 self-assigned this Aug 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants