Skip to content

Issues: GoogleCloudDataproc/spark-bigquery-connector

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

29 Open 515 Closed
29 Open 515 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

DAY partitioned BQ table data deleted fully even though 'spark.sql.sources.partitionOverwriteMode' is DYNAMIC waiting for information Waiting for additional information from the issue opener
#1325 opened Dec 13, 2024 by soumikdas-oa
@isha97
4
Intermittent error when creating tables: NOT_FOUND: Requested entity was not found
#1324 opened Dec 11, 2024 by MasterDDT
2
Spark String -> BigQuery Datetime field fails to load with Indirect load method
#1323 opened Dec 10, 2024 by jster1357
@isha97
2
"spark.sql.sources.partitionOverwriteMode": "DYNAMIC" - creates additional tables
#1314 opened Nov 15, 2024 by MichalBogoryja
Destination table's schema is not compatible with dataframe's schema. Incompatible max length for field: FIELD_NAME, cannot write source field with max length: null to destination field with max length: 8
#1312 opened Oct 28, 2024 by kumarshekhar
1
GCP Identity federation auth failure with AWS
#1306 opened Oct 16, 2024 by sytianhe
2
Support for spark version 3.5.0 - support required for UNTYPED_SCALA_UDF version
#1297 opened Sep 24, 2024 by VIKCT001
@davidrabinowitz
2
org.apache.spark.sql.AnalysisException: [UNSUPPORTED_DESERIALIZER.DATA_TYPE_MISMATCH] The deserializer is not supported: need a(n) "ARRAY" field but got "MAP<STRING, STRING>".
#1295 opened Sep 20, 2024 by VIKCT001
@isha97
6
BigQuery RANGE (and INTERVAL) support enhancement New feature or request
#1292 opened Sep 12, 2024 by 0rnella
1
Issue with BigQuery counts in Spark after writing to table
#1290 opened Sep 5, 2024 by rchynoweth
@vishalkarve15
5
bigquery.tables.create Permission required on appending data to a BigQuery Table
#1277 opened Aug 6, 2024 by smic-datalabs-jdcastro
@vishalkarve15
4
cloud cost when using spark bq connector
#1274 opened Aug 2, 2024 by kaiseu
@isha97
Empty array filtering issue
#1268 opened Jul 23, 2024 by vokuk-walkme
@vishalkarve15
1
Configuring DataProc Cluster to Publish BigQuery Metrics on GCP enhancement New feature or request
#1233 opened May 24, 2024 by gmiano
1
Add createTable(TableInfo) method to BigQueryClient enhancement New feature or request
#1213 opened Apr 15, 2024 by jphalip
java.lang.NoSuchMethodError: 'org.apache.spark.sql.catalyst.encoders.ExpressionEncoder org.apache.spark.sql.catalyst.encoders.RowEncoder.apply(org.apache.spark.sql.types.StructType)' enhancement New feature or request
#1209 opened Apr 9, 2024 by CatalinMihaiIonescu
6
BigQuery Pushdown filtering on Spark 3.4.2 enhancement New feature or request
#1207 opened Apr 3, 2024 by sid-habu
11
Automatically read JSON types enhancement New feature or request
#1203 opened Mar 25, 2024 by Guilherme-B
Idempotent write support in BQ enhancement New feature or request
#1199 opened Mar 14, 2024 by SubhamSinghal
Table expiration with write() operation enhancement New feature or request
#1189 opened Feb 23, 2024 by mikeperello-scopely
2
Clarification on Billing and Improved README.md Explanation
#1172 opened Jan 17, 2024 by LakshmanKishore
1
Support spark 3.5 enhancement New feature or request
#1142 opened Dec 11, 2023 by melin
2
BigQuery Write API cannot use BigQuery CDC feature enhancement New feature or request
#1086 opened Oct 11, 2023 by jster1357
HTTP PROXY Support NTCredentials blocked Waiting for another issue to be fixed
#1071 opened Sep 27, 2023 by dfercode
3
Spark observable metrics not working when writing to BigQuery tables enhancement New feature or request
#1040 opened Aug 9, 2023 by ylashin
3
ProTip! Find all open issues with in progress development work with linked:pr.