- Support exactly-once consistency in BigQuery sink. This is integrated with Datastream and Table/SQL API.
- Add Flink metrics for monitoring BigQuery sink.
- Package unshaded guava dependency for enforcing the correct version used by BigQuery client.
- Support BigQuery sink in Flink's Table API.
- BigQuery sink's maximum parallelism is increased from 100 to 128, beyond which the application will fail.
- Modifies the following config keys for connector source in Table API:
| Before | After |
|---|---|
read.discoveryinterval |
read.discovery-interval |
credentials.accesstoken |
credentials.access-token |
read.streams.maxcount |
read.streams.max-count |
- Release BigQuery sink with at-least-once support.
- Avro's GenericRecord to BigQuery proto is the only out-of-the-box serializer offered for now.
- BigQuery sink's maximum parallelism is capped at 100, beyond which the application with fail.
- Initial release with BQ source support