Skip to content

Latest commit

 

History

History
466 lines (389 loc) · 32.9 KB

CHANGELOG.md

File metadata and controls

466 lines (389 loc) · 32.9 KB
Raw

Pulsar-client-go Changelog

All notable changes to this project will be documented in this file.

[0.9.0] 2022-07-07

Feature

  • Add TableView support, see PR-743
  • Support ack response for Go SDK, see PR-776
  • Add basic authentication, see PR-778
  • Support multiple schema version for producer and consumer, see PR-611
  • Add schema support to Reader, see PR-741

Improve

  • Add consumer seek by time on partitioned topic, see PR-782
  • Fix using closed connection in consumer, see PR-785
  • Add go 1.18 to the test matrix, see PR-790
  • Schema creation and validation functions without panic, see PR-794
  • Fix ack request not set requestId when enable AckWithResponse option, see PR-780
  • Fix nil pointer dereference in TopicNameWithoutPartitionPart, see PR-734
  • Add error response for Ack func, see PR-775
  • Fix sequenceID is not equal to cause the connection to be closed incorrectly, see PR-774
  • Add consumer state check when request commands, see PR-772
  • Fix panic caused by flushing current batch with an incorrect internal function, see PR-750
  • Fix deadlock in Producer Send when message fails to encode, see PR-762
  • Add -c/--max-connections parameter to pulsar-perf-go and set it to 1 by default, see PR-765
  • Fix producer unable register when cnx closed, see PR-761
  • Fix annotation typo in consumer.go, see PR-758
  • Dlq producer on topic with schema, see PR-723
  • Add service not ready check, see PR-757
  • Fix ack timeout cause reconnect, see PR-756
  • Cleanup topics after unit tests, see PR-755
  • Allow config reader subscription name, see PR-754
  • Exposing broker metadata, see PR-745
  • Make go version consistent, see PR-751
  • Temporarily point ci to pulsar 2.8.2, see PR-747
  • Upgrade klauspost/compress to v1.14.4, see PR-740
  • Stop ticker when create producer failed, see PR-730

New Contributors

  • @NaraLuwan made their first contribution in apache#730
  • @shubham1172 made their first contribution in apache#735
  • @nicoloboschi made their first contribution in apache#738
  • @ZiyaoWei made their first contribution in apache#741
  • @nodece made their first contribution in apache#757
  • @lhotari made their first contribution in apache#765
  • @samuelhewitt made their first contribution in apache#762
  • @shileiyu made their first contribution in apache#750
  • @hantmac made their first contribution in apache#734
  • @liushengzhong0927 made their first contribution in apache#780
  • @oryx2 made their first contribution in apache#611

[0.8.1] 2022-03-08

What's Changed

  • Upgrade beefsack/go-rate by @shubham1172 in apache#735
  • Upgrade prometheus client to 1.11.1 by @nicoloboschi in apache#738

New Contributors

@shubham1172 made their first contribution in apache#735 @nicoloboschi made their first contribution in apache#738

[0.8.0] 2022-02-16

What's Changed

  • Update release docs with missing information by @cckellogg in apache#656
  • Update change log for 0.7.0 release by @cckellogg in apache#655
  • Update version to 0.7.0 by @cckellogg in apache#654
  • fix issue 650,different handle sequence value by @baomingyu in apache#651
  • Support nack backoff policy for SDK by @wolfstudy in apache#660
  • Remove unused dependency in oauth2 module by @reugn in apache#661
  • [Issue 662] Fix race in connection.go waitUntilReady() by @bschofield in apache#663
  • Update dependencies by @reugn in apache#665
  • [Issue 652] Quick fixes to the documentation for the main building blocks of the library by @reugn in apache#667
  • Add subscription properties for ConsumerOptions by @wolfstudy in apache#671
  • Add new bug-resistant build constraints by @reugn in apache#670
  • Handle the parameters parsing error in NewProvider by @reugn in apache#673
  • Update email template of release docs by @izumo27 in apache#674
  • Add properties filed for batch container by @wolfstudy in apache#683
  • [Issue 513] Correct apparent logic error in batchContainer's hasSpace() method by @bschofield in apache#678
  • Upgrade DataDog/zstd to v1.5.0 by @dferstay in apache#690
  • fix:add order key to message by @leizhiyuan in apache#688
  • Set default go version to 1.13 in CI related files by @reugn in apache#692
  • [Partition Consumer] Provide lock-free access to compression providers by @dferstay in apache#689
  • Use a separate gorutine to handle the logic of reconnect by @wolfstudy in apache#691
  • [DefaultRouter] add a parallel bench test by @dferstay in apache#693
  • Revert "Use a separate gorutine to handle the logic of reconnect" by @wolfstudy in apache#700
  • Fix data race while accessing connection in partitionProducer by @wolfstudy in apache#701
  • Fix stuck when reconnect broker by @wolfstudy in apache#703
  • Fix slice bounds out of range for readSingleMessage by @wolfstudy in apache#709
  • Encryption failure test case fix by @GPrabhudas in apache#708
  • [DefaultRouter] fix unnecessary system clock reads due to races accessing router state by @dferstay in apache#694
  • Fix negative WaitGroup counter issue by @wolfstudy in apache#712
  • [issue 675] oauth2 use golang-jwt address CVE-2020-26160 by @zzzming in apache#713
  • readme: add note about how to build and test by @pgier in apache#714
  • Bump oauth2 package version to the latest in master by @iorvd in apache#715
  • Fix closed connection leak by @billowqiu in apache#716
  • [Bugfix] producer runEventsLoop for reconnect early exit by @billowqiu in apache#721
  • [issue 679][oauth2] Fix macos compiler warnings by @pgier in apache#719
  • [optimize] Stop batchFlushTicker when Disable batching by @Shoothzj in apache#720
  • Markdown error fix by @Shoothzj in apache#722

New Contributors

  • @bschofield made their first contribution in apache#663
  • @izumo27 made their first contribution in apache#674
  • @pgier made their first contribution in apache#714
  • @iorvd made their first contribution in apache#715
  • @billowqiu made their first contribution in apache#716

[0.7.0] 2021-10-31

Feature

  • Encryption support for producer, see PR-560
  • Decrytion support for consumer, see PR-612
  • User-defined metric cardinality, see PR-604
  • Better support for Azure AD OAuth 2.0, see PR-630, PR-633, PR-634
  • Removed testing for go versions 1.11 and 1.12, see PR-632
  • Add epoch to create producer to prevent a duplicate producer when broker is not available., see [PR-582] (apache#582)

Improve

  • Fix batch size limit validation, see PR-528
  • Fix logic of command for sendError, see PR-622
  • Drain connection requests channel without closing, see PR-645
  • Fix ConsumersOpened counter not incremented when use multitopic or regexp consumer, see PR-619
  • Fix reconnection logic when topic is deleted, see PR-627
  • Fix panic when scale down partitions, see PR-601
  • Fix missing metrics for topics by registration of existing collector, see PR-600
  • Fix producer panic by oldProducers, see PR-598
  • Fail pending messages when topic is terminated, see PR-588
  • Fix handle send error panic, see PR-576

[0.6.0] 2021-07-21

Feature

  • Make PartitionsAutoDiscoveryInterval configurable, see PR-514.
  • Always check connection close channell, before attempting to put requests, see PR-521.
  • Add LedgerId,EntryId,BatchIdx,PartitionIdx func for MessageId interface, see PR-529.
  • Add DisableReplication to Producer Message, see PR-543.
  • Updating comments to conform to golang comment specification, see PR-532.
  • Producer respects Context passed to Send() and SendAsync() when applying backpressure, see PR-534.
  • Simplify connection close logic, see PR-559.
  • Add open tracing to pulsar go client, see PR-518.
  • Update proto file, see PR-562.
  • Add send error logic for connection, see PR-566.
  • Add license file for depend on libs, see PR-567.

Improve

  • Update jwt-go dependency to resolve vulnerabilities, see PR-524.
  • Fixed Athenz repository name, see PR-522.
  • Fix reader latest position, see PR-525.
  • Fix timeout guarantee for RequestOnCnx, see PR-492.
  • Fix nil pointer error with GetPartitionedTopicMetadata, see PR-536.
  • Release locks before calling producer consumer response callbacks, see PR-542.
  • Fix lookup service not implemented GetTopicsOfNamespace, see PR-541.
  • Regenerate the certs to work with Pulsar 2.8.0 and Java 11, see PR-548.
  • Fix race condition when resend pendingItems, see PR-551.
  • Fix data race while accessing connection in partitionConsumer, see PR-535.
  • Fix channel data race, see PR-558.
  • Fix write to closed channel panic() in internal/connection during connection close, see PR-539.
  • Fix possible race condition in connection pool, see PR-561.
  • Fix default connection timeout, see PR-563.
  • Add lock for compressionProviders to fix data race problem, see PR-533.
  • Fix send goroutine blocked, see PR-530.

[0.5.0] 2021-05-14

Feature

  • Add http lookup service support, see PR-510.
  • Support listener name for go the client, see PR-502.
  • Add multiple hosts support, see PR-484.
  • Improve error log for frame size too big and maxMessageSize, see PR-459.
  • Update jwt-go version to v4, see PR-481.

Improve

  • Fix range channel deadlock error, see PR-499.
  • Add sentAt when put item into pendingQueue, see PR-509.
  • Fix race condition/goroutine leak in partition discovery goroutine, see PR-474.
  • Close cnxPool when closing a Client, see PR-494.
  • Use newError to build return error, see PR-471.
  • Move GetPartitionedTopicMetadata to lookup service, see PR-478.
  • Fix wrong batch flush method bug, see PR-476.
  • Fix reader with start latest message id inclusive, see PR-467.
  • Fix unexpected nil pointer when reading item from keyring, see PR-470.
  • Reverted datadog to DataDog, see PR-465.

[0.4.0] 2021-02-09

Feature

  • Support send timeout in Producer side, see PR-394.
  • Add metric for internal publish latency, see PR-397.
  • Add key_based Batch logic, see PR-363.
  • Add error label to publish errors metric, see PR-405.
  • Add const client label to metrics, see PR-406.
  • Attach topic and custom labels to Prometheus metrics, see PR-410.
  • Add orderingKey apis, see PR-427.
  • Support jwt and trusted cert for pulsar perf client, see PR-427.

Improve

  • Fix bot action CI yaml file, see PR-395.
  • Update go-keyring to v1.1.6 to remove warnings on MacOS Catalina+ , see PR-404.
  • Read the clock fewer times during message routing, see PR-372.
  • Close dangling autoDiscovery goroutine in consumer, see PR-411.
  • Fix discard unacked messages, see PR-413.
  • Fixed logic to attempt reconnections to same broker, see PR-414.
  • Reduce the default TCP connection timeout from 30 to 5 seconds, see PR-415.
  • Removed unused import "C" statement, see PR-416.
  • Renamed Metrics.RpcRequestCount to RPCRequestCount to conform to style check, see PR-417.
  • Fix leaked nack tracker goroutine, see PR-418.
  • Clearing message queues after seek requests, see PR-419.
  • Fix retry policy not effective with partitioned topic, see PR-425.
  • Deduplicate user provided topics before using them, see PR-426.
  • The reader.HasNext() returns true on empty topic, see PR-441.
  • Upgrade gogo/protobuf to 1.3.2, see PR-446.
  • Fix logrusWrapper shrink interfaces slice into an interface, see PR-449.
  • Logging what really caused lookup failure, see PR-450.
  • Make state thread safe in consumer_partition and connection, see PR-451.
  • Fix KeyFileTypeServiceAccount not found compile error, see PR-455.
  • Fix unsubscribe blocked when consumer is closing or has closed, see PR-457.
  • The asynchronized send timeout checking without pending queue lock, see PR-460.

[0.3.0] 2020-11-11

Feature

  • Support retry letter topic in Go client, see PR-359.
  • Support limit the retry number of reconnectToBroker, see PR-360.
  • Support key shared policy in Go client, see PR-363.
  • Add schema logic in producer and consumer, see PR-368.

Improve

  • Fix panic on receiverQueueSize set to -1, see PR-361.
  • Fix may lead to panic test case, see PR-369.
  • Send delay message individually even batching is enabled, see PR-372.
  • Fixed buffer resize when writing request on connection, see PR-374.
  • Fixed deadlock in DLQ ack processing, see PR-375.
  • Fix deadlock when connection closed, see PR-376.
  • Fix producer deadlock after write failure, see PR-378.
  • Fix maxMessageSize not effective even if aligned with broker, see PR-381.
  • Update default router to switch partition on all batching thresholds, see PR-383.
  • Replaced github.com/DataDog/zstd with github.com/datadog/zstd, see PR-385.
  • Fix retry policy not effective with non-FQDN topics, see PR-386.

[0.2.0] 2020-08-28

Feature

  • Expose BatchingMaxSize from ProducerOptions, see PR-280.
  • Allow applications to configure the compression level, see PR-290.
  • Support producer name for Message, see PR-299.
  • Support oauth2 authentication for pulsar-client-go, see PR-313.
  • Add interceptor feature for Go client, see PR-314.
  • Export client metrics to Prometheus, see PR-317.
  • Add Name method to Consumer interface, see PR-321.
  • Add oauth2 to the provider, see PR-338.
  • Support specified the oauth2 private key with prefix file:// and data://, see PR-343.
  • Fix the keyfile unmarshal error, see PR-339.
  • Add a new method to create auth provider from tls cert supplier, see PR-347.
  • Add seek logic for reader, see PR-356.

Improve

  • Use .asf.yaml to configure github repo, see PR-216.
  • Auto update the client to handle changes in number of partitions, see PR-221.
  • Clean callbacks of connection after run loop stopped, see PR-248.
  • Fix unable to close consumer after unsubscribe in Shared Subscription, see PR-283.
  • Introduced lifecycle for compression providers, see PR-284.
  • Use maxPendingMessages for sizing producer eventsChan, see PR-285.
  • Avoid contention on producer mutex on critical path, see PR-286.
  • Switched to DataDog zstd wrapper, reusing the compression ctx, see PR-287.
  • Fix panic when creating consumer with ReceiverQueueSize set to -1, see PR-289.
  • Used pooled buffering for compression and batch serialization, see PR-292.
  • Use gogofast to have in-place protobuf serialization, see PR-294.
  • Added semaphore implementation with lower contention, see PR-298.
  • Fixed pooled buffer lifecycle, see PR-300.
  • Removed blocking queue iterator, see PR-301.
  • Fix panic in CreateReader API using custom MessageID for ReaderOptions, see PR-305.
  • Change connection failed warn log to error and print error message, see PR-309.
  • Share buffer pool across all partitions, see PR-310.
  • Add rerun feature test command to repo, see PR-311.
  • Fix CompressMaxSize() for ZLib provider, see PR-312.
  • Reduce the size of the MessageID structs by one word on 64-bit arch, see PR-316.
  • Do not allocate MessageIDs on the heap, see PR-319.
  • Different MessageID implementations for message Production and Consumption, see PR-324.
  • Fix producer block when the producer with the same id, see PR-326.
  • Get the last message when LatestMessageID and inclusive, see PR-329.
  • Fix go.mod issue with invalid version, see PR-330.
  • Fix producer goroutine leak, see PR-331.
  • Fix producer state by reconnecting when receiving unexpected receipts, see PR-336.
  • Avoid producer deadlock on connection closing, see PR-337.

Contributors

Our thanks go to the following contributors from the community for helping this release:

[0.1.1] 2020-06-19

Improve

Contributors

Our thanks go to the following contributors from the community for helping this release:

[0.1.0] 2020-03-24

New Feature

Client

  • Support TLS logic
  • Support Authentication logic
  • Support Proxy logic
  • Support Hostname verification logic

Producer

  • Add Send() method in Producer interface
  • Add SendAsync() method in Producer interface
  • Add LastSequenceID() method in Producer interface
  • Add Flush() method in Producer interface
  • Add Close() method in Producer interface
  • Add Topic() method in Producer interface
  • Add Name() method in Producer interface
  • Support MessageRouter logic
  • Support batch logic
  • Support compression message logic
  • Support HashingScheme logic
  • Support User defined properties producer logic

Consumer

  • Add Subscription() method in Consumer interface
  • Add Unsubscribe() method in Consumer interface
  • Add Receive() method in Consumer interface
  • Add Ack() method in Consumer interface
  • Add AckID() method in Consumer interface
  • Add Nack() method in Consumer interface
  • Add NackID() method in Consumer interface
  • Add Seek() method in Consumer interface
  • Add SeekByTime() method in Consumer interface
  • Add Close() method in Consumer interface
  • Support Dead Letter Queue consumer policy
  • Support Topics Pattern and Topics logic
  • Support topic consumer regx logic
  • Support multi topics consumer logic
  • Support Exclusive, Failover, Shared and KeyShared subscribe type logic
  • Support Latest and Earliest logic
  • Support ReadCompacted logic
  • Support ReplicateSubscriptionState logic
  • Support User defined properties consumer logic
  • Support Delayed Delivery Messages logic

Reader

  • Add Topic() method in Reader interface
  • Add Next() method in Reader interface
  • Add HasNext() method in Reader interface
  • Add Close() method in Reader interface
  • Support read compacted logic
  • Support start messageID logic
  • Support User defined properties reader logic

Contributors

Our thanks go to the following contributors from the community for helping this release: