Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Non transactional batch size size reconfig in client metrics #43432

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from

Adding targetMaxMicroBatchSize as client telemetry metric.

3a6459a
Select commit
Loading
Failed to load commit list.
Draft

Non transactional batch size size reconfig in client metrics #43432

Adding targetMaxMicroBatchSize as client telemetry metric.
3a6459a
Select commit
Loading
Failed to load commit list.
Azure Pipelines / java - cosmos - ci failed Dec 17, 2024 in 1h 28m 34s

Build #20241216.3 had test failures

Details

Tests

  • Failed: 1 (0.00%)
  • Passed: 91,385 (99.00%)
  • Other: 920 (1.00%)
  • Total: 92,306
Code coverage

  • 2254 of 102263 line covered (2.20%)

Annotations

Check failure on line 131536 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / java - cosmos - ci

Build log #L131536

Build failed.

Check failure on line 1 in Point Writer can create item with duplicates

See this annotation in the file changed.

@azure-pipelines azure-pipelines / java - cosmos - ci

Point Writer can create item with duplicates

{"innerErrorMessage":"ChannelHandlerContext(RntbdRequestManager#0, [id: 0x0109325b, L:/127.0.0.1:52098 - R:/127.0.0.1:10253]) closed exceptionally with 1 pending requests","cosmosDiagnostics":{"userAgent":"azsdk-java-cosmos/4.66.0-snapshot.1 WindowsServer2022/10.0 JRE/11.0.25","activityId":"0bddccea-08c6-4b07-a965-4ce1a3c30e1d","requestLatencyInMs":404,"requestStartTimeUTC":"2024-12-17T03:20:39.516352600Z","requestEndTimeUTC":"2024-12-17T03:20:39.921347900Z","responseStatisticsList":[{"storeResult":{"storePhysicalAddress":"rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer24/partitions/a4cb4964-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","lsn":0,"quorumAckedLSN":-1,"currentReplicaSetSize":-1,"globalCommittedLsn":-1,"partitionKeyRangeId":null,"isValid":true,"statusCode":410,"subStatusCode":0,"isGone":true,"isNotFound":false,"isInvalidPartition":false,"isThroughputControlRequestRateTooLarge":false,"requestCharge":0.0,"itemLSN":-1,"sessionToken":null,"backendLatencyInMs":null,"retryAfterInMs":null,"exceptionMessage":"ChannelHandlerContext(RntbdRequestManager#0, [id: 0x0109325b, L:/127.0.0.1:52098 - R:/127.0.0.1:10253]) closed exceptionally with 1 pending requests","exceptionResponseHeaders":"{x-ms-substatus=0}","replicaStatusList":{"Ignoring":["10253:S:Connected"],"Attempting":["10253:P:Connected"]},"transportRequestTimeline":[{"eventName":"created","startTimeUTC":"2024-12-17T03:20:39.516352600Z","durationInMilliSecs":0.0},{"eventName":"queued","startTimeUTC":"2024-12-17T03:20:39.516352600Z","durationInMilliSecs":0.0},{"eventName":"channelAcquisitionStarted","startTimeUTC":"2024-12-17T03:20:39.516352600Z","durationInMilliSecs":20.9996},{"eventName":"pipelined","startTimeUTC":"2024-12-17T03:20:39.537352200Z","durationInMilliSecs":6.0006},{"eventName":"transitTime","startTimeUTC":"2024-12-17T03:20:39.543352800Z","durationInMilliSecs":0.0},{"eventName":"decodeTime","startTimeUTC":null,"durationInMilliSecs":0.0},{"eventName":"received","startTimeUTC":null,"durationInMilliSecs":0.0},{"eventName":"completed","startTimeUTC":"2024-12-17T03:20:39.543352800Z","durationInMilliSecs":0.0}],"rntbdRequestLengthInBytes":601,"rntbdResponseLengthInBytes":-1,"requestPayloadLengthInBytes":163,"responsePayloadLengthInBytes":-1,"channelStatistics":{"channelId":"0109325b","channelTaskQueueSize":1,"pendingRequestsCount":0,"lastReadTime":"2024-12-17T03:20:39.537352200Z","waitForConnectionInit":false},"serviceEndpointStatistics":{"availableChannels":34,"acquiredChannels":1,"executorTaskQueueSize":36,"inflightRequests":37,"lastSuccessfulRequestTime":"2024-12-17T03:20:39.512Z","lastRequestTime":"2024-12-17T03:20:39.513Z","createdTime":"2024-12-17T03:20:18.886649600Z","isClosed":false,"cerMetrics":{}}},"requestResponseTimeUTC":"2024-12-17T03:20:39.545358100Z","requestStartTimeUTC":"2024-12-17T03:20:39.516352600Z","requestResourceType":"Document","requestOperationType":"Create","requestSessionToken":null,"e2ePolicyCfg":null,"excludedRegions":null,"sessionTokenEvaluationResults":[],"locationToLocationSpecificHealthContext":{"v":null}}],"supplementalResponseStatisticsList":[],"addressResolutionStatistics":{"8cafbc8d-4242-4751-bfd6-8c6a00adcedf":{"startTimeUTC":"2024-12-17T03:20:39.625350400Z","endTimeUTC":"2024-12-17T03:20:39.921347900Z","targetEndpoint":"https://127.0.0.1:8081/addresses/?$resolveFor=dbs%2FltBuAA%3D%3D%2Fcolls%2FltBuAMDRH40%3D%2Fdocs&$filter=protocol%20eq%20rntbd&$partitionKeyRangeIds=2","exceptionMessage":null,"forceRefresh":true,"forceCollectionRoutingMapRefresh":false,"inflightRequest":false}},"regionsContacted":["south central us"],"retryContext":{"statusAndSubStatusCodes":[[410,0]],"retryCount":1,"retryLatency":80},"metadataDiagnosticsContext":{"metadataDiagnosticList":[{"metaDataName":"SERVER_ADDRESS_LOOKUP","startTimeUTC":"2024-12-17T03:20:39.625350400Z","endTimeUTC":"2024-12-17T03:20:39.921347900Z","durationinMS":295}]},"serializationDiagnosticsContext":{"serializationDiagnosticsList":null},"gatewayStatisticsList":[],"samplingRate
Raw output
      {"ClassName":"GoneException","userAgent":"azsdk-java-cosmos/4.66.0-snapshot.1 WindowsServer2022/10.0 JRE/11.0.25","statusCode":410,"resourceAddress":"rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer24/partitions/a4cb4964-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","innerErrorMessage":"ChannelHandlerContext(RntbdRequestManager#0, [id: 0x0109325b, L:/127.0.0.1:52098 - R:/127.0.0.1:10253]) closed exceptionally with 1 pending requests","causeInfo":"[class: class java.nio.channels.ClosedChannelException, message: null]","responseHeaders":"{x-ms-substatus=0}","requestHeaders":"[x-ms-cosmos-sdk-supportedcapabilities=1, Accept=application/json, x-ms-date=Tue, 17 Dec 2024 03:20:39 GMT, x-ms-documentdb-collection-rid=ltBuAMDRH40=, x-ms-client-retry-attempt-count=0, Prefer=return=minimal, x-ms-documentdb-partitionkey=[\"57\",\"userId1\",\"sessionId1\"], x-ms-remaining-time-in-ms-on-client=60000, Content-Type=application/json]","cosmosDiagnostics":{"userAgent":"azsdk-java-cosmos/4.66.0-snapshot.1 WindowsServer2022/10.0 JRE/11.0.25","activityId":"0bddccea-08c6-4b07-a965-4ce1a3c30e1d","requestLatencyInMs":404,"requestStartTimeUTC":"2024-12-17T03:20:39.516352600Z","requestEndTimeUTC":"2024-12-17T03:20:39.921347900Z","responseStatisticsList":[{"storeResult":{"storePhysicalAddress":"rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer24/partitions/a4cb4964-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","lsn":0,"quorumAckedLSN":-1,"currentReplicaSetSize":-1,"globalCommittedLsn":-1,"partitionKeyRangeId":null,"isValid":true,"statusCode":410,"subStatusCode":0,"isGone":true,"isNotFound":false,"isInvalidPartition":false,"isThroughputControlRequestRateTooLarge":false,"requestCharge":0.0,"itemLSN":-1,"sessionToken":null,"backendLatencyInMs":null,"retryAfterInMs":null,"exceptionMessage":"ChannelHandlerContext(RntbdRequestManager#0, [id: 0x0109325b, L:/127.0.0.1:52098 - R:/127.0.0.1:10253]) closed exceptionally with 1 pending requests","exceptionResponseHeaders":"{x-ms-substatus=0}","replicaStatusList":{"Ignoring":["10253:S:Connected"],"Attempting":["10253:P:Connected"]},"transportRequestTimeline":[{"eventName":"created","startTimeUTC":"2024-12-17T03:20:39.516352600Z","durationInMilliSecs":0.0},{"eventName":"queued","startTimeUTC":"2024-12-17T03:20:39.516352600Z","durationInMilliSecs":0.0},{"eventName":"channelAcquisitionStarted","startTimeUTC":"2024-12-17T03:20:39.516352600Z","durationInMilliSecs":20.9996},{"eventName":"pipelined","startTimeUTC":"2024-12-17T03:20:39.537352200Z","durationInMilliSecs":6.0006},{"eventName":"transitTime","startTimeUTC":"2024-12-17T03:20:39.543352800Z","durationInMilliSecs":0.0},{"eventName":"decodeTime","startTimeUTC":null,"durationInMilliSecs":0.0},{"eventName":"received","startTimeUTC":null,"durationInMilliSecs":0.0},{"eventName":"completed","startTimeUTC":"2024-12-17T03:20:39.543352800Z","durationInMilliSecs":0.0}],"rntbdRequestLengthInBytes":601,"rntbdResponseLengthInBytes":-1,"requestPayloadLengthInBytes":163,"responsePayloadLengthInBytes":-1,"channelStatistics":{"channelId":"0109325b","channelTaskQueueSize":1,"pendingRequestsCount":0,"lastReadTime":"2024-12-17T03:20:39.537352200Z","waitForConnectionInit":false},"serviceEndpointStatistics":{"availableChannels":34,"acquiredChannels":1,"executorTaskQueueSize":36,"inflightRequests":37,"lastSuccessfulRequestTime":"2024-12-17T03:20:39.512Z","lastRequestTime":"2024-12-17T03:20:39.513Z","createdTime":"2024-12-17T03:20:18.886649600Z","isClosed":false,"cerMetrics":{}}},"requestResponseTimeUTC":"2024-12-17T03:20:39.545358100Z","requestStartTimeUTC":"2024-12-17T03:20:39.516352600Z","requestResourceType":"Document","requestOperationType":"Create","requestSessionToken":null,"e2ePolicyCfg":null,"excludedRegions":null,"sessionTokenEvaluationResults":[],"locationToLocationSpecificHealthContext":{"v":null}}],"supplementalResponseStatisticsList":[],"addressResolutionStatistics":{"8cafbc8d-4242-4751-bfd6-8c6a00adcedf":{"startTimeUTC":"2024-12-17T03:20:39.625350400Z","end