[Backport 2.x] [Remote Store] Add extra buffer before deleting older generations of translog

[opensearch-trigger-bot]

Backport 218a2ef from #10817.

[github-actions]

Compatibility status:

Checks if related components are compatible with change 40785b2

Incompatible components

Incompatible components: [https://github.com/opensearch-project/security-analytics.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git]

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/28798/
• CommitID: 40785b2
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[ashking94]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/28798/
• CommitID: 40785b2
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

Flaky test - #10798

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/28812/
• CommitID: 40785b2
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/28855/
• CommitID: 40785b2

[codecov]

Codecov Report

Merging #10850 (40785b2) into 2.x (59e4060) will decrease coverage by 0.20%.
Report is 8 commits behind head on 2.x.
The diff coverage is 56.25%.

@@             Coverage Diff              @@
##                2.x   #10850      +/-   ##
============================================
- Coverage     71.03%   70.83%   -0.20%     
+ Complexity    58771    58688      -83     
============================================
  Files          4843     4844       +1     
  Lines        277307   277310       +3     
  Branches      40677    40677              
============================================
- Hits         196979   196433     -546     
- Misses        63564    64131     +567     
+ Partials      16764    16746      -18     

Files	Coverage Δ
...on/admin/cluster/node/stats/NodesStatsRequest.java	70.19% <100.00%> (+0.28%)	⬆️
.../cluster/node/stats/TransportNodesStatsAction.java	100.00% <100.00%> (ø)
...min/cluster/stats/TransportClusterStatsAction.java	70.83% <ø> (ø)
...pensearch/common/settings/IndexScopedSettings.java	100.00% <ø> (ø)
.../java/org/opensearch/gateway/GatewayMetaState.java	69.25% <100.00%> (-0.19%)	⬇️
...earch/index/SegmentReplicationPressureService.java	76.69% <100.00%> (ø)
...ensearch/index/SegmentReplicationStatsTracker.java	95.83% <100.00%> (+0.37%)	⬆️
...rg/opensearch/index/translog/RemoteFsTranslog.java	75.00% <100.00%> (+1.50%)	⬆️
server/src/main/java/org/opensearch/node/Node.java	85.22% <100.00%> (+0.03%)	⬆️
...src/main/java/org/opensearch/node/NodeService.java	71.91% <50.00%> (-0.51%)	⬇️
... and 4 more

... and 486 files with indirect coverage changes