SNOW-1805174 Enable single buffer by default

[sfc-gh-mbobowski]

Overview

SNOW-1805174

This PR contains:

• enabling single buffer by default + fixes for some tests
• validation that blocks running iceberg ingestion with double buffer

Pre-review checklist

• This change should be part of a Behavior Change Release. See go/behavior-change.
• This change has passed Merge gate tests
• Snowpipe Changes
• Snowpipe Streaming Changes
• This change is TEST-ONLY
• This change is README/Javadocs only
• This change is protected by a config parameter <PARAMETER_NAME> eg snowflake.ingestion.method.
  • Yes - Added end to end and Unit Tests.
  • No - Suggest why it is not param protected
• Is his change protected by parameter <PARAMETER_NAME> on the server side?
  • The parameter/feature is not yet active in production (partial rollout or PrPr, see Changes for Unreleased Features and Fixes).
  • If there is an issue, it can be safely mitigated by turning the parameter off. This is also verified by a test (See go/ppp).

[gitguardian]

️✅ There are no secrets present in this pull request anymore.

If these secrets were true positive and are still valid, we highly recommend you to revoke them.
Once a secret has been leaked into a git repository, you should consider it compromised, even if it was deleted immediately.
Find here more information about risks.

---

^{_{🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.}}

[sfc-gh-mbobowski]

Investigated this test a little bit as it was the only one e2e that started to fail after my changes.

The test lasts for a significant amount of time not only because of ingest sdk lag, but also because of retry lags in KC framework itself (tried to tune it with "errors.retry.delay.max.ms" but didn't see any improvement). I also validated that the columns appear in the table with sleep(240) and default lag settings - anyway I decided to make it faster with lower lag.