[Bug] BufferExhaustedException will be thrown when write a high volume of data to log table with arrow formart

[luoyuxia]

Search before asking

• I searched in the issues and found nothing similar.

Fluss version

0.5.0

Minimal reproduce step

Create a log table and write into the log table with a high volume of data. Then the exception will be throw

com.alibaba.fluss.exception.FlussRuntimeException: com.alibaba.fluss.exception.BufferExhaustedException: Failed to allocate new segment within the configured max blocking time 120000 ms. Total memory: 67108864 bytes. Available memory: 72220672 bytes. page size: 131072 bytes
	at com.alibaba.fluss.client.write.WriterClient.doSend(WriterClient.java:191)
	at com.alibaba.fluss.client.write.WriterClient.send(WriterClient.java:119)
	at com.alibaba.fluss.client.table.writer.TableWriter.send(TableWriter.java:71)
	at com.alibaba.fluss.client.table.writer.AppendWriter.append(AppendWriter.java:64)
	at com.alibaba.fluss.connector.flink.sink.AppendSinkFunction.writeRow(AppendSinkFunction.java:51)
	at com.alibaba.fluss.connector.flink.sink.FlinkSinkFunction.invoke(FlinkSinkFunction.java:121)
	at com.alibaba.fluss.connector.flink.sink.FlinkSinkFunction.invoke(FlinkSinkFunction.java:56)
	at org.apache.flink.table.runtime.operators.sink.SinkOperator.processElement(SinkOperator.java:79)
	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:245)
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:201)
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:159)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:68)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:616)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:1080)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:1029)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:959)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:938)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:567)
	at java.lang.Thread.run(Thread.java:879)
Caused by: com.alibaba.fluss.exception.BufferExhaustedException: Failed to allocate new segment within the configured max blocking time 120000 ms. Total memory: 67108864 bytes. Available memory: 72220672 bytes. page size: 131072 bytes

What doesn't meet your expectations?

N/A

Anything else?

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!