[Bug] Serializers were created infinitely and caused OOM for 0.8

[xccui]

Search before asking

• I searched in the issues and found nothing similar.

Paimon version

0.8

Compute Engine

Flink 1.18.1

Minimal reproduce step

Serializers were created infinitely for the following recursive schema after bumping up Paimon to 0.8.

ARRAY <
    ROW <
        `null_value` STRING,
        `number_value` DOUBLE,
        `string_value` STRING,
        `bool_value` BOOLEAN,
        `struct_value` ROW <
            `fields` ARRAY <
                ROW <
                    `key` STRING,
                    `value` ROW <
                        `null_value` STRING,
                        `number_value` DOUBLE,
                        `string_value` STRING,
                        `bool_value` BOOLEAN,
                        `struct_value` ROW <
                            `fields` ARRAY <
                                ROW <
                                    `key` STRING,
                                    `value` ROW <
                                        `null_value` STRING,
                                        `number_value` DOUBLE,
                                        `string_value` STRING,
                                        `bool_value` BOOLEAN
                                    >
                                > NOT NULL
                            >
                        >,
                        `list_value` ROW <
                            `values` ARRAY <
                                ROW <
                                    `null_value` STRING,
                                    `number_value` DOUBLE,
                                    `string_value` STRING,
                                    `bool_value` BOOLEAN
                                > NOT NULL
                            >
                        >
                    >
                > NOT NULL
            >
        >,
        `list_value` ROW <
            `values` ARRAY <
                ROW <
                    `null_value` STRING,
                    `number_value` DOUBLE,
                    `string_value` STRING,
                    `bool_value` BOOLEAN,
                    `struct_value` ROW <
                        `fields` ARRAY <
                            ROW <
                                `key` STRING,
                                `value` ROW <
                                    `null_value` STRING,
                                    `number_value` DOUBLE,
                                    `string_value` STRING,
                                    `bool_value` BOOLEAN
                                >
                            > NOT NULL
                        >
                    >,
                    `list_value` ROW <
                        `values` ARRAY <
                            ROW <
                                `null_value` STRING,
                                `number_value` DOUBLE,
                                `string_value` STRING,
                                `bool_value` BOOLEAN
                            > NOT NULL
                        >
                    >
                > NOT NULL
            >
        >
    > NOT NULL
>

What doesn't meet your expectations?

The test case worked well with Paimon 0.7 but caused OOM with Paimon 0.8.

Anything else?

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!

[wg1026688210]

Hi~ @xccui Could you please specify when the OOM occurred? Was it during the data writing process?

[xccui]

Hi @wg1026688210, it happened when I tried to write something to a Paimon table. Here's the screenshot for the stack.

[xccui]

I think the bug was introduced in #3039 since everything's back to normal after I reverted it.
CC @JingsongLi

[wg1026688210]

Hi @wg1026688210, it happened when I tried to write something to a Paimon table. Here's the screenshot for the stack.

Hi ~ @xccui Could you provide the code reproducing this issue.