[flink] Introduce file index rewriter procedure

[leaves12138]

Purpose

Add / Drop / Modify file index for existing tables.

This action is strictly idempotent.

Trigger this procedure will:

1. If ManifestFile does not contain the target file index column and type, add it
2. If ManifestFile contains the index column and type, but table options don't, drop it
3. If ManifestFile contains the index column and type, and table options also contain, leave it

Tests

API and Format

Three options:

1. Table name
2. Partition filter

sql

CALL sys.file_index_rewrite('default.T'); -- just rewrite all the table

CALL sys.file_index_rewrite('default.T', 'pt=a'); --add partition filter

Documentation

[JingsongLi]

Please write document first.

[JingsongLi]

CALL sys.file_index_rewrite('default.T', 'pt=a', 'file-index.bloom-filter.columns=''k'', xxx=xxx');

We don't need to support this now.

[leaves12138]

CALL sys.file_index_rewrite('default.T', 'pt=a', 'file-index.bloom-filter.columns=''k'', xxx=xxx');

We don't need to support this now.

Removed

[leaves12138]

Please write document first.

Added document

[JingsongLi]

+1