[VL] Fall back scan if file scheme is not supported by registered file systems

[zhli1142015]

What changes were proposed in this pull request?

Fallback scan if root path is not supported by registered file systems

Fixes: #6620

How was this patch tested?

UT.

[github-actions]

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

• Other pull requests

[github-actions]

Run Gluten Clickhouse CI

[zhli1142015]

cc @PHILO-HE , thanks.

[PHILO-HE]

@wForget, could you take a look if you have time?

[wForget]

@zhli1142015 Thanks for your work, as comment in #4086 (comment) suggested putting the validation into SubstraitToVeloxPlanValidator, I also tried it in the original PR, can you confirm which way is better?

[zhli1142015]

Yes. There are lots of change sinse your PR. setSplitInfos method is removed from the SubstraitContext. If we want to still follow that way, we need to bing it back or add separate property for this.
And getSplitInfos is an expensive call, we should avoid to use it in validation. Instead we retrieve the first root path for validation here.
And looks all file related validation is kept in the method supportFileFormatRead, file format, schema, etc. So we put the check here also.
Last, FakeParentPathFileSystem doesn't work as expected in my local UT runs, mockfs:// is not supported by local file system. so I think a separate JNI wrapper API is needd for UT.
Hee are the differences in my mind, please le me know if this makes sense to you, @PHILO-HE and @wForget , thanks.

[PHILO-HE]

@zhli1142015, just posted some comments. Thanks!

[github-actions]

Run Gluten Clickhouse CI

[github-actions]

Run Gluten Clickhouse CI

[github-actions]

Run Gluten Clickhouse CI

[wForget]

Thanks, overall LGTM.

[PHILO-HE]

@zhli1142015, could you respond to @wForget's comments?

[github-actions]

Run Gluten Clickhouse CI

[zhli1142015]

Just updated, thanks.

[PHILO-HE]

Thanks!