You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Shuai Xu (Jira)" <ji...@apache.org> on 2023/04/27 09:24:00 UTC
[jira] [Commented] (FLINK-31956) Extend the CompiledPlan to read from/write to Flink's FileSystem
[ https://issues.apache.org/jira/browse/FLINK-31956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717082#comment-17717082 ]
Shuai Xu commented on FLINK-31956:
----------------------------------
Hi Jane, I have taken the FLINK-31952 which is similar to the task. I think it could be achieved by modifying the streamplanner and tableEnvironmentImpl.Could I take the task?
> Extend the CompiledPlan to read from/write to Flink's FileSystem
> ----------------------------------------------------------------
>
> Key: FLINK-31956
> URL: https://issues.apache.org/jira/browse/FLINK-31956
> Project: Flink
> Issue Type: Sub-task
> Components: Table SQL / Client, Table SQL / Planner
> Affects Versions: 1.18.0
> Reporter: Jane Chan
> Priority: Major
> Fix For: 1.18.0
>
>
> At present, COMPILE/EXECUTE PLAN FOR '${plan.json}' only supports writing to/reading from a local file without the scheme. We propose to extend the support for Flink's FileSystem.
> {code:sql}
> -- before
> COMPILE PLAN FOR '/tmp/foo/bar.json' <insert_query>
> EXECUTE PLAN FOR '/tmp/foo/bar.json'
> -- after
> COMPILE PLAN FOR 'file:///tmp/foo/bar.json' <insert_query>
> COMPILE PLAN FOR 'hdfs:///tmp/foo/bar.json' <insert_query>
> COMPILE PLAN FOR 's3:///tmp/foo/bar.json' <insert_query>
> COMPILE PLAN FOR 'oss:///tmp/foo/bar.json' <insert_query>
> EXECUTE PLAN FOR 'file:///tmp/foo/bar.json'
> EXECUTE PLAN FOR 'hdfs:///tmp/foo/bar.json'
> EXECUTE PLAN FOR 's3:///tmp/foo/bar.json'
> EXECUTE PLAN FOR 'oss:///tmp/foo/bar.json' {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)