You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by highfei2011 <hi...@126.com> on 2022/11/01 08:23:35 UTC
回复：flink on k8s 提交作业，使用 oss 作为 checkpoint 地址，但找不到 oss
包冲突了。
在 2022年11月1日 15:39，highfei2011<hi...@126.com> 写道：
flink 版本：apache flink 1.13.6 flink operator 版本： 1.2.0 提交命令：kubernetes-jobmanager.sh kubernetes-application 异常： Caused by: org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Could not find a file system implementation for scheme 'oss'. The scheme is directly supported by Flink through t he following plugin: flink-oss-fs-hadoop. Please ensure that each plugin resides within its own subfolder within the plugins directory. See https://ci.apache.org/projects/flink/flink-docs -stable/ops/plugins.html for more information. If you want to use a Hadoop file system for that scheme, please add the scheme to the configuration fs.allowed-fallback-filesystems. For a f ull list of supported file systems, please see https://nightlies.apache.org/flink/flink-docs-stable/ops/filesystems/. 我排查了 /opt/flink/opt/目录，下面是有 flink-oss-fs-hadoop-1.13.6.jar 注：本地测试正常，仅使用 flink operator 提交时，发生如上异常。
Re: flink on k8s 提交作业，使用 oss 作为 checkpoint 地址，但找不到 oss
Posted by Lijie Wang <wa...@gmail.com>.
flink-oss-fs-hadoop-1.13.6.jar 这个 jar 需要放到 flink 的 lib 目录下
Best，
Lijie
highfei2011 <hi...@126.com> 于2022年11月1日周二 16:23写道：
> 包冲突了。
>
>
> 在 2022年11月1日 15:39，highfei2011<hi...@126.com> 写道：
>
>
> flink 版本：apache flink 1.13.6 flink operator 版本： 1.2.0
> 提交命令：kubernetes-jobmanager.sh kubernetes-application 异常： Caused by:
> org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Could not
> find a file system implementation for scheme 'oss'. The scheme is directly
> supported by Flink through t he following plugin: flink-oss-fs-hadoop.
> Please ensure that each plugin resides within its own subfolder within the
> plugins directory. See https://ci.apache.org/projects/flink/flink-docs
> -stable/ops/plugins.html for more information. If you want to use a Hadoop
> file system for that scheme, please add the scheme to the configuration
> fs.allowed-fallback-filesystems. For a f ull list of supported file
> systems, please see
> https://nightlies.apache.org/flink/flink-docs-stable/ops/filesystems/.
> 我排查了 /opt/flink/opt/目录，下面是有 flink-oss-fs-hadoop-1.13.6.jar 注：本地测试正常，仅使用
> flink operator 提交时，发生如上异常。