You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "bianqi (Jira)" <ji...@apache.org> on 2022/06/24 02:14:00 UTC
[jira] (FLINK-28231) Support Apache Ozone FileSystem
[ https://issues.apache.org/jira/browse/FLINK-28231 ]
bianqi deleted comment on FLINK-28231:
--------------------------------
was (Author: bianqi):
!mapreduce-webui.png!
> Support Apache Ozone FileSystem
> -------------------------------
>
> Key: FLINK-28231
> URL: https://issues.apache.org/jira/browse/FLINK-28231
> Project: Flink
> Issue Type: New Feature
> Components: fs
> Affects Versions: 1.12.1
> Environment: * Flink1.12.1
> * Hadoop3.2.2
> * Ozone1.2.1
> Reporter: bianqi
> Priority: Major
> Attachments: abc.png, image-2022-06-24-10-05-42-193.png, image-2022-06-24-10-08-26-010.png, mapreduce-webui.png, 微信图片_20220623224142.png
>
>
> After the ozone environment is currently configured, mapreduce tasks can be submitted to read and write ozone, but flink tasks cannot be submitted
> The error is as follows
> {code:java}
> [root@jykj0 ozone-fs-hadoop]# flink run /soft/flink13/examples/batch/WordCount.jar --input ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli [] - Found Yarn properties file under /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli [] - Found Yarn properties file under /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:27,151 INFO org.apache.hadoop.io.retry.RetryInvocationHandler [] - java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1 failover attempts. Trying to failover after sleeping for 4000ms.
> 2022-06-23 22:30:31,152 INFO org.apache.hadoop.io.retry.RetryInvocationHandler [] - java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2 failover attempts. Trying to failover after sleeping for 6000ms.
> {code}
> Maybe there is something wrong with my configuration，Hope to update the documentation
> https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/filesystems/overview/
--
This message was sent by Atlassian Jira
(v8.20.7#820007)