You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "bianqi (Jira)" <ji...@apache.org> on 2022/06/23 14:40:00 UTC
[jira] [Updated] (FLINK-28231) Support Ozone file system
[ https://issues.apache.org/jira/browse/FLINK-28231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
bianqi updated FLINK-28231:
---------------------------
Affects Version/s: 1.12.1
(was: 1.14.5)
> Support Ozone file system
> -------------------------
>
> Key: FLINK-28231
> URL: https://issues.apache.org/jira/browse/FLINK-28231
> Project: Flink
> Issue Type: New Feature
> Components: fs
> Affects Versions: 1.12.1
> Environment: * Flink1.12.1
> * Hadoop3.2.2
> * Ozone1.2.1
> Reporter: bianqi
> Priority: Major
>
> After the ozone environment is currently configured, mapreduce tasks can be submitted to read and write ozone, but flink tasks cannot be submitted
> The error is as follows
> {code:java}
> [root@jykj0 ozone-fs-hadoop]# flink run /soft/flink13/examples/batch/WordCount.jar --input ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli [] - Found Yarn properties file under /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli [] - Found Yarn properties file under /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:27,151 INFO org.apache.hadoop.io.retry.RetryInvocationHandler [] - java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1 failover attempts. Trying to failover after sleeping for 4000ms.
> 2022-06-23 22:30:31,152 INFO org.apache.hadoop.io.retry.RetryInvocationHandler [] - java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2 failover attempts. Trying to failover after sleeping for 6000ms. {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)