You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yun Gao (Jira)" <ji...@apache.org> on 2020/07/17 05:46:00 UTC
[jira] [Commented] (FLINK-18612) WordCount example failure when
setting relative output path
[ https://issues.apache.org/jira/browse/FLINK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159691#comment-17159691 ]
Yun Gao commented on FLINK-18612:
---------------------------------
The issue is caused by when we create a file under the current user directory, we need to create the parent directory if not exists (in this case it is the current user directory), then
# path.getParent() returns the current directory, namely "." in this case.
# Flink Path object stores the path in a URI. However, according to [RFC-3986|https://tools.ietf.org/html/rfc3986] Section, 5.2.4, "." and ".." will be removed when the path is stored, thus Path.toUri().getPath() will return "".
# When trying to create the directory, the Path is transformed into new File("") via _LocalFileSystem#pathToFile._
# Then the __ condition to judge if the directory creation is successful in _LocalFileSystem#mkdirsInternal_, it will return false since _new File("").isDirectory()_ returns false.
Therefore, when transform the Path to File in the LocalFileSystem, if the path is "", we should return new File(".") instead, whose _isDirectory()_ judgement returns true.
> WordCount example failure when setting relative output path
> -----------------------------------------------------------
>
> Key: FLINK-18612
> URL: https://issues.apache.org/jira/browse/FLINK-18612
> Project: Flink
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.11.0, 1.11.1
> Reporter: Zhijiang
> Assignee: Yun Gao
> Priority: Critical
> Fix For: 1.12.0, 1.11.2
>
>
> The failure log can be found here [log|https://pipelines.actions.githubusercontent.com/revSbsLpzrFApLL6BmCvScWt72tRe3wYUv7fCdCtThtI5bydk7/_apis/pipelines/1/runs/27244/signedlogcontent/21?urlExpires=2020-07-16T06%3A35%3A49.4559813Z&urlSigningMethod=HMACV1&urlSignature=%2FfAsJgIlIf%2BDitViRJYh0DAGJZjJwhsCGS219ZyniAA%3D].
> When execute the following command, we can reproduce this problem locally.
> * bin/start-cluster.sh
> * bin/flink run -p 1 examples/streaming/WordCount.jar --input input --output result
> It is caused by the [commit|https://github.com/apache/flink/commit/a2deff2967b7de423b10f7f01a41c06565c37e62#diff-2010e422f5e43a971cd7134a9e0b9a5f ].
--
This message was sent by Atlassian Jira
(v8.3.4#803005)