[jira] [Commented] (FLINK-20267) JaasModule prevents Flink from starting if working directory is a symbolic link

["Guillaume Vauvert (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-20267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294040#comment-17294040 ] 

Guillaume Vauvert commented on FLINK-20267:
-------------------------------------------

As a workarounf, the temp directory can be configured to use the linked directory directly.

In flink-conf.yaml, add:
{noformat}
io.tmp.dirs: /mnt/tmp{noformat}

> JaasModule prevents Flink from starting if working directory is a symbolic link
> -------------------------------------------------------------------------------
>
>                 Key: FLINK-20267
>                 URL: https://issues.apache.org/jira/browse/FLINK-20267
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Coordination
>    Affects Versions: 1.12.0
>            Reporter: Till Rohrmann
>            Assignee: Matthias
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 1.12.0
>
>
> [~AHeise] reported that starting Flink on EMR fails with
> {code}
> java.lang.RuntimeException: unable to generate a JAAS configuration file
>         at org.apache.flink.runtime.security.modules.JaasModule.generateDefaultConfigFile(JaasModule.java:170)
>         at org.apache.flink.runtime.security.modules.JaasModule.install(JaasModule.java:94)
>         at org.apache.flink.runtime.security.SecurityUtils.installModules(SecurityUtils.java:78)
>         at org.apache.flink.runtime.security.SecurityUtils.install(SecurityUtils.java:59)
>         at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1045)
> Caused by: java.nio.file.FileAlreadyExistsException: /tmp
>         at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88)
>         at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
>         at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
>         at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384)
>         at java.nio.file.Files.createDirectory(Files.java:674)
>         at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781)
>         at java.nio.file.Files.createDirectories(Files.java:727)
>         at org.apache.flink.runtime.security.modules.JaasModule.generateDefaultConfigFile(JaasModule.java:162)
>         ... 4 more
> {code}
> The problem is that on EMR {{/tmp}} is a symbolic link. Due to FLINK-19252 where we introduced the [creation of the working directory|https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/security/modules/JaasModule.java#L162] in order to create the default Jaas config file, the start up process fails if the path for the working directory is not a directory (apparently {{Files.createDirectories}} cannot deal with symbolic links).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)