You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Dhananjay Badaya (Jira)" <ji...@apache.org> on 2022/09/19 10:56:00 UTC

[jira] [Created] (FLINK-29332) Flink SQL Planner Module doesn't read config from flink-conf.yaml

Dhananjay Badaya created FLINK-29332:
----------------------------------------

             Summary: Flink SQL Planner Module doesn't read config from flink-conf.yaml
                 Key: FLINK-29332
                 URL: https://issues.apache.org/jira/browse/FLINK-29332
             Project: Flink
          Issue Type: Bug
          Components: Table SQL / Planner
    Affects Versions: 1.15.0
            Reporter: Dhananjay Badaya


PlannerModule class doesn't seem to be reading the configs from the {{/etc/flink/conf/flink-conf.yaml}} directory. ([code ref|https://github.com/apache/flink/blob/master/flink-table/flink-table-planner-loader/src/main/java/org/apache/flink/table/planner/loader/PlannerModule.java#L95]). It is only reading the default config values defined in the Java code. So, we can't override configs using flink-conf.yaml.

 

 

Use-case: We need to modify the default value of {{io.tmp.dirs}} as the default value (/tmp) is a symlink on our platform , and {{java.nio.file.Files.createDirectory}} (which is used By Flink in this case) doesn't handle symlinks properly [ref|https://bugs.openjdk.org/browse/JDK-8130464].

{{}}

{{}}
{code:java}
Caused by: java.nio.file.FileAlreadyExistsException: /tmp at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) at java.nio.file.Files.createDirectory(Files.java:674) at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) at java.nio.file.Files.createDirectories(Files.java:727) at org.apache.flink.table.planner.loader.PlannerModule.<init>(PlannerModule.java:96)
{code}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)