You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@fluss.apache.org by "semlanghi (via GitHub)" <gi...@apache.org> on 2025/10/20 08:19:24 UTC
[I] Hard-coding of `client.scanner.io.tmpdir` as the temp dir of SQL Gateway [fluss]
semlanghi opened a new issue, #1845:
URL: https://github.com/apache/fluss/issues/1845
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.
### Fluss version
0.7.0 (latest release)
### Please describe the bug 🐞
In the class [`FlinkTableFactory`](https://github.com/apache/fluss/blob/main/fluss-flink/fluss-flink-common/src/main/java/org/apache/fluss/flink/catalog/FlinkTableFactory.java) there is an hard-coding of the `client.scanner.io.tmpdir` (`ConfigOptions.CLIENT_SCANNER_IO_TMP_DIR`) with the flink io tmp dir:
```
// pass flink io tmp dir to fluss client.
flussConfig.setString(
ConfigOptions.CLIENT_SCANNER_IO_TMP_DIR,
new File(flinkConfig.get(CoreOptions.TMP_DIRS), "/fluss").getAbsolutePath());
```
As a consequence, when the Flink cluster (or SQL Gateway) and the client run on different hosts, the client attempts to access a directory that may not exist (or to which it lacks privileges) on its own host, since the path references the Flink host’s temp directory.
```
Caused by: java.io.IOException: Failed to create directory <flink_java_io_tmp_dir>/fluss/<snapshot-id> for storing kv snapshot files.
```
### Solution
A possible solution to this problem would be to remove the lines https://github.com/apache/fluss/blob/6bdf031a094cd775fd2d9cb7dc3f1bcb80fdf15f/fluss-flink/fluss-flink-common/src/main/java/org/apache/fluss/flink/catalog/FlinkTableFactory.java#L237-L239
as the `ConfigOptions.CLIENT_SCANNER_IO_TMP_DIR` already defaults to the local `java.tmp.dir`
```
public static final ConfigOption<String> CLIENT_SCANNER_IO_TMP_DIR =
key("client.scanner.io.tmpdir")
.stringType()
.defaultValue(System.getProperty("java.io.tmpdir") + "/fluss")
.withDescription(
"Local directory that is used by client for"
+ " storing the data files (like kv snapshot, log segment files) to read temporarily");
```
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Hard-coding of `client.scanner.io.tmpdir` as the temp dir of SQL Gateway [fluss]
Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong commented on issue #1845:
URL: https://github.com/apache/fluss/issues/1845#issuecomment-3675460401
+1 for the solution.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Hard-coding of `client.scanner.io.tmpdir` as the temp dir of SQL Gateway [fluss]
Posted by "loserwang1024 (via GitHub)" <gi...@apache.org>.
loserwang1024 commented on issue #1845:
URL: https://github.com/apache/fluss/issues/1845#issuecomment-3669083686
@semlanghi would you like to take it? or I will help do it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Hard-coding of `client.scanner.io.tmpdir` as the temp dir of SQL Gateway [fluss]
Posted by "semlanghi (via GitHub)" <gi...@apache.org>.
semlanghi commented on issue #1845:
URL: https://github.com/apache/fluss/issues/1845#issuecomment-3824445063
@loserwang1024 apologies for the delay. Thank you very much for the help!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Hard-coding of `client.scanner.io.tmpdir` as the temp dir of SQL Gateway [fluss]
Posted by "loserwang1024 (via GitHub)" <gi...@apache.org>.
loserwang1024 closed issue #1845: Hard-coding of `client.scanner.io.tmpdir` as the temp dir of SQL Gateway
URL: https://github.com/apache/fluss/issues/1845
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Hard-coding of `client.scanner.io.tmpdir` as the temp dir of SQL Gateway [fluss]
Posted by "loserwang1024 (via GitHub)" <gi...@apache.org>.
loserwang1024 commented on issue #1845:
URL: https://github.com/apache/fluss/issues/1845#issuecomment-3691367426
@semlanghi , I will take it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org