You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Johannes (JIRA)" <ji...@apache.org> on 2015/02/21 21:23:11 UTC
[jira] [Updated] (FLINK-1596) FileIOChannel introduces space in
temp file name
[ https://issues.apache.org/jira/browse/FLINK-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Johannes updated FLINK-1596:
----------------------------
Description:
FLINK-1483 introduced separate directories for all threads.
Unfortunately this seems to not work on windows, due to spaces in the filename
Stacktrace
{code}
Caused by: java.io.IOException: Channel to path '....\AppData\Local\Temp\flink-io-366dee63-092c-415c-b119-a138506dec86\ fa44b17b98c3b1b1e30185fd92be5d01.000002.channel' could not be opened.
at org.apache.flink.runtime.io.disk.iomanager.AbstractFileIOChannel.<init>(AbstractFileIOChannel.java:61)
at org.apache.flink.runtime.io.disk.iomanager.AsynchronousFileIOChannel.<init>(AsynchronousFileIOChannel.java:77)
at org.apache.flink.runtime.io.disk.iomanager.AsynchronousBulkBlockReader.<init>(AsynchronousBulkBlockReader.java:46)
at org.apache.flink.runtime.io.disk.iomanager.AsynchronousBulkBlockReader.<init>(AsynchronousBulkBlockReader.java:39)
at org.apache.flink.runtime.io.disk.iomanager.IOManagerAsync.createBulkBlockChannelReader(IOManagerAsync.java:236)
at org.apache.flink.runtime.operators.hash.MutableHashTable.buildTableFromSpilledPartition(MutableHashTable.java:747)
at org.apache.flink.runtime.operators.hash.MutableHashTable.prepareNextPartition(MutableHashTable.java:508)
at org.apache.flink.runtime.operators.hash.ReOpenableMutableHashTable.prepareNextPartition(ReOpenableMutableHashTable.java:167)
at org.apache.flink.runtime.operators.hash.MutableHashTable.nextRecord(MutableHashTable.java:541)
at org.apache.flink.runtime.operators.hash.NonReusingBuildFirstHashMatchIterator.callWithNextKey(NonReusingBuildFirstHashMatchIterator.java:104)
at org.apache.flink.runtime.operators.AbstractCachedBuildSideMatchDriver.run(AbstractCachedBuildSideMatchDriver.java:155)
at org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:496)
at org.apache.flink.runtime.iterative.task.AbstractIterativePactTask.run(AbstractIterativePactTask.java:139)
at org.apache.flink.runtime.iterative.task.IterationIntermediatePactTask.run(IterationIntermediatePactTask.java:92)
at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:204)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: ....AppData\Local\Temp\flink-io-366dee63-092c-415c-b119-a138506dec86\ fa44b17b98c3b1b1e30185fd92be5d01.000002.channel (Das System kann die angegebene Datei nicht finden)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
at org.apache.flink.runtime.io.disk.iomanager.AbstractFileIOChannel.<init>(AbstractFileIOChannel.java:57)
... 16 more
{code}
was:
FLINK-1483 introduced separate directories for all threads.
Unfortunately this seems to not work on windows, due to spaces in the filename
> FileIOChannel introduces space in temp file name
> ------------------------------------------------
>
> Key: FLINK-1596
> URL: https://issues.apache.org/jira/browse/FLINK-1596
> Project: Flink
> Issue Type: Bug
> Components: Local Runtime
> Affects Versions: 0.9
> Reporter: Johannes
> Assignee: Johannes
> Priority: Minor
> Labels: easyfix
>
> FLINK-1483 introduced separate directories for all threads.
> Unfortunately this seems to not work on windows, due to spaces in the filename
> Stacktrace
> {code}
> Caused by: java.io.IOException: Channel to path '....\AppData\Local\Temp\flink-io-366dee63-092c-415c-b119-a138506dec86\ fa44b17b98c3b1b1e30185fd92be5d01.000002.channel' could not be opened.
> at org.apache.flink.runtime.io.disk.iomanager.AbstractFileIOChannel.<init>(AbstractFileIOChannel.java:61)
> at org.apache.flink.runtime.io.disk.iomanager.AsynchronousFileIOChannel.<init>(AsynchronousFileIOChannel.java:77)
> at org.apache.flink.runtime.io.disk.iomanager.AsynchronousBulkBlockReader.<init>(AsynchronousBulkBlockReader.java:46)
> at org.apache.flink.runtime.io.disk.iomanager.AsynchronousBulkBlockReader.<init>(AsynchronousBulkBlockReader.java:39)
> at org.apache.flink.runtime.io.disk.iomanager.IOManagerAsync.createBulkBlockChannelReader(IOManagerAsync.java:236)
> at org.apache.flink.runtime.operators.hash.MutableHashTable.buildTableFromSpilledPartition(MutableHashTable.java:747)
> at org.apache.flink.runtime.operators.hash.MutableHashTable.prepareNextPartition(MutableHashTable.java:508)
> at org.apache.flink.runtime.operators.hash.ReOpenableMutableHashTable.prepareNextPartition(ReOpenableMutableHashTable.java:167)
> at org.apache.flink.runtime.operators.hash.MutableHashTable.nextRecord(MutableHashTable.java:541)
> at org.apache.flink.runtime.operators.hash.NonReusingBuildFirstHashMatchIterator.callWithNextKey(NonReusingBuildFirstHashMatchIterator.java:104)
> at org.apache.flink.runtime.operators.AbstractCachedBuildSideMatchDriver.run(AbstractCachedBuildSideMatchDriver.java:155)
> at org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:496)
> at org.apache.flink.runtime.iterative.task.AbstractIterativePactTask.run(AbstractIterativePactTask.java:139)
> at org.apache.flink.runtime.iterative.task.IterationIntermediatePactTask.run(IterationIntermediatePactTask.java:92)
> at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
> at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:204)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.FileNotFoundException: ....AppData\Local\Temp\flink-io-366dee63-092c-415c-b119-a138506dec86\ fa44b17b98c3b1b1e30185fd92be5d01.000002.channel (Das System kann die angegebene Datei nicht finden)
> at java.io.RandomAccessFile.open(Native Method)
> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> at org.apache.flink.runtime.io.disk.iomanager.AbstractFileIOChannel.<init>(AbstractFileIOChannel.java:57)
> ... 16 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)