You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Amit (JIRA)" <ji...@apache.org> on 2018/11/18 13:07:00 UTC

[jira] [Updated] (FLINK-10918) incremental Keyed state with RocksDB throws cannot create directory error in windows

     [ https://issues.apache.org/jira/browse/FLINK-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amit updated FLINK-10918:
-------------------------
    Attachment: 0001-FLINK-10918-Fix-for-checkpoint-creation-on-windows-1.patch

> incremental Keyed state with RocksDB throws cannot create directory error in windows
> ------------------------------------------------------------------------------------
>
>                 Key: FLINK-10918
>                 URL: https://issues.apache.org/jira/browse/FLINK-10918
>             Project: Flink
>          Issue Type: Bug
>          Components: Queryable State, State Backends, Checkpointing
>    Affects Versions: 1.6.2
>         Environment: windows
> {code:java}
> val env = StreamExecutionEnvironment.getExecutionEnvironment
> val rocksdb = new RocksDBStateBackend("file:\\C:\\rocksdb\\checkpoint",true)
> rocksdb.setDbStoragePath("file:\\C:\\rocksdb\\storage")
> env.setStateBackend(rocksdb)
> env.enableCheckpointing(10)
> {code}
>  
>            Reporter: Amit
>            Priority: Major
>         Attachments: 0001-FLINK-10918-Fix-for-checkpoint-creation-on-windows-1.patch
>
>
> Facing error while enabling keyed state with RocksDBBackend with checkpointing to a local windows directory
>  
> {code:java}
> Caused by: org.rocksdb.RocksDBException: Failed to create dir: /c:/tmp/data/job_dbe01128760d4d5cb90809cd94c2a936_op_StreamMap_b5c8d46f3e7b141acf271f12622e752b__3_8__uuid_45c1f62b-a198-44f5-add5-7683079b03f8/chk-1.tmp: Invalid argument
>                 at org.rocksdb.Checkpoint.createCheckpoint(Native Method)
>                 at org.rocksdb.Checkpoint.createCheckpoint(Checkpoint.java:51)
>                 at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend$RocksDBIncrementalSnapshotOperation.takeSnapshot(RocksDBKeyedStateBackend.java:2549)
>                 at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend$IncrementalSnapshotStrategy.performSnapshot(RocksDBKeyedStateBackend.java:2008)
>                 at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.snapshot(RocksDBKeyedStateBackend.java:498)
>                 at org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:406)
>                 ... 13 more
> {code}
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)