You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@crail.apache.org by "Animesh Trivedi (JIRA)" <ji...@apache.org> on 2018/02/20 10:14:00 UTC

[jira] [Commented] (CRAIL-3) Directory index lost when writing

    [ https://issues.apache.org/jira/browse/CRAIL-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369885#comment-16369885 ] 

Animesh Trivedi commented on CRAIL-3:
-------------------------------------

Quick update: this behavior seem to come from `crail.storage.rdma.localmap` setting. If this is set to TRUE then the files/indexes are lost. If this is set to FALSE, things seems to work. 

This behavior can also be reproduced by just generating TeraGen data with multiple executor and cores. 

> Directory index lost when writing
> ---------------------------------
>
>                 Key: CRAIL-3
>                 URL: https://issues.apache.org/jira/browse/CRAIL-3
>             Project: Apache Crail
>          Issue Type: Bug
>            Reporter: Animesh Trivedi
>            Priority: Critical
>
> The current master branch has a bug where writes under certain conditions (generating TPC-DS data from Spark) are lost. So when files are enumerated, files in certain sequence are missing. The last good branch that works is 2ff90be2acd6a08f44ef4ef42d8a3ff8cd50781e. 
> This probably was introduced with the directory logic update done for the KV interface. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)