You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Christian Kunz (JIRA)" <ji...@apache.org> on 2007/10/05 23:31:51 UTC

[jira] Commented: (HADOOP-1612) listing of an output directory shortly after job completion fails

    [ https://issues.apache.org/jira/browse/HADOOP-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12532781 ] 

Christian Kunz commented on HADOOP-1612:
----------------------------------------

Just wanted to mention that I still see that listing a job output directory using libhdfs after successful job completion sometimes fails for up to 6 secs.

> listing of an output directory shortly after job completion fails
> -----------------------------------------------------------------
>
>                 Key: HADOOP-1612
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1612
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.0
>            Reporter: Christian Kunz
>            Assignee: Arun C Murthy
>             Fix For: 0.15.0
>
>
> Sometimes, after a job finishes, and another application wants to rename dfs files created by that job, listing of the output directory containing the newly created files fails. File creation and directory listing is done via libhdfs, but it is unlikely that this makes any difference, therefore, I add this to the mapred component.
> It might be a race condition: does the job complete before the files in the output directory are promoted?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.