You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2007/02/08 23:21:06 UTC

[jira] Created: (HADOOP-999) DFS Client should create file when the user creates the file

DFS Client should create file when the user creates the file
------------------------------------------------------------

                 Key: HADOOP-999
                 URL: https://issues.apache.org/jira/browse/HADOOP-999
             Project: Hadoop
          Issue Type: Bug
          Components: dfs
    Affects Versions: 0.11.0
            Reporter: Owen O'Malley
         Assigned To: Sameer Paranjpye
             Fix For: 0.12.0


Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: 999_20070730.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Open  (was: Patch Available)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12516115 ] 

Hadoop QA commented on HADOOP-999:
----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12362707/999_20070727b.patch applied and successfully tested against trunk revision r560014.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/480/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/480/console

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070727b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070730.patch

- revert the UTF8 changes

- changed FSNamesystem.startFile so that is only starts file but not allocates the first block.

Thank you, Hairong.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070730c.patch

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Open  (was: Patch Available)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Patch Available  (was: Open)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Open  (was: Patch Available)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

dhruba borthakur updated HADOOP-999:
------------------------------------

    Fix Version/s: 0.15.0

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070710.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12516764 ] 

Hadoop QA commented on HADOOP-999:
----------------------------------

-1, build or testing failed

2 attempts failed to build and test the latest attachment http://issues.apache.org/jira/secure/attachment/12362892/999_20070730c.patch against trunk revision r561382.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/491/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/491/console

Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Patch Available  (was: Open)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12512605 ] 

Hairong Kuang commented on HADOOP-999:
--------------------------------------

I do not think that this patch should change the retry policy of AlreadyBeingCreatedException. Instead, it should change the copy utility so that it takes an additional flag indicating if the destination file should be overwritten or not.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Raghu Angadi
>         Attachments: 999_20070710.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

dhruba borthakur updated HADOOP-999:
------------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I just committed this. Thanks Nicholas!

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070731.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raghu Angadi reassigned HADOOP-999:
-----------------------------------

    Assignee: Raghu Angadi  (was: Sameer Paranjpye)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>         Assigned To: Raghu Angadi
>             Fix For: 0.12.0
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070727c.patch

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070727c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: 999_20070706.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Raghu Angadi
>         Attachments: 999_20070710.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Patch Available  (was: Open)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070727b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Patch Available  (was: Open)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070727b.patch

Unlinked HADOOP-1595 since there are more discussion in HADOOP-1595

In this patch, RetryPolicy remains unchanged.
 

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070727b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070730c.patch

this one should be applied to the trunk

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: 999_20070710.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070727b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070731.patch

Not sure why the previous patch cannot be applied.  Re-make one without changing the codes.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070731.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Patch Available  (was: Open)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: layout20070730b.patch

- added a junit test for coping zero size file

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12512335 ] 

Konstantin Shvachko commented on HADOOP-999:
--------------------------------------------

The patch looks very reasonable to me. Although it does not apply to the trunk.
Other than that I am
+1

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Raghu Angadi
>         Attachments: 999_20070710.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: 999_20070730c.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: 999_20070727b.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070727c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: 999_20070730c.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070730b.patch

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12516786 ] 

Hadoop QA commented on HADOOP-999:
----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12362908/999_20070731.patch applied and successfully tested against trunk revision r561432.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/492/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/492/console

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070731.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12516521 ] 

Hadoop QA commented on HADOOP-999:
----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12362804/999_20070730.patch applied and successfully tested against trunk revision r560014.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/484/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/484/console

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12516511 ] 

Hairong Kuang commented on HADOOP-999:
--------------------------------------

+ The code looks good.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12516460 ] 

Hairong Kuang commented on HADOOP-999:
--------------------------------------

1. I'd prefer that this patch does not change the use of UT8 to String. The change is not related to this issue. I think it is better to do it in a separeate jira.
2. This patch makes the namenode to create the first block when an application calls create. A side effect is that a block needs to be created for a zero length file. Also with this change, all block allocation code pieces are not in one place as before. 

Does it make more sense that we change the semantics of file creation at the server side? It seems to me that it is cleaner if startFile only creates a pendingCreate but does not create a block.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070727c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

dhruba borthakur reassigned HADOOP-999:
---------------------------------------

    Assignee: Tsz Wo (Nicholas), SZE  (was: Raghu Angadi)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070710.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070710.patch

added a junit test

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Raghu Angadi
>         Attachments: 999_20070710.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12516597 ] 

Hadoop QA commented on HADOOP-999:
----------------------------------

-1, build or testing failed

2 attempts failed to build and test the latest attachment http://issues.apache.org/jira/secure/attachment/12362837/999_20070730b.patch against trunk revision r561200.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/488/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/488/console

Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Open  (was: Patch Available)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070727b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Patch Available  (was: Open)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070731.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Status: Open  (was: Patch Available)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment: 999_20070706.patch

- created firstBlock in the constructor of DFSOutputStream, not in DFSOutputStream.nextBlockOutputStream().

- modified the RetryPolicy for create, so that it won't retry if there is an AlreadyBeingCreatedException.

- removed deprecated class UTF8 in DFSClient.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Raghu Angadi
>         Attachments: 999_20070706.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: 999_20070730b.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: 999_20070727c.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12516612 ] 

Hadoop QA commented on HADOOP-999:
----------------------------------

-1, build or testing failed

2 attempts failed to build and test the latest attachment http://issues.apache.org/jira/secure/attachment/12362848/999_20070730c.patch against trunk revision r561200.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/489/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/489/console

Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730c.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-999) DFS Client should create file when the user creates the file

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-999:
------------------------------------------

    Attachment:     (was: layout20070730b.patch)

> DFS Client should create file when the user creates the file
> ------------------------------------------------------------
>
>                 Key: HADOOP-999
>                 URL: https://issues.apache.org/jira/browse/HADOOP-999
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.15.0
>
>         Attachments: 999_20070730b.patch
>
>
> Currently, the DFS client code does not create the file on the namenode until the first block is flushed. This leads to difficult to diagnose error conditions when there is a conflicting file creation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.