You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Stephen Rose (JIRA)" <ji...@apache.org> on 2011/02/14 00:11:58 UTC

[jira] Created: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
-----------------------------------------------------------------------------------------

                 Key: HADOOP-7139
                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
             Project: Hadoop Common
          Issue Type: Improvement
          Components: io
            Reporter: Stephen Rose
            Priority: Minor




-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFiles

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated HADOOP-7139:
------------------------------

    Assignee: Mac Yang
      Status: Open  (was: Patch Available)

> Allow appending to existing SequenceFiles
> -----------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Assignee: Mac Yang
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Attachment: HADOOP-7139.patch

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>         Attachments: HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Status: Patch Available  (was: Open)

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7139) Allow appending to existing SequenceFiles

Posted by "Kristofer Tomasette (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kristofer Tomasette updated HADOOP-7139:
----------------------------------------

    Affects Version/s:     (was: 0.20.1)
                       1.0.0
               Status: Patch Available  (was: Open)
    
> Allow appending to existing SequenceFiles
> -----------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 1.0.0
>            Reporter: Stephen Rose
>            Assignee: Stephen Rose
>            Priority: Minor
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7139-kt.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7139) Allow appending to existing SequenceFiles

Posted by "Keith Wyss (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453657#comment-13453657 ] 

Keith Wyss commented on HADOOP-7139:
------------------------------------

Looking at this patch, it looks like a bunch of bookkeeping about compression metadata and support for not initializing the file with the typical SequenceFile header. Am I reading it correctly? Will this apply cleanly to #"CDH3U[45]"? Anyone tested it on those systems? Thank you.
                
> Allow appending to existing SequenceFiles
> -----------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 1.0.0
>            Reporter: Stephen Rose
>            Assignee: Stephen Rose
>            Priority: Minor
>         Attachments: HADOOP-7139-kt.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7139) Allow appending to existing SequenceFiles

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13187841#comment-13187841 ] 

Hadoop QA commented on HADOOP-7139:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12510845/HADOOP-7139-kt.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 26 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/515//console

This message is automatically generated.
                
> Allow appending to existing SequenceFiles
> -----------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 1.0.0
>            Reporter: Stephen Rose
>            Assignee: Stephen Rose
>            Priority: Minor
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7139-kt.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFiles

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Release Note: Existing SequenceFiles can now be appended to  (was: Existing SequenceFiles and MapFiles can now be appended to)
         Summary: Allow appending to existing SequenceFiles  (was: Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize)

> Allow appending to existing SequenceFiles
> -----------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Affects Version/s: 0.20.1

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

       Resolution: Fixed
    Fix Version/s: 0.23.0
     Release Note: Existing SequenceFiles and MapFiles can now be appended to
           Status: Resolved  (was: Patch Available)

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998636#comment-12998636 ] 

Todd Lipcon commented on HADOOP-7139:
-------------------------------------

Also, could you write a unit test for this against RawLocalFileSystem? eg create a seqfile, close it, reopen it, append, close it, and then verify you can read the whole thing?

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Status: Open  (was: Patch Available)

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994172#comment-12994172 ] 

Hadoop QA commented on HADOOP-7139:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12470968/HADOOP-7139.patch
  against trunk revision 1070021.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these core unit tests:
                  org.apache.hadoop.io.compress.TestCodec
                  org.apache.hadoop.io.TestArrayFile
                  org.apache.hadoop.io.TestBloomMapFile
                  org.apache.hadoop.io.TestMapFile
                  org.apache.hadoop.io.TestSequenceFileSerialization
                  org.apache.hadoop.io.TestSequenceFile
                  org.apache.hadoop.io.TestSetFile

    +1 contrib tests.  The patch passed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/232//testReport/
Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/232//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/232//console

This message is automatically generated.

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994174#comment-12994174 ] 

Hadoop QA commented on HADOOP-7139:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12470970/HADOOP-7139.patch
  against trunk revision 1070021.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these core unit tests:
                  org.apache.hadoop.io.compress.TestCodec
                  org.apache.hadoop.io.TestArrayFile
                  org.apache.hadoop.io.TestBloomMapFile
                  org.apache.hadoop.io.TestMapFile
                  org.apache.hadoop.io.TestSequenceFileSerialization
                  org.apache.hadoop.io.TestSequenceFile
                  org.apache.hadoop.io.TestSetFile

    +1 contrib tests.  The patch passed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/233//testReport/
Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/233//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/233//console

This message is automatically generated.

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Reopened: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose reopened HADOOP-7139:
----------------------------------


Didn't mean to close it

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Attachment: HADOOP-7139.patch

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998634#comment-12998634 ] 

Todd Lipcon commented on HADOOP-7139:
-------------------------------------

- looks like the patch introduces some incorrect whitespace - our coding style is to use two spaces for indentation, and no "hard tabs"
- appending to a seqfile should probably check that the version of the seqfile to be appended is the same as the current file format version - I see you added a getVersion() function but it's not used.
- the Release Note and JIRA description indicates support for appending to MapFile, but that isn't available in the API.
- It seems the change to be able to specify the compression block size is a separate logical change from the ability to append. We should probably break this into two JIRAs since it's two different features.

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Attachment: HADOOP-7139.patch

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Status: Patch Available  (was: Reopened)

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998491#comment-12998491 ] 

Stephen Rose commented on HADOOP-7139:
--------------------------------------

No additional unit tests created as checksum fs doesn't support append. Have tested on HDFS.

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7139) Allow appending to existing SequenceFiles

Posted by "Kristofer Tomasette (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kristofer Tomasette updated HADOOP-7139:
----------------------------------------

    Attachment: HADOOP-7139-kt.patch

This patch depends on HADOOP-7817
                
> Allow appending to existing SequenceFiles
> -----------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 1.0.0
>            Reporter: Stephen Rose
>            Assignee: Stephen Rose
>            Priority: Minor
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7139-kt.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Attachment: HADOOP-7139.patch

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Assigned: (HADOOP-7139) Allow appending to existing SequenceFiles

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White reassigned HADOOP-7139:
---------------------------------

    Assignee: Stephen Rose  (was: Mac Yang)

Sorry, I made a mistake assigning this a moment ago when marking it as open (while Todd's feedback is addressed).

> Allow appending to existing SequenceFiles
> -----------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Assignee: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998484#comment-12998484 ] 

Hadoop QA commented on HADOOP-7139:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12471759/HADOOP-7139.patch
  against trunk revision 1071364.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/295//testReport/
Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/295//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://hudson.apache.org/hudson/job/PreCommit-HADOOP-Build/295//console

This message is automatically generated.

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7139) Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize

Posted by "Stephen Rose (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephen Rose updated HADOOP-7139:
---------------------------------

    Status: Patch Available  (was: Open)

> Allow appending to existing SequenceFile and MapFile and allow configuration of blocksize
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.1
>            Reporter: Stephen Rose
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7139) Allow appending to existing SequenceFiles

Posted by "Harsh J (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J updated HADOOP-7139:
----------------------------

    Target Version/s: 3.0.0
       Fix Version/s:     (was: 0.24.0)
    
> Allow appending to existing SequenceFiles
> -----------------------------------------
>
>                 Key: HADOOP-7139
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7139
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 1.0.0
>            Reporter: Stephen Rose
>            Assignee: Stephen Rose
>            Priority: Minor
>         Attachments: HADOOP-7139-kt.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch, HADOOP-7139.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira