You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Bruno Mahé (Created JIRA)" <ji...@apache.org> on 2011/12/22 19:35:31 UTC

[jira] [Created] (FLUME-901) Make Flume NG build and pass tests against Hadoop 0.23 branch

Make Flume NG build and pass tests against Hadoop 0.23 branch
-------------------------------------------------------------

                 Key: FLUME-901
                 URL: https://issues.apache.org/jira/browse/FLUME-901
             Project: Flume
          Issue Type: Task
    Affects Versions: NG alpha 1
            Reporter: Bruno Mahé


This task is about adding an experimental profile for Hadoop 0.23

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Assigned] (FLUME-901) Make Flume NG build and pass tests against Hadoop 0.23 branch

Posted by "E. Sammer (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

E. Sammer reassigned FLUME-901:
-------------------------------

    Assignee: Bruno Mahé
    
> Make Flume NG build and pass tests against Hadoop 0.23 branch
> -------------------------------------------------------------
>
>                 Key: FLUME-901
>                 URL: https://issues.apache.org/jira/browse/FLUME-901
>             Project: Flume
>          Issue Type: Task
>    Affects Versions: NG alpha 1
>            Reporter: Bruno Mahé
>            Assignee: Bruno Mahé
>              Labels: bigtop
>
> This task is about adding an experimental profile for Hadoop 0.23

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Closed] (FLUME-901) Make Flume NG build and pass tests against Hadoop 0.23 branch

Posted by "E. Sammer (Closed) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

E. Sammer closed FLUME-901.
---------------------------

    
> Make Flume NG build and pass tests against Hadoop 0.23 branch
> -------------------------------------------------------------
>
>                 Key: FLUME-901
>                 URL: https://issues.apache.org/jira/browse/FLUME-901
>             Project: Flume
>          Issue Type: Task
>    Affects Versions: NG alpha 1
>            Reporter: Bruno Mahé
>            Assignee: Bruno Mahé
>              Labels: bigtop
>         Attachments: FLUME-901.PATCH
>
>
> This task is about adding an experimental profile for Hadoop 0.23

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Updated] (FLUME-901) Make Flume NG build and pass tests against Hadoop 0.23 branch

Posted by "E. Sammer (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

E. Sammer updated FLUME-901:
----------------------------

    Fix Version/s: NG alpha 3
    
> Make Flume NG build and pass tests against Hadoop 0.23 branch
> -------------------------------------------------------------
>
>                 Key: FLUME-901
>                 URL: https://issues.apache.org/jira/browse/FLUME-901
>             Project: Flume
>          Issue Type: Task
>    Affects Versions: NG alpha 1
>            Reporter: Bruno Mahé
>            Assignee: Bruno Mahé
>              Labels: bigtop
>             Fix For: NG alpha 3
>
>         Attachments: FLUME-901.PATCH
>
>
> This task is about adding an experimental profile for Hadoop 0.23

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Updated] (FLUME-901) Make Flume NG build and pass tests against Hadoop 0.23 branch

Posted by "Bruno Mahé (Updated JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bruno Mahé updated FLUME-901:
-----------------------------

    Status: Patch Available  (was: Open)
    
> Make Flume NG build and pass tests against Hadoop 0.23 branch
> -------------------------------------------------------------
>
>                 Key: FLUME-901
>                 URL: https://issues.apache.org/jira/browse/FLUME-901
>             Project: Flume
>          Issue Type: Task
>    Affects Versions: NG alpha 1
>            Reporter: Bruno Mahé
>            Assignee: Bruno Mahé
>              Labels: bigtop
>
> This task is about adding an experimental profile for Hadoop 0.23

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Updated] (FLUME-901) Make Flume NG build and pass tests against Hadoop 0.23 branch

Posted by "E. Sammer (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

E. Sammer updated FLUME-901:
----------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed to branch flume-728.

Thanks Bruno!
                
> Make Flume NG build and pass tests against Hadoop 0.23 branch
> -------------------------------------------------------------
>
>                 Key: FLUME-901
>                 URL: https://issues.apache.org/jira/browse/FLUME-901
>             Project: Flume
>          Issue Type: Task
>    Affects Versions: NG alpha 1
>            Reporter: Bruno Mahé
>            Assignee: Bruno Mahé
>              Labels: bigtop
>         Attachments: FLUME-901.PATCH
>
>
> This task is about adding an experimental profile for Hadoop 0.23

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (FLUME-901) Make Flume NG build and pass tests against Hadoop 0.23 branch

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175197#comment-13175197 ] 

Hudson commented on FLUME-901:
------------------------------

Integrated in flume-728 #82 (See [https://builds.apache.org/job/flume-728/82/])
    FLUME-901: Make Flume NG build and pass tests against Hadoop 0.23 branch

(Bruno Mahé via Eric Sammer)

esammer : http://svn.apache.org/viewvc/?view=rev&rev=1222508
Files : 
* /incubator/flume/branches/flume-728/flume-ng-sinks/flume-hdfs-sink/pom.xml
* /incubator/flume/branches/flume-728/flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSTextFormatter.java
* /incubator/flume/branches/flume-728/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSink.java
* /incubator/flume/branches/flume-728/pom.xml

                
> Make Flume NG build and pass tests against Hadoop 0.23 branch
> -------------------------------------------------------------
>
>                 Key: FLUME-901
>                 URL: https://issues.apache.org/jira/browse/FLUME-901
>             Project: Flume
>          Issue Type: Task
>    Affects Versions: NG alpha 1
>            Reporter: Bruno Mahé
>            Assignee: Bruno Mahé
>              Labels: bigtop
>             Fix For: NG alpha 3
>
>         Attachments: FLUME-901.PATCH
>
>
> This task is about adding an experimental profile for Hadoop 0.23

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Updated] (FLUME-901) Make Flume NG build and pass tests against Hadoop 0.23 branch

Posted by "Bruno Mahé (Updated JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bruno Mahé updated FLUME-901:
-----------------------------

    Attachment: FLUME-901.PATCH

Please find attached a patch.
This patch introduces profiles to select which line of Apache Hadoop you wish to build against. By default, it will build against 0.20.205.0.
Flume will not build yet against Hadoop 0.23 until HADOOP-7937 gets resolved. But this will not require any change on Flume side. Hadoop 0.23 is still in development, hence the -SNAPSHOT version

Minor changes:
* HDFSTextFormatter.java has to be updated to work against both Hadoop 0.20.20X and Hadoop 0.23. Text::getBytes() still returns the raw byte array, but now Text is also doing some preallocation. So the byte array would be different from what would be expected
* TestHDFSEventSink.java had at least one of its assert parameters in the wrong order (got, expected) versus (expected, got)

Don't hesitate to let me know if you would like me to rework any part

                
> Make Flume NG build and pass tests against Hadoop 0.23 branch
> -------------------------------------------------------------
>
>                 Key: FLUME-901
>                 URL: https://issues.apache.org/jira/browse/FLUME-901
>             Project: Flume
>          Issue Type: Task
>    Affects Versions: NG alpha 1
>            Reporter: Bruno Mahé
>            Assignee: Bruno Mahé
>              Labels: bigtop
>         Attachments: FLUME-901.PATCH
>
>
> This task is about adding an experimental profile for Hadoop 0.23

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira