You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Roman Shaposhnik (JIRA)" <ji...@apache.org> on 2012/10/17 19:36:02 UTC

[jira] [Created] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Roman Shaposhnik created FLUME-1650:
---------------------------------------

             Summary: Fix flume-ng-hbase-sink compilation against Hadoop 2.X
                 Key: FLUME-1650
                 URL: https://issues.apache.org/jira/browse/FLUME-1650
             Project: Flume
          Issue Type: Bug
          Components: Sinks+Sources
    Affects Versions: v1.3.0
            Reporter: Roman Shaposhnik
            Assignee: Roman Shaposhnik
            Priority: Blocker
             Fix For: v1.3.0


This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.

Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478091#comment-13478091 ] 

Hari Shreedharan commented on FLUME-1650:
-----------------------------------------

Patch looks good. I am running a full build in both profiles now. If it works fine, I will commit this unless there is an objection.
                
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478552#comment-13478552 ] 

Hudson commented on FLUME-1650:
-------------------------------

Integrated in flume-trunk #315 (See [https://builds.apache.org/job/flume-trunk/315/])
    FLUME-1650. Fix flume-ng-hbase-sink compilation against Hadoop 2.X. (Revision ab984d24babf80d502ee317c6337dc8b3d7d4163)

     Result = SUCCESS
hshreedharan : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=ab984d24babf80d502ee317c6337dc8b3d7d4163
Files : 
* flume-ng-sinks/flume-ng-hbase-sink/pom.xml

                
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478201#comment-13478201 ] 

Mike Percy commented on FLUME-1650:
-----------------------------------

Thanks Roman! +1 on getting this into 1.3.0.
                
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13479515#comment-13479515 ] 

Hudson commented on FLUME-1650:
-------------------------------

Integrated in flume-1.3.0 #11 (See [https://builds.apache.org/job/flume-1.3.0/11/])
    FLUME-1650. Fix flume-ng-hbase-sink compilation against Hadoop 2.X. (Revision 9e039637220cf12d8a0b73cd22128cea25397a16)

     Result = FAILURE
hshreedharan : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git;a=summary&a=commit&h=9e039637220cf12d8a0b73cd22128cea25397a16
Files : 
* flume-ng-sinks/flume-ng-hbase-sink/pom.xml

                
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Brock Noland (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brock Noland updated FLUME-1650:
--------------------------------

    Release Note: To build against Hadoop 2.X, either HBase must built against hadoop-2.0 and be available in M2_REPO, typically $HOME/.m2/repository on the machine. Alternatively, the build can use -DskipTests.
    
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hari Shreedharan resolved FLUME-1650.
-------------------------------------

    Resolution: Fixed
    
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478214#comment-13478214 ] 

Hari Shreedharan commented on FLUME-1650:
-----------------------------------------

+1. Builds fine in both profiles. Committed to trunk, flume-1.3.0 and flume-1.4. 

Thanks Roman!
                
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478294#comment-13478294 ] 

Hari Shreedharan commented on FLUME-1650:
-----------------------------------------

[~brocknoland]Please make sure this is added to the release notes. In the hadoop-23 profile, either HBase built against hadoop-2.0 must be available in the .m2/M2_HOME on the machine or the build should be run with -DskipTests. Also to run against hadoop-2.0, an hbase version built against hadoop-2.0 is required.
                
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Roman Shaposhnik updated FLUME-1650:
------------------------------------

    Attachment: FLUME-1650.patch.txt

Attaching a patch that fixes the problem in both profiles. Those who wish to run HBase sink tests on top of Hadoop 2.X can easily workaround lack of artifacts by simply compiling HBase against Hadoop 2.X locally and installing the resulting artifacts in local .m2.

Not an ideal, but perhaps an acceptable solution. Bigtop has been doing it all along. 
                
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Comment Edited] (FLUME-1650) Fix flume-ng-hbase-sink compilation against Hadoop 2.X

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478294#comment-13478294 ] 

Hari Shreedharan edited comment on FLUME-1650 at 10/17/12 7:40 PM:
-------------------------------------------------------------------

[~brocknoland] Please make sure this is added to the release notes. In the hadoop-23 profile, either HBase built against hadoop-2.0 must be available in the .m2/M2_HOME on the machine or the build should be run with -DskipTests. Also to run against hadoop-2.0, an hbase version built against hadoop-2.0 is required.
                
      was (Author: hshreedharan):
    [~brocknoland]Please make sure this is added to the release notes. In the hadoop-23 profile, either HBase built against hadoop-2.0 must be available in the .m2/M2_HOME on the machine or the build should be run with -DskipTests. Also to run against hadoop-2.0, an hbase version built against hadoop-2.0 is required.
                  
> Fix flume-ng-hbase-sink compilation against Hadoop 2.X
> ------------------------------------------------------
>
>                 Key: FLUME-1650
>                 URL: https://issues.apache.org/jira/browse/FLUME-1650
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1650.patch.txt
>
>
> This is related to FLUME-1618 but is way less ambitious in scope which, I hope, will qualify it to be included in 1.3.0.
> Currently hadoop-0.23 profile is broken wrt. flume-ng-hbase-sink

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira