You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Hari Shreedharan <hs...@cloudera.com> on 2014/07/26 23:41:40 UTC
Re: Flume Compile 1.5.0 for HBase 0.98.3
Run mvn clean install -Dhadoop.profile=hbase-98
-Dhbase.version=<specific version of hbase 98>.
On Saturday, July 26, 2014, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> I have tried several times about compiling Flume 1.5.0 for HBase 0.98.3,
> with some progress but still failed.
>
> Can someone advise what the proper settings in pom.xml is? or which
> repository contains HBase 0.98.3 jar files? or any ideas to fix this?
>
> Many thanks!!
> Arthur
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building Flume NG HBase Sink 1.5.0
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The POM for org.apache.hbase:hbase:jar:0.98.3 is missing, no
> dependency information available
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Flume ...................................... SUCCESS [0.873s]
> [INFO] Flume NG SDK ...................................... SUCCESS [1.681s]
> [INFO] Flume NG Configuration ............................ SUCCESS [0.249s]
> [INFO] Flume NG Core ..................................... SUCCESS [1.771s]
> [INFO] Flume NG Sinks .................................... SUCCESS [0.048s]
> [INFO] Flume NG HDFS Sink ................................ SUCCESS [0.914s]
> [INFO] Flume NG IRC Sink ................................. SUCCESS [0.144s]
> [INFO] Flume NG Channels ................................. SUCCESS [0.067s]
> [INFO] Flume NG JDBC channel ............................. SUCCESS [0.210s]
> [INFO] Flume NG file-based channel ....................... SUCCESS [0.246s]
> [INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.127s]
> [INFO] Flume NG Node ..................................... SUCCESS [0.159s]
> [INFO] Flume NG Embedded Agent ........................... SUCCESS [0.414s]
> [INFO] Flume NG HBase Sink ............................... FAILURE [0.064s]
> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
> [INFO] Flume NG Kite Dataset Sink ........................ SKIPPED
> [INFO] Flume Sources ..................................... SKIPPED
> [INFO] Flume Scribe Source ............................... SKIPPED
> [INFO] Flume JMS Source .................................. SKIPPED
> [INFO] Flume Twitter Source .............................. SKIPPED
> [INFO] Flume legacy Sources .............................. SKIPPED
> [INFO] Flume legacy Avro source .......................... SKIPPED
> [INFO] Flume legacy Thrift Source ........................ SKIPPED
> [INFO] Flume NG Clients .................................. SKIPPED
> [INFO] Flume NG Log4j Appender ........................... SKIPPED
> [INFO] Flume NG Tools .................................... SKIPPED
> [INFO] Flume NG distribution ............................. SKIPPED
> [INFO] Flume NG Integration Tests ........................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 7.385s
> [INFO] Finished at: Sat Jul 26 22:52:42 HKT 2014
> [INFO] Final Memory: 41M/622M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not
> resolve dependencies for project
> org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: Failure to
> find org.apache.hbase:hbase:jar:0.98.3 in
> http://people.apache.org/~garyh/mvn/ was cached in the local repository,
> resolution will not be reattempted until the update interval of nexus has
> elapsed or updates are forced -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :flume-ng-hbase-sink
>
>
>
> On 26 Jul, 2014, at 7:28 pm, ac@hsk.hk
> <javascript:_e(%7B%7D,'cvml','ac@hsk.hk');> wrote:
>
> Hi,
>
> I am trying to compile and run unit test (flume 1.5.0) for Hadoop 2.4.0
> and HBase 0.98.3.
>
> I got "cannot find symbol: class MiniDFSCluster”, is it something wrong in
> pom.xml? please help!!
>
> Regards
> Arthur
>
>
>
>
>
>
> command: mvn clean test
>
> === log ===
> [ERROR] COMPILATION ERROR :
> [INFO] -------------------------------------------------------------
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29]
> cannot find symbol
> symbol : class MiniDFSCluster
> location: package org.apache.hadoop.hdfs
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17]
> cannot find symbol
> symbol : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39]
> cannot find symbol
> symbol : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18]
> cannot find symbol
> symbol : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18]
> cannot find symbol
> symbol : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18]
> cannot find symbol
> symbol : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18]
> cannot find symbol
> symbol : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [INFO] 7 errors
> [INFO] -------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Flume ...................................... SUCCESS [0.649s]
> [INFO] Flume NG SDK ...................................... SUCCESS
> [1:12.668s]
> [INFO] Flume NG Configuration ............................ SUCCESS [1.092s]
> [INFO] Flume NG Core ..................................... SUCCESS
> [6:52.046s]
> [INFO] Flume NG Sinks .................................... SUCCESS [0.095s]
> [INFO] Flume NG HDFS Sink ................................ FAILURE [1.990s]
> [INFO] Flume NG IRC Sink ................................. SKIPPED
> [INFO] Flume NG Channels ................................. SKIPPED
> [INFO] Flume NG JDBC channel ............................. SKIPPED
> [INFO] Flume NG file-based channel ....................... SKIPPED
> [INFO] Flume NG Spillable Memory channel ................. SKIPPED
> [INFO] Flume NG Node ..................................... SKIPPED
> [INFO] Flume NG Embedded Agent ........................... SKIPPED
> [INFO] Flume NG HBase Sink ............................... SKIPPED
> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
> [INFO] Flume Sources ..................................... SKIPPED
> [INFO] Flume Scribe Source ............................... SKIPPED
> [INFO] Flume JMS Source .................................. SKIPPED
> [INFO] Flume Twitter Source .............................. SKIPPED
> [INFO] Flume legacy Sources .............................. SKIPPED
> [INFO] Flume legacy Avro source .......................... SKIPPED
> [INFO] Flume legacy Thrift Source ........................ SKIPPED
> [INFO] Flume NG Clients .................................. SKIPPED
> [INFO] Flume NG Log4j Appender ........................... SKIPPED
> [INFO] Flume NG Tools .................................... SKIPPED
> [INFO] Flume NG distribution ............................. SKIPPED
> [INFO] Flume NG Integration Tests ........................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 8:09.120s
> [INFO] Finished at: Sat Jul 26 19:18:55 HKT 2014
> [INFO] Final Memory: 71M/455M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile
> (default-testCompile) on project flume-hdfs-sink: Compilation failure:
> Compilation failure:
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29]
> cannot find symbol
> [ERROR] symbol : class MiniDFSCluster
> [ERROR] location: package org.apache.hadoop.hdfs
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17]
> cannot find symbol
> [ERROR] symbol : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39]
> cannot find symbol
> [ERROR] symbol : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18]
> cannot find symbol
> [ERROR] symbol : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18]
> cannot find symbol
> [ERROR] symbol : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18]
> cannot find symbol
> [ERROR] symbol : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18]
> cannot find symbol
> [ERROR] symbol : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :flume-hdfs-sink
>
>
>
>
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by ac...@hsk.hk.
Hi Andrew and Hari,
Thank you!
At the moment, I can just ignore the warning, the compilation works.
Regards
Arthur
----- Original Message -----
From: Andrew Purtell <an...@gmail.com>
To: user@flume.apache.org
Cc: ac@hsk.hk
Sent: Mon, 28 Jul 2014 05:52:23 +0800 (HKT)
Subject: Re: Flume Compile 1.5.0 for HBase 0.98.3
Something built against HBase 0.98.2-hadoop2 will definitely work with any later release that has also been built against Hadoop 2. We just released 0.98.4 last week.
IIRC, setting the umask like that was needed for Hadoop 1 miniclusters. I haven't personally needed to set it when working with Hadoop 2 miniclusters. Sometimes I switch back to Hadoop 1 and always forget.
> On Jul 27, 2014, at 9:16 AM, Hari Shreedharan <hs...@cloudera.com> wrote:
>
> If you remove the -Dhbase.version and use the default one (0.98.2-hadoop2), then it should build fine (at least it builds fine for me). Flume built against hbase-98 should be able to write to hbase 0.98.3.
>
> Also, I remember a hadoop minicluster requirement that requires umask be set to 022 (not sure if that is required now).
>
>
>> On Sun, Jul 27, 2014 at 2:18 AM, ac@hsk.hk <ac...@hsk.hk> wrote:
>> Hi Hari,
>>
>> I have finally managed to compile it successfully, many thanks for your help!!
>>
>>
>> I edited pom.xml and deleted the following lines (around line 247), and stop all Hadoop and HBase
>> ### DELETED
>> <dependency>
>> <groupId>org.apache.hadoop</groupId>
>> <artifactId>hadoop-minicluster</artifactId>
>> <version>${hadoop.version}</version>
>> <scope>test</scope>
>> </dependency>
>> ### DELETED
>>
>> By the way, I found some warning at the beginning of the compilation
>>
>> [WARNING] Some problems were encountered while building the effective model for org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0.1
>> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate declaration of version (?) @ line 86, column 17
>>
>> Is there a way to fix this warning too? How to find the full path and file name about "line 86 column 17"?
>>
>> Regards
>> Arthur
>>
>>
>>
>>
>>
>>
>> [INFO] Scanning for projects...
>> [WARNING]
>> [WARNING] Some problems were encountered while building the effective model for org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0.1
>> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate declaration of version (?) @ line 86, column 17
>> [WARNING]
>> [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
>> [WARNING]
>> [WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
>> [WARNING]
>> …
>> INFO] Apache Flume ...................................... SUCCESS [1.297s]
>> [INFO] Flume NG SDK ...................................... SUCCESS [2.772s]
>> [INFO] Flume NG Configuration ............................ SUCCESS [0.874s]
>> [INFO] Flume NG Core ..................................... SUCCESS [4.033s]
>> [INFO] Flume NG Sinks .................................... SUCCESS [0.106s]
>> [INFO] Flume NG HDFS Sink ................................ SUCCESS [1.946s]
>> [INFO] Flume NG IRC Sink ................................. SUCCESS [0.595s]
>> [INFO] Flume NG Channels ................................. SUCCESS [0.053s]
>> [INFO] Flume NG JDBC channel ............................. SUCCESS [0.892s]
>> [INFO] Flume NG file-based channel ....................... SUCCESS [2.439s]
>> [INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.721s]
>> [INFO] Flume NG Node ..................................... SUCCESS [1.545s]
>> [INFO] Flume NG Embedded Agent ........................... SUCCESS [0.722s]
>> [INFO] Flume NG HBase Sink ............................... SUCCESS [1.893s]
>> [INFO] Flume NG ElasticSearch Sink ....................... SUCCESS [1.447s]
>> [INFO] Flume NG Morphline Solr Sink ...................... SUCCESS [1:13.893s]
>> [INFO] Flume NG Kite Dataset Sink ........................ SUCCESS [8.526s]
>> [INFO] Flume Sources ..................................... SUCCESS [0.020s]
>> [INFO] Flume Scribe Source ............................... SUCCESS [0.485s]
>> [INFO] Flume JMS Source .................................. SUCCESS [0.994s]
>> [INFO] Flume Twitter Source .............................. SUCCESS [0.591s]
>> [INFO] Flume legacy Sources .............................. SUCCESS [0.017s]
>> [INFO] Flume legacy Avro source .......................... SUCCESS [0.619s]
>> [INFO] Flume legacy Thrift Source ........................ SUCCESS [0.956s]
>> [INFO] Flume NG Clients .................................. SUCCESS [0.020s]
>> [INFO] Flume NG Log4j Appender ........................... SUCCESS [1:10.438s]
>> [INFO] Flume NG Tools .................................... SUCCESS [1.188s]
>> [INFO] Flume NG distribution ............................. SUCCESS [9.275s]
>> [INFO] Flume NG Integration Tests ........................ SUCCESS [15.610s]
>> [INFO] ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Total time: 3:24.410s
>> [INFO] Finished at: Sun Jul 27 15:30:11 HKT 2014
>> [INFO] Final Memory: 61M/6296M
>> [INFO] ------------------------------------------------------------------------
>
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by Andrew Purtell <an...@gmail.com>.
Something built against HBase 0.98.2-hadoop2 will definitely work with any later release that has also been built against Hadoop 2. We just released 0.98.4 last week.
IIRC, setting the umask like that was needed for Hadoop 1 miniclusters. I haven't personally needed to set it when working with Hadoop 2 miniclusters. Sometimes I switch back to Hadoop 1 and always forget.
> On Jul 27, 2014, at 9:16 AM, Hari Shreedharan <hs...@cloudera.com> wrote:
>
> If you remove the -Dhbase.version and use the default one (0.98.2-hadoop2), then it should build fine (at least it builds fine for me). Flume built against hbase-98 should be able to write to hbase 0.98.3.
>
> Also, I remember a hadoop minicluster requirement that requires umask be set to 022 (not sure if that is required now).
>
>
>> On Sun, Jul 27, 2014 at 2:18 AM, ac@hsk.hk <ac...@hsk.hk> wrote:
>> Hi Hari,
>>
>> I have finally managed to compile it successfully, many thanks for your help!!
>>
>>
>> I edited pom.xml and deleted the following lines (around line 247), and stop all Hadoop and HBase
>> ### DELETED
>> <dependency>
>> <groupId>org.apache.hadoop</groupId>
>> <artifactId>hadoop-minicluster</artifactId>
>> <version>${hadoop.version}</version>
>> <scope>test</scope>
>> </dependency>
>> ### DELETED
>>
>> By the way, I found some warning at the beginning of the compilation
>>
>> [WARNING] Some problems were encountered while building the effective model for org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0.1
>> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate declaration of version (?) @ line 86, column 17
>>
>> Is there a way to fix this warning too? How to find the full path and file name about "line 86 column 17"?
>>
>> Regards
>> Arthur
>>
>>
>>
>>
>>
>>
>> [INFO] Scanning for projects...
>> [WARNING]
>> [WARNING] Some problems were encountered while building the effective model for org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0.1
>> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate declaration of version (?) @ line 86, column 17
>> [WARNING]
>> [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
>> [WARNING]
>> [WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
>> [WARNING]
>> …
>> INFO] Apache Flume ...................................... SUCCESS [1.297s]
>> [INFO] Flume NG SDK ...................................... SUCCESS [2.772s]
>> [INFO] Flume NG Configuration ............................ SUCCESS [0.874s]
>> [INFO] Flume NG Core ..................................... SUCCESS [4.033s]
>> [INFO] Flume NG Sinks .................................... SUCCESS [0.106s]
>> [INFO] Flume NG HDFS Sink ................................ SUCCESS [1.946s]
>> [INFO] Flume NG IRC Sink ................................. SUCCESS [0.595s]
>> [INFO] Flume NG Channels ................................. SUCCESS [0.053s]
>> [INFO] Flume NG JDBC channel ............................. SUCCESS [0.892s]
>> [INFO] Flume NG file-based channel ....................... SUCCESS [2.439s]
>> [INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.721s]
>> [INFO] Flume NG Node ..................................... SUCCESS [1.545s]
>> [INFO] Flume NG Embedded Agent ........................... SUCCESS [0.722s]
>> [INFO] Flume NG HBase Sink ............................... SUCCESS [1.893s]
>> [INFO] Flume NG ElasticSearch Sink ....................... SUCCESS [1.447s]
>> [INFO] Flume NG Morphline Solr Sink ...................... SUCCESS [1:13.893s]
>> [INFO] Flume NG Kite Dataset Sink ........................ SUCCESS [8.526s]
>> [INFO] Flume Sources ..................................... SUCCESS [0.020s]
>> [INFO] Flume Scribe Source ............................... SUCCESS [0.485s]
>> [INFO] Flume JMS Source .................................. SUCCESS [0.994s]
>> [INFO] Flume Twitter Source .............................. SUCCESS [0.591s]
>> [INFO] Flume legacy Sources .............................. SUCCESS [0.017s]
>> [INFO] Flume legacy Avro source .......................... SUCCESS [0.619s]
>> [INFO] Flume legacy Thrift Source ........................ SUCCESS [0.956s]
>> [INFO] Flume NG Clients .................................. SUCCESS [0.020s]
>> [INFO] Flume NG Log4j Appender ........................... SUCCESS [1:10.438s]
>> [INFO] Flume NG Tools .................................... SUCCESS [1.188s]
>> [INFO] Flume NG distribution ............................. SUCCESS [9.275s]
>> [INFO] Flume NG Integration Tests ........................ SUCCESS [15.610s]
>> [INFO] ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Total time: 3:24.410s
>> [INFO] Finished at: Sun Jul 27 15:30:11 HKT 2014
>> [INFO] Final Memory: 61M/6296M
>> [INFO] ------------------------------------------------------------------------
>
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by Hari Shreedharan <hs...@cloudera.com>.
If you remove the -Dhbase.version and use the default one (0.98.2-hadoop2),
then it should build fine (at least it builds fine for me). Flume built
against hbase-98 should be able to write to hbase 0.98.3.
Also, I remember a hadoop minicluster requirement that requires umask be
set to 022 (not sure if that is required now).
On Sun, Jul 27, 2014 at 2:18 AM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi Hari,
>
> I have finally managed to compile it successfully, many thanks for your
> help!!
>
>
> I edited pom.xml and deleted the following lines (around line 247), and
> stop all Hadoop and HBase
> ### DELETED
> <dependency>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>hadoop-minicluster</artifactId>
> <version>${hadoop.version}</version>
> <scope>test</scope>
> </dependency>
> ### DELETED
>
> By the way, I found some warning at the beginning of the compilation
>
> [WARNING] Some problems were encountered while building the effective
> model for
> org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0.1
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)'
> must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate
> declaration of version (?) @ line 86, column 17
>
> Is there a way to fix this warning too? How to find the full path and
> file name about "line 86 column 17"?
>
> Regards
> Arthur
>
>
>
>
>
>
> [INFO] Scanning for projects...
> [WARNING]
> [WARNING] Some problems were encountered while building the effective
> model for
> org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0.1
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)'
> must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate
> declaration of version (?) @ line 86, column 17
> [WARNING]
> [WARNING] It is highly recommended to fix these problems because they
> threaten the stability of your build.
> [WARNING]
> [WARNING] For this reason, future Maven versions might no longer support
> building such malformed projects.
> [WARNING]
> …
> INFO] Apache Flume ...................................... SUCCESS [1.297s]
> [INFO] Flume NG SDK ...................................... SUCCESS [2.772s]
> [INFO] Flume NG Configuration ............................ SUCCESS [0.874s]
> [INFO] Flume NG Core ..................................... SUCCESS [4.033s]
> [INFO] Flume NG Sinks .................................... SUCCESS [0.106s]
> [INFO] Flume NG HDFS Sink ................................ SUCCESS [1.946s]
> [INFO] Flume NG IRC Sink ................................. SUCCESS [0.595s]
> [INFO] Flume NG Channels ................................. SUCCESS [0.053s]
> [INFO] Flume NG JDBC channel ............................. SUCCESS [0.892s]
> [INFO] Flume NG file-based channel ....................... SUCCESS [2.439s]
> [INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.721s]
> [INFO] Flume NG Node ..................................... SUCCESS [1.545s]
> [INFO] Flume NG Embedded Agent ........................... SUCCESS [0.722s]
> [INFO] Flume NG HBase Sink ............................... SUCCESS [1.893s]
> [INFO] Flume NG ElasticSearch Sink ....................... SUCCESS [1.447s]
> [INFO] Flume NG Morphline Solr Sink ...................... SUCCESS
> [1:13.893s]
> [INFO] Flume NG Kite Dataset Sink ........................ SUCCESS [8.526s]
> [INFO] Flume Sources ..................................... SUCCESS [0.020s]
> [INFO] Flume Scribe Source ............................... SUCCESS [0.485s]
> [INFO] Flume JMS Source .................................. SUCCESS [0.994s]
> [INFO] Flume Twitter Source .............................. SUCCESS [0.591s]
> [INFO] Flume legacy Sources .............................. SUCCESS [0.017s]
> [INFO] Flume legacy Avro source .......................... SUCCESS [0.619s]
> [INFO] Flume legacy Thrift Source ........................ SUCCESS [0.956s]
> [INFO] Flume NG Clients .................................. SUCCESS [0.020s]
> [INFO] Flume NG Log4j Appender ........................... SUCCESS
> [1:10.438s]
> [INFO] Flume NG Tools .................................... SUCCESS [1.188s]
> [INFO] Flume NG distribution ............................. SUCCESS [9.275s]
> [INFO] Flume NG Integration Tests ........................ SUCCESS
> [15.610s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 3:24.410s
> [INFO] Finished at: Sun Jul 27 15:30:11 HKT 2014
> [INFO] Final Memory: 61M/6296M
> [INFO]
> ------------------------------------------------------------------------
>
>
>
>
>
>
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi Hari,
I have finally managed to compile it successfully, many thanks for your help!!
I edited pom.xml and deleted the following lines (around line 247), and stop all Hadoop and HBase
### DELETED
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-minicluster</artifactId>
<version>${hadoop.version}</version>
<scope>test</scope>
</dependency>
### DELETED
By the way, I found some warning at the beginning of the compilation
[WARNING] Some problems were encountered while building the effective model for org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0.1
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate declaration of version (?) @ line 86, column 17
Is there a way to fix this warning too? How to find the full path and file name about "line 86 column 17"?
Regards
Arthur
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0.1
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate declaration of version (?) @ line 86, column 17
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
…
INFO] Apache Flume ...................................... SUCCESS [1.297s]
[INFO] Flume NG SDK ...................................... SUCCESS [2.772s]
[INFO] Flume NG Configuration ............................ SUCCESS [0.874s]
[INFO] Flume NG Core ..................................... SUCCESS [4.033s]
[INFO] Flume NG Sinks .................................... SUCCESS [0.106s]
[INFO] Flume NG HDFS Sink ................................ SUCCESS [1.946s]
[INFO] Flume NG IRC Sink ................................. SUCCESS [0.595s]
[INFO] Flume NG Channels ................................. SUCCESS [0.053s]
[INFO] Flume NG JDBC channel ............................. SUCCESS [0.892s]
[INFO] Flume NG file-based channel ....................... SUCCESS [2.439s]
[INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.721s]
[INFO] Flume NG Node ..................................... SUCCESS [1.545s]
[INFO] Flume NG Embedded Agent ........................... SUCCESS [0.722s]
[INFO] Flume NG HBase Sink ............................... SUCCESS [1.893s]
[INFO] Flume NG ElasticSearch Sink ....................... SUCCESS [1.447s]
[INFO] Flume NG Morphline Solr Sink ...................... SUCCESS [1:13.893s]
[INFO] Flume NG Kite Dataset Sink ........................ SUCCESS [8.526s]
[INFO] Flume Sources ..................................... SUCCESS [0.020s]
[INFO] Flume Scribe Source ............................... SUCCESS [0.485s]
[INFO] Flume JMS Source .................................. SUCCESS [0.994s]
[INFO] Flume Twitter Source .............................. SUCCESS [0.591s]
[INFO] Flume legacy Sources .............................. SUCCESS [0.017s]
[INFO] Flume legacy Avro source .......................... SUCCESS [0.619s]
[INFO] Flume legacy Thrift Source ........................ SUCCESS [0.956s]
[INFO] Flume NG Clients .................................. SUCCESS [0.020s]
[INFO] Flume NG Log4j Appender ........................... SUCCESS [1:10.438s]
[INFO] Flume NG Tools .................................... SUCCESS [1.188s]
[INFO] Flume NG distribution ............................. SUCCESS [9.275s]
[INFO] Flume NG Integration Tests ........................ SUCCESS [15.610s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3:24.410s
[INFO] Finished at: Sun Jul 27 15:30:11 HKT 2014
[INFO] Final Memory: 61M/6296M
[INFO] ------------------------------------------------------------------------
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
Thanks!
I downloaded 1.5.0.1, if I add -DskipTests, I compiled it successfully.
However, if run the following (i.e. with tests) , I still got error.
Many thanks.
Regards
Arthur
mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3-hadoop2
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ flume-ng-embedded-agent ---
[INFO] Installing /home/hduser/apache-flume-1.5.0.1-src/flume-ng-embedded-agent/target/flume-ng-embedded-agent-1.5.0.1.jar to /root/.m2/repository/org/apache/flume/flume-ng-embedded-agent/1.5.0.1/flume-ng-embedded-agent-1.5.0.1.jar
[INFO] Installing /home/hduser/apache-flume-1.5.0.1-src/flume-ng-embedded-agent/pom.xml to /root/.m2/repository/org/apache/flume/flume-ng-embedded-agent/1.5.0.1/flume-ng-embedded-agent-1.5.0.1.pom
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Flume NG HBase Sink 1.5.0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ flume-ng-hbase-sink ---
[INFO] Deleting /home/hduser/apache-flume-1.5.0.1-src/flume-ng-sinks/flume-ng-hbase-sink/target
[INFO]
[INFO] --- maven-remote-resources-plugin:1.1:process (default) @ flume-ng-hbase-sink ---
[INFO]
[INFO] --- maven-resources-plugin:2.4.3:resources (default-resources) @ flume-ng-hbase-sink ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/hduser/apache-flume-1.5.0.1-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ flume-ng-hbase-sink ---
[INFO] Compiling 11 source files to /home/hduser/apache-flume-1.5.0.1-src/flume-ng-sinks/flume-ng-hbase-sink/target/classes
[INFO]
[INFO] --- maven-resources-plugin:2.4.3:testResources (default-testResources) @ flume-ng-hbase-sink ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/hduser/apache-flume-1.5.0.1-src/flume-ng-sinks/flume-ng-hbase-sink/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ flume-ng-hbase-sink ---
[INFO] Compiling 7 source files to /home/hduser/apache-flume-1.5.0.1-src/flume-ng-sinks/flume-ng-hbase-sink/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.12.3:test (default-test) @ flume-ng-hbase-sink ---
[INFO] Surefire report directory: /home/hduser/apache-flume-1.5.0.1-src/flume-ng-sinks/flume-ng-hbase-sink/target/surefire-reports
-------------------------------------------------------
T E S T S
-------------------------------------------------------
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.flume.sink.hbase.TestAsyncHBaseSink
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.333 sec <<< FAILURE!
org.apache.flume.sink.hbase.TestAsyncHBaseSink Time elapsed: 35333 sec <<< ERROR!
java.io.IOException: Shutting down
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:231)
at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:93)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:890)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:854)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:771)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:742)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:711)
at org.apache.flume.sink.hbase.TestAsyncHBaseSink.setUp(TestAsyncHBaseSink.java:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:27)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
Caused by: java.lang.RuntimeException: Master not active after 30 seconds
at org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:190)
at org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:425)
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:224)
... 29 more
Running org.apache.flume.sink.hbase.TestRegexHbaseEventSerializer
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.307 sec
Running org.apache.flume.sink.hbase.TestHBaseSinkCreation
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.174 sec
Running org.apache.flume.sink.hbase.TestHBaseSink
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 33.782 sec <<< FAILURE!
org.apache.flume.sink.hbase.TestHBaseSink Time elapsed: 33781 sec <<< ERROR!
java.io.IOException: Shutting down
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:231)
at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:93)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:890)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:854)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:771)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:742)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:711)
at org.apache.flume.sink.hbase.TestHBaseSink.setUpOnce(TestHBaseSink.java:81)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:27)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
Caused by: java.lang.RuntimeException: Master not active after 30 seconds
at org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:190)
at org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:425)
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:224)
... 29 more
Results :
Tests in error:
org.apache.flume.sink.hbase.TestAsyncHBaseSink: Shutting down
org.apache.flume.sink.hbase.TestHBaseSink: Shutting down
Tests run: 8, Failures: 0, Errors: 2, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Flume ...................................... SUCCESS [2.018s]
[INFO] Flume NG SDK ...................................... SUCCESS [1:13.040s]
[INFO] Flume NG Configuration ............................ SUCCESS [1.213s]
[INFO] Flume NG Core ..................................... SUCCESS [4:48.152s]
[INFO] Flume NG Sinks .................................... SUCCESS [0.053s]
[INFO] Flume NG HDFS Sink ................................ SUCCESS [4:37.424s]
[INFO] Flume NG IRC Sink ................................. SUCCESS [1.214s]
[INFO] Flume NG Channels ................................. SUCCESS [0.045s]
[INFO] Flume NG JDBC channel ............................. SUCCESS [2:17.684s]
[INFO] Flume NG file-based channel ....................... SUCCESS [10:23.760s]
[INFO] Flume NG Spillable Memory channel ................. SUCCESS [4:43.061s]
[INFO] Flume NG Node ..................................... SUCCESS [24.352s]
[INFO] Flume NG Embedded Agent ........................... SUCCESS [11.610s]
[INFO] Flume NG HBase Sink ............................... FAILURE [1:13.813s]
[INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
[INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
[INFO] Flume NG Kite Dataset Sink ........................ SKIPPED
[INFO] Flume Sources ..................................... SKIPPED
[INFO] Flume Scribe Source ............................... SKIPPED
[INFO] Flume JMS Source .................................. SKIPPED
[INFO] Flume Twitter Source .............................. SKIPPED
[INFO] Flume legacy Sources .............................. SKIPPED
[INFO] Flume legacy Avro source .......................... SKIPPED
[INFO] Flume legacy Thrift Source ........................ SKIPPED
[INFO] Flume NG Clients .................................. SKIPPED
[INFO] Flume NG Log4j Appender ........................... SKIPPED
[INFO] Flume NG Tools .................................... SKIPPED
[INFO] Flume NG distribution ............................. SKIPPED
[INFO] Flume NG Integration Tests ........................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 29:58.146s
[INFO] Finished at: Sun Jul 27 16:04:02 HKT 2014
[INFO] Final Memory: 70M/556M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.3:test (default-test) on project flume-ng-hbase-sink: There are test failures.
[ERROR]
[ERROR] Please refer to /home/hduser/apache-flume-1.5.0.1-src/flume-ng-sinks/flume-ng-hbase-sink/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :flume-ng-hbase-sink
Detail error log:
tail flume-ng-sinks/flume-ng-hbase-sink/target/surefire-reports/org.apache.flume.sink.hbase.TestHBaseSink.txt -n 1000
-------------------------------------------------------------------------------
Test set: org.apache.flume.sink.hbase.TestHBaseSink
-------------------------------------------------------------------------------
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 33.782 sec <<< FAILURE!
org.apache.flume.sink.hbase.TestHBaseSink Time elapsed: 33781 sec <<< ERROR!
java.io.IOException: Shutting down
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:231)
at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:93)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:890)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:854)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:771)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:742)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:711)
at org.apache.flume.sink.hbase.TestHBaseSink.setUpOnce(TestHBaseSink.java:81)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:27)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
Caused by: java.lang.RuntimeException: Master not active after 30 seconds
at org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:190)
at org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:425)
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:224)
... 29 more
On 27 Jul, 2014, at 9:26 am, Hari Shreedharan <hs...@cloudera.com> wrote:
> Looks like you are trying to build flume-1.5.0. To build with hbase-98 support, you need to either checkout trunk branch or the release-1.5.0.1 tag (that release was specifically meant to add hbase-98 support).
>
> Hari
>
> On Sat, Jul 26, 2014 at 5:05 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> Tried:
>
> mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3
> [INFO] Scanning for projects...
> [ERROR] The build could not read 3 projects -> [Help 1]
> [ERROR]
> [ERROR] The project org.apache.flume.flume-ng-sinks:flume-hdfs-sink:1.5.0 (flume-ng-sinks/flume-hdfs-sink/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 89, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 87, column 17
> [ERROR]
> [ERROR] The project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:1.5.0 (flume-ng-sinks/flume-ng-hbase-sink/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 96, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 94, column 17
> [ERROR]
> [ERROR] The project org.apache.flume:flume-ng-tests:1.5.0 (flume-ng-tests/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 60, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 58, column 17
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>
>
>
> Are there something wrong in default pom.xml files?
>
> flume-ng-sinks/flume-hdfs-sink/pom.xml @ line 89
> <dependency>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>${hadoop.common.artifact.id}</artifactId>
> <optional>true</optional>
> </dependency>
>
> flume-ng-sinks/flume-ng-hbase-sink/pom.xml @ line 96,
> <dependency>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>${hadoop.common.artifact.id}</artifactId>
> <optional>true</optional>
> </dependency>
>
> flume-ng-tests/pom.xml @ line 58
> <dependency>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>${hadoop.common.artifact.id}</artifactId>
> <optional>true</optional>
> </dependency>
>
>
> Many thanks!
> Arthur
>
>
>
>
>
>
>
>
> Also tried:
> mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3-hadoop2
> [INFO] Scanning for projects...
> [ERROR] The build could not read 3 projects -> [Help 1]
> [ERROR]
> [ERROR] The project org.apache.flume.flume-ng-sinks:flume-hdfs-sink:1.5.0 (flume-ng-sinks/flume-hdfs-sink/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 89, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 87, column 17
> [ERROR]
> [ERROR] The project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:1.5.0 (flume-ng-sinks/flume-ng-hbase-sink/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 96, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 94, column 17
> [ERROR]
> [ERROR] The project org.apache.flume:flume-ng-tests:1.5.0 (flume-ng-tests/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 60, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 58, column 17
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>
>
>
>
>
>
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by Hari Shreedharan <hs...@cloudera.com>.
Looks like you are trying to build flume-1.5.0. To build with hbase-98
support, you need to either checkout trunk branch or the release-1.5.0.1
tag (that release was specifically meant to add hbase-98 support).
Hari
On Sat, Jul 26, 2014 at 5:05 PM, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> Tried:
>
> mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3
> [INFO] Scanning for projects...
> [ERROR] The build could not read 3 projects -> [Help 1]
> [ERROR]
> [ERROR] The project
> org.apache.flume.flume-ng-sinks:flume-hdfs-sink:1.5.0 (
> flume-ng-sinks/flume-hdfs-sink/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}'
> does not match a valid id pattern. @ line 89, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar is missing. @ line 87, column 17
> [ERROR]
> [ERROR] The project
> org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:1.5.0 (
> flume-ng-sinks/flume-ng-hbase-sink/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}'
> does not match a valid id pattern. @ line 96, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar is missing. @ line 94, column 17
> [ERROR]
> [ERROR] The project org.apache.flume:flume-ng-tests:1.5.0 (
> flume-ng-tests/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}'
> does not match a valid id pattern. @ line 60, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar is missing. @ line 58, column 17
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>
>
>
> Are there something wrong in default pom.xml files?
>
> flume-ng-sinks/flume-hdfs-sink/pom.xml @ line 89
> <dependency>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>${hadoop.common.artifact.id}</artifactId>
> <optional>true</optional>
> </dependency>
>
> flume-ng-sinks/flume-ng-hbase-sink/pom.xml @ line 96,
> <dependency>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>${hadoop.common.artifact.id}</artifactId>
> <optional>true</optional>
> </dependency>
>
> flume-ng-tests/pom.xml @ line 58
> <dependency>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>${hadoop.common.artifact.id}</artifactId>
> <optional>true</optional>
> </dependency>
>
>
> Many thanks!
> Arthur
>
>
>
>
>
>
>
>
> Also tried:
> mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3-hadoop2
> [INFO] Scanning for projects...
> [ERROR] The build could not read 3 projects -> [Help 1]
> [ERROR]
> [ERROR] The project
> org.apache.flume.flume-ng-sinks:flume-hdfs-sink:1.5.0
> (flume-ng-sinks/flume-hdfs-sink/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}'
> does not match a valid id pattern. @ line 89, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar is missing. @ line 87, column 17
> [ERROR]
> [ERROR] The project
> org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:1.5.0
> (flume-ng-sinks/flume-ng-hbase-sink/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}'
> does not match a valid id pattern. @ line 96, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar is missing. @ line 94, column 17
> [ERROR]
> [ERROR] The project org.apache.flume:flume-ng-tests:1.5.0
> (flume-ng-tests/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}'
> does not match a valid id pattern. @ line 60, column 19
> [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${
> hadoop.common.artifact.id}:jar is missing. @ line 58, column 17
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>
>
>
>
>
>
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
Tried:
mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3
[INFO] Scanning for projects...
[ERROR] The build could not read 3 projects -> [Help 1]
[ERROR]
[ERROR] The project org.apache.flume.flume-ng-sinks:flume-hdfs-sink:1.5.0 (flume-ng-sinks/flume-hdfs-sink/pom.xml) has 2 errors
[ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 89, column 19
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 87, column 17
[ERROR]
[ERROR] The project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:1.5.0 (flume-ng-sinks/flume-ng-hbase-sink/pom.xml) has 2 errors
[ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 96, column 19
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 94, column 17
[ERROR]
[ERROR] The project org.apache.flume:flume-ng-tests:1.5.0 (flume-ng-tests/pom.xml) has 2 errors
[ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 60, column 19
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 58, column 17
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
Are there something wrong in default pom.xml files?
flume-ng-sinks/flume-hdfs-sink/pom.xml @ line 89
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>${hadoop.common.artifact.id}</artifactId>
<optional>true</optional>
</dependency>
flume-ng-sinks/flume-ng-hbase-sink/pom.xml @ line 96,
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>${hadoop.common.artifact.id}</artifactId>
<optional>true</optional>
</dependency>
flume-ng-tests/pom.xml @ line 58
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>${hadoop.common.artifact.id}</artifactId>
<optional>true</optional>
</dependency>
Many thanks!
Arthur
Also tried:
mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3-hadoop2
[INFO] Scanning for projects...
[ERROR] The build could not read 3 projects -> [Help 1]
[ERROR]
[ERROR] The project org.apache.flume.flume-ng-sinks:flume-hdfs-sink:1.5.0 (flume-ng-sinks/flume-hdfs-sink/pom.xml) has 2 errors
[ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 89, column 19
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 87, column 17
[ERROR]
[ERROR] The project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:1.5.0 (flume-ng-sinks/flume-ng-hbase-sink/pom.xml) has 2 errors
[ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 96, column 19
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 94, column 17
[ERROR]
[ERROR] The project org.apache.flume:flume-ng-tests:1.5.0 (flume-ng-tests/pom.xml) has 2 errors
[ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @ line 60, column 19
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @ line 58, column 17
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
Also tried but with error, can you please advise what would be the correct names for -Dhadoop.profile and -Dhbase.version ?
Many thanks.
Arthur
I tried:
mvn clean install -Phadoop-2 -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3-hadoop2 -rf :flume-ng-hbase-sink -e
[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.flume.flume-ng-sinks:flume-ng-elasticsearch-sink:jar:1.5.0
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.httpcomponents:httpclient:jar -> duplicate declaration of version (?) @ line 86, column 17
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Flume NG HBase Sink
[INFO] Flume NG ElasticSearch Sink
[INFO] Flume NG Morphline Solr Sink
[INFO] Flume NG Kite Dataset Sink
[INFO] Flume Sources
[INFO] Flume Scribe Source
[INFO] Flume JMS Source
[INFO] Flume Twitter Source
[INFO] Flume legacy Sources
[INFO] Flume legacy Avro source
[INFO] Flume legacy Thrift Source
[INFO] Flume NG Clients
[INFO] Flume NG Log4j Appender
[INFO] Flume NG Tools
[INFO] Flume NG distribution
[INFO] Flume NG Integration Tests
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Flume NG HBase Sink 1.5.0
[INFO] ------------------------------------------------------------------------
Downloading: http://people.apache.org/~garyh/mvn/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2.pom
Downloading: http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2.pom
Downloaded: http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2.pom (77 KB at 54.6 KB/sec)
Downloading: http://people.apache.org/~garyh/mvn/org/apache/apache/12/apache-12.pom
Downloading: http://repo1.maven.org/maven2/org/apache/apache/12/apache-12.pom
Downloaded: http://repo1.maven.org/maven2/org/apache/apache/12/apache-12.pom (16 KB at 23.4 KB/sec)
Downloading: http://people.apache.org/~garyh/mvn/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.pom
Downloading: http://repo1.maven.org/maven2/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.pom
Downloaded: http://repo1.maven.org/maven2/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.pom (7 KB at 12.6 KB/sec)
[WARNING] The POM for org.apache.flume.flume-ng-sinks:flume-hdfs-sink:jar:1.5.0 is invalid, transitive dependencies (if any) will not be available: 2 problems were encountered while building the effective model for org.apache.flume.flume-ng-sinks:flume-hdfs-sink:1.5.0
[ERROR] 'dependencies.dependency.artifactId' for org.apache.hadoop:${hadoop.common.artifact.id}:jar with value '${hadoop.common.artifact.id}' does not match a valid id pattern. @
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:${hadoop.common.artifact.id}:jar is missing. @
Downloading: http://people.apache.org/~garyh/mvn/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2.jar
Downloading: http://people.apache.org/~garyh/mvn/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar
Downloading: http://people.apache.org/~garyh/mvn/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2-tests.jar
Downloading: http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2.jar
Downloading: http://repo1.maven.org/maven2/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar
Downloading: http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2-tests.jar
Downloaded: http://repo1.maven.org/maven2/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar (15 KB at 17.8 KB/sec)
Downloading: http://repository.jboss.org/nexus/content/groups/public/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2.jar
Downloading: http://repository.jboss.org/nexus/content/groups/public/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2-tests.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Flume NG HBase Sink ............................... FAILURE [6.403s]
[INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
[INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
[INFO] Flume NG Kite Dataset Sink ........................ SKIPPED
[INFO] Flume Sources ..................................... SKIPPED
[INFO] Flume Scribe Source ............................... SKIPPED
[INFO] Flume JMS Source .................................. SKIPPED
[INFO] Flume Twitter Source .............................. SKIPPED
[INFO] Flume legacy Sources .............................. SKIPPED
[INFO] Flume legacy Avro source .......................... SKIPPED
[INFO] Flume legacy Thrift Source ........................ SKIPPED
[INFO] Flume NG Clients .................................. SKIPPED
[INFO] Flume NG Log4j Appender ........................... SKIPPED
[INFO] Flume NG Tools .................................... SKIPPED
[INFO] Flume NG distribution ............................. SKIPPED
[INFO] Flume NG Integration Tests ........................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.831s
[INFO] Finished at: Sun Jul 27 07:41:34 HKT 2014
[INFO] Final Memory: 15M/479M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3-hadoop2, org.apache.hbase:hbase:jar:tests:0.98.3-hadoop2: Failure to find org.apache.hbase:hbase:jar:0.98.3-hadoop2 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3-hadoop2, org.apache.hbase:hbase:jar:tests:0.98.3-hadoop2: Failure to find org.apache.hbase:hbase:jar:0.98.3-hadoop2 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:220)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:127)
at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:257)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:200)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:317)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:152)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:555)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.project.DependencyResolutionException: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3-hadoop2, org.apache.hbase:hbase:jar:tests:0.98.3-hadoop2: Failure to find org.apache.hbase:hbase:jar:0.98.3-hadoop2 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:198)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:195)
... 22 more
Caused by: org.eclipse.aether.resolution.DependencyResolutionException: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3-hadoop2, org.apache.hbase:hbase:jar:tests:0.98.3-hadoop2: Failure to find org.apache.hbase:hbase:jar:0.98.3-hadoop2 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:384)
at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:192)
... 23 more
Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3-hadoop2, org.apache.hbase:hbase:jar:tests:0.98.3-hadoop2: Failure to find org.apache.hbase:hbase:jar:0.98.3-hadoop2 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:459)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:262)
at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:367)
... 24 more
Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Failure to find org.apache.hbase:hbase:jar:0.98.3-hadoop2 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.eclipse.aether.internal.impl.DefaultUpdateCheckManager.newException(DefaultUpdateCheckManager.java:232)
at org.eclipse.aether.internal.impl.DefaultUpdateCheckManager.checkArtifact(DefaultUpdateCheckManager.java:206)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.gatherDownloads(DefaultArtifactResolver.java:599)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.performDownloads(DefaultArtifactResolver.java:518)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:436)
... 26 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
On 27 Jul, 2014, at 5:41 am, Hari Shreedharan <hs...@cloudera.com> wrote:
> Run mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=<specific version of hbase 98>.
>
>
>
> On Saturday, July 26, 2014, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> I have tried several times about compiling Flume 1.5.0 for HBase 0.98.3, with some progress but still failed.
>
> Can someone advise what the proper settings in pom.xml is? or which repository contains HBase 0.98.3 jar files? or any ideas to fix this?
>
> Many thanks!!
> Arthur
>
>
>
> [INFO] ------------------------------------------------------------------------
> [INFO] Building Flume NG HBase Sink 1.5.0
> [INFO] ------------------------------------------------------------------------
> [WARNING] The POM for org.apache.hbase:hbase:jar:0.98.3 is missing, no dependency information available
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Flume ...................................... SUCCESS [0.873s]
> [INFO] Flume NG SDK ...................................... SUCCESS [1.681s]
> [INFO] Flume NG Configuration ............................ SUCCESS [0.249s]
> [INFO] Flume NG Core ..................................... SUCCESS [1.771s]
> [INFO] Flume NG Sinks .................................... SUCCESS [0.048s]
> [INFO] Flume NG HDFS Sink ................................ SUCCESS [0.914s]
> [INFO] Flume NG IRC Sink ................................. SUCCESS [0.144s]
> [INFO] Flume NG Channels ................................. SUCCESS [0.067s]
> [INFO] Flume NG JDBC channel ............................. SUCCESS [0.210s]
> [INFO] Flume NG file-based channel ....................... SUCCESS [0.246s]
> [INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.127s]
> [INFO] Flume NG Node ..................................... SUCCESS [0.159s]
> [INFO] Flume NG Embedded Agent ........................... SUCCESS [0.414s]
> [INFO] Flume NG HBase Sink ............................... FAILURE [0.064s]
> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
> [INFO] Flume NG Kite Dataset Sink ........................ SKIPPED
> [INFO] Flume Sources ..................................... SKIPPED
> [INFO] Flume Scribe Source ............................... SKIPPED
> [INFO] Flume JMS Source .................................. SKIPPED
> [INFO] Flume Twitter Source .............................. SKIPPED
> [INFO] Flume legacy Sources .............................. SKIPPED
> [INFO] Flume legacy Avro source .......................... SKIPPED
> [INFO] Flume legacy Thrift Source ........................ SKIPPED
> [INFO] Flume NG Clients .................................. SKIPPED
> [INFO] Flume NG Log4j Appender ........................... SKIPPED
> [INFO] Flume NG Tools .................................... SKIPPED
> [INFO] Flume NG distribution ............................. SKIPPED
> [INFO] Flume NG Integration Tests ........................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 7.385s
> [INFO] Finished at: Sat Jul 26 22:52:42 HKT 2014
> [INFO] Final Memory: 41M/622M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR] mvn <goals> -rf :flume-ng-hbase-sink
>
>
>
> On 26 Jul, 2014, at 7:28 pm, ac@hsk.hk wrote:
>
>> Hi,
>>
>> I am trying to compile and run unit test (flume 1.5.0) for Hadoop 2.4.0 and HBase 0.98.3.
>>
>> I got "cannot find symbol: class MiniDFSCluster”, is it something wrong in pom.xml? please help!!
>>
>> Regards
>> Arthur
>>
>>
>>
>>
>>
>>
>> command: mvn clean test
>>
>> === log ===
>> [ERROR] COMPILATION ERROR :
>> [INFO] -------------------------------------------------------------
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: package org.apache.hadoop.hdfs
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [INFO] 7 errors
>> [INFO] -------------------------------------------------------------
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Apache Flume ...................................... SUCCESS [0.649s]
>> [INFO] Flume NG SDK ...................................... SUCCESS [1:12.668s]
>> [INFO] Flume NG Configuration ............................ SUCCESS [1.092s]
>> [INFO] Flume NG Core ..................................... SUCCESS [6:52.046s]
>> [INFO] Flume NG Sinks .................................... SUCCESS [0.095s]
>> [INFO] Flume NG HDFS Sink ................................ FAILURE [1.990s]
>> [INFO] Flume NG IRC Sink ................................. SKIPPED
>> [INFO] Flume NG Channels ................................. SKIPPED
>> [INFO] Flume NG JDBC channel ............................. SKIPPED
>> [INFO] Flume NG file-based channel ....................... SKIPPED
>> [INFO] Flume NG Spillable Memory channel ................. SKIPPED
>> [INFO] Flume NG Node ..................................... SKIPPED
>> [INFO] Flume NG Embedded Agent ........................... SKIPPED
>> [INFO] Flume NG HBase Sink ............................... SKIPPED
>> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
>> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
>> [INFO] Flume Sources ..................................... SKIPPED
>> [INFO] Flume Scribe Source ............................... SKIPPED
>> [INFO] Flume JMS Source .................................. SKIPPED
>> [INFO] Flume Twitter Source .............................. SKIPPED
>> [INFO] Flume legacy Sources .............................. SKIPPED
>> [INFO] Flume legacy Avro source .......................... SKIPPED
>> [INFO] Flume legacy Thrift Source ........................ SKIPPED
>> [INFO] Flume NG Clients .................................. SKIPPED
>> [INFO] Flume NG Log4j Appender ........................... SKIPPED
>> [INFO] Flume NG Tools .................................... SKIPPED
>> [INFO] Flume NG distribution ............................. SKIPPED
>> [INFO] Flume NG Integration Tests ........................ SKIPPED
>> [INFO] ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Total time: 8:09.120s
>> [INFO] Finished at: Sat Jul 26 19:18:55 HKT 2014
>> [INFO] Final Memory: 71M/455M
>> [INFO] ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile (default-testCompile) on project flume-hdfs-sink: Compilation failure: Compilation failure:
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: package org.apache.hadoop.hdfs
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please read the following articles:
>> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build with the command
>> [ERROR] mvn <goals> -rf :flume-hdfs-sink
>>
>>
>
Re: Flume Compile 1.5.0 for HBase 0.98.3
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi.
Thanks so much for your reply.
I tried again with following mvm but still get warning and error. Does it mean I am using wrong repository? or something in my pom.xml file incorrect? Please help!
Regards
Arthur
mvn clean install -Phadoop-2 -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Flume NG HBase Sink 1.5.0
[INFO] ------------------------------------------------------------------------
Downloading: http://people.apache.org/~garyh/mvn/org/apache/hbase/hbase/0.98.3/hbase-0.98.3.pom
Downloading: http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.98.3/hbase-0.98.3.pom
Downloading: http://repository.jboss.org/nexus/content/groups/public/org/apache/hbase/hbase/0.98.3/hbase-0.98.3.pom
[WARNING] The POM for org.apache.hbase:hbase:jar:0.98.3 is missing, no dependency information available
[WARNING] The POM for org.apache.hbase:hbase:jar:tests:0.98.3 is missing, no dependency information available
Downloading: http://people.apache.org/~garyh/mvn/org/apache/hbase/hbase/0.98.3/hbase-0.98.3.jar
Downloading: http://people.apache.org/~garyh/mvn/org/apache/hbase/hbase/0.98.3/hbase-0.98.3-tests.jar
Downloading: http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.98.3/hbase-0.98.3.jar
Downloading: http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.98.3/hbase-0.98.3-tests.jar
Downloading: http://repository.jboss.org/nexus/content/groups/public/org/apache/hbase/hbase/0.98.3/hbase-0.98.3.jar
Downloading: http://repository.jboss.org/nexus/content/groups/public/org/apache/hbase/hbase/0.98.3/hbase-0.98.3-tests.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Flume ...................................... SUCCESS [0.765s]
[INFO] Flume NG SDK ...................................... SUCCESS [1:12.380s]
[INFO] Flume NG Configuration ............................ SUCCESS [1.183s]
[INFO] Flume NG Core ..................................... SUCCESS [4:50.464s]
[INFO] Flume NG Sinks .................................... SUCCESS [0.201s]
[INFO] Flume NG HDFS Sink ................................ SUCCESS [4:28.655s]
[INFO] Flume NG IRC Sink ................................. SUCCESS [1.099s]
[INFO] Flume NG Channels ................................. SUCCESS [0.087s]
[INFO] Flume NG JDBC channel ............................. SUCCESS [2:02.433s]
[INFO] Flume NG file-based channel ....................... SUCCESS [10:26.224s]
[INFO] Flume NG Spillable Memory channel ................. SUCCESS [4:43.048s]
[INFO] Flume NG Node ..................................... SUCCESS [21.761s]
[INFO] Flume NG Embedded Agent ........................... SUCCESS [17.537s]
[INFO] Flume NG HBase Sink ............................... FAILURE [3.636s]
[INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
[INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
[INFO] Flume NG Kite Dataset Sink ........................ SKIPPED
[INFO] Flume Sources ..................................... SKIPPED
[INFO] Flume Scribe Source ............................... SKIPPED
[INFO] Flume JMS Source .................................. SKIPPED
[INFO] Flume Twitter Source .............................. SKIPPED
[INFO] Flume legacy Sources .............................. SKIPPED
[INFO] Flume legacy Avro source .......................... SKIPPED
[INFO] Flume legacy Thrift Source ........................ SKIPPED
[INFO] Flume NG Clients .................................. SKIPPED
[INFO] Flume NG Log4j Appender ........................... SKIPPED
[INFO] Flume NG Tools .................................... SKIPPED
[INFO] Flume NG distribution ............................. SKIPPED
[INFO] Flume NG Integration Tests ........................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 28:29.899s
[INFO] Finished at: Sun Jul 27 07:24:04 HKT 2014
[INFO] Final Memory: 53M/616M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3, org.apache.hbase:hbase:jar:tests:0.98.3: Could not find artifact org.apache.hbase:hbase:jar:0.98.3 in nexus (http://people.apache.org/~garyh/mvn/) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :flume-ng-hbase-sink
Log with debug information as follows:
[ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3, org.apache.hbase:hbase:jar:tests:0.98.3: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3, org.apache.hbase:hbase:jar:tests:0.98.3: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:220)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:127)
at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:257)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:200)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:317)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:152)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:555)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.project.DependencyResolutionException: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3, org.apache.hbase:hbase:jar:tests:0.98.3: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:198)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:195)
... 22 more
Caused by: org.eclipse.aether.resolution.DependencyResolutionException: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3, org.apache.hbase:hbase:jar:tests:0.98.3: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:384)
at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:192)
... 23 more
Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.98.3, org.apache.hbase:hbase:jar:tests:0.98.3: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:459)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:262)
at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:367)
... 24 more
Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced
at org.eclipse.aether.internal.impl.DefaultUpdateCheckManager.newException(DefaultUpdateCheckManager.java:232)
at org.eclipse.aether.internal.impl.DefaultUpdateCheckManager.checkArtifact(DefaultUpdateCheckManager.java:206)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.gatherDownloads(DefaultArtifactResolver.java:599)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.performDownloads(DefaultArtifactResolver.java:518)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:436)
... 26 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
On 27 Jul, 2014, at 5:41 am, Hari Shreedharan <hs...@cloudera.com> wrote:
> Run mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=<specific version of hbase 98>.
>
>
>
> On Saturday, July 26, 2014, ac@hsk.hk <ac...@hsk.hk> wrote:
> Hi,
>
> I have tried several times about compiling Flume 1.5.0 for HBase 0.98.3, with some progress but still failed.
>
> Can someone advise what the proper settings in pom.xml is? or which repository contains HBase 0.98.3 jar files? or any ideas to fix this?
>
> Many thanks!!
> Arthur
>
>
>
> [INFO] ------------------------------------------------------------------------
> [INFO] Building Flume NG HBase Sink 1.5.0
> [INFO] ------------------------------------------------------------------------
> [WARNING] The POM for org.apache.hbase:hbase:jar:0.98.3 is missing, no dependency information available
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Flume ...................................... SUCCESS [0.873s]
> [INFO] Flume NG SDK ...................................... SUCCESS [1.681s]
> [INFO] Flume NG Configuration ............................ SUCCESS [0.249s]
> [INFO] Flume NG Core ..................................... SUCCESS [1.771s]
> [INFO] Flume NG Sinks .................................... SUCCESS [0.048s]
> [INFO] Flume NG HDFS Sink ................................ SUCCESS [0.914s]
> [INFO] Flume NG IRC Sink ................................. SUCCESS [0.144s]
> [INFO] Flume NG Channels ................................. SUCCESS [0.067s]
> [INFO] Flume NG JDBC channel ............................. SUCCESS [0.210s]
> [INFO] Flume NG file-based channel ....................... SUCCESS [0.246s]
> [INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.127s]
> [INFO] Flume NG Node ..................................... SUCCESS [0.159s]
> [INFO] Flume NG Embedded Agent ........................... SUCCESS [0.414s]
> [INFO] Flume NG HBase Sink ............................... FAILURE [0.064s]
> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
> [INFO] Flume NG Kite Dataset Sink ........................ SKIPPED
> [INFO] Flume Sources ..................................... SKIPPED
> [INFO] Flume Scribe Source ............................... SKIPPED
> [INFO] Flume JMS Source .................................. SKIPPED
> [INFO] Flume Twitter Source .............................. SKIPPED
> [INFO] Flume legacy Sources .............................. SKIPPED
> [INFO] Flume legacy Avro source .......................... SKIPPED
> [INFO] Flume legacy Thrift Source ........................ SKIPPED
> [INFO] Flume NG Clients .................................. SKIPPED
> [INFO] Flume NG Log4j Appender ........................... SKIPPED
> [INFO] Flume NG Tools .................................... SKIPPED
> [INFO] Flume NG distribution ............................. SKIPPED
> [INFO] Flume NG Integration Tests ........................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 7.385s
> [INFO] Finished at: Sat Jul 26 22:52:42 HKT 2014
> [INFO] Final Memory: 41M/622M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR] mvn <goals> -rf :flume-ng-hbase-sink
>
>
>
> On 26 Jul, 2014, at 7:28 pm, ac@hsk.hk wrote:
>
>> Hi,
>>
>> I am trying to compile and run unit test (flume 1.5.0) for Hadoop 2.4.0 and HBase 0.98.3.
>>
>> I got "cannot find symbol: class MiniDFSCluster”, is it something wrong in pom.xml? please help!!
>>
>> Regards
>> Arthur
>>
>>
>>
>>
>>
>>
>> command: mvn clean test
>>
>> === log ===
>> [ERROR] COMPILATION ERROR :
>> [INFO] -------------------------------------------------------------
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: package org.apache.hadoop.hdfs
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18] cannot find symbol
>> symbol : class MiniDFSCluster
>> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [INFO] 7 errors
>> [INFO] -------------------------------------------------------------
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Apache Flume ...................................... SUCCESS [0.649s]
>> [INFO] Flume NG SDK ...................................... SUCCESS [1:12.668s]
>> [INFO] Flume NG Configuration ............................ SUCCESS [1.092s]
>> [INFO] Flume NG Core ..................................... SUCCESS [6:52.046s]
>> [INFO] Flume NG Sinks .................................... SUCCESS [0.095s]
>> [INFO] Flume NG HDFS Sink ................................ FAILURE [1.990s]
>> [INFO] Flume NG IRC Sink ................................. SKIPPED
>> [INFO] Flume NG Channels ................................. SKIPPED
>> [INFO] Flume NG JDBC channel ............................. SKIPPED
>> [INFO] Flume NG file-based channel ....................... SKIPPED
>> [INFO] Flume NG Spillable Memory channel ................. SKIPPED
>> [INFO] Flume NG Node ..................................... SKIPPED
>> [INFO] Flume NG Embedded Agent ........................... SKIPPED
>> [INFO] Flume NG HBase Sink ............................... SKIPPED
>> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
>> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
>> [INFO] Flume Sources ..................................... SKIPPED
>> [INFO] Flume Scribe Source ............................... SKIPPED
>> [INFO] Flume JMS Source .................................. SKIPPED
>> [INFO] Flume Twitter Source .............................. SKIPPED
>> [INFO] Flume legacy Sources .............................. SKIPPED
>> [INFO] Flume legacy Avro source .......................... SKIPPED
>> [INFO] Flume legacy Thrift Source ........................ SKIPPED
>> [INFO] Flume NG Clients .................................. SKIPPED
>> [INFO] Flume NG Log4j Appender ........................... SKIPPED
>> [INFO] Flume NG Tools .................................... SKIPPED
>> [INFO] Flume NG distribution ............................. SKIPPED
>> [INFO] Flume NG Integration Tests ........................ SKIPPED
>> [INFO] ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Total time: 8:09.120s
>> [INFO] Finished at: Sat Jul 26 19:18:55 HKT 2014
>> [INFO] Final Memory: 71M/455M
>> [INFO] ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile (default-testCompile) on project flume-hdfs-sink: Compilation failure: Compilation failure:
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: package org.apache.hadoop.hdfs
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18] cannot find symbol
>> [ERROR] symbol : class MiniDFSCluster
>> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
>> [ERROR] -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please read the following articles:
>> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build with the command
>> [ERROR] mvn <goals> -rf :flume-hdfs-sink
>>
>>
>