Re: Review Request 16415: flume-ng accumulo sink

[Matt Molek <mm...@clearedgeit.com>]

> On Dec. 31, 2013, 6:43 a.m., Bruno MAHE wrote:
> > flume-ng-sinks/flume-ng-accumulo-sink/pom.xml, line 47
> > <https://reviews.apache.org/r/16415/diff/1/?file=401609#file401609line47>
> >
> >     * Does Apache Accumulo work with Apache Hadoop 2?
> >     * Why not using the Apache Hadoop profile from the main Apache Flume pom.xml? That's the way to select which Apache Hadoop to build Apache Flume against.
> >     
> >

Accumulo 1.5.0 works with Hadoop 2, but as far as I know, 1.4.x does not. So I guess it would be appropriate to set accumulo version based on which hadoop profile is being used.

I'm having a problem with profiles though. I'm pretty inexperienced with maven. I was having issues building my branch, but I don't think my changes are the problem. I tried cloning a fresh copy of Flume, and tried to 'mvn -Phadoop-2 clean compile' before testing. The build fails with the error:

[ERROR] Failed to execute goal on project flume-hdfs-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-hdfs-sink:jar:1.5.0-SNAPSHOT: The following artifacts could not be resolved: org.apache.hadoop:hadoop-hdfs:jar:1.0.1, org.apache.hadoop:hadoop-auth:jar:1.0.1: Failure to find org.apache.hadoop:hadoop-hdfs:jar:1.0.1 in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of repo1.maven.org has elapsed or updates are forced -> [Help 1]

It appears that maven is trying to source a bunch of 1.0.1 hadoop jars even though I'm specifing -Phadoop-2. The build succeeds with -Phadoop-1.0. Am I doing something wrong? Any idea why it won't build?


- Matt


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/16415/#review30996
-----------------------------------------------------------


On Dec. 27, 2013, 6 p.m., Matt Molek wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/16415/
> -----------------------------------------------------------
> 
> (Updated Dec. 27, 2013, 6 p.m.)
> 
> 
> Review request for Flume.
> 
> 
> Repository: flume-git
> 
> 
> Description
> -------
> 
> This patch is identical to FLUME-2234-0.patch except I had to regenerate it with different git options to get review board to accept it.
> 
> 
> Diffs
> -----
> 
>   flume-ng-sinks/flume-ng-accumulo-sink/pom.xml PRE-CREATION 
>   flume-ng-sinks/flume-ng-accumulo-sink/src/main/java/org/apache/flume/sink/accumulo/AccumuloEventSerializer.java PRE-CREATION 
>   flume-ng-sinks/flume-ng-accumulo-sink/src/main/java/org/apache/flume/sink/accumulo/AccumuloSink.java PRE-CREATION 
>   flume-ng-sinks/flume-ng-accumulo-sink/src/main/java/org/apache/flume/sink/accumulo/AccumuloSinkConfigurationConstants.java PRE-CREATION 
>   flume-ng-sinks/flume-ng-accumulo-sink/src/main/java/org/apache/flume/sink/accumulo/SimpleAccumuloEventSerializer.java PRE-CREATION 
>   flume-ng-sinks/flume-ng-accumulo-sink/src/test/java/org/apache/flume/sink/accumulo/TestAccumuloSink.java PRE-CREATION 
>   flume-ng-sinks/pom.xml d03576b 
> 
> Diff: https://reviews.apache.org/r/16415/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Matt Molek
> 
>