You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Brock Noland (JIRA)" <ji...@apache.org> on 2012/11/20 17:09:00 UTC
[jira] [Created] (FLUME-1732) Build is failing due to nett problems
Brock Noland created FLUME-1732:
-----------------------------------
Summary: Build is failing due to nett problems
Key: FLUME-1732
URL: https://issues.apache.org/jira/browse/FLUME-1732
Project: Flume
Issue Type: Bug
Reporter: Brock Noland
FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1732) Build is failing due to netty
problems
Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mike Percy updated FLUME-1732:
------------------------------
Attachment: FLUME-1732-3.patch
This is kinda gross but essentially this patch just adds netty as a dep everywhere that this bug is surfaced.
This should only be needed to get past this bug, would be best to remove these deps from anything that doesn't explicitly using netty jars after the SNAPSHOT with these changes gets built and pushed.
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Affects Versions: v1.4.0
> Reporter: Brock Noland
> Fix For: v1.4.0
>
> Attachments: FLUME-1732-3.patch, FLUME-1732.patch
>
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1732) Build is failing due to netty
problems
Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hari Shreedharan updated FLUME-1732:
------------------------------------
Attachment: FLUME-1732.patch
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Affects Versions: v1.4.0
> Reporter: Brock Noland
> Fix For: v1.4.0
>
> Attachments: FLUME-1732.patch
>
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1732) Build is failing due to netty
problems
Posted by "Brock Noland (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501398#comment-13501398 ]
Brock Noland commented on FLUME-1732:
-------------------------------------
Yeah not sure why it doesn't work, but it failed twice (I manually re-ran the build) so something, somewhere is wrong.
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Reporter: Brock Noland
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1732) Build is failing due to netty
problems
Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501435#comment-13501435 ]
Mike Percy commented on FLUME-1732:
-----------------------------------
Hmm yeah, seeing this:
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ flume-avro-source ---
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] /home/jenkins/jenkins-slave/workspace/flume-trunk/flume-ng-legacy-sources/flume-avro-source/src/test/java/org/apache/flume/source/avroLegacy/TestLegacyAvroSource.java:[46,30] package org.jboss.netty.channel does not exist
[ERROR] /home/jenkins/jenkins-slave/workspace/flume-trunk/flume-ng-legacy-sources/flume-avro-source/src/test/java/org/apache/flume/source/avroLegacy/TestLegacyAvroSource.java:[95,15] cannot find symbol
symbol : class ChannelException
location: class org.apache.flume.source.avroLegacy.TestLegacyAvroSource
[ERROR] /home/jenkins/jenkins-slave/workspace/flume-trunk/flume-ng-legacy-sources/flume-avro-source/src/test/java/org/apache/flume/source/avroLegacy/TestLegacyAvroSource.java:[129,15] cannot find symbol
symbol : class ChannelException
location: class org.apache.flume.source.avroLegacy.TestLegacyAvroSource
[INFO] 3 errors
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Reporter: Brock Noland
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1732) Build is failing due to netty
problems
Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mike Percy updated FLUME-1732:
------------------------------
Affects Version/s: v1.4.0
Fix Version/s: v1.4.0
This bug does not appear to affect release artifacts, so it is not a 1.3.0 blocker, as was pointed out on the dev list.
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Affects Versions: v1.4.0
> Reporter: Brock Noland
> Fix For: v1.4.0
>
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1732) Build is failing due to netty
problems
Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501596#comment-13501596 ]
Mike Percy commented on FLUME-1732:
-----------------------------------
Ugh... I think I found a Maven bug. Verifying again, then I will report it @ Sonatype and look for workarounds.
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Reporter: Brock Noland
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1732) Build is failing due to netty
problems
Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501393#comment-13501393 ]
Hari Shreedharan commented on FLUME-1732:
-----------------------------------------
I deleted the io/ directory in my .m2 and ran full build on trunk, works fine for me:
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Flume ...................................... SUCCESS [1:01.288s]
[INFO] Flume NG SDK ...................................... SUCCESS [1:00.110s]
[INFO] Flume NG Configuration ............................ SUCCESS [2.923s]
[INFO] Flume NG Core ..................................... SUCCESS [3:02.713s]
[INFO] Flume NG Sinks .................................... SUCCESS [5.879s]
[INFO] Flume NG HDFS Sink ................................ SUCCESS [40.226s]
[INFO] Flume NG IRC Sink ................................. SUCCESS [1.109s]
[INFO] Flume NG HBase Sink ............................... SUCCESS [1:22.791s]
[INFO] Flume NG ElasticSearch Sink ....................... SUCCESS [10.948s]
[INFO] Flume Sources ..................................... SUCCESS [0.760s]
[INFO] Flume Scribe Source ............................... SUCCESS [1.272s]
[INFO] Flume NG Channels ................................. SUCCESS [0.812s]
[INFO] Flume NG JDBC channel ............................. SUCCESS [39.709s]
[INFO] Flume NG Node ..................................... SUCCESS [20.339s]
[INFO] Flume NG file-based channel ....................... SUCCESS [4:09.418s]
[INFO] Flume NG file backed Memory channel ............... SUCCESS [27.975s]
[INFO] Flume legacy Sources .............................. SUCCESS [0.697s]
[INFO] Flume legacy Avro source .......................... SUCCESS [2.554s]
[INFO] Flume legacy Thrift Source ........................ SUCCESS [2.460s]
[INFO] Flume NG Clients .................................. SUCCESS [0.760s]
[INFO] Flume NG Log4j Appender ........................... SUCCESS [3.329s]
[INFO] Flume NG distribution ............................. SUCCESS [29.753s]
[INFO] Flume NG Integration Tests ........................ SUCCESS [46.625s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14:35.136s
[INFO] Finished at: Tue Nov 20 11:22:04 PST 2012
[INFO] Final Memory: 98M/554M
[INFO] ------------------------------------------------------------------------
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Reporter: Brock Noland
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1732) Build is failing due to netty
problems
Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501708#comment-13501708 ]
Hari Shreedharan commented on FLUME-1732:
-----------------------------------------
We actually catch Netty's ChannelException in AvroLegacySource, so we should pull it in anyway. Here is a patch which does that.
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Affects Versions: v1.4.0
> Reporter: Brock Noland
> Fix For: v1.4.0
>
> Attachments: FLUME-1732.patch
>
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1732) Build is failing due to netty
problems
Posted by "Brock Noland (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland updated FLUME-1732:
--------------------------------
Summary: Build is failing due to netty problems (was: Build is failing due to nett problems)
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Reporter: Brock Noland
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1732) Build is failing due to netty
problems
Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501625#comment-13501625 ]
Mike Percy commented on FLUME-1732:
-----------------------------------
Looks like a Maven bug to me.
To reproduce:
1. Delete all flume jars from your Maven repo: rm -rf ~/.m2/repository/org/apache
2. Run install build with -U:
{noformat}
mvn clean install -B -U -e -Dtest=TestLog4jAppender,TestPropertiesFileConfigurationProvider,TestRpcClient,TestRpcClientCommunicationFailure,TestLegacyAvroSource -DfailIfNoTests=false
{noformat}
This build will fail with tests complaining about missing dependencies. Even though it says it is installing the locally built modules to the local repository, in reality the artifacts are not there. They are whatever was downloaded from upstream. So these lines, for example, are a lie:
{noformat}
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ flume-ng-sdk ---
[INFO] Installing /Users/mpercy/src/flume.alt/flume-ng-sdk/target/flume-ng-sdk-1.4.0-SNAPSHOT.jar to /Users/mpercy/.m2/repository/org/apache/flume/flume-ng-sdk/1.4.0-SNAPSHOT/flume-ng-sdk-1.4.0-SNAPSHOT.jar
[INFO] Installing /Users/mpercy/src/flume.alt/flume-ng-sdk/pom.xml to /Users/mpercy/.m2/repository/org/apache/flume/flume-ng-sdk/1.4.0-SNAPSHOT/flume-ng-sdk-1.4.0-SNAPSHOT.pom
{noformat}
because that .pom matches the old one that was downloaded from a few days ago (specifically, it does not contain the netty dependency).
Even weirder, if you simply execute the same command as in the above step, it will go through fine.
3. Run install build with -U:
{noformat}
mvn clean install -B -U -e -Dtest=TestLog4jAppender,TestPropertiesFileConfigurationProvider,TestRpcClient,TestRpcClientCommunicationFailure,TestLegacyAvroSource -DfailIfNoTests=false
{noformat}
Build success!
As one might expect under normal circumstances, now the SNAPSHOT artifacts in the local repository are from the local build (the install message was not a lie).
I wonder if this is related to http://jira.codehaus.org/browse/MNG-3282
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Reporter: Brock Noland
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1732) Build is failing due to netty
problems
Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501709#comment-13501709 ]
Hari Shreedharan commented on FLUME-1732:
-----------------------------------------
This patch alone does not fix the issue btw.
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Affects Versions: v1.4.0
> Reporter: Brock Noland
> Fix For: v1.4.0
>
> Attachments: FLUME-1732.patch
>
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1732) Build is failing due to netty
problems
Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501448#comment-13501448 ]
Mike Percy commented on FLUME-1732:
-----------------------------------
I wonder if it's the -U flag. Trying a build with that.
> Build is failing due to netty problems
> --------------------------------------
>
> Key: FLUME-1732
> URL: https://issues.apache.org/jira/browse/FLUME-1732
> Project: Flume
> Issue Type: Bug
> Reporter: Brock Noland
>
> FLUME-1723 changed how we bring in netty and that seems to have broken the build https://builds.apache.org/job/flume-trunk/330/#showFailuresLink
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira