You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Anatoli Fomenko <af...@yahoo.com> on 2012/12/03 03:27:13 UTC
Re: Flume 1.2.0 PermGen build problem
Hi Roman,
I'm still getting for Flume 1.3.0:
from http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-bin.tar.gz:
...
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ flume-ng-sdk ---
[INFO] Compiling 6 source files to git/branch-0.3.1/bigtop/output/flume/flume-1.3.0/flume-ng-sdk/target/test-classes
...
[INFO] Flume NG SDK ...................................... FAILURE [12.853s]
...
Exception in thread "MainThread" java.lang.OutOfMemoryError: PermGen space
or from http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-src.tar.gz:
...
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ flume-ng-sdk ---
[ERROR] PermGen space -> [Help 1]
...
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
with recommended variables set on command line:
$ echo $JAVA_OPTS
-Xmx1536m -Xms256m -XX:MaxPermSize=256m
$ echo $MAVEN_OPTS
-Xmx1536m -Xms256m -XX:MaxPermSize=256m
Any ideas what went wrong?
Thank you,
Anatoli
________________________________
From: Roman Shaposhnik <rv...@apache.org>
To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
Sent: Tuesday, November 27, 2012 9:08 AM
Subject: Re: Flume 1.2.0 PermGen build problem
On Tue, Nov 27, 2012 at 8:58 AM, Anatoli Fomenko <af...@yahoo.com> wrote:
> I tried up to MAVEN_OPTS="-Xmx3G -XX:MaxPermSize=2G", same problem.introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop
I'm not sure Flume 1.2.0 is worth pursuing at this point. For
the upcoming Flume 1.3.0 here's what works for me:
JAVA_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
Perhaps this needs to included into the do-component-build proper.
Thanks,
Roman.
Re: Flume 1.2.0 PermGen build problem
Posted by Konstantin Boudnik <co...@apache.org>.
Me too... because I never been able to get this awesome thing work.
Cos
On Sun, Dec 02, 2012 at 07:53PM, Anatoli Fomenko wrote:
> With the bumped PermGen size
> $ echo $JAVA_OPTS
> -Xmx1536m -Xms256m -XX:MaxPermSize=1536m
> $ echo $MAVEN_OPTS
> -Xmx1536m -Xms256m -XX:MaxPermSize=1536m
>
> I've got the same problem.
>
> I'm wondering how to reproduce Roman's conditions that worked for him.
>
> Thanks,
> Anatoli
>
>
> ________________________________
> From: Konstantin Boudnik <co...@apache.org>
> To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
> Sent: Sunday, December 2, 2012 7:33 PM
> Subject: Re: Flume 1.2.0 PermGen build problem
>
> Anatoli,
>
> you might want to bump up PermGen size to 1536M or something. Heap size isn't
> relevant to the PermGen issues.
>
> Cos
>
> On Sun, Dec 02, 2012 at 06:27PM, Anatoli Fomenko wrote:
> > Hi Roman,
> >
> > I'm still getting for Flume 1.3.0:
> >
> > from http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-bin.tar.gz:
> >
> > ...
> > [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ flume-ng-sdk ---
> > [INFO] Compiling 6 source files to git/branch-0.3.1/bigtop/output/flume/flume-1.3.0/flume-ng-sdk/target/test-classes
> > ...
> > [INFO] Flume NG SDK ...................................... FAILURE [12.853s]
> > ...
> > Exception in thread "MainThread" java.lang.OutOfMemoryError: PermGen space
> >
> > or from═http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-src.tar.gz:
> > ...
> > [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ flume-ng-sdk ---
> >
> > [ERROR] PermGen space -> [Help 1]
> > ...
> > [ERROR] For more information about the errors and possible solutions, please read the following articles:
> > [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
> >
> >
> > with recommended variables set on command line:
> > $ echo $JAVA_OPTS
> > -Xmx1536m -Xms256m -XX:MaxPermSize=256m
> > $ echo $MAVEN_OPTS
> >
> > -Xmx1536m -Xms256m -XX:MaxPermSize=256m
> >
> > Any ideas what went wrong?
> >
> > Thank you,
> > Anatoli
> >
> >
> > ________________________________
> > From: Roman Shaposhnik <rv...@apache.org>
> > To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
> > Sent: Tuesday, November 27, 2012 9:08 AM
> > Subject: Re: Flume 1.2.0 PermGen build problem
> >
> > On Tue, Nov 27, 2012 at 8:58 AM, Anatoli Fomenko <af...@yahoo.com> wrote:
> > > I tried up to MAVEN_OPTS="-Xmx3G -XX:MaxPermSize=2G", same problem.introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop
> >
> > I'm not sure Flume 1.2.0 is worth pursuing at this point. For
> > the upcoming Flume 1.3.0 here's what works for me:
> > ═ JAVA_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
> > ═ MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
> >
> > Perhaps this needs to included into the do-component-build proper.
> >
> > Thanks,
> > Roman.
Re: Flume 1.2.0 PermGen build problem
Posted by Anatoli Fomenko <af...@yahoo.com>.
With the bumped PermGen size
$ echo $JAVA_OPTS
-Xmx1536m -Xms256m -XX:MaxPermSize=1536m
$ echo $MAVEN_OPTS
-Xmx1536m -Xms256m -XX:MaxPermSize=1536m
I've got the same problem.
I'm wondering how to reproduce Roman's conditions that worked for him.
Thanks,
Anatoli
________________________________
From: Konstantin Boudnik <co...@apache.org>
To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
Sent: Sunday, December 2, 2012 7:33 PM
Subject: Re: Flume 1.2.0 PermGen build problem
Anatoli,
you might want to bump up PermGen size to 1536M or something. Heap size isn't
relevant to the PermGen issues.
Cos
On Sun, Dec 02, 2012 at 06:27PM, Anatoli Fomenko wrote:
> Hi Roman,
>
> I'm still getting for Flume 1.3.0:
>
> from http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-bin.tar.gz:
>
> ...
> [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ flume-ng-sdk ---
> [INFO] Compiling 6 source files to git/branch-0.3.1/bigtop/output/flume/flume-1.3.0/flume-ng-sdk/target/test-classes
> ...
> [INFO] Flume NG SDK ...................................... FAILURE [12.853s]
> ...
> Exception in thread "MainThread" java.lang.OutOfMemoryError: PermGen space
>
> or from═http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-src.tar.gz:
> ...
> [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ flume-ng-sdk ---
>
> [ERROR] PermGen space -> [Help 1]
> ...
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
>
>
> with recommended variables set on command line:
> $ echo $JAVA_OPTS
> -Xmx1536m -Xms256m -XX:MaxPermSize=256m
> $ echo $MAVEN_OPTS
>
> -Xmx1536m -Xms256m -XX:MaxPermSize=256m
>
> Any ideas what went wrong?
>
> Thank you,
> Anatoli
>
>
> ________________________________
> From: Roman Shaposhnik <rv...@apache.org>
> To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
> Sent: Tuesday, November 27, 2012 9:08 AM
> Subject: Re: Flume 1.2.0 PermGen build problem
>
> On Tue, Nov 27, 2012 at 8:58 AM, Anatoli Fomenko <af...@yahoo.com> wrote:
> > I tried up to MAVEN_OPTS="-Xmx3G -XX:MaxPermSize=2G", same problem.introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop
>
> I'm not sure Flume 1.2.0 is worth pursuing at this point. For
> the upcoming Flume 1.3.0 here's what works for me:
> ═ JAVA_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
> ═ MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
>
> Perhaps this needs to included into the do-component-build proper.
>
> Thanks,
> Roman.
Re: Flume 1.2.0 PermGen build problem
Posted by Konstantin Boudnik <co...@apache.org>.
Anatoli,
you might want to bump up PermGen size to 1536M or something. Heap size isn't
relevant to the PermGen issues.
Cos
On Sun, Dec 02, 2012 at 06:27PM, Anatoli Fomenko wrote:
> Hi Roman,
>
> I'm still getting for Flume 1.3.0:
>
> from http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-bin.tar.gz:
>
> ...
> [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ flume-ng-sdk ---
> [INFO] Compiling 6 source files to git/branch-0.3.1/bigtop/output/flume/flume-1.3.0/flume-ng-sdk/target/test-classes
> ...
> [INFO] Flume NG SDK ...................................... FAILURE [12.853s]
> ...
> Exception in thread "MainThread" java.lang.OutOfMemoryError: PermGen space
>
> or from═http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-src.tar.gz:
> ...
> [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ flume-ng-sdk ---
>
> [ERROR] PermGen space -> [Help 1]
> ...
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
>
>
> with recommended variables set on command line:
> $ echo $JAVA_OPTS
> -Xmx1536m -Xms256m -XX:MaxPermSize=256m
> $ echo $MAVEN_OPTS
>
> -Xmx1536m -Xms256m -XX:MaxPermSize=256m
>
> Any ideas what went wrong?
>
> Thank you,
> Anatoli
>
>
> ________________________________
> From: Roman Shaposhnik <rv...@apache.org>
> To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
> Sent: Tuesday, November 27, 2012 9:08 AM
> Subject: Re: Flume 1.2.0 PermGen build problem
>
> On Tue, Nov 27, 2012 at 8:58 AM, Anatoli Fomenko <af...@yahoo.com> wrote:
> > I tried up to MAVEN_OPTS="-Xmx3G -XX:MaxPermSize=2G", same problem.introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop
>
> I'm not sure Flume 1.2.0 is worth pursuing at this point. For
> the upcoming Flume 1.3.0 here's what works for me:
> ═ JAVA_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
> ═ MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
>
> Perhaps this needs to included into the do-component-build proper.
>
> Thanks,
> Roman.
Re: Flume 1.2.0 PermGen build problem
Posted by Mike Percy <mp...@cloudera.com>.
Oops... I mean Lion (10.7). Too many different kitties to keep track of all
their names.
On Sun, Dec 2, 2012 at 10:34 PM, Mike Percy <mp...@cloudera.com> wrote:
> Apologies for the delay, I need to fix my mail filters for this list. This
> is what I do:
>
> $ echo $MAVEN_OPTS
> -Xmx512M -XX:MaxPermSize=512M
>
> $ mvn clean install -DskipTests
>
> Works on my Mac (Tiger) install with Maven 3.0.3.
>
> Regards,
> Mike
>
>
> On Sun, Dec 2, 2012 at 8:58 PM, Roman Shaposhnik <ro...@shaposhnik.org>wrote:
>
>> Here's what work for me (and seems to be working out
>> nicely on Jenkins). I plan to commit it this week to trunk:
>>
>> export MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
>>
>> mvn -DskipTests -Dhadoop.profile=2 \
>> -Dhadoop.version=$HADOOP_VERSION \
>> -Dhbase.version=$HBASE_VERSION \
>> clean install "$@"
>>
>> Thanks,
>> Roman.
>>
>> On Sun, Dec 2, 2012 at 6:27 PM, Anatoli Fomenko <af...@yahoo.com>
>> wrote:
>> > Hi Roman,
>> >
>> > I'm still getting for Flume 1.3.0:
>> >
>> > from
>> http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-bin.tar.gz:
>> >
>> > ...
>> > [INFO] --- maven-compiler-plugin:2.3.2:testCompile
>> (default-testCompile) @ flume-ng-sdk ---
>> > [INFO] Compiling 6 source files to
>> git/branch-0.3.1/bigtop/output/flume/flume-1.3.0/flume-ng-sdk/target/test-classes
>> > ...
>> > [INFO] Flume NG SDK ...................................... FAILURE
>> [12.853s]
>> > ...
>> > Exception in thread "MainThread" java.lang.OutOfMemoryError: PermGen
>> space
>> >
>> > or from
>> http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-src.tar.gz:
>> > ...
>> > [INFO] --- maven-surefire-plugin:2.12:test (default-test) @
>> flume-ng-sdk ---
>> >
>> > [ERROR] PermGen space -> [Help 1]
>> > ...
>> > [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> > [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
>> >
>> >
>> > with recommended variables set on command line:
>> > $ echo $JAVA_OPTS
>> > -Xmx1536m -Xms256m -XX:MaxPermSize=256m
>> > $ echo $MAVEN_OPTS
>> >
>> > -Xmx1536m -Xms256m -XX:MaxPermSize=256m
>> >
>> > Any ideas what went wrong?
>> >
>> > Thank you,
>> > Anatoli
>> >
>> >
>> > ________________________________
>> > From: Roman Shaposhnik <rv...@apache.org>
>> > To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
>> > Sent: Tuesday, November 27, 2012 9:08 AM
>> > Subject: Re: Flume 1.2.0 PermGen build problem
>> >
>> > On Tue, Nov 27, 2012 at 8:58 AM, Anatoli Fomenko <af...@yahoo.com>
>> wrote:
>> >> I tried up to MAVEN_OPTS="-Xmx3G -XX:MaxPermSize=2G", same
>> problem.introduce Python as build-time and run-time dependency for Hadoop
>> and throughout Hadoop
>> >
>> > I'm not sure Flume 1.2.0 is worth pursuing at this point. For
>> > the upcoming Flume 1.3.0 here's what works for me:
>> > JAVA_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
>> > MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
>> >
>> > Perhaps this needs to included into the do-component-build proper.
>> >
>> > Thanks,
>> > Roman.
>>
>
>
Re: Flume 1.2.0 PermGen build problem
Posted by Mike Percy <mp...@cloudera.com>.
Apologies for the delay, I need to fix my mail filters for this list. This
is what I do:
$ echo $MAVEN_OPTS
-Xmx512M -XX:MaxPermSize=512M
$ mvn clean install -DskipTests
Works on my Mac (Tiger) install with Maven 3.0.3.
Regards,
Mike
On Sun, Dec 2, 2012 at 8:58 PM, Roman Shaposhnik <ro...@shaposhnik.org>wrote:
> Here's what work for me (and seems to be working out
> nicely on Jenkins). I plan to commit it this week to trunk:
>
> export MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
>
> mvn -DskipTests -Dhadoop.profile=2 \
> -Dhadoop.version=$HADOOP_VERSION \
> -Dhbase.version=$HBASE_VERSION \
> clean install "$@"
>
> Thanks,
> Roman.
>
> On Sun, Dec 2, 2012 at 6:27 PM, Anatoli Fomenko <af...@yahoo.com>
> wrote:
> > Hi Roman,
> >
> > I'm still getting for Flume 1.3.0:
> >
> > from
> http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-bin.tar.gz:
> >
> > ...
> > [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile)
> @ flume-ng-sdk ---
> > [INFO] Compiling 6 source files to
> git/branch-0.3.1/bigtop/output/flume/flume-1.3.0/flume-ng-sdk/target/test-classes
> > ...
> > [INFO] Flume NG SDK ...................................... FAILURE
> [12.853s]
> > ...
> > Exception in thread "MainThread" java.lang.OutOfMemoryError: PermGen
> space
> >
> > or from
> http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-src.tar.gz:
> > ...
> > [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ flume-ng-sdk
> ---
> >
> > [ERROR] PermGen space -> [Help 1]
> > ...
> > [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> > [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
> >
> >
> > with recommended variables set on command line:
> > $ echo $JAVA_OPTS
> > -Xmx1536m -Xms256m -XX:MaxPermSize=256m
> > $ echo $MAVEN_OPTS
> >
> > -Xmx1536m -Xms256m -XX:MaxPermSize=256m
> >
> > Any ideas what went wrong?
> >
> > Thank you,
> > Anatoli
> >
> >
> > ________________________________
> > From: Roman Shaposhnik <rv...@apache.org>
> > To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
> > Sent: Tuesday, November 27, 2012 9:08 AM
> > Subject: Re: Flume 1.2.0 PermGen build problem
> >
> > On Tue, Nov 27, 2012 at 8:58 AM, Anatoli Fomenko <af...@yahoo.com>
> wrote:
> >> I tried up to MAVEN_OPTS="-Xmx3G -XX:MaxPermSize=2G", same
> problem.introduce Python as build-time and run-time dependency for Hadoop
> and throughout Hadoop
> >
> > I'm not sure Flume 1.2.0 is worth pursuing at this point. For
> > the upcoming Flume 1.3.0 here's what works for me:
> > JAVA_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
> > MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
> >
> > Perhaps this needs to included into the do-component-build proper.
> >
> > Thanks,
> > Roman.
>
Re: Flume 1.2.0 PermGen build problem
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Here's what work for me (and seems to be working out
nicely on Jenkins). I plan to commit it this week to trunk:
export MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
mvn -DskipTests -Dhadoop.profile=2 \
-Dhadoop.version=$HADOOP_VERSION \
-Dhbase.version=$HBASE_VERSION \
clean install "$@"
Thanks,
Roman.
On Sun, Dec 2, 2012 at 6:27 PM, Anatoli Fomenko <af...@yahoo.com> wrote:
> Hi Roman,
>
> I'm still getting for Flume 1.3.0:
>
> from http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-bin.tar.gz:
>
> ...
> [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ flume-ng-sdk ---
> [INFO] Compiling 6 source files to git/branch-0.3.1/bigtop/output/flume/flume-1.3.0/flume-ng-sdk/target/test-classes
> ...
> [INFO] Flume NG SDK ...................................... FAILURE [12.853s]
> ...
> Exception in thread "MainThread" java.lang.OutOfMemoryError: PermGen space
>
> or from http://archive.apache.org/dist/flume/1.3.0/apache-flume-1.3.0-src.tar.gz:
> ...
> [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ flume-ng-sdk ---
>
> [ERROR] PermGen space -> [Help 1]
> ...
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
>
>
> with recommended variables set on command line:
> $ echo $JAVA_OPTS
> -Xmx1536m -Xms256m -XX:MaxPermSize=256m
> $ echo $MAVEN_OPTS
>
> -Xmx1536m -Xms256m -XX:MaxPermSize=256m
>
> Any ideas what went wrong?
>
> Thank you,
> Anatoli
>
>
> ________________________________
> From: Roman Shaposhnik <rv...@apache.org>
> To: dev@bigtop.apache.org; Anatoli Fomenko <af...@yahoo.com>
> Sent: Tuesday, November 27, 2012 9:08 AM
> Subject: Re: Flume 1.2.0 PermGen build problem
>
> On Tue, Nov 27, 2012 at 8:58 AM, Anatoli Fomenko <af...@yahoo.com> wrote:
>> I tried up to MAVEN_OPTS="-Xmx3G -XX:MaxPermSize=2G", same problem.introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop
>
> I'm not sure Flume 1.2.0 is worth pursuing at this point. For
> the upcoming Flume 1.3.0 here's what works for me:
> JAVA_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
> MAVEN_OPTS="-Xmx1536m -Xms256m -XX:MaxPermSize=256m"
>
> Perhaps this needs to included into the do-component-build proper.
>
> Thanks,
> Roman.