You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Stephen Boesch <ja...@gmail.com> on 2014/09/27 22:22:19 UTC
testCacheMultiThreadedSingleKey producing "unable to create new
native thread" in 0.98 branch?
This is my first attempt to run the unit tests on the 0.98.X branch: and
the failures I see are:
Running org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache
Tests run: 8, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 204.045 sec
<<< FAILURE!
Tests in error:
testCacheMultiThreadedSingleKey[0: blockSize=8\u002C192\u002C
bucketSizes=null](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
unable to create new native thread
testCacheMultiThreadedSingleKey[1: blockSize=16\u002C384\u002C
bucketSizes=[I@3f253efb](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
unable to create new native thread
My test env: CentOS 6.5 version="0.98.6-SNAPSHOT" VM with 3 cores
and 9GB RAM
Re: testCacheMultiThreadedSingleKey producing "unable to create new
native thread" in 0.98 branch?
Posted by Weichen YE <ye...@gmail.com>.
if you have larger test, it is better to change the limit configuration for
your hbase and hdfs user.
Like for example:
# cat /etc/security/limits.d/hbase.conf
hbase - nofile 32768
hbase - memlock unlimited
# cat /etc/security/limits.d/hdfs.conf
hdfs - nofile 32768
hdfs - nproc 65536
2014-09-28 5:06 GMT+08:00 Stephen Boesch <ja...@gmail.com>:
> Thanks Ted. Spot on. I am running the small and medium tests now - and it
> has well passed the point of the threads issue.
>
> 2014-09-27 13:41 GMT-07:00 Ted Yu <yu...@gmail.com>:
>
> > Have you looked at 15.9.2.4. under
> > http://hbase.apache.org/book.html#trouble.rs.runtime ?
> >
> > Cheers
> >
> > On Sat, Sep 27, 2014 at 1:22 PM, Stephen Boesch <ja...@gmail.com>
> wrote:
> >
> > > This is my first attempt to run the unit tests on the 0.98.X branch:
> and
> > > the failures I see are:
> > >
> > > Running org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache
> > > Tests run: 8, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 204.045
> > sec
> > > <<< FAILURE!
> > >
> > > Tests in error:
> > > testCacheMultiThreadedSingleKey[0: blockSize=8\u002C192\u002C
> > >
> >
> bucketSizes=null](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
> > > unable to create new native thread
> > > testCacheMultiThreadedSingleKey[1: blockSize=16\u002C384\u002C
> > > bucketSizes=[I@3f253efb
> > > ](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
> > > unable to create new native thread
> > >
> > >
> > > My test env: CentOS 6.5 version="0.98.6-SNAPSHOT" VM with 3
> cores
> > > and 9GB RAM
> > >
> >
>
Re: testCacheMultiThreadedSingleKey producing "unable to create new
native thread" in 0.98 branch?
Posted by Stephen Boesch <ja...@gmail.com>.
Thanks Ted. Spot on. I am running the small and medium tests now - and it
has well passed the point of the threads issue.
2014-09-27 13:41 GMT-07:00 Ted Yu <yu...@gmail.com>:
> Have you looked at 15.9.2.4. under
> http://hbase.apache.org/book.html#trouble.rs.runtime ?
>
> Cheers
>
> On Sat, Sep 27, 2014 at 1:22 PM, Stephen Boesch <ja...@gmail.com> wrote:
>
> > This is my first attempt to run the unit tests on the 0.98.X branch: and
> > the failures I see are:
> >
> > Running org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache
> > Tests run: 8, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 204.045
> sec
> > <<< FAILURE!
> >
> > Tests in error:
> > testCacheMultiThreadedSingleKey[0: blockSize=8\u002C192\u002C
> >
> bucketSizes=null](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
> > unable to create new native thread
> > testCacheMultiThreadedSingleKey[1: blockSize=16\u002C384\u002C
> > bucketSizes=[I@3f253efb
> > ](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
> > unable to create new native thread
> >
> >
> > My test env: CentOS 6.5 version="0.98.6-SNAPSHOT" VM with 3 cores
> > and 9GB RAM
> >
>
Re: testCacheMultiThreadedSingleKey producing "unable to create new
native thread" in 0.98 branch?
Posted by Ted Yu <yu...@gmail.com>.
Have you looked at 15.9.2.4. under
http://hbase.apache.org/book.html#trouble.rs.runtime ?
Cheers
On Sat, Sep 27, 2014 at 1:22 PM, Stephen Boesch <ja...@gmail.com> wrote:
> This is my first attempt to run the unit tests on the 0.98.X branch: and
> the failures I see are:
>
> Running org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache
> Tests run: 8, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 204.045 sec
> <<< FAILURE!
>
> Tests in error:
> testCacheMultiThreadedSingleKey[0: blockSize=8\u002C192\u002C
> bucketSizes=null](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
> unable to create new native thread
> testCacheMultiThreadedSingleKey[1: blockSize=16\u002C384\u002C
> bucketSizes=[I@3f253efb
> ](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
> unable to create new native thread
>
>
> My test env: CentOS 6.5 version="0.98.6-SNAPSHOT" VM with 3 cores
> and 9GB RAM
>