You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@trafodion.apache.org by 吴仕富 <wu...@163.com> on 2016/05/16 02:58:50 UTC
Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this error.
The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
please focus on the following log info.
I go to check the idle process HMaster whether run or not, the following is my attached figure.
Go through this file, HBase is running correctly.
So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer
Re: RE: RE: RE: 答复: Initialize Trafodion Error
Posted by Gunnar Tapper <ta...@gmail.com>.
For next time:
http://trafodion.apache.org/docs/provisioning_guide/index.html#requirements-operating-system-changes
On Tue, May 17, 2016 at 11:24 AM, Narain Arvind <na...@gmail.com>
wrote:
> You are welcome Swayer. Glad to know your instance is up and running and
> you are able to proceed further.
>
>
>
> Regards
>
> Arvind
>
>
>
> *From:* 吴仕富 [mailto:wushifu1000@163.com]
> *Sent:* Tuesday, May 17, 2016 1:16 AM
> *To:* user@trafodion.incubator.apache.org
> *Subject:* 回复:RE: RE: RE: 答复: Initialize Trafodion Error
>
>
>
>
>
> Arvind, thanks for your help so much. this problem have been solved by
> your below solution. we just increase these processes' number, now we can
> initialize trafodion,
>
> and finish creating test environment.
>
> #
>
> # Added for Trafodion: Increase maximum number of processes
>
> * soft nproc 267263
>
> * hard nproc 267263
>
>
>
> Best regards
>
> Swayer
>
>
>
>
>
>
>
>
> At 2016-05-16 20:41:01, "Arvind" <na...@gmail.com> wrote:
>
> Thanks Swayer for trying out the suggestions.
>
>
>
> Yes it does look ok to me. You could verify by executing “ulimit -u” or
> “ulimit -a” from a new shell to check on the new limit for nproc. It is
> similar to the suggestions mentioned in the following to setup the test
> environment (1) and also for clusters (2).
>
>
>
> 1)
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Test+Environment#CreateTestEnvironment-SystemLimits
>
> 2)
> http://trafodion.apache.org/docs/provisioning_guide/index.html#requirements-operating-system-changes
>
>
>
> This is how it is setup on some of the development systems I’ve worked on
>
>
>
> total 8
>
> -rw-r--r--. 1 root root 191 Aug 18 2015 90-nproc.conf
>
> -rw-r--r--. 1 root root 554 Nov 25 23:57 trafdev.conf
>
> [arvindn@edev06 limits.d]$ cat trafdev.conf
>
> ….
>
>
>
> #
>
> # Added for Trafodion: Increase maximum number of processes
>
> * soft nproc 267263
>
> * hard nproc 267263
>
>
>
>
>
> Coming back to the error being seen now (assuming ulimit setup is ok):
>
>
>
> Couldn’t see in your output if “initialize trafodion,drop” succeeded or
> hung.
>
>
>
> If the command was not successful, then I think there is a mismatch
> between the metadata and hbase information because of the previous errors
> seen with thread creation.
>
>
>
> You could utilize a convenience script “ilh_trafinit” available in
> $MY_SQROOT/sql/scripts” that clears up the environment and the database for
> you and also does a initialize trafodion.
>
>
>
> Other way would be to do some of those steps on our own ( I would suggest
> to utilize the script ilh_trafinit – it’s simpler).
>
>
>
> ckillall;
>
> swhbase
>
> - disable_all ‘TRAFODION.*’
>
> - drop_all ‘TRAFODION.*’
>
>
>
> followed by sqstart and initialize trafodion via sqlci.
>
>
>
>
>
> Do please let me know if this works for you.
>
>
>
> Regards
>
> Arvind
>
>
>
>
>
>
>
> *From:* 吴仕富 [mailto:wushifu1000@163.com]
> *Sent:* Monday, May 16, 2016 3:22 AM
> *To:* user@trafodion.incubator.apache.org
> *Subject:* 回复:RE: RE: 答复: Initialize Trafodion Error
>
>
>
> please focus on following modification, is it correct?
>
> and go to initialize trafodion, still fail with below info
>
>
>
> thanks
>
>
>
>
>
>
> At 2016-05-16 15:14:30, "Arvind" <na...@gmail.com> wrote:
>
> Could you please try by increasing nproc limit via ulimit -u in .bashrc or
> modifying 90-nproc.conf /adding trafodion.conf with say:
>
>
>
> * soft nproc 100000
>
> * hard nproc 100000
>
>
>
>
>
> *From:* 吴仕富 [mailto:wushifu1000@163.com]
> *Sent:* Sunday, May 15, 2016 11:20 PM
> *To:* user@trafodion.incubator.apache.org
> *Subject:* 回复:RE: 答复: Initialize Trafodion Error
>
>
>
>
>
> 1. I checked the memory size which is 16G.
>
> 2. Hadoop version with Hadoop 2.6.0-cdh5.4.4, it's the local hadoop
> version, use command install_local_hadoop, it's a single node.
>
> 3. [centos@gyvm-4 scripts]$ ulimit -a
>
> core file size (blocks, -c) 1000000
>
> data seg size (kbytes, -d) unlimited
>
> scheduling priority (-e) 0
>
> file size (blocks, -f) unlimited
>
> pending signals (-i) 267263
>
> max locked memory (kbytes, -l) 267263
>
> max memory size (kbytes, -m) unlimited
>
> open files (-n) 32000
>
> pipe size (512 bytes, -p) 8
>
> POSIX message queues (bytes, -q) 819200
>
> real-time priority (-r) 0
>
> stack size (kbytes, -s) 10240
>
> cpu time (seconds, -t) unlimited
>
> max user processes (-u) 1024
>
> virtual memory (kbytes, -v) unlimited
>
> file locks (-x) unlimited
>
> [centos@gyvm-4 etc]$ cd /etc/security/limits.d
>
> [centos@gyvm-4 limits.d]$ ls
>
> 90-nproc.conf
>
>
>
>
>
> thanks
>
>
>
>
> At 2016-05-16 12:54:28, "Arvind" <na...@gmail.com> wrote:
>
> In addition to Amanda’s question, do please also check on nproc/nofile via
> ulimit -a, ulimit -n, ulimit -u and/or /etc/security/limits.d. Saw some
> pthread create errors in the logs:
>
>
>
> src/mt_adaptor.c:223: start_threads: Assertion `"pthread_create() failed
> for the IO thread
>
>
>
>
>
> *From:* Amanda Moran [mailto:amanda.moran@esgyn.com]
> *Sent:* Sunday, May 15, 2016 8:52 PM
> *To:* user@trafodion.incubator.apache.org
> *Subject:* Re: 答复: Initialize Trafodion Error
>
>
>
> Which version of Hadoop are you using?
>
>
>
> If it's Cloudera, check your HBase role groups. You can only have one (the
> default group).
>
>
>
> Thanks!
>
>
> Sent from my iPhone
>
>
> On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <mi...@esgyn.cn> wrote:
>
> Hi,
>
>
>
> The error message said :
>
> Java.lang.OutOfMemoryError
>
>
>
> So would you please check the system memory usage by
>
> free -m
>
> before try to sqstart
>
>
>
> At least there need 2G free memory to start Trafodion I guess.
>
>
>
>
>
> Thanks,
>
> Ming
>
>
>
> *发件人**:* 吴仕富 [mailto:wushifu1000@163.com <wu...@163.com>]
> *发送时间:* 2016年5月16日 10:59
> *收件人:* user@trafodion.incubator.apache.org
> *主题:* Initialize Trafodion Error
>
>
>
> Hi,
>
> Attached all log info, please check it out if you try to go through this
> error.
>
> The error is posted during initializing Trafodion, the HBase’s interface
> create() can’t be invoked,
>
> please focus on the following log info.
>
> <image001.png>
>
> I go to check the idle process HMaster whether run or not, the following
> is my attached figure.
>
> <image002.png>
>
> Go through this file, HBase is running correctly.
>
> So I try to “initialize trafodion, drop” and go to reinitialize trafodion,
> it still can’t pass with this error, and try many times.
>
> Please give some advice if you guys solve this problem.
>
>
>
> Thanks
>
> Swayer
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
--
Thanks,
Gunnar
*If you think you can you can, if you think you can't you're right.*
RE: RE: RE: RE: 答复: Initialize Trafodion Error
Posted by Narain Arvind <na...@gmail.com>.
You are welcome Swayer. Glad to know your instance is up and running and you
are able to proceed further.
Regards
Arvind
From: ���˸� [mailto:wushifu1000@163.com]
Sent: Tuesday, May 17, 2016 1:16 AM
To: user@trafodion.incubator.apache.org
Subject: �ظ�:RE: RE: RE: ��: Initialize Trafodion Error
Arvind, thanks for your help so much. this problem have been solved by your
below solution. we just increase these processes' number, now we can
initialize trafodion,
and finish creating test environment.
#
# Added for Trafodion: Increase maximum number of processes
* soft nproc 267263
* hard nproc 267263
Best regards
Swayer
At 2016-05-16 20:41:01, "Arvind" <narain.arvind@gmail.com
<ma...@gmail.com> > wrote:
Thanks Swayer for trying out the suggestions.
Yes it does look ok to me. You could verify by executing ��ulimit -u�� or
��ulimit -a�� from a new shell to check on the new limit for nproc. It is
similar to the suggestions mentioned in the following to setup the test
environment (1) and also for clusters (2).
1)
https://cwiki.apache.org/confluence/display/TRAFODION/Create+Test+Environmen
t#CreateTestEnvironment-SystemLimits
2)
http://trafodion.apache.org/docs/provisioning_guide/index.html#requirements-
operating-system-changes
This is how it is setup on some of the development systems I��ve worked on
total 8
-rw-r--r--. 1 root root 191 Aug 18 2015 90-nproc.conf
-rw-r--r--. 1 root root 554 Nov 25 23:57 trafdev.conf
[arvindn@edev06 limits.d]$ cat trafdev.conf
��.
#
# Added for Trafodion: Increase maximum number of processes
* soft nproc 267263
* hard nproc 267263
Coming back to the error being seen now (assuming ulimit setup is ok):
Couldn��t see in your output if ��initialize trafodion,drop�� succeeded or
hung.
If the command was not successful, then I think there is a mismatch between
the metadata and hbase information because of the previous errors seen with
thread creation.
You could utilize a convenience script ��ilh_trafinit�� available in
$MY_SQROOT/sql/scripts�� that clears up the environment and the database for
you and also does a initialize trafodion.
Other way would be to do some of those steps on our own ( I would suggest to
utilize the script ilh_trafinit �C it��s simpler).
ckillall;
swhbase
- disable_all ��TRAFODION.*��
- drop_all ��TRAFODION.*��
followed by sqstart and initialize trafodion via sqlci.
Do please let me know if this works for you.
Regards
Arvind
From: ���˸� [mailto:wushifu1000@163.com <ma...@163.com> ]
Sent: Monday, May 16, 2016 3:22 AM
To: user@trafodion.incubator.apache.org
<ma...@trafodion.incubator.apache.org>
Subject: �ظ�:RE: RE: ��: Initialize Trafodion Error
please focus on following modification, is it correct?
and go to initialize trafodion, still fail with below info
thanks
At 2016-05-16 15:14:30, "Arvind" <narain.arvind@gmail.com
<ma...@gmail.com> > wrote:
Could you please try by increasing nproc limit via ulimit -u in .bashrc or
modifying 90-nproc.conf /adding trafodion.conf with say:
* soft nproc 100000
* hard nproc 100000
From: ���˸� [mailto:wushifu1000@163.com <ma...@163.com> ]
Sent: Sunday, May 15, 2016 11:20 PM
To: user@trafodion.incubator.apache.org
<ma...@trafodion.incubator.apache.org>
Subject: �ظ�:RE: ��: Initialize Trafodion Error
1. I checked the memory size which is 16G.
2. Hadoop version with Hadoop 2.6.0-cdh5.4.4, it's the local hadoop version,
use command install_local_hadoop, it's a single node.
3. [centos@gyvm-4 scripts]$ ulimit -a
core file size (blocks, -c) 1000000
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 267263
max locked memory (kbytes, -l) 267263
max memory size (kbytes, -m) unlimited
open files (-n) 32000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[centos@gyvm-4 etc]$ cd /etc/security/limits.d
[centos@gyvm-4 limits.d]$ ls
90-nproc.conf
thanks
At 2016-05-16 12:54:28, "Arvind" <narain.arvind@gmail.com
<ma...@gmail.com> > wrote:
In addition to Amanda��s question, do please also check on nproc/nofile via
ulimit -a, ulimit -n, ulimit -u and/or /etc/security/limits.d. Saw some
pthread create errors in the logs:
src/mt_adaptor.c:223: start_threads: Assertion `"pthread_create() failed for
the IO thread
From: Amanda Moran [mailto:amanda.moran@esgyn.com
<ma...@esgyn.com> ]
Sent: Sunday, May 15, 2016 8:52 PM
To: user@trafodion.incubator.apache.org
<ma...@trafodion.incubator.apache.org>
Subject: Re: ��: Initialize Trafodion Error
Which version of Hadoop are you using?
If it's Cloudera, check your HBase role groups. You can only have one (the
default group).
Thanks!
Sent from my iPhone
On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <ming.liu@esgyn.cn
<ma...@esgyn.cn> > wrote:
Hi,
The error message said :
Java.lang.OutOfMemoryError
So would you please check the system memory usage by
free -m
before try to sqstart
At least there need 2G free memory to start Trafodion I guess.
Thanks,
Ming
������: ���˸� [mailto:wushifu1000@163.com]
����ʱ��: 2016��5��16�� 10:59
�ռ���: user@trafodion.incubator.apache.org
<ma...@trafodion.incubator.apache.org>
����: Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this
error.
The error is posted during initializing Trafodion, the HBase��s interface
create() can��t be invoked,
please focus on the following log info.
<image001.png>
I go to check the idle process HMaster whether run or not, the following is
my attached figure.
<image002.png>
Go through this file, HBase is running correctly.
So I try to ��initialize trafodion, drop�� and go to reinitialize trafodion,
it still can��t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer
回复:RE: RE: RE: 答复: Initialize Trafodion Error
Posted by 吴仕富 <wu...@163.com>.
Arvind, thanks for your help so much. this problem have been solved by your below solution. we just increase these processes' number, now we can initialize trafodion,
and finish creating test environment.
#
# Added for Trafodion: Increase maximum number of processes
* soft nproc 267263
* hard nproc 267263
Best regards
Swayer
At 2016-05-16 20:41:01, "Arvind" <na...@gmail.com> wrote:
Thanks Swayer for trying out the suggestions.
Yes it does look ok to me. You could verify by executing “ulimit -u” or “ulimit -a” from a new shell to check on the new limit for nproc. It is similar to the suggestions mentioned in the following to setup the test environment (1) and also for clusters (2).
1) https://cwiki.apache.org/confluence/display/TRAFODION/Create+Test+Environment#CreateTestEnvironment-SystemLimits
2) http://trafodion.apache.org/docs/provisioning_guide/index.html#requirements-operating-system-changes
This is how it is setup on some of the development systems I’ve worked on
total 8
-rw-r--r--. 1 root root 191 Aug 18 2015 90-nproc.conf
-rw-r--r--. 1 root root 554 Nov 25 23:57 trafdev.conf
[arvindn@edev06 limits.d]$ cat trafdev.conf
….
#
# Added for Trafodion: Increase maximum number of processes
* soft nproc 267263
* hard nproc 267263
Coming back to the error being seen now (assuming ulimit setup is ok):
Couldn’t see in your output if “initialize trafodion,drop” succeeded or hung.
If the command was not successful, then I think there is a mismatch between the metadata and hbase information because of the previous errors seen with thread creation.
You could utilize a convenience script “ilh_trafinit” available in $MY_SQROOT/sql/scripts” that clears up the environment and the database for you and also does a initialize trafodion.
Other way would be to do some of those steps on our own ( I would suggest to utilize the script ilh_trafinit – it’s simpler).
ckillall;
swhbase
- disable_all ‘TRAFODION.*’
- drop_all ‘TRAFODION.*’
followed by sqstart and initialize trafodion via sqlci.
Do please let me know if this works for you.
Regards
Arvind
From:吴仕富 [mailto:wushifu1000@163.com]
Sent: Monday, May 16, 2016 3:22 AM
To:user@trafodion.incubator.apache.org
Subject:回复:RE: RE: 答复: Initialize Trafodion Error
please focus on following modification, is it correct?
and go to initialize trafodion, still fail with below info
thanks
At 2016-05-16 15:14:30, "Arvind" <na...@gmail.com> wrote:
Could you please try by increasing nproc limit via ulimit -u in .bashrc or modifying 90-nproc.conf /adding trafodion.conf with say:
* soft nproc 100000
* hard nproc 100000
From:吴仕富 [mailto:wushifu1000@163.com]
Sent: Sunday, May 15, 2016 11:20 PM
To:user@trafodion.incubator.apache.org
Subject:回复:RE: 答复: Initialize Trafodion Error
1. I checked the memory size which is 16G.
2. Hadoop version with Hadoop 2.6.0-cdh5.4.4, it's the local hadoop version, use command install_local_hadoop, it's a single node.
3. [centos@gyvm-4 scripts]$ ulimit -a
core file size (blocks, -c) 1000000
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 267263
max locked memory (kbytes, -l) 267263
max memory size (kbytes, -m) unlimited
open files (-n) 32000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[centos@gyvm-4 etc]$ cd /etc/security/limits.d
[centos@gyvm-4 limits.d]$ ls
90-nproc.conf
thanks
At 2016-05-16 12:54:28, "Arvind" <na...@gmail.com> wrote:
In addition to Amanda’s question, do please also check on nproc/nofile via ulimit -a, ulimit -n, ulimit -u and/or /etc/security/limits.d. Saw some pthread create errors in the logs:
src/mt_adaptor.c:223: start_threads: Assertion `"pthread_create() failed for the IO thread
From: Amanda Moran [mailto:amanda.moran@esgyn.com]
Sent: Sunday, May 15, 2016 8:52 PM
To:user@trafodion.incubator.apache.org
Subject: Re: 答复: Initialize Trafodion Error
Which version of Hadoop are you using?
If it's Cloudera, check your HBase role groups. You can only have one (the default group).
Thanks!
Sent from my iPhone
On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <mi...@esgyn.cn> wrote:
Hi,
The error message said :
Java.lang.OutOfMemoryError
So would you please check the system memory usage by
free -m
before try to sqstart
At least there need 2G free memory to start Trafodion I guess.
Thanks,
Ming
发件人:吴仕富 [mailto:wushifu1000@163.com]
发送时间: 2016年5月16日 10:59
收件人:user@trafodion.incubator.apache.org
主题: Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this error.
The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
please focus on the following log info.
<image001.png>
I go to check the idle process HMaster whether run or not, the following is my attached figure.
<image002.png>
Go through this file, HBase is running correctly.
So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer
RE: RE: RE: 答复: Initialize Trafodion Error
Posted by Arvind <na...@gmail.com>.
Thanks Swayer for trying out the suggestions.
Yes it does look ok to me. You could verify by executing “ulimit -u” or “ulimit -a” from a new shell to check on the new limit for nproc. It is similar to the suggestions mentioned in the following to setup the test environment (1) and also for clusters (2).
1) https://cwiki.apache.org/confluence/display/TRAFODION/Create+Test+Environment#CreateTestEnvironment-SystemLimits
2) http://trafodion.apache.org/docs/provisioning_guide/index.html#requirements-operating-system-changes
This is how it is setup on some of the development systems I’ve worked on
total 8
-rw-r--r--. 1 root root 191 Aug 18 2015 90-nproc.conf
-rw-r--r--. 1 root root 554 Nov 25 23:57 trafdev.conf
[arvindn@edev06 limits.d]$ cat trafdev.conf
….
#
# Added for Trafodion: Increase maximum number of processes
* soft nproc 267263
* hard nproc 267263
Coming back to the error being seen now (assuming ulimit setup is ok):
Couldn’t see in your output if “initialize trafodion,drop” succeeded or hung.
If the command was not successful, then I think there is a mismatch between the metadata and hbase information because of the previous errors seen with thread creation.
You could utilize a convenience script “ilh_trafinit” available in $MY_SQROOT/sql/scripts” that clears up the environment and the database for you and also does a initialize trafodion.
Other way would be to do some of those steps on our own ( I would suggest to utilize the script ilh_trafinit – it’s simpler).
ckillall;
swhbase
- disable_all ‘TRAFODION.*’
- drop_all ‘TRAFODION.*’
followed by sqstart and initialize trafodion via sqlci.
Do please let me know if this works for you.
Regards
Arvind
From: 吴仕富 [mailto:wushifu1000@163.com]
Sent: Monday, May 16, 2016 3:22 AM
To: user@trafodion.incubator.apache.org
Subject: 回复:RE: RE: 答复: Initialize Trafodion Error
please focus on following modification, is it correct?
and go to initialize trafodion, still fail with below info
thanks
At 2016-05-16 15:14:30, "Arvind" <narain.arvind@gmail.com <ma...@gmail.com> > wrote:
Could you please try by increasing nproc limit via ulimit -u in .bashrc or modifying 90-nproc.conf /adding trafodion.conf with say:
* soft nproc 100000
* hard nproc 100000
From: 吴仕富 [mailto:wushifu1000@163.com <ma...@163.com> ]
Sent: Sunday, May 15, 2016 11:20 PM
To: user@trafodion.incubator.apache.org <ma...@trafodion.incubator.apache.org>
Subject: 回复:RE: 答复: Initialize Trafodion Error
1. I checked the memory size which is 16G.
2. Hadoop version with Hadoop 2.6.0-cdh5.4.4, it's the local hadoop version, use command install_local_hadoop, it's a single node.
3. [centos@gyvm-4 scripts]$ ulimit -a
core file size (blocks, -c) 1000000
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 267263
max locked memory (kbytes, -l) 267263
max memory size (kbytes, -m) unlimited
open files (-n) 32000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[centos@gyvm-4 etc]$ cd /etc/security/limits.d
[centos@gyvm-4 limits.d]$ ls
90-nproc.conf
thanks
At 2016-05-16 12:54:28, "Arvind" <narain.arvind@gmail.com <ma...@gmail.com> > wrote:
In addition to Amanda’s question, do please also check on nproc/nofile via ulimit -a, ulimit -n, ulimit -u and/or /etc/security/limits.d. Saw some pthread create errors in the logs:
src/mt_adaptor.c:223: start_threads: Assertion `"pthread_create() failed for the IO thread
From: Amanda Moran [mailto:amanda.moran@esgyn.com <ma...@esgyn.com> ]
Sent: Sunday, May 15, 2016 8:52 PM
To: user@trafodion.incubator.apache.org <ma...@trafodion.incubator.apache.org>
Subject: Re: 答复: Initialize Trafodion Error
Which version of Hadoop are you using?
If it's Cloudera, check your HBase role groups. You can only have one (the default group).
Thanks!
Sent from my iPhone
On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <ming.liu@esgyn.cn <ma...@esgyn.cn> > wrote:
Hi,
The error message said :
Java.lang.OutOfMemoryError
So would you please check the system memory usage by
free -m
before try to sqstart
At least there need 2G free memory to start Trafodion I guess.
Thanks,
Ming
发件人: 吴仕富 [mailto:wushifu1000@163.com]
发送时间: 2016年5月16日 10:59
收件人: user@trafodion.incubator.apache.org <ma...@trafodion.incubator.apache.org>
主题: Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this error.
The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
please focus on the following log info.
<image001.png>
I go to check the idle process HMaster whether run or not, the following is my attached figure.
<image002.png>
Go through this file, HBase is running correctly.
So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer
回复:RE: RE: 答复: Initialize Trafodion Error
Posted by 吴仕富 <wu...@163.com>.
please focus on following modification, is it correct?
and go to initialize trafodion, still fail with below info
thanks
At 2016-05-16 15:14:30, "Arvind" <na...@gmail.com> wrote:
Could you please try by increasing nproc limit via ulimit -u in .bashrc or modifying 90-nproc.conf /adding trafodion.conf with say:
* soft nproc 100000
* hard nproc 100000
From:吴仕富 [mailto:wushifu1000@163.com]
Sent: Sunday, May 15, 2016 11:20 PM
To:user@trafodion.incubator.apache.org
Subject:回复:RE: 答复: Initialize Trafodion Error
1. I checked the memory size which is 16G.
2. Hadoop version with Hadoop 2.6.0-cdh5.4.4, it's the local hadoop version, use command install_local_hadoop, it's a single node.
3. [centos@gyvm-4 scripts]$ ulimit -a
core file size (blocks, -c) 1000000
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 267263
max locked memory (kbytes, -l) 267263
max memory size (kbytes, -m) unlimited
open files (-n) 32000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[centos@gyvm-4 etc]$ cd /etc/security/limits.d
[centos@gyvm-4 limits.d]$ ls
90-nproc.conf
thanks
At 2016-05-16 12:54:28, "Arvind" <na...@gmail.com> wrote:
In addition to Amanda’s question, do please also check on nproc/nofile via ulimit -a, ulimit -n, ulimit -u and/or /etc/security/limits.d. Saw some pthread create errors in the logs:
src/mt_adaptor.c:223: start_threads: Assertion `"pthread_create() failed for the IO thread
From: Amanda Moran [mailto:amanda.moran@esgyn.com]
Sent: Sunday, May 15, 2016 8:52 PM
To:user@trafodion.incubator.apache.org
Subject: Re: 答复: Initialize Trafodion Error
Which version of Hadoop are you using?
If it's Cloudera, check your HBase role groups. You can only have one (the default group).
Thanks!
Sent from my iPhone
On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <mi...@esgyn.cn> wrote:
Hi,
The error message said :
Java.lang.OutOfMemoryError
So would you please check the system memory usage by
free -m
before try to sqstart
At least there need 2G free memory to start Trafodion I guess.
Thanks,
Ming
发件人:吴仕富 [mailto:wushifu1000@163.com]
发送时间: 2016年5月16日 10:59
收件人:user@trafodion.incubator.apache.org
主题: Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this error.
The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
please focus on the following log info.
<image001.png>
I go to check the idle process HMaster whether run or not, the following is my attached figure.
<image002.png>
Go through this file, HBase is running correctly.
So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer
RE: RE: 答复: Initialize Trafodion Error
Posted by Arvind <na...@gmail.com>.
Could you please try by increasing nproc limit via ulimit -u in .bashrc or modifying 90-nproc.conf /adding trafodion.conf with say:
* soft nproc 100000
* hard nproc 100000
From: 吴仕富 [mailto:wushifu1000@163.com]
Sent: Sunday, May 15, 2016 11:20 PM
To: user@trafodion.incubator.apache.org
Subject: 回复:RE: 答复: Initialize Trafodion Error
1. I checked the memory size which is 16G.
2. Hadoop version with Hadoop 2.6.0-cdh5.4.4, it's the local hadoop version, use command install_local_hadoop, it's a single node.
3. [centos@gyvm-4 scripts]$ ulimit -a
core file size (blocks, -c) 1000000
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 267263
max locked memory (kbytes, -l) 267263
max memory size (kbytes, -m) unlimited
open files (-n) 32000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[centos@gyvm-4 etc]$ cd /etc/security/limits.d
[centos@gyvm-4 limits.d]$ ls
90-nproc.conf
thanks
At 2016-05-16 12:54:28, "Arvind" <narain.arvind@gmail.com <ma...@gmail.com> > wrote:
In addition to Amanda’s question, do please also check on nproc/nofile via ulimit -a, ulimit -n, ulimit -u and/or /etc/security/limits.d. Saw some pthread create errors in the logs:
src/mt_adaptor.c:223: start_threads: Assertion `"pthread_create() failed for the IO thread
From: Amanda Moran [mailto:amanda.moran@esgyn.com <ma...@esgyn.com> ]
Sent: Sunday, May 15, 2016 8:52 PM
To: user@trafodion.incubator.apache.org <ma...@trafodion.incubator.apache.org>
Subject: Re: 答复: Initialize Trafodion Error
Which version of Hadoop are you using?
If it's Cloudera, check your HBase role groups. You can only have one (the default group).
Thanks!
Sent from my iPhone
On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <ming.liu@esgyn.cn <ma...@esgyn.cn> > wrote:
Hi,
The error message said :
Java.lang.OutOfMemoryError
So would you please check the system memory usage by
free -m
before try to sqstart
At least there need 2G free memory to start Trafodion I guess.
Thanks,
Ming
发件人: 吴仕富 [mailto:wushifu1000@163.com]
发送时间: 2016年5月16日 10:59
收件人: user@trafodion.incubator.apache.org <ma...@trafodion.incubator.apache.org>
主题: Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this error.
The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
please focus on the following log info.
<image001.png>
I go to check the idle process HMaster whether run or not, the following is my attached figure.
<image002.png>
Go through this file, HBase is running correctly.
So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer
回复:RE: 答复: Initialize Trafodion Error
Posted by 吴仕富 <wu...@163.com>.
1. I checked the memory size which is 16G.
2. Hadoop version with Hadoop 2.6.0-cdh5.4.4, it's the local hadoop version, use command install_local_hadoop, it's a single node.
3. [centos@gyvm-4 scripts]$ ulimit -a
core file size (blocks, -c) 1000000
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 267263
max locked memory (kbytes, -l) 267263
max memory size (kbytes, -m) unlimited
open files (-n) 32000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[centos@gyvm-4 etc]$ cd /etc/security/limits.d
[centos@gyvm-4 limits.d]$ ls
90-nproc.conf
thanks
At 2016-05-16 12:54:28, "Arvind" <na...@gmail.com> wrote:
In addition to Amanda’s question, do please also check on nproc/nofile via ulimit -a, ulimit -n, ulimit -u and/or /etc/security/limits.d. Saw some pthread create errors in the logs:
src/mt_adaptor.c:223: start_threads: Assertion `"pthread_create() failed for the IO thread
From: Amanda Moran [mailto:amanda.moran@esgyn.com]
Sent: Sunday, May 15, 2016 8:52 PM
To:user@trafodion.incubator.apache.org
Subject: Re: 答复: Initialize Trafodion Error
Which version of Hadoop are you using?
If it's Cloudera, check your HBase role groups. You can only have one (the default group).
Thanks!
Sent from my iPhone
On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <mi...@esgyn.cn> wrote:
Hi,
The error message said :
Java.lang.OutOfMemoryError
So would you please check the system memory usage by
free -m
before try to sqstart
At least there need 2G free memory to start Trafodion I guess.
Thanks,
Ming
发件人: 吴仕富 [mailto:wushifu1000@163.com]
发送时间: 2016年5月16日 10:59
收件人:user@trafodion.incubator.apache.org
主题: Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this error.
The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
please focus on the following log info.
<image001.png>
I go to check the idle process HMaster whether run or not, the following is my attached figure.
<image002.png>
Go through this file, HBase is running correctly.
So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer
RE: 答复: Initialize Trafodion Error
Posted by Arvind <na...@gmail.com>.
In addition to Amanda’s question, do please also check on nproc/nofile via ulimit -a, ulimit -n, ulimit -u and/or /etc/security/limits.d. Saw some pthread create errors in the logs:
src/mt_adaptor.c:223: start_threads: Assertion `"pthread_create() failed for the IO thread
From: Amanda Moran [mailto:amanda.moran@esgyn.com]
Sent: Sunday, May 15, 2016 8:52 PM
To: user@trafodion.incubator.apache.org
Subject: Re: 答复: Initialize Trafodion Error
Which version of Hadoop are you using?
If it's Cloudera, check your HBase role groups. You can only have one (the default group).
Thanks!
Sent from my iPhone
On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <ming.liu@esgyn.cn <ma...@esgyn.cn> > wrote:
Hi,
The error message said :
Java.lang.OutOfMemoryError
So would you please check the system memory usage by
free -m
before try to sqstart
At least there need 2G free memory to start Trafodion I guess.
Thanks,
Ming
发件人: 吴仕富 [mailto:wushifu1000@163.com]
发送时间: 2016年5月16日 10:59
收件人: user@trafodion.incubator.apache.org <ma...@trafodion.incubator.apache.org>
主题: Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this error.
The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
please focus on the following log info.
<image001.png>
I go to check the idle process HMaster whether run or not, the following is my attached figure.
<image002.png>
Go through this file, HBase is running correctly.
So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer
Re: 答复: Initialize Trafodion Error
Posted by Amanda Moran <am...@esgyn.com>.
Which version of Hadoop are you using?
If it's Cloudera, check your HBase role groups. You can only have one (the default group).
Thanks!
Sent from my iPhone
> On May 15, 2016, at 8:11 PM, Liu, Ming (Ming) <mi...@esgyn.cn> wrote:
>
> Hi,
>
> The error message said :
> Java.lang.OutOfMemoryError
>
> So would you please check the system memory usage by
> free -m
> before try to sqstart
>
> At least there need 2G free memory to start Trafodion I guess.
>
>
> Thanks,
> Ming
>
> 发件人: 吴仕富 [mailto:wushifu1000@163.com]
> 发送时间: 2016年5月16日 10:59
> 收件人: user@trafodion.incubator.apache.org
> 主题: Initialize Trafodion Error
>
> Hi,
> Attached all log info, please check it out if you try to go through this error.
> The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
> please focus on the following log info.
> <image001.png>
> I go to check the idle process HMaster whether run or not, the following is my attached figure.
> <image002.png>
> Go through this file, HBase is running correctly.
> So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
> Please give some advice if you guys solve this problem.
>
> Thanks
> Swayer
>
>
>
>
>
>
>
>
答复: Initialize Trafodion Error
Posted by "Liu, Ming (Ming)" <mi...@esgyn.cn>.
Hi,
The error message said :
Java.lang.OutOfMemoryError
So would you please check the system memory usage by
free -m
before try to sqstart
At least there need 2G free memory to start Trafodion I guess.
Thanks,
Ming
发件人: 吴仕富 [mailto:wushifu1000@163.com]
发送时间: 2016年5月16日 10:59
收件人: user@trafodion.incubator.apache.org
主题: Initialize Trafodion Error
Hi,
Attached all log info, please check it out if you try to go through this error.
The error is posted during initializing Trafodion, the HBase’s interface create() can’t be invoked,
please focus on the following log info.
[cid:image001.png@01D1AF62.E3298560]
I go to check the idle process HMaster whether run or not, the following is my attached figure.
[cid:image002.png@01D1AF62.E3298560]
Go through this file, HBase is running correctly.
So I try to “initialize trafodion, drop” and go to reinitialize trafodion, it still can’t pass with this error, and try many times.
Please give some advice if you guys solve this problem.
Thanks
Swayer