You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@trafodion.apache.org by Eric Owhadi <er...@esgyn.com> on 2015/12/21 21:48:09 UTC
sqstart or sqstop not responding?
First time I see this: sqstart command or sqstop command not responding.
Doing ckillall does not restore good behavior. Swtartall and swstopall
ealso have no effect on restoring good behavior of sqstart and sqstop?
Anyone know what could be going on, and how to recover?
Eric
RE: sqstart or sqstop not responding?
Posted by Roberta Marton <ro...@esgyn.com>.
I ran the linc-cleanup-sockets and had to manually remove some hbase/Hadoop
processes and now everything is back up.
Thanks for the tip Anoop.
Roberta
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 1:09 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
FYI, not sure if what I did fixed it, but after running sqcheck, then
sqstart, it started working again???
Eric
-----Original Message-----
From: Roberta Marton [mailto:roberta.marton@esgyn.com]
Sent: Monday, December 21, 2015 2:58 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
I noticed my data node was down.
Roberta
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:58 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Yes dev05
-----Original Message-----
From: Roberta Marton [mailto:roberta.marton@esgyn.com]
Sent: Monday, December 21, 2015 2:56 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Are you an dev05? I am seeing some interesting errors on this system also.
My sqstop is hanging.
When I try to bring up hbase, I am seeing:
015-12-21 20:52:12,949 INFO [main] Configuration.deprecation:
hadoop.native.lib is deprecated. Instead, use io.native.lib.available
java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: No space left on
device
I look and things seem okay:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/vda1 30829600 25063972 4192928 86% /
tmpfs 15406600 96 15406504 1% /dev/shm
/dev/vdb 206292968 90033592 105773616 46% /mnt
Disk usage
16K /mnt/lost+found
1.7G /mnt/ssubbiah
2.0G /mnt/hegdean
2.0G /mnt/owhadi
4.0K /mnt/amishra
4.0K /mnt/amoran
4.0K /mnt/ansharma
4.0K /mnt/arvindn
4.0K /mnt/carolp
4.0K /mnt/gselva
4.0K /mnt/gtapper
4.0K /mnt/muthuven
4.0K /mnt/ngoyal
4.0K /mnt/qfc
4.0K /mnt/sandhyasun
4.0K /mnt/vasudevp
4.0K /mnt/wtsai
4.0K /mnt/zellerh
63G /mnt
7.5G /mnt/sbroeder
8.7G /mnt/trinak
9.0G /mnt/rmarton
9.4G /mnt/dmarkt
11G /mnt/birdsall
12G /mnt/sstung
Roberta
-----Original Message-----
From: Dave Birdsall [mailto:dave.birdsall@esgyn.com]
Sent: Monday, December 21, 2015 12:53 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Perhaps there are some VM issues?
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:48 PM
To: dev@trafodion.incubator.apache.org
Subject: sqstart or sqstop not responding?
First time I see this: sqstart command or sqstop command not responding.
Doing ckillall does not restore good behavior. Swtartall and swstopall ealso
have no effect on restoring good behavior of sqstart and sqstop?
Anyone know what could be going on, and how to recover?
Eric
RE: sqstart or sqstop not responding?
Posted by Eric Owhadi <er...@esgyn.com>.
FYI, not sure if what I did fixed it, but after running sqcheck, then
sqstart, it started working again???
Eric
-----Original Message-----
From: Roberta Marton [mailto:roberta.marton@esgyn.com]
Sent: Monday, December 21, 2015 2:58 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
I noticed my data node was down.
Roberta
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:58 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Yes dev05
-----Original Message-----
From: Roberta Marton [mailto:roberta.marton@esgyn.com]
Sent: Monday, December 21, 2015 2:56 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Are you an dev05? I am seeing some interesting errors on this system also.
My sqstop is hanging.
When I try to bring up hbase, I am seeing:
015-12-21 20:52:12,949 INFO [main] Configuration.deprecation:
hadoop.native.lib is deprecated. Instead, use io.native.lib.available
java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: No space left on
device
I look and things seem okay:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/vda1 30829600 25063972 4192928 86% /
tmpfs 15406600 96 15406504 1% /dev/shm
/dev/vdb 206292968 90033592 105773616 46% /mnt
Disk usage
16K /mnt/lost+found
1.7G /mnt/ssubbiah
2.0G /mnt/hegdean
2.0G /mnt/owhadi
4.0K /mnt/amishra
4.0K /mnt/amoran
4.0K /mnt/ansharma
4.0K /mnt/arvindn
4.0K /mnt/carolp
4.0K /mnt/gselva
4.0K /mnt/gtapper
4.0K /mnt/muthuven
4.0K /mnt/ngoyal
4.0K /mnt/qfc
4.0K /mnt/sandhyasun
4.0K /mnt/vasudevp
4.0K /mnt/wtsai
4.0K /mnt/zellerh
63G /mnt
7.5G /mnt/sbroeder
8.7G /mnt/trinak
9.0G /mnt/rmarton
9.4G /mnt/dmarkt
11G /mnt/birdsall
12G /mnt/sstung
Roberta
-----Original Message-----
From: Dave Birdsall [mailto:dave.birdsall@esgyn.com]
Sent: Monday, December 21, 2015 12:53 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Perhaps there are some VM issues?
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:48 PM
To: dev@trafodion.incubator.apache.org
Subject: sqstart or sqstop not responding?
First time I see this: sqstart command or sqstop command not responding.
Doing ckillall does not restore good behavior. Swtartall and swstopall ealso
have no effect on restoring good behavior of sqstart and sqstop?
Anyone know what could be going on, and how to recover?
Eric
RE: sqstart or sqstop not responding?
Posted by Roberta Marton <ro...@esgyn.com>.
I noticed my data node was down.
Roberta
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:58 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Yes dev05
-----Original Message-----
From: Roberta Marton [mailto:roberta.marton@esgyn.com]
Sent: Monday, December 21, 2015 2:56 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Are you an dev05? I am seeing some interesting errors on this system also.
My sqstop is hanging.
When I try to bring up hbase, I am seeing:
015-12-21 20:52:12,949 INFO [main] Configuration.deprecation:
hadoop.native.lib is deprecated. Instead, use io.native.lib.available
java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: No space left on
device
I look and things seem okay:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/vda1 30829600 25063972 4192928 86% /
tmpfs 15406600 96 15406504 1% /dev/shm
/dev/vdb 206292968 90033592 105773616 46% /mnt
Disk usage
16K /mnt/lost+found
1.7G /mnt/ssubbiah
2.0G /mnt/hegdean
2.0G /mnt/owhadi
4.0K /mnt/amishra
4.0K /mnt/amoran
4.0K /mnt/ansharma
4.0K /mnt/arvindn
4.0K /mnt/carolp
4.0K /mnt/gselva
4.0K /mnt/gtapper
4.0K /mnt/muthuven
4.0K /mnt/ngoyal
4.0K /mnt/qfc
4.0K /mnt/sandhyasun
4.0K /mnt/vasudevp
4.0K /mnt/wtsai
4.0K /mnt/zellerh
63G /mnt
7.5G /mnt/sbroeder
8.7G /mnt/trinak
9.0G /mnt/rmarton
9.4G /mnt/dmarkt
11G /mnt/birdsall
12G /mnt/sstung
Roberta
-----Original Message-----
From: Dave Birdsall [mailto:dave.birdsall@esgyn.com]
Sent: Monday, December 21, 2015 12:53 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Perhaps there are some VM issues?
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:48 PM
To: dev@trafodion.incubator.apache.org
Subject: sqstart or sqstop not responding?
First time I see this: sqstart command or sqstop command not responding.
Doing ckillall does not restore good behavior. Swtartall and swstopall ealso
have no effect on restoring good behavior of sqstart and sqstop?
Anyone know what could be going on, and how to recover?
Eric
RE: sqstart or sqstop not responding?
Posted by Eric Owhadi <er...@esgyn.com>.
Yes dev05
-----Original Message-----
From: Roberta Marton [mailto:roberta.marton@esgyn.com]
Sent: Monday, December 21, 2015 2:56 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Are you an dev05? I am seeing some interesting errors on this system also.
My sqstop is hanging.
When I try to bring up hbase, I am seeing:
015-12-21 20:52:12,949 INFO [main] Configuration.deprecation:
hadoop.native.lib is deprecated. Instead, use io.native.lib.available
java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: No space left on
device
I look and things seem okay:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/vda1 30829600 25063972 4192928 86% /
tmpfs 15406600 96 15406504 1% /dev/shm
/dev/vdb 206292968 90033592 105773616 46% /mnt
Disk usage
16K /mnt/lost+found
1.7G /mnt/ssubbiah
2.0G /mnt/hegdean
2.0G /mnt/owhadi
4.0K /mnt/amishra
4.0K /mnt/amoran
4.0K /mnt/ansharma
4.0K /mnt/arvindn
4.0K /mnt/carolp
4.0K /mnt/gselva
4.0K /mnt/gtapper
4.0K /mnt/muthuven
4.0K /mnt/ngoyal
4.0K /mnt/qfc
4.0K /mnt/sandhyasun
4.0K /mnt/vasudevp
4.0K /mnt/wtsai
4.0K /mnt/zellerh
63G /mnt
7.5G /mnt/sbroeder
8.7G /mnt/trinak
9.0G /mnt/rmarton
9.4G /mnt/dmarkt
11G /mnt/birdsall
12G /mnt/sstung
Roberta
-----Original Message-----
From: Dave Birdsall [mailto:dave.birdsall@esgyn.com]
Sent: Monday, December 21, 2015 12:53 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Perhaps there are some VM issues?
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:48 PM
To: dev@trafodion.incubator.apache.org
Subject: sqstart or sqstop not responding?
First time I see this: sqstart command or sqstop command not responding.
Doing ckillall does not restore good behavior. Swtartall and swstopall ealso
have no effect on restoring good behavior of sqstart and sqstop?
Anyone know what could be going on, and how to recover?
Eric
RE: sqstart or sqstop not responding?
Posted by Eric Owhadi <er...@esgyn.com>.
When I say not responding, I get no error message, no message at all. Just
my command typed in , that s it.
-----Original Message-----
From: Roberta Marton [mailto:roberta.marton@esgyn.com]
Sent: Monday, December 21, 2015 2:56 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Are you an dev05? I am seeing some interesting errors on this system also.
My sqstop is hanging.
When I try to bring up hbase, I am seeing:
015-12-21 20:52:12,949 INFO [main] Configuration.deprecation:
hadoop.native.lib is deprecated. Instead, use io.native.lib.available
java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: No space left on
device
I look and things seem okay:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/vda1 30829600 25063972 4192928 86% /
tmpfs 15406600 96 15406504 1% /dev/shm
/dev/vdb 206292968 90033592 105773616 46% /mnt
Disk usage
16K /mnt/lost+found
1.7G /mnt/ssubbiah
2.0G /mnt/hegdean
2.0G /mnt/owhadi
4.0K /mnt/amishra
4.0K /mnt/amoran
4.0K /mnt/ansharma
4.0K /mnt/arvindn
4.0K /mnt/carolp
4.0K /mnt/gselva
4.0K /mnt/gtapper
4.0K /mnt/muthuven
4.0K /mnt/ngoyal
4.0K /mnt/qfc
4.0K /mnt/sandhyasun
4.0K /mnt/vasudevp
4.0K /mnt/wtsai
4.0K /mnt/zellerh
63G /mnt
7.5G /mnt/sbroeder
8.7G /mnt/trinak
9.0G /mnt/rmarton
9.4G /mnt/dmarkt
11G /mnt/birdsall
12G /mnt/sstung
Roberta
-----Original Message-----
From: Dave Birdsall [mailto:dave.birdsall@esgyn.com]
Sent: Monday, December 21, 2015 12:53 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Perhaps there are some VM issues?
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:48 PM
To: dev@trafodion.incubator.apache.org
Subject: sqstart or sqstop not responding?
First time I see this: sqstart command or sqstop command not responding.
Doing ckillall does not restore good behavior. Swtartall and swstopall ealso
have no effect on restoring good behavior of sqstart and sqstop?
Anyone know what could be going on, and how to recover?
Eric
RE: sqstart or sqstop not responding?
Posted by Roberta Marton <ro...@esgyn.com>.
Are you an dev05? I am seeing some interesting errors on this system also.
My sqstop is hanging.
When I try to bring up hbase, I am seeing:
015-12-21 20:52:12,949 INFO [main] Configuration.deprecation:
hadoop.native.lib is deprecated. Instead, use io.native.lib.available
java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: No space left on
device
I look and things seem okay:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/vda1 30829600 25063972 4192928 86% /
tmpfs 15406600 96 15406504 1% /dev/shm
/dev/vdb 206292968 90033592 105773616 46% /mnt
Disk usage
16K /mnt/lost+found
1.7G /mnt/ssubbiah
2.0G /mnt/hegdean
2.0G /mnt/owhadi
4.0K /mnt/amishra
4.0K /mnt/amoran
4.0K /mnt/ansharma
4.0K /mnt/arvindn
4.0K /mnt/carolp
4.0K /mnt/gselva
4.0K /mnt/gtapper
4.0K /mnt/muthuven
4.0K /mnt/ngoyal
4.0K /mnt/qfc
4.0K /mnt/sandhyasun
4.0K /mnt/vasudevp
4.0K /mnt/wtsai
4.0K /mnt/zellerh
63G /mnt
7.5G /mnt/sbroeder
8.7G /mnt/trinak
9.0G /mnt/rmarton
9.4G /mnt/dmarkt
11G /mnt/birdsall
12G /mnt/sstung
Roberta
-----Original Message-----
From: Dave Birdsall [mailto:dave.birdsall@esgyn.com]
Sent: Monday, December 21, 2015 12:53 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: sqstart or sqstop not responding?
Perhaps there are some VM issues?
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:48 PM
To: dev@trafodion.incubator.apache.org
Subject: sqstart or sqstop not responding?
First time I see this: sqstart command or sqstop command not responding.
Doing ckillall does not restore good behavior. Swtartall and swstopall ealso
have no effect on restoring good behavior of sqstart and sqstop?
Anyone know what could be going on, and how to recover?
Eric
RE: sqstart or sqstop not responding?
Posted by Dave Birdsall <da...@esgyn.com>.
Perhaps there are some VM issues?
-----Original Message-----
From: Eric Owhadi [mailto:eric.owhadi@esgyn.com]
Sent: Monday, December 21, 2015 12:48 PM
To: dev@trafodion.incubator.apache.org
Subject: sqstart or sqstop not responding?
First time I see this: sqstart command or sqstop command not responding.
Doing ckillall does not restore good behavior. Swtartall and swstopall ealso
have no effect on restoring good behavior of sqstart and sqstop?
Anyone know what could be going on, and how to recover?
Eric