You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hawq.apache.org by 来熊 <yi...@163.com> on 2016/04/17 19:42:46 UTC
Segment init failed
hi,all,
when I init cluster ,I got this problem:
by the way,I using "./configure --prefix=/usr/local/hawq --with-python" when I configure hawq
[gpadmin@stars1 ~]$
[gpadmin@stars1 ~]$ hawq init cluster -a
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Prepare to do 'hawq init'
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-You can find log in:
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-/home/gpadmin/hawqAdminLogs/hawq_init_20160418.log
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-GPHOME is set to:
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-/usr/local/hawq
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Init hawq with args: ['init', 'cluster']
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-No standby host configured, skip it
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Check if hdfs path is available
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[WARNING]:-2016-04-18 01:36:56.665941, p24914, th140573519669408, WARNING the number of nodes in pipeline is 1 [stars1(192.168.19.11)], is less than the expected number of replica 3 for block [block pool ID: BP-404165782-192.168.19.11-1460475603628 block ID 1073741858_1034] file /hawq_default/testFile
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-1 segment hosts defined
20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Set default_hash_table_bucket_number as: 6
20160418:01:37:03:024807 hawq_init:stars1:gpadmin-[INFO]:-Start to init master node: 'stars1'
20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-20160418:01:37:15:025063 hawqinit.sh:stars1:gpadmin-[INFO]:-Loading hawq_toolkit...
20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Master init successfully
20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Init segments in list: ['stars1']
20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Total segment number is: 1
.20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-20160418:01:37:16:025322 hawqinit.sh:stars1:gpadmin-[ERROR]:-Postgres initdb failed
20160418:01:37:16:025322 hawqinit.sh:stars1:gpadmin-[ERROR]:-Segment init failed on stars1
20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-fgets failure: Success
The program "postgres" is needed by initdb but was either not found in the same directory as "/usr/local/hawq/bin/initdb" or failed unexpectedly.
Check your installation; "postgres -V" may have more information.
20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[ERROR]:-HAWQ init failed on stars1
.
20160418:01:37:18:024807 hawq_init:stars1:gpadmin-[INFO]:-0 of 1 segments init successfully
20160418:01:37:18:024807 hawq_init:stars1:gpadmin-[ERROR]:-Segments init failed, exit
[gpadmin@stars1 ~]$
[gpadmin@stars1 ~]$
[gpadmin@stars1 ~]$ ll /usr/local/hawq/bin/initdb
-rwxr-xr-x 1 gpadmin gpadmin 82929 Apr 17 09:54 /usr/local/hawq/bin/initdb
[gpadmin@stars1 ~]$ ll /usr/local/hawq/bin/postgres
-rwxr-xr-x 1 gpadmin gpadmin 9833827 Apr 17 09:54 /usr/local/hawq/bin/postgres
[gpadmin@stars1 ~]$
Re: Segment init failed
Posted by Lei Chang <le...@apache.org>.
you can check more information in log: /home/gpadmin/
hawqAdminLogs/hawq_init_20160418.log
And in log: ~/hawq-data-directory/masterdd/pg_log/
Thanks
Lei
On Mon, Apr 18, 2016 at 1:42 AM, 来熊 <yi...@163.com> wrote:
> hi,all,
> when I init cluster ,I got this problem:
> by the way,I using "./configure --prefix=/usr/local/hawq --with-python"
> when I configure hawq
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$ hawq init cluster -a
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Prepare to do
> 'hawq init'
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-You can find log
> in:
> 20160418:01:36:56:024807
> hawq_init:stars1:gpadmin-[INFO]:-/home/gpadmin/hawqAdminLogs/hawq_init_20160418.log
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-GPHOME is set to:
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-/usr/local/hawq
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Init hawq with
> args: ['init', 'cluster']
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-No standby host
> configured, skip it
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Check if hdfs
> path is available
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[WARNING]:-2016-04-18
> 01:36:56.665941, p24914, th140573519669408, WARNING the number of nodes in
> pipeline is 1 [stars1(192.168.19.11)], is less than the expected number of
> replica 3 for block [block pool ID:
> BP-404165782-192.168.19.11-1460475603628 block ID 1073741858_1034] file
> /hawq_default/testFile
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-1 segment hosts
> defined
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Set
> default_hash_table_bucket_number as: 6
> 20160418:01:37:03:024807 hawq_init:stars1:gpadmin-[INFO]:-Start to init
> master node: 'stars1'
> 20160418:01:37:16:024807
> hawq_init:stars1:gpadmin-[INFO]:-20160418:01:37:15:025063
> hawqinit.sh:stars1:gpadmin-[INFO]:-Loading hawq_toolkit...
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Master init
> successfully
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Init segments in
> list: ['stars1']
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Total segment
> number is: 1
> .20160418:01:37:16:024807
> hawq_init:stars1:gpadmin-[INFO]:-20160418:01:37:16:025322
> hawqinit.sh:stars1:gpadmin-[ERROR]:-Postgres initdb failed
> 20160418:01:37:16:025322 hawqinit.sh:stars1:gpadmin-[ERROR]:-Segment init
> failed on stars1
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-fgets failure:
> Success
> The program "postgres" is needed by initdb but was either not found in the
> same directory as "/usr/local/hawq/bin/initdb" or failed unexpectedly.
> Check your installation; "postgres -V" may have more information.
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[ERROR]:-HAWQ init
> failed on stars1
> .
> 20160418:01:37:18:024807 hawq_init:stars1:gpadmin-[INFO]:-0 of 1 segments
> init successfully
> 20160418:01:37:18:024807 hawq_init:stars1:gpadmin-[ERROR]:-Segments init
> failed, exit
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$ ll /usr/local/hawq/bin/initdb
> -rwxr-xr-x 1 gpadmin gpadmin 82929 Apr 17 09:54 /usr/local/hawq/bin/initdb
> [gpadmin@stars1 ~]$ ll /usr/local/hawq/bin/postgres
> -rwxr-xr-x 1 gpadmin gpadmin 9833827 Apr 17 09:54
> /usr/local/hawq/bin/postgres
> [gpadmin@stars1 ~]$
>
>
Re: Segment init failed
Posted by Lei Chang <le...@apache.org>.
you can check more information in log: /home/gpadmin/
hawqAdminLogs/hawq_init_20160418.log
And in log: ~/hawq-data-directory/masterdd/pg_log/
Thanks
Lei
On Mon, Apr 18, 2016 at 1:42 AM, 来熊 <yi...@163.com> wrote:
> hi,all,
> when I init cluster ,I got this problem:
> by the way,I using "./configure --prefix=/usr/local/hawq --with-python"
> when I configure hawq
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$ hawq init cluster -a
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Prepare to do
> 'hawq init'
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-You can find log
> in:
> 20160418:01:36:56:024807
> hawq_init:stars1:gpadmin-[INFO]:-/home/gpadmin/hawqAdminLogs/hawq_init_20160418.log
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-GPHOME is set to:
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-/usr/local/hawq
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Init hawq with
> args: ['init', 'cluster']
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-No standby host
> configured, skip it
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Check if hdfs
> path is available
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[WARNING]:-2016-04-18
> 01:36:56.665941, p24914, th140573519669408, WARNING the number of nodes in
> pipeline is 1 [stars1(192.168.19.11)], is less than the expected number of
> replica 3 for block [block pool ID:
> BP-404165782-192.168.19.11-1460475603628 block ID 1073741858_1034] file
> /hawq_default/testFile
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-1 segment hosts
> defined
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Set
> default_hash_table_bucket_number as: 6
> 20160418:01:37:03:024807 hawq_init:stars1:gpadmin-[INFO]:-Start to init
> master node: 'stars1'
> 20160418:01:37:16:024807
> hawq_init:stars1:gpadmin-[INFO]:-20160418:01:37:15:025063
> hawqinit.sh:stars1:gpadmin-[INFO]:-Loading hawq_toolkit...
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Master init
> successfully
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Init segments in
> list: ['stars1']
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Total segment
> number is: 1
> .20160418:01:37:16:024807
> hawq_init:stars1:gpadmin-[INFO]:-20160418:01:37:16:025322
> hawqinit.sh:stars1:gpadmin-[ERROR]:-Postgres initdb failed
> 20160418:01:37:16:025322 hawqinit.sh:stars1:gpadmin-[ERROR]:-Segment init
> failed on stars1
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-fgets failure:
> Success
> The program "postgres" is needed by initdb but was either not found in the
> same directory as "/usr/local/hawq/bin/initdb" or failed unexpectedly.
> Check your installation; "postgres -V" may have more information.
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[ERROR]:-HAWQ init
> failed on stars1
> .
> 20160418:01:37:18:024807 hawq_init:stars1:gpadmin-[INFO]:-0 of 1 segments
> init successfully
> 20160418:01:37:18:024807 hawq_init:stars1:gpadmin-[ERROR]:-Segments init
> failed, exit
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$ ll /usr/local/hawq/bin/initdb
> -rwxr-xr-x 1 gpadmin gpadmin 82929 Apr 17 09:54 /usr/local/hawq/bin/initdb
> [gpadmin@stars1 ~]$ ll /usr/local/hawq/bin/postgres
> -rwxr-xr-x 1 gpadmin gpadmin 9833827 Apr 17 09:54
> /usr/local/hawq/bin/postgres
> [gpadmin@stars1 ~]$
>
>
Re: Segment init failed
Posted by "yuwei.sung@gmail.com" <yu...@gmail.com>.
Try add/set "output.replace-datanode-on-failure" to "false" in
/usr/local/hawq/etc/hdfs-client.xml.
On Sun, Apr 17, 2016 at 12:42 PM, 来熊 <yi...@163.com> wrote:
> hi,all,
> when I init cluster ,I got this problem:
> by the way,I using "./configure --prefix=/usr/local/hawq --with-python"
> when I configure hawq
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$ hawq init cluster -a
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Prepare to do
> 'hawq init'
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-You can find log
> in:
> 20160418:01:36:56:024807
> hawq_init:stars1:gpadmin-[INFO]:-/home/gpadmin/hawqAdminLogs/hawq_init_20160418.log
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-GPHOME is set to:
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-/usr/local/hawq
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Init hawq with
> args: ['init', 'cluster']
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-No standby host
> configured, skip it
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Check if hdfs
> path is available
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[WARNING]:-2016-04-18
> 01:36:56.665941, p24914, th140573519669408, WARNING the number of nodes in
> pipeline is 1 [stars1(192.168.19.11)], is less than the expected number of
> replica 3 for block [block pool ID:
> BP-404165782-192.168.19.11-1460475603628 block ID 1073741858_1034] file
> /hawq_default/testFile
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-1 segment hosts
> defined
> 20160418:01:36:56:024807 hawq_init:stars1:gpadmin-[INFO]:-Set
> default_hash_table_bucket_number as: 6
> 20160418:01:37:03:024807 hawq_init:stars1:gpadmin-[INFO]:-Start to init
> master node: 'stars1'
> 20160418:01:37:16:024807
> hawq_init:stars1:gpadmin-[INFO]:-20160418:01:37:15:025063
> hawqinit.sh:stars1:gpadmin-[INFO]:-Loading hawq_toolkit...
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Master init
> successfully
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Init segments in
> list: ['stars1']
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-Total segment
> number is: 1
> .20160418:01:37:16:024807
> hawq_init:stars1:gpadmin-[INFO]:-20160418:01:37:16:025322
> hawqinit.sh:stars1:gpadmin-[ERROR]:-Postgres initdb failed
> 20160418:01:37:16:025322 hawqinit.sh:stars1:gpadmin-[ERROR]:-Segment init
> failed on stars1
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[INFO]:-fgets failure:
> Success
> The program "postgres" is needed by initdb but was either not found in the
> same directory as "/usr/local/hawq/bin/initdb" or failed unexpectedly.
> Check your installation; "postgres -V" may have more information.
> 20160418:01:37:16:024807 hawq_init:stars1:gpadmin-[ERROR]:-HAWQ init
> failed on stars1
> .
> 20160418:01:37:18:024807 hawq_init:stars1:gpadmin-[INFO]:-0 of 1 segments
> init successfully
> 20160418:01:37:18:024807 hawq_init:stars1:gpadmin-[ERROR]:-Segments init
> failed, exit
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$
> [gpadmin@stars1 ~]$ ll /usr/local/hawq/bin/initdb
> -rwxr-xr-x 1 gpadmin gpadmin 82929 Apr 17 09:54 /usr/local/hawq/bin/initdb
> [gpadmin@stars1 ~]$ ll /usr/local/hawq/bin/postgres
> -rwxr-xr-x 1 gpadmin gpadmin 9833827 Apr 17 09:54
> /usr/local/hawq/bin/postgres
> [gpadmin@stars1 ~]$
>
>
>
>
>
--
Yu-wei Sung