You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kudu.apache.org by Raymond Xie <xi...@gmail.com> on 2017/11/24 01:27:17 UTC
Need help on starting a new Kudu service
Hello,
I am trying to start a newly installed Kudu on my home cluster which
contains three nodes on VMWare but encountered problem described as below,
thank you very much if you can help to fix it.
Settings are as below:
Master:
Kudu Master WAL Directory: /data/kudu/master/wal
Kudu Master Data Directories: /data/kudu/master
Tablet Server:
Kudu Tablet Server WAL Directory: /data/kudu/tserver/wal
Kudu Tablet Server Data Directories: /data/kudu/tserver
Error messages are below when I attempt to start Master:
Thu Nov 23 19:52:46 EST 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER as conf dir
Using scripts/kudu.sh as process script
CONF_DIR=/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Thu Nov 23 19:52:46 EST 2017: KUDU_HOME:
/opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
Thu Nov 23 19:52:46 EST 2017: CONF_DIR:
/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
Thu Nov 23 19:52:46 EST 2017: CMD: master
Thu Nov 23 19:52:46 EST 2017: Found master(s) on pocnnr1n1.raymond.com
Wrote minidump to
/var/log/kudu/minidumps/kudu-master/676e270a-91bf-5ff2-66aa63b2-6f84bac5.dmp
Thu Nov 23 19:52:49 EST 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER as conf dir
Using scripts/kudu.sh as process script
CONF_DIR=/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Thu Nov 23 19:52:49 EST 2017: KUDU_HOME:
/opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
Thu Nov 23 19:52:49 EST 2017: CONF_DIR:
/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
Thu Nov 23 19:52:49 EST 2017: CMD: master
Thu Nov 23 19:52:49 EST 2017: Found master(s) on pocnnr1n1.raymond.com
Wrote minidump to
/var/log/kudu/minidumps/kudu-master/032403ba-b7f4-3eeb-3895e94b-1e534c6f.dmp
Thu Nov 23 19:52:51 EST 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER as conf dir
Using scripts/kudu.sh as process script
CONF_DIR=/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Thu Nov 23 19:52:51 EST 2017: KUDU_HOME:
/opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
Thu Nov 23 19:52:51 EST 2017: CONF_DIR:
/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
Thu Nov 23 19:52:51 EST 2017: CMD: master
Thu Nov 23 19:52:51 EST 2017: Found master(s) on pocnnr1n1.raymond.com
Wrote minidump to
/var/log/kudu/minidumps/kudu-master/5ebcfa1e-e7dc-34ea-0a5b90d4-4d726371.dmp
Thu Nov 23 19:52:55 EST 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER as conf dir
Using scripts/kudu.sh as process script
CONF_DIR=/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Thu Nov 23 19:52:55 EST 2017: KUDU_HOME:
/opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
Thu Nov 23 19:52:55 EST 2017: CONF_DIR:
/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
Thu Nov 23 19:52:55 EST 2017: CMD: master
Thu Nov 23 19:52:55 EST 2017: Found master(s) on pocnnr1n1.raymond.com
Wrote minidump to
/var/log/kudu/minidumps/kudu-master/16b10895-8389-83f2-2ec951bc-6c27dfcc.dmp
When starting Tablet Server, I receive the following:
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER as conf dir
Using scripts/kudu.sh as process script
CONF_DIR=/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Thu Nov 23 20:21:39 EST 2017: KUDU_HOME:
/opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
Thu Nov 23 20:21:39 EST 2017: CONF_DIR:
/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
Thu Nov 23 20:21:39 EST 2017: CMD: tserver
Thu Nov 23 20:21:39 EST 2017: Found master(s) on pocnnr1n1.raymond.com
Wrote minidump to
/var/log/kudu/minidumps/kudu-tserver/426498da-a27b-f657-5ce3a499-0d90a995.dmp
Thu Nov 23 20:21:41 EST 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER as conf dir
Using scripts/kudu.sh as process script
CONF_DIR=/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Thu Nov 23 20:21:41 EST 2017: KUDU_HOME:
/opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
Thu Nov 23 20:21:41 EST 2017: CONF_DIR:
/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
Thu Nov 23 20:21:41 EST 2017: CMD: tserver
Thu Nov 23 20:21:41 EST 2017: Found master(s) on pocnnr1n1.raymond.com
Wrote minidump to
/var/log/kudu/minidumps/kudu-tserver/5e7c6a3e-9973-e345-6f3fdd94-7d4dfdc9.dmp
Thu Nov 23 20:21:45 EST 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER as conf dir
Using scripts/kudu.sh as process script
CONF_DIR=/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Thu Nov 23 20:21:45 EST 2017: KUDU_HOME:
/opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
Thu Nov 23 20:21:45 EST 2017: CONF_DIR:
/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
Thu Nov 23 20:21:45 EST 2017: CMD: tserver
Thu Nov 23 20:21:45 EST 2017: Found master(s) on pocnnr1n1.raymond.com
Wrote minidump to
/var/log/kudu/minidumps/kudu-tserver/5537e0e2-0271-b1eb-5242dea7-5a3e5df1.dmp
*------------------------------------------------*
*Sincerely yours,*
*Raymond*
Re: Need help on starting a new Kudu service
Posted by Andrew Wong <aw...@cloudera.com>.
Hi Raymond,
Sorry for the delayed response. Do you happen to still have the Kudu logs
from startup?
That aside, based on your configurations, see here
<https://kudu.apache.org/docs/configuration.html#_configuring_tablet_servers>:
the WAL directory must not be a subdirectory of a data directory. Maybe try
again with --fs_data_dirs=/data/kudu/master/data and
--fs_wal_dir=/data/kudu/master/wal or somesuch (same for tserver).
Hope this helped!
Andrew
On Thu, Nov 23, 2017 at 5:27 PM, Raymond Xie <xi...@gmail.com> wrote:
> Hello,
>
> I am trying to start a newly installed Kudu on my home cluster which
> contains three nodes on VMWare but encountered problem described as below,
> thank you very much if you can help to fix it.
>
> Settings are as below:
>
> Master:
> Kudu Master WAL Directory: /data/kudu/master/wal
> Kudu Master Data Directories: /data/kudu/master
>
> Tablet Server:
> Kudu Tablet Server WAL Directory: /data/kudu/tserver/wal
> Kudu Tablet Server Data Directories: /data/kudu/tserver
>
> Error messages are below when I attempt to start Master:
>
> Thu Nov 23 19:52:46 EST 2017
> JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
> Using /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER as conf dir
> Using scripts/kudu.sh as process script
> CONF_DIR=/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
> CMF_CONF_DIR=/etc/cloudera-scm-agent
> Thu Nov 23 19:52:46 EST 2017: KUDU_HOME: /opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
> Thu Nov 23 19:52:46 EST 2017: CONF_DIR: /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
> Thu Nov 23 19:52:46 EST 2017: CMD: master
> Thu Nov 23 19:52:46 EST 2017: Found master(s) on pocnnr1n1.raymond.com
> Wrote minidump to /var/log/kudu/minidumps/kudu-master/676e270a-91bf-5ff2-66aa63b2-6f84bac5.dmp
> Thu Nov 23 19:52:49 EST 2017
> JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
> Using /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER as conf dir
> Using scripts/kudu.sh as process script
> CONF_DIR=/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
> CMF_CONF_DIR=/etc/cloudera-scm-agent
> Thu Nov 23 19:52:49 EST 2017: KUDU_HOME: /opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
> Thu Nov 23 19:52:49 EST 2017: CONF_DIR: /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
> Thu Nov 23 19:52:49 EST 2017: CMD: master
> Thu Nov 23 19:52:49 EST 2017: Found master(s) on pocnnr1n1.raymond.com
> Wrote minidump to /var/log/kudu/minidumps/kudu-master/032403ba-b7f4-3eeb-3895e94b-1e534c6f.dmp
> Thu Nov 23 19:52:51 EST 2017
> JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
> Using /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER as conf dir
> Using scripts/kudu.sh as process script
> CONF_DIR=/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
> CMF_CONF_DIR=/etc/cloudera-scm-agent
> Thu Nov 23 19:52:51 EST 2017: KUDU_HOME: /opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
> Thu Nov 23 19:52:51 EST 2017: CONF_DIR: /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
> Thu Nov 23 19:52:51 EST 2017: CMD: master
> Thu Nov 23 19:52:51 EST 2017: Found master(s) on pocnnr1n1.raymond.com
> Wrote minidump to /var/log/kudu/minidumps/kudu-master/5ebcfa1e-e7dc-34ea-0a5b90d4-4d726371.dmp
> Thu Nov 23 19:52:55 EST 2017
> JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
> Using /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER as conf dir
> Using scripts/kudu.sh as process script
> CONF_DIR=/run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
> CMF_CONF_DIR=/etc/cloudera-scm-agent
> Thu Nov 23 19:52:55 EST 2017: KUDU_HOME: /opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
> Thu Nov 23 19:52:55 EST 2017: CONF_DIR: /run/cloudera-scm-agent/process/314-kudu-KUDU_MASTER
> Thu Nov 23 19:52:55 EST 2017: CMD: master
> Thu Nov 23 19:52:55 EST 2017: Found master(s) on pocnnr1n1.raymond.com
> Wrote minidump to /var/log/kudu/minidumps/kudu-master/16b10895-8389-83f2-2ec951bc-6c27dfcc.dmp
>
> When starting Tablet Server, I receive the following:
>
> JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
> Using /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER as conf dir
> Using scripts/kudu.sh as process script
> CONF_DIR=/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
> CMF_CONF_DIR=/etc/cloudera-scm-agent
> Thu Nov 23 20:21:39 EST 2017: KUDU_HOME: /opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
> Thu Nov 23 20:21:39 EST 2017: CONF_DIR: /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
> Thu Nov 23 20:21:39 EST 2017: CMD: tserver
> Thu Nov 23 20:21:39 EST 2017: Found master(s) on pocnnr1n1.raymond.com
> Wrote minidump to /var/log/kudu/minidumps/kudu-tserver/426498da-a27b-f657-5ce3a499-0d90a995.dmp
> Thu Nov 23 20:21:41 EST 2017
> JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
> Using /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER as conf dir
> Using scripts/kudu.sh as process script
> CONF_DIR=/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
> CMF_CONF_DIR=/etc/cloudera-scm-agent
> Thu Nov 23 20:21:41 EST 2017: KUDU_HOME: /opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
> Thu Nov 23 20:21:41 EST 2017: CONF_DIR: /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
> Thu Nov 23 20:21:41 EST 2017: CMD: tserver
> Thu Nov 23 20:21:41 EST 2017: Found master(s) on pocnnr1n1.raymond.com
> Wrote minidump to /var/log/kudu/minidumps/kudu-tserver/5e7c6a3e-9973-e345-6f3fdd94-7d4dfdc9.dmp
> Thu Nov 23 20:21:45 EST 2017
> JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
> Using /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER as conf dir
> Using scripts/kudu.sh as process script
> CONF_DIR=/run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
> CMF_CONF_DIR=/etc/cloudera-scm-agent
> Thu Nov 23 20:21:45 EST 2017: KUDU_HOME: /opt/cloudera/parcels/KUDU-1.4.0-1.cdh5.12.1.p0.10/lib/kudu
> Thu Nov 23 20:21:45 EST 2017: CONF_DIR: /run/cloudera-scm-agent/process/315-kudu-KUDU_TSERVER
> Thu Nov 23 20:21:45 EST 2017: CMD: tserver
> Thu Nov 23 20:21:45 EST 2017: Found master(s) on pocnnr1n1.raymond.com
> Wrote minidump to /var/log/kudu/minidumps/kudu-tserver/5537e0e2-0271-b1eb-5242dea7-5a3e5df1.dmp
>
>
>
>
> *------------------------------------------------*
> *Sincerely yours,*
>
>
> *Raymond*
>
--
Andrew Wong