You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Clay McDonald <st...@bateswhite.com> on 2013/10/17 14:54:21 UTC
Problem starting Hive
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com |
| root | Bigdata5.bateswhite.com |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com immediately.
*****************************************************
Re: Problem starting Hive
Posted by Selvamohan Neethiraj <se...@infotekies.com>.
Hi:
Check LOG4J log file (Usaually, it is in /tmp/hive/hive.log or /tmp/${LOGNAME}/hive.log) for more details on the reason for the failure to instantiate HiveMetaStore client.
If the MySQLConnection was stale due to long pause, try adding 'autoReconnect=true' option to the MySQL url ....
> jdbc:mysql://bigdata5.bateswhite.com:3306/hadoop?auto-Reconnect=true
* This should automatically reconnect the socket connection if it was timed-out if the connection was not used for a while.
Thanks,
Selva-
On Oct 17, 2013, at 10:03 AM, "Garg, Rinku" <Ri...@fisglobal.com> wrote:
> Hi,
>
> Try this also in hive-site
>
> <property>
> <name>javax.jdo.option.ConnectionDriverName</name>
> <value> com.mysql.jdbc.Driver </value>
> <description>Driver class name for a JDBC metastore</description>
> </property>
>
>
> Thanks & Regards,
> Rinku Garg
>
> From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
> Sent: 17 October 2013 18:53
> To: 'user@hive.apache.org'; 'NiMartin@pssd.com'
> Cc: 'Eric Mizell'; Rommel Garcia; Yi Zhang
> Subject: RE: Problem starting Hive
>
> It looks good to me…
>
> <property>
> <name>javax.jdo.option.ConnectionURL</name>
> <value>jdbc:mysql://bigdata5.bateswhite.com:3306/hadoop</value>
> <description>JDBC connect string for a JDBC metastore</description>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionDriverName</name>
> <value>sqladmin</value>
> <description>Driver class name for a JDBC metastore</description>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionPassword</name>
> <value>password</value>
> <description>Enter your MySQL credentials. </description>
> </property>
>
> <property>
> <name>hive.metastore.uris</name>
> <value>thrift://bigdata5.bateswhite.com:9083</value>
> <description>URI for client to contact metastore server. To enable HiveServer2, leave the property value empty. </description>
> </property>
>
> </configuration>
>
>
> From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
> Sent: Thursday, October 17, 2013 9:17 AM
> To: 'NiMartin@pssd.com'
> Cc: 'user@hive.apache.org'; 'Eric Mizell'; Rommel Garcia; Yi Zhang
> Subject: RE: Problem starting Hive
>
> Nick, let me check…
>
>
> From: Martin, Nick [mailto:]
> Sent: Thursday, October 17, 2013 9:00 AM
> To: user@hive.apache.org
> Subject: RE: Problem starting Hive
>
> Hi Clay,
>
> Quick housekeeping/config check…is the URI in /etc/hive/conf/hive-site.xml pointing to the right place?
>
> From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
> Sent: Thursday, October 17, 2013 8:54 AM
> To: 'Eric Mizell'; Rommel Garcia; Yi Zhang; 'user@hive.apache.org'
> Cc: Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
> Subject: Problem starting Hive
>
> Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
>
> [root@bigdata5 staff]# hive
> 13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
> 13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
> 13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
> 13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
> 13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
> 13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
>
> Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> hive> show tables;
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
> hive>
>
> --------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
>
> mysql> SELECT user, host FROM mysql.user;
> +----------+-------------------------+
> | user | host |
> +----------+-------------------------+
> | sqladmin | % |
> | root | 127.0.0.1 |
> | | Bigdata5.bateswhite.com |
> | root | Bigdata5.bateswhite.com |
> | | localhost |
> | root | localhost |
> | sqladmin | localhost |
> +----------+-------------------------+
> 7 rows in set (0.00 sec)
>
> mysql> SHOW DATABASES;
> +--------------------+
> | Database |
> +--------------------+
> | information_schema |
> | hadoop |
> | mysql |
> | test |
> +--------------------+
> 4 rows in set (0.00 sec)
>
> Clay McDonald
> Database Administrator
> Bates White, LLC
> 1300 Eye St, NW, Suite 600 East
> Washington, DC 20005
> Main: 202.408.6110
> Cell: 202.560.4101
> Direct: 202.747.5962
> Email: clay.mcdonald@bateswhite.com
> ****************************************************
> This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
> If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com immediately.
> *****************************************************
> _____________
> The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.
RE: Problem starting Hive
Posted by Clay McDonald <st...@bateswhite.com>.
Thanks Rinku, Nick, Rommel, and Eric,
I think I have other issues with MySQL.. Anyway, I've got another more important fire to put out. I'll take this up again later..
Clay McDonald
From: Garg, Rinku [mailto:Rinku.Garg@fisglobal.com]
Sent: Thursday, October 17, 2013 10:03 AM
To: user@hive.apache.org; 'NiMartin@pssd.com'
Cc: 'Eric Mizell'; Rommel Garcia; Yi Zhang
Subject: RE: Problem starting Hive
Hi,
Try this also in hive-site
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value> com.mysql.jdbc.Driver </value>
<description>Driver class name for a JDBC metastore</description>
</property>
Thanks & Regards,
Rinku Garg
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: 17 October 2013 18:53
To: 'user@hive.apache.org'; 'NiMartin@pssd.com'
Cc: 'Eric Mizell'; Rommel Garcia; Yi Zhang
Subject: RE: Problem starting Hive
It looks good to me...
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://bigdata5.bateswhite.com:3306/hadoop</value>
<description>JDBC connect string for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>sqladmin</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>password</value>
<description>Enter your MySQL credentials. </description>
</property>
<property>
<name>hive.metastore.uris</name>
<value>thrift://bigdata5.bateswhite.com:9083</value>
<description>URI for client to contact metastore server. To enable HiveServer2, leave the property value empty. </description>
</property>
</configuration>
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: Thursday, October 17, 2013 9:17 AM
To: 'NiMartin@pssd.com'
Cc: 'user@hive.apache.org'; 'Eric Mizell'; Rommel Garcia; Yi Zhang
Subject: RE: Problem starting Hive
Nick, let me check...
From: Martin, Nick [mailto:]
Sent: Thursday, October 17, 2013 9:00 AM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: RE: Problem starting Hive
Hi Clay,
Quick housekeeping/config check...is the URI in /etc/hive/conf/hive-site.xml pointing to the right place?
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: Thursday, October 17, 2013 8:54 AM
To: 'Eric Mizell'; Rommel Garcia; Yi Zhang; 'user@hive.apache.org'
Cc: Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Problem starting Hive
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings<https://urldefense.proofpoint.com/v1/url?u=http://www.slf4j.org/codes.html%23multiple_bindings&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=VSG5xWy%2BQD3Grytk%2B5zCI7EoDshioa%2F5J2E%2BUCPctFA%3D%0A&s=c443c2cb03575fe638d0272425e9b63226e9dd0b4380262ad3b1826bb13ab0d7> for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com |
| root | Bigdata5.bateswhite.com |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.
RE: Problem starting Hive
Posted by "Garg, Rinku" <Ri...@fisglobal.com>.
Hi,
Try this also in hive-site
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value> com.mysql.jdbc.Driver </value>
<description>Driver class name for a JDBC metastore</description>
</property>
Thanks & Regards,
Rinku Garg
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: 17 October 2013 18:53
To: 'user@hive.apache.org'; 'NiMartin@pssd.com'
Cc: 'Eric Mizell'; Rommel Garcia; Yi Zhang
Subject: RE: Problem starting Hive
It looks good to me...
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://bigdata5.bateswhite.com:3306/hadoop</value>
<description>JDBC connect string for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>sqladmin</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>password</value>
<description>Enter your MySQL credentials. </description>
</property>
<property>
<name>hive.metastore.uris</name>
<value>thrift://bigdata5.bateswhite.com:9083</value>
<description>URI for client to contact metastore server. To enable HiveServer2, leave the property value empty. </description>
</property>
</configuration>
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: Thursday, October 17, 2013 9:17 AM
To: 'NiMartin@pssd.com'
Cc: 'user@hive.apache.org'; 'Eric Mizell'; Rommel Garcia; Yi Zhang
Subject: RE: Problem starting Hive
Nick, let me check...
From: Martin, Nick [mailto:]
Sent: Thursday, October 17, 2013 9:00 AM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: RE: Problem starting Hive
Hi Clay,
Quick housekeeping/config check...is the URI in /etc/hive/conf/hive-site.xml pointing to the right place?
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: Thursday, October 17, 2013 8:54 AM
To: 'Eric Mizell'; Rommel Garcia; Yi Zhang; 'user@hive.apache.org'
Cc: Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Problem starting Hive
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings<https://urldefense.proofpoint.com/v1/url?u=http://www.slf4j.org/codes.html%23multiple_bindings&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=VSG5xWy%2BQD3Grytk%2B5zCI7EoDshioa%2F5J2E%2BUCPctFA%3D%0A&s=c443c2cb03575fe638d0272425e9b63226e9dd0b4380262ad3b1826bb13ab0d7> for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com |
| root | Bigdata5.bateswhite.com |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.
RE: Problem starting Hive
Posted by Clay McDonald <st...@bateswhite.com>.
It looks good to me...
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://bigdata5.bateswhite.com:3306/hadoop</value>
<description>JDBC connect string for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>sqladmin</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>password</value>
<description>Enter your MySQL credentials. </description>
</property>
<property>
<name>hive.metastore.uris</name>
<value>thrift://bigdata5.bateswhite.com:9083</value>
<description>URI for client to contact metastore server. To enable HiveServer2, leave the property value empty. </description>
</property>
</configuration>
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: Thursday, October 17, 2013 9:17 AM
To: 'NiMartin@pssd.com'
Cc: 'user@hive.apache.org'; 'Eric Mizell'; Rommel Garcia; Yi Zhang
Subject: RE: Problem starting Hive
Nick, let me check...
From: Martin, Nick [mailto:]
Sent: Thursday, October 17, 2013 9:00 AM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: RE: Problem starting Hive
Hi Clay,
Quick housekeeping/config check...is the URI in /etc/hive/conf/hive-site.xml pointing to the right place?
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: Thursday, October 17, 2013 8:54 AM
To: 'Eric Mizell'; Rommel Garcia; Yi Zhang; 'user@hive.apache.org'
Cc: Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Problem starting Hive
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com |
| root | Bigdata5.bateswhite.com |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
RE: Problem starting Hive
Posted by Clay McDonald <st...@bateswhite.com>.
Nick, let me check...
From: Martin, Nick [mailto:]
Sent: Thursday, October 17, 2013 9:00 AM
To: user@hive.apache.org
Subject: RE: Problem starting Hive
Hi Clay,
Quick housekeeping/config check...is the URI in /etc/hive/conf/hive-site.xml pointing to the right place?
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: Thursday, October 17, 2013 8:54 AM
To: 'Eric Mizell'; Rommel Garcia; Yi Zhang; 'user@hive.apache.org'
Cc: Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Problem starting Hive
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com |
| root | Bigdata5.bateswhite.com |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
RE: Problem starting Hive
Posted by "Martin, Nick" <Ni...@pssd.com>.
Hi Clay,
Quick housekeeping/config check...is the URI in /etc/hive/conf/hive-site.xml pointing to the right place?
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: Thursday, October 17, 2013 8:54 AM
To: 'Eric Mizell'; Rommel Garcia; Yi Zhang; 'user@hive.apache.org'
Cc: Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Problem starting Hive
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com |
| root | Bigdata5.bateswhite.com |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
RE: Problem starting Hive
Posted by "Garg, Rinku" <Ri...@fisglobal.com>.
Remove this file /tmp/hive/hive.log and try again using hdfs user.
Thanks & Regards,
Rinku Garg
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: 17 October 2013 19:09
To: Garg, Rinku
Cc: user@hive.apache.org
Subject: RE: Problem starting Hive
Hi Rinku, I tried running hive as the root user and hdfs user, both failed. I didn’t create a hive user. I’m using the sqladmin user to connect to the metastore in the config file.
From: Garg, Rinku [mailto:Rinku.Garg@fisglobal.com]
Sent: Thursday, October 17, 2013 9:32 AM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: RE: Problem starting Hive
Hi,
Are you logged in using hive specific user or as root user.
/tmp/hive/hive.log file may be created once root user and it can’t be updated by any other user so it says permission denied.
Thanks & Regards,
Rinku Garg
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: 17 October 2013 18:41
To: 'Eric Mizell'; user@hive.apache.org<ma...@hive.apache.org>
Cc: Rommel Garcia; Yi Zhang; Chris Hackett; Steve Puckett; Terry Padgett
Subject: RE: Problem starting Hive
Thanks Eric! My Hive log is attached.
From: Eric Mizell [mailto:emizell@hortonworks.com]
Sent: Thursday, October 17, 2013 8:59 AM
To: Clay McDonald
Cc: Rommel Garcia; Yi Zhang; user@hive.apache.org<ma...@hive.apache.org>; Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Re: Problem starting Hive
Clay,
Can you send the Hive log file?
--
Eric
-
Sent from iPhone
On Oct 17, 2013, at 8:54 AM, Clay McDonald <st...@bateswhite.com>> wrote:
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings<https://urldefense.proofpoint.com/v1/url?u=http://www.slf4j.org/codes.html%23multiple_bindings&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=080cb8415402a8b24564c5a9e64501a74cb672ff1556c095aee42ed2b38a5e2f> for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com<https://urldefense.proofpoint.com/v1/url?u=http://Bigdata5.bateswhite.com&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=ff04527098c060c9576d46a4216c57544804ed9bc41f47bedf18569c16be11ea> |
| root | Bigdata5.bateswhite.com<https://urldefense.proofpoint.com/v1/url?u=http://Bigdata5.bateswhite.com&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=ff04527098c060c9576d46a4216c57544804ed9bc41f47bedf18569c16be11ea> |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.
_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.
RE: Problem starting Hive
Posted by Clay McDonald <st...@bateswhite.com>.
Hi Rinku, I tried running hive as the root user and hdfs user, both failed. I didn’t create a hive user. I’m using the sqladmin user to connect to the metastore in the config file.
From: Garg, Rinku [mailto:Rinku.Garg@fisglobal.com]
Sent: Thursday, October 17, 2013 9:32 AM
To: user@hive.apache.org
Subject: RE: Problem starting Hive
Hi,
Are you logged in using hive specific user or as root user.
/tmp/hive/hive.log file may be created once root user and it can’t be updated by any other user so it says permission denied.
Thanks & Regards,
Rinku Garg
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: 17 October 2013 18:41
To: 'Eric Mizell'; user@hive.apache.org<ma...@hive.apache.org>
Cc: Rommel Garcia; Yi Zhang; Chris Hackett; Steve Puckett; Terry Padgett
Subject: RE: Problem starting Hive
Thanks Eric! My Hive log is attached.
From: Eric Mizell [mailto:emizell@hortonworks.com]
Sent: Thursday, October 17, 2013 8:59 AM
To: Clay McDonald
Cc: Rommel Garcia; Yi Zhang; user@hive.apache.org<ma...@hive.apache.org>; Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Re: Problem starting Hive
Clay,
Can you send the Hive log file?
--
Eric
-
Sent from iPhone
On Oct 17, 2013, at 8:54 AM, Clay McDonald <st...@bateswhite.com>> wrote:
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings<https://urldefense.proofpoint.com/v1/url?u=http://www.slf4j.org/codes.html%23multiple_bindings&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=080cb8415402a8b24564c5a9e64501a74cb672ff1556c095aee42ed2b38a5e2f> for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com<https://urldefense.proofpoint.com/v1/url?u=http://Bigdata5.bateswhite.com&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=ff04527098c060c9576d46a4216c57544804ed9bc41f47bedf18569c16be11ea> |
| root | Bigdata5.bateswhite.com<https://urldefense.proofpoint.com/v1/url?u=http://Bigdata5.bateswhite.com&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=ff04527098c060c9576d46a4216c57544804ed9bc41f47bedf18569c16be11ea> |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.
RE: Problem starting Hive
Posted by "Garg, Rinku" <Ri...@fisglobal.com>.
Hi,
Are you logged in using hive specific user or as root user.
/tmp/hive/hive.log file may be created once root user and it can’t be updated by any other user so it says permission denied.
Thanks & Regards,
Rinku Garg
From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]
Sent: 17 October 2013 18:41
To: 'Eric Mizell'; user@hive.apache.org
Cc: Rommel Garcia; Yi Zhang; Chris Hackett; Steve Puckett; Terry Padgett
Subject: RE: Problem starting Hive
Thanks Eric! My Hive log is attached.
From: Eric Mizell [mailto:emizell@hortonworks.com]
Sent: Thursday, October 17, 2013 8:59 AM
To: Clay McDonald
Cc: Rommel Garcia; Yi Zhang; user@hive.apache.org<ma...@hive.apache.org>; Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Re: Problem starting Hive
Clay,
Can you send the Hive log file?
--
Eric
-
Sent from iPhone
On Oct 17, 2013, at 8:54 AM, Clay McDonald <st...@bateswhite.com>> wrote:
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings<https://urldefense.proofpoint.com/v1/url?u=http://www.slf4j.org/codes.html%23multiple_bindings&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=080cb8415402a8b24564c5a9e64501a74cb672ff1556c095aee42ed2b38a5e2f> for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com<https://urldefense.proofpoint.com/v1/url?u=http://Bigdata5.bateswhite.com&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=ff04527098c060c9576d46a4216c57544804ed9bc41f47bedf18569c16be11ea> |
| root | Bigdata5.bateswhite.com<https://urldefense.proofpoint.com/v1/url?u=http://Bigdata5.bateswhite.com&k=%2FbkpAUdJWZuiTILCq%2FFnQg%3D%3D%0A&r=zqOP248aNQyhYgwT%2FsREm5ngqRHnJdl9rnHZ1a6ArtU%3D%0A&m=N5YDuUCH9J3DMyaafAw8tDUw6NMLQztDvoJeWmjNlLY%3D%0A&s=ff04527098c060c9576d46a4216c57544804ed9bc41f47bedf18569c16be11ea> |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.
RE: Problem starting Hive
Posted by Clay McDonald <st...@bateswhite.com>.
Yep..
[root@bigdata5 ~]# find / -type f -name mysql-connector-java*
/usr/lib/hive/lib/mysql-connector-java-5.1.24-bin.jar
/usr/share/java/mysql-connector-java-5.1.17.jar
From: Rommel Garcia [mailto:rgarcia@hortonworks.com]
Sent: Thursday, October 17, 2013 9:24 AM
To: Clay McDonald
Cc: Eric Mizell; user@hive.apache.org; Yi Zhang; Chris Hackett; Steve Puckett; Terry Padgett
Subject: Re: Problem starting Hive
Do you have the MySQL connector jar on you hive lib?
Rommel Garcia
Big Data Solutions Engineer - Southeast
Hortonworks, Inc.
Email: rgarcia@hortonworks.com<ma...@hortonworks.com>
Mobile: 404.502.9672<tel:404.502.9672>
www.hortonworks.com<http://www.hortonworks.com/>
On Oct 17, 2013, at 9:11 AM, Clay McDonald <st...@bateswhite.com>> wrote:
Thanks Eric! My Hive log is attached.
From: Eric Mizell [mailto:emizell@hortonworks.com]
Sent: Thursday, October 17, 2013 8:59 AM
To: Clay McDonald
Cc: Rommel Garcia; Yi Zhang; user@hive.apache.org<ma...@hive.apache.org>; Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Re: Problem starting Hive
Clay,
Can you send the Hive log file?
--
Eric
-
Sent from iPhone
On Oct 17, 2013, at 8:54 AM, Clay McDonald <st...@bateswhite.com>> wrote:
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com<http://Bigdata5.bateswhite.com> |
| root | Bigdata5.bateswhite.com<http://Bigdata5.bateswhite.com> |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
<hive.log>
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
RE: Problem starting Hive
Posted by Clay McDonald <st...@bateswhite.com>.
Thanks Eric! My Hive log is attached.
From: Eric Mizell [mailto:emizell@hortonworks.com]
Sent: Thursday, October 17, 2013 8:59 AM
To: Clay McDonald
Cc: Rommel Garcia; Yi Zhang; user@hive.apache.org; Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett
Subject: Re: Problem starting Hive
Clay,
Can you send the Hive log file?
--
Eric
-
Sent from iPhone
On Oct 17, 2013, at 8:54 AM, Clay McDonald <st...@bateswhite.com>> wrote:
Good morning all, I have another issue this morning. This time with Hive. Hive was working before I restarted the server. My metastore is MySQL on the same server. See error below;
[root@bigdata5 staff]# hive
13/10/16 12:31:18 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/10/16 12:31:18 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/10/16 12:31:18 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.5.0-67.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
hive>
--------------------------------------------------------------------------------------- snip ------------------------------------------------------------------------
mysql> SELECT user, host FROM mysql.user;
+----------+-------------------------+
| user | host |
+----------+-------------------------+
| sqladmin | % |
| root | 127.0.0.1 |
| | Bigdata5.bateswhite.com<http://Bigdata5.bateswhite.com> |
| root | Bigdata5.bateswhite.com<http://Bigdata5.bateswhite.com> |
| | localhost |
| root | localhost |
| sqladmin | localhost |
+----------+-------------------------+
7 rows in set (0.00 sec)
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| hadoop |
| mysql |
| test |
+--------------------+
4 rows in set (0.00 sec)
Clay McDonald
Database Administrator
Bates White, LLC
1300 Eye St, NW, Suite 600 East
Washington, DC 20005
Main: 202.408.6110
Cell: 202.560.4101
Direct: 202.747.5962
Email: clay.mcdonald@bateswhite.com<ma...@bateswhite.com>
****************************************************
This electronic message transmission contains information from Bates White, LLC, which may be confidential or privileged. The information is intended to be for the use of the individual or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is prohibited.
If you have received this electronic transmission in error, please notify me by telephone at 202.747.5962 or by electronic mail at clay.mcdonald@bateswhite.com<ma...@bateswhite.com> immediately.
*****************************************************
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.