You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by sreeramvenkat <sr...@infosys.com> on 2015/09/01 12:10:37 UTC
HiveThriftServer not registering with Zookeeper
Hi,
I am trying to setup dynamic service discovery for HiveThriftServer in a
two node cluster.
In the thrift server logs, I am not seeing itself registering with zookeeper
- no znode is getting created.
Pasting relevant section from my $SPARK_HOME/conf/hive-site.xml
<property>
<name>hive.zookeeper.quorum</name>
<value>host1:port1,host2:port2</value>
</property>
<property>
<name>hive.server2.support.dynamic.service.discovery</name>
<value>true</value>
</property>
<property>
<name>hive.server2.zookeeper.namespace</name>
<value>hivethriftserver2</value>
</property>
<property>
<name>hive.zookeeper.client.port</name>
<value>2181</value>
</property>
Any help is appreciated.
PS: Zookeeper is working fine and zknodes are getting created with
hiveserver2. This issue happens only with hivethriftserver.
Regards,
Sreeram
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/HiveThriftServer-not-registering-with-Zookeeper-tp24534.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: HiveThriftServer not registering with Zookeeper
Posted by Xiaoyu Wang <wa...@jd.com>.
I create a jira and pull request for this issue.
https://issues.apache.org/jira/browse/SPARK-11100
在 2015年10月13日 16:36, Xiaoyu Wang 写道:
> I have the same issue.
> I think spark thrift server is not suport HA with zookeeper now.
>
> 在 2015年09月01日 18:10, sreeramvenkat 写道:
>> Hi,
>>
>> I am trying to setup dynamic service discovery for HiveThriftServer
>> in a
>> two node cluster.
>>
>> In the thrift server logs, I am not seeing itself registering with
>> zookeeper
>> - no znode is getting created.
>>
>> Pasting relevant section from my $SPARK_HOME/conf/hive-site.xml
>>
>> <property>
>> <name>hive.zookeeper.quorum</name>
>> <value>host1:port1,host2:port2</value>
>> </property>
>>
>> <property>
>> <name>hive.server2.support.dynamic.service.discovery</name>
>> <value>true</value>
>> </property>
>>
>> <property>
>> <name>hive.server2.zookeeper.namespace</name>
>> <value>hivethriftserver2</value>
>> </property>
>>
>> <property>
>> <name>hive.zookeeper.client.port</name>
>> <value>2181</value>
>> </property>
>>
>>
>> Any help is appreciated.
>>
>> PS: Zookeeper is working fine and zknodes are getting created with
>> hiveserver2. This issue happens only with hivethriftserver.
>>
>> Regards,
>> Sreeram
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/HiveThriftServer-not-registering-with-Zookeeper-tp24534.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
> .
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: HiveThriftServer not registering with Zookeeper
Posted by Xiaoyu Wang <wa...@jd.com>.
I have the same issue.
I think spark thrift server is not suport HA with zookeeper now.
在 2015年09月01日 18:10, sreeramvenkat 写道:
> Hi,
>
> I am trying to setup dynamic service discovery for HiveThriftServer in a
> two node cluster.
>
> In the thrift server logs, I am not seeing itself registering with zookeeper
> - no znode is getting created.
>
> Pasting relevant section from my $SPARK_HOME/conf/hive-site.xml
>
> <property>
> <name>hive.zookeeper.quorum</name>
> <value>host1:port1,host2:port2</value>
> </property>
>
> <property>
> <name>hive.server2.support.dynamic.service.discovery</name>
> <value>true</value>
> </property>
>
> <property>
> <name>hive.server2.zookeeper.namespace</name>
> <value>hivethriftserver2</value>
> </property>
>
> <property>
> <name>hive.zookeeper.client.port</name>
> <value>2181</value>
> </property>
>
>
> Any help is appreciated.
>
> PS: Zookeeper is working fine and zknodes are getting created with
> hiveserver2. This issue happens only with hivethriftserver.
>
> Regards,
> Sreeram
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/HiveThriftServer-not-registering-with-Zookeeper-tp24534.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: HiveThriftServer not registering with Zookeeper
Posted by Xiaoyu Wang <wa...@jd.com>.
I have the same issue.
I think spark thrift server is not suport HA with zookeeper now.
在 2015年09月01日 18:10, sreeramvenkat 写道:
> Hi,
>
> I am trying to setup dynamic service discovery for HiveThriftServer in a
> two node cluster.
>
> In the thrift server logs, I am not seeing itself registering with zookeeper
> - no znode is getting created.
>
> Pasting relevant section from my $SPARK_HOME/conf/hive-site.xml
>
> <property>
> <name>hive.zookeeper.quorum</name>
> <value>host1:port1,host2:port2</value>
> </property>
>
> <property>
> <name>hive.server2.support.dynamic.service.discovery</name>
> <value>true</value>
> </property>
>
> <property>
> <name>hive.server2.zookeeper.namespace</name>
> <value>hivethriftserver2</value>
> </property>
>
> <property>
> <name>hive.zookeeper.client.port</name>
> <value>2181</value>
> </property>
>
>
> Any help is appreciated.
>
> PS: Zookeeper is working fine and zknodes are getting created with
> hiveserver2. This issue happens only with hivethriftserver.
>
> Regards,
> Sreeram
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/HiveThriftServer-not-registering-with-Zookeeper-tp24534.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org