You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Nihal kumar ojha (Jira)" <ji...@apache.org> on 2020/10/14 11:06:00 UTC

[jira] [Commented] (CARBONDATA-3880) How to start JDBC service in distributed index

    [ https://issues.apache.org/jira/browse/CARBONDATA-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213825#comment-17213825 ] 

Nihal kumar ojha commented on CARBONDATA-3880:
----------------------------------------------

Hi, please follow the below steps to configure the distributed index server with JDBC.

1. Add these properties in spark-defaults.conf
     spark.yarn.keytab=<spark-keytab file location>
     spark.carbon.indexserver.keytab=<spark-keytab file location>
     spark.carbon.indexserver.principal=spark2x/hadoop.hadoop.com@HADOOP.COM
     spark.yarn.principal=spark2x/hadoop.hadoop.com@HADOOP.COM

2. Add following configuration in carbon.properties(Ensure the carbon.properties is configured in spark-defaults.conf in driver extra java option)
     carbon.enable.index.server=true
     carbon.indexserver.enable.prepriming=true
     carbon.indexserver.HA.enabled=true
     carbon.max.executor.lru.cache.size=-1
     carbon.disable.index.server.fallback=false
     carbon.indexserver.zookeeper.dir=/indexserver2x
     carbon.index.server.port=<port no>

Then run below spark-submit command at $spark_home location
bin/spark-submit  --num-executors 2 --master yarn --class org.apache.carbondata.indexserver.indexserver <carbondata-spark jar location> <IP address>

then start spark JDBCserver as usual.
Queries should reflect in yarn UI, in the index server and spark JDBC application.
     

>  How to start JDBC service in distributed index
> -----------------------------------------------
>
>                 Key: CARBONDATA-3880
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3880
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 2.0.0
>            Reporter: li
>            Priority: Major
>             Fix For: 2.1.0
>
>
> How to start JDBC service in distributed index



--
This message was sent by Atlassian Jira
(v8.3.4#803005)