Drill To Hive connectivity issue

[Uday Sharma <er...@gmail.com>]

Hi Team,


Need your help in resolving this. I am struggling from last many days for
this.


I am getting error(ERROR hive.log - Got exception:
org.apache.thrift.transport.TTransportException java.net.SocketException:
Broken pipe (Write failed) while trying to connect Drill to Hive. For Hive
Microsoft HDInsight (Remote metastore (MS SQL Server)) is getting used and
for Drill I am using other VM which is under same VNet as cluster. I am
able to make Drill Storage plugin with below configuration


{

  "type": "hive",

  "enabled": true,

  "configProps": {

    "hive.metastore.uris": "thrift://hn0-xyz.cloudapp.net:9083,thrift://
hn1-xyz.cloudapp.net:9083",

    "hive.metastore.warehouse.dir": "/hive/warehouse",

    "fs.default.name": "wasb://qwerty @demo.blob.core.windows.net",

    "hive.metastore.sasl.enabled": "false"

  }

}



Stack Trace of error: PFA


core-site.xml:

<configuration>

    <property>

        <name>fs.azure.account.keyprovider.kkhdistore.blob.core.windows.net
</name>

        <value>org.apache.hadoop.fs.azure.ShellDecryptionKeyProvider</value>

    </property>

    <property>

        <name>fs.azure.shellkeyprovider.script</name>


<value>/usr/lib/python2.7/dist-packages/hdinsight_common/decrypt.sh</value>

    </property>

    <property>

        <name>fs.azure.account.key.kkhdistore.blob.core.windows.net</name>

        <value>{COPY FROM CLUSTER core-site.xml}</value>

    </property>

    <property>

        <name>fs.AbstractFileSystem.wasb.impl</name>

        <value>org.apache.hadoop.fs.azure.Wasb</value>

    </property>

</configuration>



Regards
Uday Sharma
er.udaysharma@gmail.com