You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by arjun s <ar...@gmail.com> on 2023/01/11 18:39:59 UTC
Hive Engine Execution Error
Hi,
I had installed and set up linkis(version 1.3.0) successfully. While trying
to run hive query in linkis cli it's showing failed to create engine. I am
trying to connect to Hive of version 3.1.2.The error screenshot is attached
below. Did I need to change any configuration? because the default hive
version is 2.3.3.
[image: image.png]
Thanks and Regards,
Arjun
Re: Hive Engine Execution Error
Posted by arjun s <ar...@gmail.com>.
Hi peacewong,
Thanks for your reply.Can you please share your workspace name in Slack.
This is my workspace : rnd-ovf9440
This is my slack user : arjunjoicernd <ar...@gmail.com>
Thank and Regards,
Arjun
On Sat, 14 Jan 2023 at 08:41, peacewong <pe...@apache.org> wrote:
> Hi Arjun
> My Slack account is peacewong
>
> peacewong <pe...@apache.org> 于2023年1月14日周六 11:09写道：
>
> > Hi Arjun
> > 1. If it is still the default 2.3.3, you can submit the task like this[1]
> > sh ./bin/linkis-cli -engineType hive-2.3.3 \
> > -codeType hql -code "show databases" \
> > -submitUser hadoop -proxyUser hadoop
> > 2. How to modify the default value, you can refer to Instanll
> EnginqConn[2]
> > You need to change the directory name to:
> > LINKIS_HOME/lib/linkis-engineconn-plugins/hive/dist/v3.1.2/*
> > LINKIS_HOME/lib/linkis-engineconn-plugins/hive/plugin/v3.1.2/*
> >
> > [1] https://linkis.apache.org/docs/1.3.1/engine-usage/hive
> > [2] https://linkis.apache.org/docs/1.3.1/deployment/install-engineconn
> >
> > Best Regards
> > Peace
> >
> > arjun s <ar...@gmail.com> 于2023年1月13日周五 01:11写道：
> >
> >> Hi,
> >> Thank you for your reply.
> >> I tried to reach out to you in slack but due to some issues I was not
> >> able to connect with you.So here I mentioned the issue i am facing.
> >>
> >> I am trying to connect linkis with hive of version 3.1.2. So I had
> >> changed the parameter in deploy-config/linkis-env.sh file as mentioned
> >> below.
> >>
> >> #HADOOP
> >> HADOOP_HOME=/usr/lib/hadoop
> >> HADOOP_CONF_DIR=/etc/hadoop/conf
> >> #HADOOP_KERBEROS_ENABLE=true
> >> #HADOOP_KEYTAB_PATH=/appcom/keytab/
> >>
> >> #Hive
> >> HIVE_HOME=/usr/lib/hive
> >> HIVE_CONF_DIR=/etc/hive/conf
> >>
> >> #Spark
> >> SPARK_HOME=/usr/lib/spark
> >> SPARK_CONF_DIR=/etc/spark/conf
> >>
> >>
> >> 1.After configuring above parameters i had executed the sh
> bin/install.sh
> >> command and installed.
> >> 2.After executing sh sbin/linkis-start-all.sh command i checked the
> >> version value of hive in linkis_cg_engine_conn_plugin_bml_resources
> >> table,still value is default ,ie 2.3.3
> >>
> >>
> >> I am not able to change the default Hive engine.Did I need to change any
> >> configuration apart from these?.
> >>
> >> I tried to run sh ./bin/linkis-cli -submitUser techuser -engineType
> >> hive-3.1.2 -codeType hql -code "show tables", but the jobs gets
> failed(No
> >> plugin found hive-3.1.2). The log of these command is attached below
> >>
> >> I look forward to hearing from you.
> >>
> >> Thanks and Regards,
> >> Arjun S
> >>
> >> On Thu, 12 Jan 2023 at 17:17, peacewong <pe...@apache.org> wrote:
> >>
> >>> Hi Arjun
> >>> I can't see the picture, can we communicate through slack? You can send
> >>> messages here
> >>> https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C
> >>> <https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C>
> >>>
> >>> Thanks and Regards,
> >>> Peace
> >>>
> >>> arjun s <ar...@gmail.com> 于2023年1月12日周四 02:41写道：
> >>>
> >>> > Hi,
> >>> >
> >>> > I had installed and set up linkis(version 1.3.0) successfully. While
> >>> > trying to run hive query in linkis cli it's showing failed to create
> >>> > engine. I am trying to connect to Hive of version 3.1.2.The error
> >>> > screenshot is attached below. Did I need to change any configuration?
> >>> > because the default hive version is 2.3.3.
> >>> >
> >>> > [image: image.png]
> >>> >
> >>> >
> >>> > Thanks and Regards,
> >>> > Arjun
> >>> >
> >>>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
> >> For additional commands, e-mail: dev-help@linkis.apache.org
> >
> >
>
Re: Hive Engine Execution Error
Posted by peacewong <pe...@apache.org>.
Hi Arjun
My Slack account is peacewong
peacewong <pe...@apache.org> 于2023年1月14日周六 11:09写道：
> Hi Arjun
> 1. If it is still the default 2.3.3, you can submit the task like this[1]
> sh ./bin/linkis-cli -engineType hive-2.3.3 \
> -codeType hql -code "show databases" \
> -submitUser hadoop -proxyUser hadoop
> 2. How to modify the default value, you can refer to Instanll EnginqConn[2]
> You need to change the directory name to:
> LINKIS_HOME/lib/linkis-engineconn-plugins/hive/dist/v3.1.2/*
> LINKIS_HOME/lib/linkis-engineconn-plugins/hive/plugin/v3.1.2/*
>
> [1] https://linkis.apache.org/docs/1.3.1/engine-usage/hive
> [2] https://linkis.apache.org/docs/1.3.1/deployment/install-engineconn
>
> Best Regards
> Peace
>
> arjun s <ar...@gmail.com> 于2023年1月13日周五 01:11写道：
>
>> Hi,
>> Thank you for your reply.
>> I tried to reach out to you in slack but due to some issues I was not
>> able to connect with you.So here I mentioned the issue i am facing.
>>
>> I am trying to connect linkis with hive of version 3.1.2. So I had
>> changed the parameter in deploy-config/linkis-env.sh file as mentioned
>> below.
>>
>> #HADOOP
>> HADOOP_HOME=/usr/lib/hadoop
>> HADOOP_CONF_DIR=/etc/hadoop/conf
>> #HADOOP_KERBEROS_ENABLE=true
>> #HADOOP_KEYTAB_PATH=/appcom/keytab/
>>
>> #Hive
>> HIVE_HOME=/usr/lib/hive
>> HIVE_CONF_DIR=/etc/hive/conf
>>
>> #Spark
>> SPARK_HOME=/usr/lib/spark
>> SPARK_CONF_DIR=/etc/spark/conf
>>
>>
>> 1.After configuring above parameters i had executed the sh bin/install.sh
>> command and installed.
>> 2.After executing sh sbin/linkis-start-all.sh command i checked the
>> version value of hive in linkis_cg_engine_conn_plugin_bml_resources
>> table,still value is default ,ie 2.3.3
>>
>>
>> I am not able to change the default Hive engine.Did I need to change any
>> configuration apart from these?.
>>
>> I tried to run sh ./bin/linkis-cli -submitUser techuser -engineType
>> hive-3.1.2 -codeType hql -code "show tables", but the jobs gets failed(No
>> plugin found hive-3.1.2). The log of these command is attached below
>>
>> I look forward to hearing from you.
>>
>> Thanks and Regards,
>> Arjun S
>>
>> On Thu, 12 Jan 2023 at 17:17, peacewong <pe...@apache.org> wrote:
>>
>>> Hi Arjun
>>> I can't see the picture, can we communicate through slack? You can send
>>> messages here
>>> https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C
>>> <https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C>
>>>
>>> Thanks and Regards,
>>> Peace
>>>
>>> arjun s <ar...@gmail.com> 于2023年1月12日周四 02:41写道：
>>>
>>> > Hi,
>>> >
>>> > I had installed and set up linkis(version 1.3.0) successfully. While
>>> > trying to run hive query in linkis cli it's showing failed to create
>>> > engine. I am trying to connect to Hive of version 3.1.2.The error
>>> > screenshot is attached below. Did I need to change any configuration?
>>> > because the default hive version is 2.3.3.
>>> >
>>> > [image: image.png]
>>> >
>>> >
>>> > Thanks and Regards,
>>> > Arjun
>>> >
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
>> For additional commands, e-mail: dev-help@linkis.apache.org
>
>
Re: Hive Engine Execution Error
Posted by peacewong <pe...@apache.org>.
Hi Arjun
1. If it is still the default 2.3.3, you can submit the task like this[1]
sh ./bin/linkis-cli -engineType hive-2.3.3 \
-codeType hql -code "show databases" \
-submitUser hadoop -proxyUser hadoop
2. How to modify the default value, you can refer to Instanll EnginqConn[2]
You need to change the directory name to:
LINKIS_HOME/lib/linkis-engineconn-plugins/hive/dist/v3.1.2/*
LINKIS_HOME/lib/linkis-engineconn-plugins/hive/plugin/v3.1.2/*
[1] https://linkis.apache.org/docs/1.3.1/engine-usage/hive
[2] https://linkis.apache.org/docs/1.3.1/deployment/install-engineconn
Best Regards
Peace
arjun s <ar...@gmail.com> 于2023年1月13日周五 01:11写道：
> Hi,
> Thank you for your reply.
> I tried to reach out to you in slack but due to some issues I was not able
> to connect with you.So here I mentioned the issue i am facing.
>
> I am trying to connect linkis with hive of version 3.1.2. So I had changed
> the parameter in deploy-config/linkis-env.sh file as mentioned below.
>
> #HADOOP
> HADOOP_HOME=/usr/lib/hadoop
> HADOOP_CONF_DIR=/etc/hadoop/conf
> #HADOOP_KERBEROS_ENABLE=true
> #HADOOP_KEYTAB_PATH=/appcom/keytab/
>
> #Hive
> HIVE_HOME=/usr/lib/hive
> HIVE_CONF_DIR=/etc/hive/conf
>
> #Spark
> SPARK_HOME=/usr/lib/spark
> SPARK_CONF_DIR=/etc/spark/conf
>
>
> 1.After configuring above parameters i had executed the sh bin/install.sh
> command and installed.
> 2.After executing sh sbin/linkis-start-all.sh command i checked the
> version value of hive in linkis_cg_engine_conn_plugin_bml_resources
> table,still value is default ,ie 2.3.3
>
>
> I am not able to change the default Hive engine.Did I need to change any
> configuration apart from these?.
>
> I tried to run sh ./bin/linkis-cli -submitUser techuser -engineType
> hive-3.1.2 -codeType hql -code "show tables", but the jobs gets failed(No
> plugin found hive-3.1.2). The log of these command is attached below
>
> I look forward to hearing from you.
>
> Thanks and Regards,
> Arjun S
>
> On Thu, 12 Jan 2023 at 17:17, peacewong <pe...@apache.org> wrote:
>
>> Hi Arjun
>> I can't see the picture, can we communicate through slack? You can send
>> messages here
>> https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C
>> <https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C>
>>
>> Thanks and Regards,
>> Peace
>>
>> arjun s <ar...@gmail.com> 于2023年1月12日周四 02:41写道：
>>
>> > Hi,
>> >
>> > I had installed and set up linkis(version 1.3.0) successfully. While
>> > trying to run hive query in linkis cli it's showing failed to create
>> > engine. I am trying to connect to Hive of version 3.1.2.The error
>> > screenshot is attached below. Did I need to change any configuration?
>> > because the default hive version is 2.3.3.
>> >
>> > [image: image.png]
>> >
>> >
>> > Thanks and Regards,
>> > Arjun
>> >
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
> For additional commands, e-mail: dev-help@linkis.apache.org
Re: Hive Engine Execution Error
Posted by Chen Xia <ca...@apache.org>.
It should be noted that the default release version of linkis may not
directly support hive 3.0+ version.
If your hive cluster version 3+, needs to be modified and adapted,
you can refer to https://linkis.apache.org/docs/1.3
.1/deployment/version-adaptation#51-apache31x-version.
In addition, can you run shell engine tasks normally like
" sh ./bin/linkis-cli -engineType shell-1 \
-codeType shell -code "echo \"hello\" " \
-submitUser hadoop -proxyUser hadoop "
If necessary, you can join slack, we can communicate on slack
Best Regards!
Chen Xia.
arjun s <ar...@gmail.com> 于2023年1月13日周五 01:11写道：
>
> Hi,
> Thank you for your reply.
> I tried to reach out to you in slack but due to some issues I was not able to connect with you.So here I mentioned the issue i am facing.
>
> I am trying to connect linkis with hive of version 3.1.2. So I had changed the parameter in deploy-config/linkis-env.sh file as mentioned below.
>
> #HADOOP
> HADOOP_HOME=/usr/lib/hadoop
> HADOOP_CONF_DIR=/etc/hadoop/conf
> #HADOOP_KERBEROS_ENABLE=true
> #HADOOP_KEYTAB_PATH=/appcom/keytab/
>
> #Hive
> HIVE_HOME=/usr/lib/hive
> HIVE_CONF_DIR=/etc/hive/conf
>
> #Spark
> SPARK_HOME=/usr/lib/spark
> SPARK_CONF_DIR=/etc/spark/conf
>
>
> 1.After configuring above parameters i had executed the sh bin/install.sh command and installed.
> 2.After executing sh sbin/linkis-start-all.sh command i checked the version value of hive in linkis_cg_engine_conn_plugin_bml_resources table,still value is default ,ie 2.3.3
>
>
> I am not able to change the default Hive engine.Did I need to change any configuration apart from these?.
>
> I tried to run sh ./bin/linkis-cli -submitUser techuser -engineType hive-3.1.2 -codeType hql -code "show tables", but the jobs gets failed(No plugin found hive-3.1.2). The log of these command is attached below
>
> I look forward to hearing from you.
>
> Thanks and Regards,
> Arjun S
>
> On Thu, 12 Jan 2023 at 17:17, peacewong <pe...@apache.org> wrote:
>>
>> Hi Arjun
>> I can't see the picture, can we communicate through slack? You can send
>> messages here
>> https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C
>> <https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C>
>>
>> Thanks and Regards,
>> Peace
>>
>> arjun s <ar...@gmail.com> 于2023年1月12日周四 02:41写道：
>>
>> > Hi,
>> >
>> > I had installed and set up linkis(version 1.3.0) successfully. While
>> > trying to run hive query in linkis cli it's showing failed to create
>> > engine. I am trying to connect to Hive of version 3.1.2.The error
>> > screenshot is attached below. Did I need to change any configuration?
>> > because the default hive version is 2.3.3.
>> >
>> > [image: image.png]
>> >
>> >
>> > Thanks and Regards,
>> > Arjun
>> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
> For additional commands, e-mail: dev-help@linkis.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org
Re: Hive Engine Execution Error
Posted by arjun s <ar...@gmail.com>.
Hi,
Thank you for your reply.
I tried to reach out to you in slack but due to some issues I was not able
to connect with you.So here I mentioned the issue i am facing.
I am trying to connect linkis with hive of version 3.1.2. So I had changed
the parameter in deploy-config/linkis-env.sh file as mentioned below.
#HADOOP
HADOOP_HOME=/usr/lib/hadoop
HADOOP_CONF_DIR=/etc/hadoop/conf
#HADOOP_KERBEROS_ENABLE=true
#HADOOP_KEYTAB_PATH=/appcom/keytab/
#Hive
HIVE_HOME=/usr/lib/hive
HIVE_CONF_DIR=/etc/hive/conf
#Spark
SPARK_HOME=/usr/lib/spark
SPARK_CONF_DIR=/etc/spark/conf
1.After configuring above parameters i had executed the sh bin/install.sh
command and installed.
2.After executing sh sbin/linkis-start-all.sh command i checked the version
value of hive in linkis_cg_engine_conn_plugin_bml_resources table,still
value is default ,ie 2.3.3
I am not able to change the default Hive engine.Did I need to change any
configuration apart from these?.
I tried to run sh ./bin/linkis-cli -submitUser techuser -engineType
hive-3.1.2 -codeType hql -code "show tables", but the jobs gets failed(No
plugin found hive-3.1.2). The log of these command is attached below
I look forward to hearing from you.
Thanks and Regards,
Arjun S
On Thu, 12 Jan 2023 at 17:17, peacewong <pe...@apache.org> wrote:
> Hi Arjun
> I can't see the picture, can we communicate through slack? You can send
> messages here
> https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C
> <https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C>
>
> Thanks and Regards,
> Peace
>
> arjun s <ar...@gmail.com> 于2023年1月12日周四 02:41写道：
>
> > Hi,
> >
> > I had installed and set up linkis(version 1.3.0) successfully. While
> > trying to run hive query in linkis cli it's showing failed to create
> > engine. I am trying to connect to Hive of version 3.1.2.The error
> > screenshot is attached below. Did I need to change any configuration?
> > because the default hive version is 2.3.3.
> >
> > [image: image.png]
> >
> >
> > Thanks and Regards,
> > Arjun
> >
>
Re: Hive Engine Execution Error
Posted by peacewong <pe...@apache.org>.
Hi Arjun
I can't see the picture, can we communicate through slack? You can send
messages here
https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C
<https://app.slack.com/client/T4S1WH2J3/C02QFPDDB6C>
Thanks and Regards,
Peace
arjun s <ar...@gmail.com> 于2023年1月12日周四 02:41写道：
> Hi,
>
> I had installed and set up linkis(version 1.3.0) successfully. While
> trying to run hive query in linkis cli it's showing failed to create
> engine. I am trying to connect to Hive of version 3.1.2.The error
> screenshot is attached below. Did I need to change any configuration?
> because the default hive version is 2.3.3.
>
> [image: image.png]
>
>
> Thanks and Regards,
> Arjun
>