You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Chetan Khatri <ch...@gmail.com> on 2020/03/04 17:09:04 UTC
Read Hive ACID Managed table in Spark
Hi Spark Users,
I want to read Hive ACID managed table data (ORC) in Spark. Can someone
help me here.
I've tried, https://github.com/qubole/spark-acid but no success.
Thanks
Re: Read Hive ACID Managed table in Spark
Posted by Chetan Khatri <ch...@gmail.com>.
Hi Amogh,
Thanks for your reply. I'll send you seperate email for the communication.
On Thu, Apr 9, 2020 at 1:11 PM amogh margoor <am...@gmail.com> wrote:
> Sorry for the late reply.
> I can help you with getting started with
> https://github.com/qubole/spark-acid to read Hive ACID tables. Feel free
> to drop me a mail or raise an issue here:
> https://github.com/qubole/spark-acid/issues
>
> Regards,
> Amogh
>
> On Tue, Mar 10, 2020 at 4:20 AM Chetan Khatri <ch...@gmail.com>
> wrote:
>
>> Hi Venkata,
>> Thanks for your reply. I am using HDP 2.6 and I don't think above will
>> work for me, Any other suggestions? Thanks
>>
>> On Thu, Mar 5, 2020 at 8:24 AM venkata naidu udamala <
>> vudamala.gyanada@gmail.com> wrote:
>>
>>> You can try using have warehouse connector
>>> https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html
>>>
>>> On Thu, Mar 5, 2020, 6:51 AM Chetan Khatri <ch...@gmail.com>
>>> wrote:
>>>
>>>> Just followup, if anyone has worried on this before
>>>>
>>>> On Wed, Mar 4, 2020 at 12:09 PM Chetan Khatri <
>>>> chetan.opensource@gmail.com> wrote:
>>>>
>>>>> Hi Spark Users,
>>>>> I want to read Hive ACID managed table data (ORC) in Spark. Can
>>>>> someone help me here.
>>>>> I've tried, https://github.com/qubole/spark-acid but no success.
>>>>>
>>>>> Thanks
>>>>>
>>>>
Re: Read Hive ACID Managed table in Spark
Posted by amogh margoor <am...@gmail.com>.
Sorry for the late reply.
I can help you with getting started with
https://github.com/qubole/spark-acid to read Hive ACID tables. Feel free
to drop me a mail or raise an issue here:
https://github.com/qubole/spark-acid/issues
Regards,
Amogh
On Tue, Mar 10, 2020 at 4:20 AM Chetan Khatri <ch...@gmail.com>
wrote:
> Hi Venkata,
> Thanks for your reply. I am using HDP 2.6 and I don't think above will
> work for me, Any other suggestions? Thanks
>
> On Thu, Mar 5, 2020 at 8:24 AM venkata naidu udamala <
> vudamala.gyanada@gmail.com> wrote:
>
>> You can try using have warehouse connector
>> https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html
>>
>> On Thu, Mar 5, 2020, 6:51 AM Chetan Khatri <ch...@gmail.com>
>> wrote:
>>
>>> Just followup, if anyone has worried on this before
>>>
>>> On Wed, Mar 4, 2020 at 12:09 PM Chetan Khatri <
>>> chetan.opensource@gmail.com> wrote:
>>>
>>>> Hi Spark Users,
>>>> I want to read Hive ACID managed table data (ORC) in Spark. Can someone
>>>> help me here.
>>>> I've tried, https://github.com/qubole/spark-acid but no success.
>>>>
>>>> Thanks
>>>>
>>>
Re: Read Hive ACID Managed table in Spark
Posted by Chetan Khatri <ch...@gmail.com>.
Hi Venkata,
Thanks for your reply. I am using HDP 2.6 and I don't think above will work
for me, Any other suggestions? Thanks
On Thu, Mar 5, 2020 at 8:24 AM venkata naidu udamala <
vudamala.gyanada@gmail.com> wrote:
> You can try using have warehouse connector
> https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html
>
> On Thu, Mar 5, 2020, 6:51 AM Chetan Khatri <ch...@gmail.com>
> wrote:
>
>> Just followup, if anyone has worried on this before
>>
>> On Wed, Mar 4, 2020 at 12:09 PM Chetan Khatri <
>> chetan.opensource@gmail.com> wrote:
>>
>>> Hi Spark Users,
>>> I want to read Hive ACID managed table data (ORC) in Spark. Can someone
>>> help me here.
>>> I've tried, https://github.com/qubole/spark-acid but no success.
>>>
>>> Thanks
>>>
>>
Re: Read Hive ACID Managed table in Spark
Posted by venkata naidu udamala <vu...@gmail.com>.
You can try using have warehouse connector
https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html
On Thu, Mar 5, 2020, 6:51 AM Chetan Khatri <ch...@gmail.com>
wrote:
> Just followup, if anyone has worried on this before
>
> On Wed, Mar 4, 2020 at 12:09 PM Chetan Khatri <ch...@gmail.com>
> wrote:
>
>> Hi Spark Users,
>> I want to read Hive ACID managed table data (ORC) in Spark. Can someone
>> help me here.
>> I've tried, https://github.com/qubole/spark-acid but no success.
>>
>> Thanks
>>
>
Re: Read Hive ACID Managed table in Spark
Posted by Chetan Khatri <ch...@gmail.com>.
Just followup, if anyone has worried on this before
On Wed, Mar 4, 2020 at 12:09 PM Chetan Khatri <ch...@gmail.com>
wrote:
> Hi Spark Users,
> I want to read Hive ACID managed table data (ORC) in Spark. Can someone
> help me here.
> I've tried, https://github.com/qubole/spark-acid but no success.
>
> Thanks
>