You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by Joice Jacob <jo...@gmail.com> on 2024/06/03 06:53:11 UTC
Issue Integrating Hive on CDP Distribution with Doris 2.1.3
Dear Doris Community,
I am reaching out to the community to seek assistance with an integration
issue I've encountered while trying to use Hive on a CDP distribution with
Doris 2.1.3
Here are the details of my setup:
Doris Version: 2.1.3
Hive Version: 3.1.3
Cloudera Version: 7.4.4
I have successfully created a Hive catalog in Doris and have been able to
set up the integration between Hive and Doris. However, when I attempt to
query a Hive internal table using Doris, I encounter the following error:
[image: image.png]
ERROR 1105 (HY000): errCode = 2, detailMessage = get file split failed for
table: baby1, err: java.lang.Exception: Hive 2.x versioned full-acid tables
need to run major compaction.
I would greatly appreciate any insights, guidance, or solutions that the
Doris community can offer to help me resolve this issue. If anyone has
encountered a similar problem or has expertise in integrating cloudera Hive
with Doris, your assistance would be invaluable.
Thank you in advance for your time and support. I look forward to hearing
from the community and working together to find a solution to this
challenge.
[image: image.png]
Re: Issue Integrating Hive on CDP Distribution with Doris 2.1.3
Posted by Joice Jacob <jo...@gmail.com>.
Hi,
Has Doris already been integrated with Cloudera Hive? Has anyone tested
CDP Hive with the latest version of Doris?
On Mon, Jun 3, 2024 at 4:54 PM Joice Jacob <jo...@gmail.com> wrote:
> Hi,
> I checked that document.
> In CDP Hive tables are transactional by default. If the transactional
> property is not specified, Hive will automatically make the table
> transactional. I have also performed a major compaction, but the issue
> still persists.
>
> On Mon, Jun 3, 2024 at 3:05 PM Mingyu Chen <mo...@163.com> wrote:
>
>> Have you seen this?
>>
>>
>> https://doris.apache.org/docs/dev/lakehouse/datalake-analytics/hive/#hive-transactional-tables
>>
>>
>> --
>> Best Regards
>> Mingyu Chen
>>
>> Email:
>> morningman@apache.org
>>
>>
>> At 2024-06-03 14:53:11, "Joice Jacob" <jo...@gmail.com> wrote:
>>
>> Dear Doris Community,
>> I am reaching out to the community to seek assistance with an integration
>> issue I've encountered while trying to use Hive on a CDP distribution with
>> Doris 2.1.3
>>
>> Here are the details of my setup:
>>
>> Doris Version: 2.1.3
>> Hive Version: 3.1.3
>> Cloudera Version: 7.4.4
>>
>>
>> I have successfully created a Hive catalog in Doris and have been able to
>> set up the integration between Hive and Doris. However, when I attempt to
>> query a Hive internal table using Doris, I encounter the following error:
>> [image: image.png]
>> ERROR 1105 (HY000): errCode = 2, detailMessage = get file split failed
>> for table: baby1, err: java.lang.Exception: Hive 2.x versioned full-acid
>> tables need to run major compaction.
>>
>>
>> I would greatly appreciate any insights, guidance, or solutions that the
>> Doris community can offer to help me resolve this issue. If anyone has
>> encountered a similar problem or has expertise in integrating cloudera Hive
>> with Doris, your assistance would be invaluable.
>>
>> Thank you in advance for your time and support. I look forward to hearing
>> from the community and working together to find a solution to this
>> challenge.
>> [image: image.png]
>>
>>
Re: Issue Integrating Hive on CDP Distribution with Doris 2.1.3
Posted by Joice Jacob <jo...@gmail.com>.
Hi,
I checked that document.
In CDP Hive tables are transactional by default. If the transactional
property is not specified, Hive will automatically make the table
transactional. I have also performed a major compaction, but the issue
still persists.
On Mon, Jun 3, 2024 at 3:05 PM Mingyu Chen <mo...@163.com> wrote:
> Have you seen this?
>
>
> https://doris.apache.org/docs/dev/lakehouse/datalake-analytics/hive/#hive-transactional-tables
>
>
> --
> Best Regards
> Mingyu Chen
>
> Email:
> morningman@apache.org
>
>
> At 2024-06-03 14:53:11, "Joice Jacob" <jo...@gmail.com> wrote:
>
> Dear Doris Community,
> I am reaching out to the community to seek assistance with an integration
> issue I've encountered while trying to use Hive on a CDP distribution with
> Doris 2.1.3
>
> Here are the details of my setup:
>
> Doris Version: 2.1.3
> Hive Version: 3.1.3
> Cloudera Version: 7.4.4
>
>
> I have successfully created a Hive catalog in Doris and have been able to
> set up the integration between Hive and Doris. However, when I attempt to
> query a Hive internal table using Doris, I encounter the following error:
> [image: image.png]
> ERROR 1105 (HY000): errCode = 2, detailMessage = get file split failed for
> table: baby1, err: java.lang.Exception: Hive 2.x versioned full-acid tables
> need to run major compaction.
>
>
> I would greatly appreciate any insights, guidance, or solutions that the
> Doris community can offer to help me resolve this issue. If anyone has
> encountered a similar problem or has expertise in integrating cloudera Hive
> with Doris, your assistance would be invaluable.
>
> Thank you in advance for your time and support. I look forward to hearing
> from the community and working together to find a solution to this
> challenge.
> [image: image.png]
>
>
Re:Issue Integrating Hive on CDP Distribution with Doris 2.1.3
Posted by Mingyu Chen <mo...@163.com>.
Have you seen this?
https://doris.apache.org/docs/dev/lakehouse/datalake-analytics/hive/#hive-transactional-tables
--
Best Regards
Mingyu Chen
Email:
morningman@apache.org
At 2024-06-03 14:53:11, "Joice Jacob" <jo...@gmail.com> wrote:
Dear Doris Community,
I am reaching out to the community to seek assistance with an integration issue I've encountered while trying to use Hive on a CDP distribution with Doris 2.1.3
Here are the details of my setup:
Doris Version: 2.1.3
Hive Version: 3.1.3
Cloudera Version: 7.4.4
I have successfully created a Hive catalog in Doris and have been able to set up the integration between Hive and Doris. However, when I attempt to query a Hive internal table using Doris, I encounter the following error:
ERROR 1105 (HY000): errCode = 2, detailMessage = get file split failed for table: baby1, err: java.lang.Exception: Hive 2.x versioned full-acid tables need to run major compaction.
I would greatly appreciate any insights, guidance, or solutions that the Doris community can offer to help me resolve this issue. If anyone has encountered a similar problem or has expertise in integrating cloudera Hive with Doris, your assistance would be invaluable.
Thank you in advance for your time and support. I look forward to hearing from the community and working together to find a solution to this challenge.