You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by 潘庭锋 <pa...@pcitech.com> on 2025/03/20 03:29:16 UTC

Subject: Multi-Condition Query on Hive External Table Causes All BE Nodes to Crash (Doris 3.0.2 + Hive 3.1.0)

Dear Doris Community/Support Team,
I hope this email finds you well. I am writing to report an issue encountered while querying a Hive external table via Doris, which leads to BE node crashes. Your expertise would be greatly appreciated in resolving this problem.


github issue:&nbsp;&nbsp;https://github.com/apache/doris/issues/49034



Environment Details

Doris Version:&nbsp;3.0.2


Hive Version:&nbsp;3.1.0.3.1.5.0-152



Issue Description:

When querying a Hive external table with multiple non-partition column filters (e.g.,&nbsp;PERSON_ID,&nbsp;RECORD_ID,&nbsp;CARD_PHYSICAL_ID), all BE nodes crash and return the error&nbsp;io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason.





Error Details:
●Client Error:复制SQL error [1105] [HY000]: RpcException, msg: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason &nbsp;
●Reproducibility:
○Stably Reproducible&nbsp;when querying with non-partition column filters on a large table (~300 million rows).
○Works Correctly&nbsp;if:
■Query includes&nbsp;all partition columns&nbsp;(stat_day&nbsp;and&nbsp;order_type).
■Query is simple (e.g., no&nbsp;WHERE&nbsp;clause or only partition column filters).
■Table size is small.








Request for Support:
Could you help investigate:
1.&nbsp;Why non-partition column filters cause BE crashes on large tables?
2.&nbsp;Whether this is related to metadata propagation, predicate pushdown, or resource constraints (e.g., memory/network)?
3.&nbsp;Required configurations to avoid such crashes.


Thank you for your assistance!

Best regards,


Tingfeng Pan&nbsp;

Re:Subject: Multi-Condition Query on Hive External Table Causes All BE Nodes to Crash (Doris 3.0.2 + Hive 3.1.0)

Posted by Mingyu Chen <mo...@163.com>.
I've commented in on issue, PTAL










--

Best Regards
Mingyu Chen

Email:
morningman@apache.org





At 2025-03-20 11:29:16, "潘庭锋" <pa...@pcitech.com> wrote:
>Dear Doris Community/Support Team,
>I hope this email finds you well. I am writing to report an issue encountered while querying a Hive external table via Doris, which leads to BE node crashes. Your expertise would be greatly appreciated in resolving this problem.
>
>
>github issue:&nbsp;&nbsp;https://github.com/apache/doris/issues/49034
>
>
>
>Environment Details
>
>Doris Version:&nbsp;3.0.2
>
>
>Hive Version:&nbsp;3.1.0.3.1.5.0-152
>
>
>
>Issue Description:
>
>When querying a Hive external table with multiple non-partition column filters (e.g.,&nbsp;PERSON_ID,&nbsp;RECORD_ID,&nbsp;CARD_PHYSICAL_ID), all BE nodes crash and return the error&nbsp;io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason.
>
>
>
>
>
>Error Details:
>●Client Error:复制SQL error [1105] [HY000]: RpcException, msg: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason &nbsp;
>●Reproducibility:
>○Stably Reproducible&nbsp;when querying with non-partition column filters on a large table (~300 million rows).
>○Works Correctly&nbsp;if:
>■Query includes&nbsp;all partition columns&nbsp;(stat_day&nbsp;and&nbsp;order_type).
>■Query is simple (e.g., no&nbsp;WHERE&nbsp;clause or only partition column filters).
>■Table size is small.
>
>
>
>
>
>
>
>
>Request for Support:
>Could you help investigate:
>1.&nbsp;Why non-partition column filters cause BE crashes on large tables?
>2.&nbsp;Whether this is related to metadata propagation, predicate pushdown, or resource constraints (e.g., memory/network)?
>3.&nbsp;Required configurations to avoid such crashes.
>
>
>Thank you for your assistance!
>
>Best regards,
>
>
>Tingfeng Pan&nbsp;