[jira] [Commented] (IMPALA-11296) The executor has some resident threads that occupy CPU abnormally.

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-11296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814215#comment-17814215 ] 

ASF subversion and git services commented on IMPALA-11296:
----------------------------------------------------------

Commit 763b378f4f55757364273b39f30732b9cc486953 in impala's branch refs/heads/branch-3.4.2 from ttttttz
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=763b378f4 ]

IMPALA-11296: Fix infinite loop when reading orc files

When querying an ORC table, selecting only the missing fields of ORC
files causes the query to be executed indefinitely. The
corresponding execution node will see some resident threads that
occupy CPU abnormally. The problem is caused by this:
when OrcComplexColumnReader.children_.empty() is true,
OrcComplexColumnReader.row_idx_ will remain constant, causing an
infinite loop at HdfsOrcScanner::TransferTuples().
We should allow empty 'children_' for original files.

Testing:
- Added a test to test_scanners.py that ensures the query can be
  executed successfully when selecting only the missing fields of
  ORC files.
Change-Id: Ic7ecf5e9c94ffcc02d3ca6c2ec8d55a685ec3968
Reviewed-on: http://gerrit.cloudera.org:8080/18571
Reviewed-by: Quanlong Huang <hu...@gmail.com>
Reviewed-by: Zoltan Borok-Nagy <bo...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> The executor has some resident threads that occupy CPU abnormally.
> ------------------------------------------------------------------
>
>                 Key: IMPALA-11296
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11296
>             Project: IMPALA
>          Issue Type: Bug
>    Affects Versions: Impala 3.4.0
>            Reporter: Zhi Tang
>            Assignee: Zhi Tang
>            Priority: Critical
>             Fix For: Impala 3.4.2
>
>         Attachments: image-2022-05-17-16-40-52-110.png, top_info.png
>
>
> The executor has some resident threads that occupy CPU abnormally. The following is the call stack information of a thread:
> !image-2022-05-17-16-40-52-110.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org