You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Xixu Wang (Jira)" <ji...@apache.org> on 2023/03/09 02:07:00 UTC

[jira] [Commented] (KUDU-3455) Improve space complexity about prune hash partitions for in-list predicate

    [ https://issues.apache.org/jira/browse/KUDU-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17698143#comment-17698143 ] 

Xixu Wang commented on KUDU-3455:
---------------------------------

Do you have fetched the java heap that can really proves this problem will cause OOM?

> Improve space complexity about prune hash partitions for in-list predicate
> --------------------------------------------------------------------------
>
>                 Key: KUDU-3455
>                 URL: https://issues.apache.org/jira/browse/KUDU-3455
>             Project: Kudu
>          Issue Type: Task
>            Reporter: shenxingwuying
>            Assignee: shenxingwuying
>            Priority: Major
>         Attachments: image-2023-03-06-17-23-35-119.png
>
>
> Improve space complexity about prune hash partitions for in-list predicate
>     Pruning hash partitions for in-list predicate at java-client, the logic
>     codes has a high space complexity, and it may cause java-client out
>     of memory.  And at the same time, PartialRow has many deep copy, it may be slow.
>  
> !image-2023-03-06-17-23-35-119.png!
>  
>  
> So, we need to fix the problem to improve the space complexity and speed optimization.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)