You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by "Chen Luo (JIRA)" <ji...@apache.org> on 2018/03/22 16:46:00 UTC
[jira] [Commented] (ASTERIXDB-2336) Sorting big tuples fails due to
memory budget
[ https://issues.apache.org/jira/browse/ASTERIXDB-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409857#comment-16409857 ]
Chen Luo commented on ASTERIXDB-2336:
-------------------------------------
I think this is designed intentionally to enforce memory budgeting during sort. The record size cannot exceed the memory budget for sort, otherwise the actual memory usage would be unbounded. If this happens, should the user just increase the memory budget for sort?
> Sorting big tuples fails due to memory budget
> ---------------------------------------------
>
> Key: ASTERIXDB-2336
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-2336
> Project: Apache AsterixDB
> Issue Type: Bug
> Reporter: Ali Alsuliman
> Assignee: Ali Alsuliman
> Priority: Major
>
> Currently, when sorting data in a partition, and during merging the sorted run files, the system throws an exception if one of the run files has a huge tuple. The reason is that such a huge tuple will take almost the entire budget allocated for sorting. For such cases, allow exceeding the budget in order to sort the data.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)