You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/09/15 14:50:00 UTC

[jira] [Commented] (TRAFODION-2738) Rowset buffer size during insert/upsert should be limited

    [ https://issues.apache.org/jira/browse/TRAFODION-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167963#comment-16167963 ] 

ASF GitHub Bot commented on TRAFODION-2738:
-------------------------------------------

GitHub user selvaganesang opened a pull request:

    https://github.com/apache/incubator-trafodion/pull/1232

    [TRAFODION-2738] Rowset buffer size during insert/upsert should be li…

    …mited
    
    Rowset insert includes UnpackRows operator in its query tree. UnPackRows
    operator was allocating a larger memory based on rowset size and row size
    to flow the data to its parent operator.
    
    Introduced a CQD EXE_MEMORY_FOR_UNPACK_ROWS_IN_MB to limit the amount
    of memory allocated in this operator. The default value is 100MB.
    
    In addition, streamlined the NAMemory infrastruture to return NULL or
    dump core when more than 2 GB of memory is allocated in one chunk.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/selvaganesang/incubator-trafodion trafodion-2738

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-trafodion/pull/1232.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1232
    
----
commit 3a15d7c8932fa26b123d4d9c85e41e8d7bf697b0
Author: selvaganesang <se...@esgyn.com>
Date:   2017-09-15T14:37:07Z

    [TRAFODION-2738] Rowset buffer size during insert/upsert should be limited
    
    Rowset insert includes UnpackRows operator in its query tree. UnPackRows
    operator was allocating a larger memory based on rowset size and row size
    to flow the data to its parent operator.
    
    Introduced a CQD EXE_MEMORY_FOR_UNPACK_ROWS_IN_MB to limit the amount
    of memory allocated in this operator. The default value is 100MB.
    
    In addition, streamlined the NAMemory infrastruture to return NULL or
    dump core when more than 2 GB of memory is allocated in one chunk.

----


> Rowset buffer size during insert/upsert should be limited
> ---------------------------------------------------------
>
>                 Key: TRAFODION-2738
>                 URL: https://issues.apache.org/jira/browse/TRAFODION-2738
>             Project: Apache Trafodion
>          Issue Type: Bug
>            Reporter: Selvaganesan Govindarajan
>
> Currently, the rowset size for upsert and insert can be given in a such way that it would be allocate unlimited buffer size to move the data from client to Trafodion SQL engine. This can cause memory corruption and unexpected behavior. Hence, we need a way to limit the number of rows in the rowset.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)