[jira] [Commented] (HAWQ-94) Storage error when insert a large tuple

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAWQ-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999975#comment-14999975 ] 

ASF GitHub Bot commented on HAWQ-94:
------------------------------------

GitHub user jianlirong opened a pull request:

    https://github.com/apache/incubator-hawq/pull/95

    HAWQ-94. Handle one case when reaching EOF for AO large tuple

    When *blockLimitLen = 0, we should return false to indicate this is the end of file.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/jianlirong/incubator-hawq HAWQ-94

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-hawq/pull/95.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #95
    
----
commit 1f93480e3515dbe93eadc0a87011c223baf02dfb
Author: Lirong Jian <ji...@gmail.com>
Date:   2015-11-11T05:53:25Z

    HAWQ-94. Handle one case when reaching EOF for AO large tuple

----


> Storage error when insert a large tuple
> ---------------------------------------
>
>                 Key: HAWQ-94
>                 URL: https://issues.apache.org/jira/browse/HAWQ-94
>             Project: Apache HAWQ
>          Issue Type: Bug
>          Components: Storage
>            Reporter: Dong Li
>            Assignee: Lirong Jian
>
> 1. Set guc value "appendonly_split_write_size_mb" 
> hawq config -c appendonly_split_write_size_mb -v 2
> 2.Run sql
> set default_segment_num=1;
> create table eightbytleft_for_readsplit(str varchar) with (appendonly=true,blocksize=2097152,checksum=true);
> insert into eightbytleft_for_readsplit select repeat('a',2097136*63-8);
> WARNING:  skipping "eightbytleft_for_readsplit" --- error returned: Bad append-only storage header of type small content. Header check error 7, detail 'Append-only storage header is invalid -- overall block length 2097152 is > block limit length 0 (smallcontent_bytes_0_3 0x120003ff, smallcontent_bytes_4_7 0xfe000000)' (cdbappendonlystorageread.c:972)  (seg0 sdw1.hawq.greenplum.com:31100 pid=641344)
> DETAIL:
> Append-Only storage Small Content header: smallcontent_bytes_0_3 0x120003FF, smallcontent_bytes_4_7 0xFE000000, headerKind = 1, executorBlockKind = 2, rowCount = 0, usingChecksums = true, header checksum 0xAD931AF8, block checksum 0x3B923D8, dataLength 2097136, compressedLength 0, overallBlockLen 2097152
> Scan of Append-Only Row-Oriented relation 'eightbytleft_for_readsplit'. Append-Only segment file 'hdfs://smdw:9000/hawq/hawq-1446007451/16385/32094/32095/1', block header offset in file = 136314880, bufferCount 66
> INFO:  ANALYZE completed. Success: 0, Failure: 1 (eightbytleft_for_readsplit)
> INSERT 0 1



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)