You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "苏锦佩 (JIRA)" <ji...@apache.org> on 2017/09/30 06:36:00 UTC
[jira] [Commented] (TRAFODION-2432) odb extract lineitem table over
250 thousand rows return error
[ https://issues.apache.org/jira/browse/TRAFODION-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186935#comment-16186935 ]
苏锦佩 commented on TRAFODION-2432:
--------------------------------
can't reproduce this issue
> odb extract lineitem table over 250 thousand rows return error
> ---------------------------------------------------------------
>
> Key: TRAFODION-2432
> URL: https://issues.apache.org/jira/browse/TRAFODION-2432
> Project: Apache Trafodion
> Issue Type: Bug
> Components: db-utility-odb
> Reporter: zhangliang
> Assignee: zhangliang
>
> Using odb to extract lineitem table will return error while extract over 250 thousand rows, but within 200 thousand rows, it behave well.
> Extract 250 thousand log:
> [root@gy08 bin]# ./ori_odb64luo -u trafodion -p traf123 -d traf -e src=trafodion.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS:tgt=output/data_encrypt_lineitem_170109_25w:fs=,:trim:max=250000
> Connected to Trafodion
> [0] odb(13004) [2017-01-09 14:53:32] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_ORDERKEY) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:53:32] (State: 01000 Native Err: 6008)
> [0] odb(13004) [2017-01-09 14:53:32] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_LINENUMBER) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:53:32] (State: 01000 Native Err: 6008)
> [0] odb(13004) [2017-01-09 14:53:32] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_SHIPDATE) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:53:32] (State: 01000 Native Err: 6008)
> odb [2017-01-09 14:53:26]: starting ODBC connection(s)... 0
> [0] odb(3207) [2017-01-09 14:53:38] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_ORDERKEY) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:53:38] (State: 01000 Native Err: 6008)
> [0] odb(3207) [2017-01-09 14:53:38] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_LINENUMBER) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:53:38] (State: 01000 Native Err: 6008)
> [0] odb(3207) [2017-01-09 14:53:38] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_SHIPDATE) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:53:38] (State: 01000 Native Err: 6008)
> [0] 100 records extracted
> [0] 200 records extracted
> [0] 300 records extracted
> [0] 400 records extracted
> [0] 500 records extracted
> [0] 600 records extracted
> [0] 700 records extracted
> [0] 800 records extracted
> [0] 900 records extracted
> [0] 1,000 records extracted
> ...
> [0] 248,900 records extracted
> [0] 249,000 records extracted
> [0] 249,100 records extracted
> [0] 249,200 records extracted
> [0] 249,300 records extracted
> [0] 249,400 records extracted
> [0] 249,500 records extracted
> [0] 249,600 records extracted
> [0] 249,700 records extracted
> [0] 249,800 records extracted
> [0] 249,900 records extracted
> [0] 250,000 records extracted
> *** glibc detected *** ./ori_odb64luo: double free or corruption (!prev): 0x0000000000c6a9d0 ***
> ======= Backtrace: =========
> /lib64/libc.so.6(+0x75f3e)[0x7fd0c4d0af3e]
> /lib64/libc.so.6(+0x78dd0)[0x7fd0c4d0ddd0]
> ./ori_odb64luo[0x40bb36]
> ./ori_odb64luo[0x41ddf2]
> ./ori_odb64luo[0x43514a]
> /lib64/libc.so.6(__libc_start_main+0xfd)[0x7fd0c4cb3d1d]
> ./ori_odb64luo[0x403339]
> ======= Memory map: ========
> 00400000-0044a000 r-xp 00000000 08:03 2491606 /root/zale/incubator-trafodion/core/conn/odb/bin/ori_odb64luo
> 00649000-0064a000 rw-p 00049000 08:03 2491606 /root/zale/incubator-trafodion/core/conn/odb/bin/ori_odb64luo
> 0064a000-0064c000 rw-p 00000000 00:00 0
> 00c36000-00cbb000 rw-p 00000000 00:00 0 [heap]
> 7fd0b8000000-7fd0b8021000 rw-p 00000000 00:00 0
> 7fd0b8021000-7fd0bc000000 ---p 00000000 00:00 0
> 7fd0bf110000-7fd0bf111000 ---p 00000000 00:00 0
> 7fd0bf111000-7fd0bfb11000 rw-p 00000000 00:00 0
> 7fd0bfb11000-7fd0bfb2e000 r-xp 00000000 08:03 7995444 /lib64/libselinux.so.1
> 7fd0bfb2e000-7fd0bfd2d000 ---p 0001d000 08:03 7995444 /lib64/libselinux.so.1
> 7fd0bfd2d000-7fd0bfd2e000 r--p 0001c000 08:03 7995444 /lib64/libselinux.so.1
> 7fd0bfd2e000-7fd0bfd2f000 rw-p 0001d000 08:03 7995444 /lib64/libselinux.so.1
> 7fd0bfd2f000-7fd0bfd30000 rw-p 00000000 00:00 0
> 7fd0bfd30000-7fd0bfd32000 r-xp 00000000 08:03 7995572 /lib64/libkeyutils.so.1.3
> 7fd0bfd32000-7fd0bff31000 ---p 00002000 08:03 7995572 /lib64/libkeyutils.so.1.3
> 7fd0bff31000-7fd0bff32000 r--p 00001000 08:03 7995572 /lib64/libkeyutils.so.1.3
> 7fd0bff32000-7fd0bff33000 rw-p 00002000 08:03 7995572 /lib64/libkeyutils.so.1.3
> 7fd0bff33000-7fd0bff3d000 r-xp 00000000 08:03 7995581 /lib64/libkrb5support.so.0.1
> 7fd0bff3d000-7fd0c013c000 ---p 0000a000 08:03 7995581 /lib64/libkrb5support.so.0.1
> 7fd0c013c000-7fd0c013d000 r--p 00009000 08:03 7995581 /lib64/libkrb5support.so.0.1
> 7fd0c013d000-7fd0c013e000 rw-p 0000a000 08:03 7995581 /lib64/libkrb5support.so.0.1
> 7fd0c013e000-7fd0c0177000 r-xp 00000000 08:03 7995488 /lib64/libnspr4.so
> 7fd0c0177000-7fd0c0377000 ---p 00039000 08:03 7995488 /lib64/libnspr4.so
> 7fd0c0377000-7fd0c0378000 r--p 00039000 08:03 7995488 /lib64/libnspr4.so
> 7fd0c0378000-7fd0c037a000 rw-p 0003a000 08:03 7995488 /lib64/libnspr4.so
> 7fd0c037a000-7fd0c037c000 rw-p 00000000 00:00 0
> 7fd0c037c000-7fd0c0380000 r-xp 00000000 08:03 7995830 /lib64/libplc4.so
> 7fd0c0380000-7fd0c057f000 ---p 00004000 08:03 7995830 /lib64/libplc4.so
> 7fd0c057f000-7fd0c0580000 r--p 00003000 08:03 7995830 /lib64/libplc4.so
> 7fd0c0580000-7fd0c0581000 rw-p 00004000 08:03 7995830 /lib64/libplc4.so
> 7fd0c0581000-7fd0c0584000 r-xp 00000000 08:03 7995831 /lib64/libplds4.so
> 7fd0c0584000-7fd0c0783000 ---p 00003000 08:03 7995831 /lib64/libplds4.so
> 7fd0c0783000-7fd0c0784000 r--p 00002000 08:03 7995831 /lib64/libplds4.so
> 7fd0c0784000-7fd0c0785000 rw-p 00003000 08:03 7995831 /lib64/libplds4.so
> 7fd0c0785000-7fd0c07ab000 r-xp 00000000 08:03 14823810 /usr/lib64/libnssutil3.so
> 7fd0c07ab000-7fd0c09aa000 ---p 00026000 08:03 14823810 /usr/lib64/libnssutil3.so
> 7fd0c09aa000-7fd0c09b0000 r--p 00025000 08:03 14823810 /usr/lib64/libnssutil3.so
> 7fd0c09b0000-7fd0c09b1000 rw-p 0002b000 08:03 14823810 /usr/lib64/libnssutil3.so
> 7fd0c09b1000-7fd0c0ae8000 r-xp 00000000 08:03 14812660 /usr/lib64/libnss3.so
> 7fd0c0ae8000-7fd0c0ce8000 ---p 00137000 08:03 14812660 /usr/lib64/libnss3.so
> 7fd0c0ce8000-7fd0c0ced000 r--p 00137000 08:03 14812660 /usr/lib64/libnss3.so
> 7fd0c0ced000-7fd0c0cef000 rw-p 0013c000 08:03 14812660 /usr/lib64/libnss3.so
> 7fd0c0cef000-7fd0c0cf1000 rw-p 00000000 00:00 0
> 7fd0c0cf1000-7fd0c0d19000 r-xp 00000000 08:03 14817621 /usr/lib64/libsmime3.so
> 7fd0c0d19000-7fd0c0f18000 ---p 00028000 08:03 14817621 /usr/lib64/libsmime3.so
> 7fd0c0f18000-7fd0c0f1d000 r--p 00027000 08:03 14817621 /usr/lib64/libsmime3.so
> 7fd0c0f1d000-7fd0c0f1e000 rw-p 0002c000 08:03 14817621 /usr/lib64/libsmime3.so
> 7fd0c0f1e000-7fd0c0f5c000 r-xp 00000000 08:03 14823814 /usr/lib64/libssl3.so
> 7fd0c0f5c000-7fd0c115c000 ---p 0003e000 08:03 14823814 /usr/lib64/libssl3.so
> 7fd0c115c000-7fd0c115f000 r--p 0003e000 08:03 14823814 /usr/lib64/libssl3.so
> 7fd0c115f000-7fd0c1160000 rw-p 00041000 08:03 14823814 /usr/lib64/libssl3.so
> 7fd0c1160000-7fd0c1161000 rw-p 00000000 00:00 0
> 7fd0c1161000-7fd0c1177000 r-xp 00000000 08:03 7995433 /lib64/libresolv-2.12.so
> 7fd0c1177000-7fd0c1377000 ---p 00016000 08:03 7995433 /lib64/libresolv-2.12.so
> 7fd0c1377000-7fd0c1378000 r--p 00016000 08:03 7995433 /lib64/libresolv-2.12.so
> 7fd0c1378000-7fd0c1379000 rw-p 00017000 08:03 7995433 /lib64/libresolv-2.12.so
> 7fd0c1379000-7fd0c137b000 rw-p 00000000 00:00 0
> 7fd0c137b000-7fd0c1535000 r-xp 00000000 08:03 14812705 /usr/lib64/libcrypto.so.1.0.1e
> 7fd0c1535000-7fd0c1734000 ---p 001ba000 08:03 14812705 /usr/lib64/libcrypto.so.1.0.1e
> 7fd0c1734000-7fd0c174f000 r--p 001b9000 08:03 14812705 /usr/lib64/libcrypto.so.1.0.1e
> 7fd0c174f000-7fd0c175b000 rw-p 001d4000 08:03 14812705 /usr/lib64/libcrypto.so.1.0.1e
> 7fd0c175b000-7fd0c175f000 rw-p 00000000 00:00 0
> 7fd0c175f000-7fd0c1788000 r-xp 00000000 08:03 7995577 /lib64/libk5crypto.so.3.1
> 7fd0c1788000-7fd0c1988000 ---p 00029000 08:03 7995577 /lib64/libk5crypto.so.3.1
> 7fd0c1988000-7fd0c1989000 r--p 00029000 08:03 7995577 /lib64/libk5crypto.so.3.1
> 7fd0c1989000-7fd0c198a000 rw-p 0002a000 08:03 7995577 /lib64/libk5crypto.so.3.1
> 7fd0c198a000-7fd0c198b000 rw-p 00000000 00:00 0
> 7fd0c198b000-7fd0c198e000 r-xp 00000000 08:03 7995466 /lib64/libcom_err.so.2.1Aborted
> Extract 200 thousand log:
> [root@gy08 bin]# ./ori_odb64luo -u trafodion -p traf123 -d traf -e src=trafodion.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS:tgt=output/data_encrypt_lineitem_170109_20w:fs=,:trim:max=200000
> Connected to Trafodion
> [0] odb(13004) [2017-01-09 14:54:02] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_ORDERKEY) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:54:02] (State: 01000 Native Err: 6008)
> [0] odb(13004) [2017-01-09 14:54:02] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_LINENUMBER) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:54:02] (State: 01000 Native Err: 6008)
> [0] odb(13004) [2017-01-09 14:54:02] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_SHIPDATE) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:54:02] (State: 01000 Native Err: 6008)
> odb [2017-01-09 14:53:56]: starting ODBC connection(s)... 0
> [0] odb(3207) [2017-01-09 14:54:07] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_ORDERKEY) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:54:07] (State: 01000 Native Err: 6008)
> [0] odb(3207) [2017-01-09 14:54:07] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_LINENUMBER) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:54:07] (State: 01000 Native Err: 6008)
> [0] odb(3207) [2017-01-09 14:54:07] - [Trafodion ODBC Driver][Trafodion Database] SQL WARNING:*** WARNING[6008] Statistics for column (L_SHIPDATE) from table TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS were not available. As a result, the access path chosen might not be the best possible. [2017-01-09 14:54:07] (State: 01000 Native Err: 6008)
> [0] 100 records extracted
> [0] 200 records extracted
> [0] 300 records extracted
> [0] 400 records extracted
> ...
> [0] 199,000 records extracted
> [0] 199,100 records extracted
> [0] 199,200 records extracted
> [0] 199,300 records extracted
> [0] 199,400 records extracted
> [0] 199,500 records extracted
> [0] 199,600 records extracted
> [0] 199,700 records extracted
> [0] 199,800 records extracted
> [0] 199,900 records extracted
> [0] 200,000 records extracted
> [0] odb version 1.1.0 Extract statistics:
> [0] Source: TRAFODION.ODB_LOAD.LINEITEM_ODB_LOAD_4_PARTITIONS
> [0] Target: output/data_encrypt_lineitem_170109_20w
> [0] Record buffer size: 232 bytes
> [0] Rowset size: 100
> [0] Rowset buffer size: 22.66 KiB
> [0] Pre-extract time: 6.377 s (00:00:06.377)
> [0] Extract time: 9.172 s (00:00:09.172)
> [0] Total records extracted: 200,000 (21.805 krec/s)
> [0] Total data bytes written: 26,225,552 (2,792.291 KiB/s)
> odb [2017-01-09 14:54:16]: exiting. Session Elapsed time 19.658 seconds (00:00:19.658)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)