You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Chiyang Wan (JIRA)" <ji...@apache.org> on 2018/01/04 01:26:00 UTC

[jira] [Comment Edited] (HAWQ-1578) Regression Test (Feature->Ranger)Failed because pxfwritable_import_beginscan function was not found

    [ https://issues.apache.org/jira/browse/HAWQ-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310560#comment-16310560 ] 

Chiyang Wan edited comment on HAWQ-1578 at 1/4/18 1:25 AM:
-----------------------------------------------------------

Due to some unknown issue(ERROR:  remote component error (0): (libchurl.c:897)), I could not set up the test environment to verify my fix. I have attached the patch. Please help to apply the patch into your test environment to verify it. Thanks! 



was (Author: chiyang10000):
Due to some unknown issue(ERROR:  remote component error (0): (libchurl.c:897)), I could not set up the test environment to verify my fix. Please help to apply the patch into your test environment to verify it. Thanks! I attach the patch content below.


diff --git a/src/backend/access/external/plugstorage.c b/src/backend/access/external/plugstorage.c
index 21dd51e6..ad7d2605 100644
--- a/src/backend/access/external/plugstorage.c
+++ b/src/backend/access/external/plugstorage.c
@@ -58,6 +58,11 @@ void getExternalTableTypeInList(const char formatType,
                *formatterName = NULL;
        }
        else if (fmttype_is_custom(formatType))
+       {
+               *formatterType = ExternalTableType_CUSTOM;
+               *formatterName = NULL;
+       }
+       else if (fmttype_is_custom(formatType))
        {
                Assert(formatOptions);

@@ -89,6 +94,11 @@ void getExternalTableTypeInStr(const char formatType,
                *formatterName = NULL;
        }
        else if (fmttype_is_custom(formatType))
+       {
+               *formatterType = ExternalTableType_CUSTOM;
+               *formatterName = NULL;
+       }
+       else if (fmttype_is_custom(formatType))
        {
                Assert(formatOptions);

diff --git a/src/include/access/plugstorage_utils.h b/src/include/access/plugstorage_utils.h
index 6e1bf6b2..e0a397dd 100644
--- a/src/include/access/plugstorage_utils.h
+++ b/src/include/access/plugstorage_utils.h
@@ -85,6 +85,7 @@ typedef enum
        ExternalTableType_GENERIC,     /* GENERIC external table format and protocol */
        ExternalTableType_TEXT,        /* TEXT format with gpfdist(s), http, command protocol */
        ExternalTableType_CSV,         /* CSV format with gpfdist(s), http, command protocol */
+       ExternalTableType_CUSTOM,      /* Temporary workaround to support the old framework */
        ExternalTableType_PLUG,        /* Pluggable format with hdfs protocol, i.e., ORC */
        ExternalTableType_Invalid
 } ExternalTableType;



> Regression Test (Feature->Ranger)Failed because pxfwritable_import_beginscan function was not found 
> ----------------------------------------------------------------------------------------------------
>
>                 Key: HAWQ-1578
>                 URL: https://issues.apache.org/jira/browse/HAWQ-1578
>             Project: Apache HAWQ
>          Issue Type: Bug
>          Components: PXF, Tests
>            Reporter: WANG Weinan
>            Assignee: Chiyang Wan
>         Attachments: HAWQ-1578.patch
>
>
> The TestHawqRanger failed when do test PXFHiveTest and PXFHBaseTest, the test log is shown as follow:
> Note: Google Test filter = TestHawqRanger.PXFHiveTest
> [==========] Running 1 test from 1 test case.
> [----------] Global test environment set-up.
> [----------] 1 test from TestHawqRanger
> [ RUN      ] TestHawqRanger.PXFHiveTest
> lib/sql_util.cpp:197: Failure
> Value of: is_sql_ans_diff
>   Actual: true
> Expected: false
> lib/sql_util.cpp:203: Failure
> Value of: true
>   Actual: true
> Expected: false
> [  FAILED  ] TestHawqRanger.PXFHiveTest (89777 ms)
> [----------] 1 test from TestHawqRanger (89777 ms total)
> [----------] Global test environment tear-down
> [==========] 1 test from 1 test case ran. (89777 ms total)
> [  PASSED  ] 0 tests.
> [  FAILED  ] 1 test, listed below:
> [  FAILED  ] TestHawqRanger.PXFHiveTest
>  1 FAILED TEST
> [125/133] TestHawqRanger.PXFHiveTest returned/aborted with exit code 1 (89787 ms)
> [128/133] TestHawqRanger.PXFHBaseTest (87121 ms)                                
> Note: Google Test filter = TestHawqRanger.PXFHBaseTest
> [==========] Running 1 test from 1 test case.
> [----------] Global test environment set-up.
> [----------] 1 test from TestHawqRanger
> [ RUN      ] TestHawqRanger.PXFHBaseTest
> lib/sql_util.cpp:197: Failure
> Value of: is_sql_ans_diff
>   Actual: true
> Expected: false
> lib/sql_util.cpp:203: Failure
> Value of: true
>   Actual: true
> Expected: false
> [  FAILED  ] TestHawqRanger.PXFHBaseTest (87098 ms)
> [----------] 1 test from TestHawqRanger (87098 ms total)
> [----------] Global test environment tear-down
> [==========] 1 test from 1 test case ran. (87099 ms total)
> [  PASSED  ] 0 tests.
> [  FAILED  ] 1 test, listed below:
> [  FAILED  ] TestHawqRanger.PXFHBaseTest
> We can find some suspicious log in master segment log file :
> 2018-01-03 05:21:30.170970 UTC,"gpadmin","hawq_feature_test_db",p109703,th-290256608,"127.0.0.1","56288",2018-01-03 05:21:29 UTC,14669,con2342,cmd4,seg-1,,,x14669,sx1,"ERROR","XX000","pxfwritable_import_beginscan function was not found (nodeExternalscan.c:310)",,,,,,"select * from test_hbase;",0,,"nodeExternalscan.c",310,"Stack trace:
> 1    0x8cf31e postgres errstart (elog.c:505)
> 2    0x8d11bb postgres elog_finish (elog.c:1459)
> 3    0x69134a postgres ExecInitExternalScan (nodeExternalscan.c:215)
> 4    0x670b9d postgres ExecInitNode (execProcnode.c:371)
> 5    0x69b7d1 postgres ExecInitMotion (nodeMotion.c:1096)
> 6    0x670064 postgres ExecInitNode (execProcnode.c:629)
> 7    0x66a407 postgres ExecutorStart (execMain.c:2048)
> 8    0x7f8fcd postgres PortalStart (pquery.c:1308)
> 9    0x7f0628 postgres <symbol not found> (postgres.c:1795)
> 10   0x7f1cb0 postgres PostgresMain (postgres.c:4897)
> 11   0x7a40c0 postgres <symbol not found> (postmaster.c:5486)
> 12   0x7a6e89 postgres PostmasterMain (postmaster.c:1459)
> 13   0x4a5a59 postgres main (main.c:226)
> 14   0x7fceea8a1d1d libc.so.6 __libc_start_main (??:0)
> 15   0x4a5ad9 postgres <symbol not found> (??:0)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)