You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/04/14 00:33:25 UTC
[jira] [Commented] (HAWQ-644) Failure in security ha environment
with certain writable external tables
[ https://issues.apache.org/jira/browse/HAWQ-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240147#comment-15240147 ]
ASF GitHub Bot commented on HAWQ-644:
-------------------------------------
GitHub user kavinderd opened a pull request:
https://github.com/apache/incubator-hawq/pull/604
HAWQ-644. Account for '\0' when dispatching namespace length
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kavinderd/incubator-hawq HAWQ-644
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-hawq/pull/604.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #604
----
commit 6538dce957cd59079db524b2466d0f27d4b5c287
Author: Kavinder Dhaliwal <ka...@gmail.com>
Date: 2016-04-13T22:32:19Z
HAWQ-644. Account for '\0' when dispatching namespace length
----
> Failure in security ha environment with certain writable external tables
> ------------------------------------------------------------------------
>
> Key: HAWQ-644
> URL: https://issues.apache.org/jira/browse/HAWQ-644
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF, Security
> Reporter: Goden Yao
> Assignee: Goden Yao
>
> In a Secure HA environment:
> Few tests which tests writable table fail due to empty dfs_address prior to getting the delegation token in the segment.
> On an initial investigation, the shared_path seems to not be set by the hawq master.
> Log from the specific segment. The hdfs path available in the segment is empty and hence the failure.
> {code}
> 2016-04-08 22:53:11.034661 UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"DEBUG2","00000","PXF received from configuration HA Namenode-1 having rpc-address <ip-10-32-37-27.ore1.vpc.pivotal.io:8020> and rest-address <ip-10-32-37-27.ore1.vpc.pivotal.io:50070>",,,,,"External table readable_table, line 1 of pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: """"","INSERT INTO writable_table SELECT * FROM readable_table;",0,,"ha_config.c",157,
> 2016-04-08 22:53:11.034699 UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"DEBUG2","00000","PXF received from configuration HA Namenode-2 having rpc-address <ip-10-32-39-243.ore1.vpc.pivotal.io:8020> and rest-address <ip-10-32-39-243.ore1.vpc.pivotal.io:50070>",,,,,"External table readable_table, line 1 of pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: """"","INSERT INTO writable_table SELECT * FROM readable_table;",0,,"ha_config.c",157,
> 2016-04-08 22:53:11.034785 UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"DEBUG2","00000","locating token for 0^N\",,,,,"External table readable_table, line 1 of pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: """"","INSERT INTO writable_table SELECT * FROM readable_table;",0,,"gpbridgeapi.c",521,
> 2016-04-08 22:53:11.034871 UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"WARNING","01000","internal error HdfsParsePath: no filesystem protocol found in path ""0^N\^A""",,,,,"External table readable_table, line 1 of pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: """"","INSERT INTO writable_table SELECT * FROM readable_table;",0,,"fd.c",2501,
> 2016-04-08 22:53:11.035004 UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"DEBUG1","00000","Deleted entry for query (sessionid=73, commandcnt=43)",,,,,,"INSERT INTO writable_table SELECT * FROM readable_table;",0,,"workfile_queryspace.c",329,
> 2016-04-08 22:53:11.066243 UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"ERROR","XX000","fail to parse uri: 0^N\ (cdbfilesystemcredential.c:529)",,,,,"External table readable_table, line 1 of pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: """"","INSERT INTO writable_table SELECT * FROM readable_table;",0,,"cdbfilesystemcredential.c",529,"Stack trace:
> 1 0x871f8f postgres <symbol not found> + 0x871f8f
> 2 0x872679 postgres elog_finish + 0xa9
> 3 0x99d7b8 postgres find_filesystem_credential_with_uri + 0x78
> 4 0x7fc935c8f5a2 pxf.so add_delegation_token + 0xa2
> 5 0x7fc935c8f9b2 pxf.so get_pxf_server + 0xe2
> 6 0x7fc935c8ff02 pxf.so gpbridge_export_start + 0x42
> 7 0x7fc935c90170 pxf.so gpbridge_export + 0x50
> 8 0x507eb8 postgres <symbol not found> + 0x507eb8
> 9 0x5083af postgres url_fwrite + 0x9f
> 10 0x5042b4 postgres external_insert + 0x184
> 11 0x69dcca postgres ExecInsert + 0x1fa
> 12 0x69d41c postgres ExecDML + 0x1ec
> 13 0x65e185 postgres ExecProcNode + 0x3c5
> 14 0x659f4a postgres <symbol not found> + 0x659f4a
> 15 0x65a8d3 postgres ExecutorRun + 0x4a3
> 16 0x7b550a postgres <symbol not found> + 0x7b550a
> 17 0x7b5baf postgres <symbol not found> + 0x7b5baf
> 18 0x7b6142 postgres PortalRun + 0x342
> 19 0x7b2c21 postgres PostgresMain + 0x3861
> 20 0x763ce3 postgres <symbol not found> + 0x763ce3
> 21 0x76443d postgres <symbol not found> + 0x76443d
> 22 0x76626e postgres PostmasterMain + 0xc7e
> 23 0x6c04ea postgres main + 0x48a
> 24 0x7fc95f276d5d libc.so.6 __libc_start_main + 0xfd
> 25 0x4a1489 postgres <symbol not found> + 0x4a1489
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)