You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Grant Krieger (JIRA)" <ji...@apache.org> on 2017/11/10 13:02:00 UTC

[jira] [Updated] (HAWQ-1547) Increase default table name length from 64 to 128 to match Hive

     [ https://issues.apache.org/jira/browse/HAWQ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Grant Krieger updated HAWQ-1547:
--------------------------------
    Description: 
Hi,

Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h property default NAMEDATALEN from 64 to 128. 

This hopefully will allow one to be able to read Hive tables from Hawq larger than 64 by default without having to change this setting when compiling for downstream systems. It will also allow for equivalently name Hawq tables.

Does anyone foresee performance challenges with the increase? 

See problem below:

In hive

CREATE TABLE default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test ( 
	rtlymth	int, 
	rtly   	int)

STORED AS ORC

in Hawq

select * from hcatalog.default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test

 ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception report   message   NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345 table not found)    description   The server encountered an internal error that prevented it from fulfilling this request.    exception   javax.servlet.ServletException: NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345 table not found) (libchurl.c:897)
  Position: 15
 Line: 1 

Thanks

Grant

  was:
Hi,

Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h property default NAMEDATALEN from 64 to 128. 

This hopefully will allow one to be able to read Hive tables from Hawq larger than 64 by default without having to change this setting when compiling for downstream systems. It will also allow for equivalently name Hawq tables.

Does anyone foresee performance challenges with the increase? 

See problem below:

In hive

CREATE TABLE default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test ( 
	rtlymth	int, 
	rtly   	int)

STORED AS ORC

in Hawq

select * from default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test

ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception report   message   NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345 table not found)    description   The server encountered an internal error that prevented it from fulfilling this request.    exception   javax.servlet.ServletException: NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345 table not found) (libchurl.c:897)
  Position: 15

Thanks

Grant


> Increase default table name length from 64 to 128 to match Hive
> ---------------------------------------------------------------
>
>                 Key: HAWQ-1547
>                 URL: https://issues.apache.org/jira/browse/HAWQ-1547
>             Project: Apache HAWQ
>          Issue Type: Improvement
>          Components: Unknown
>            Reporter: Grant Krieger
>            Assignee: Radar Lei
>
> Hi,
> Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h property default NAMEDATALEN from 64 to 128. 
> This hopefully will allow one to be able to read Hive tables from Hawq larger than 64 by default without having to change this setting when compiling for downstream systems. It will also allow for equivalently name Hawq tables.
> Does anyone foresee performance challenges with the increase? 
> See problem below:
> In hive
> CREATE TABLE default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test ( 
> 	rtlymth	int, 
> 	rtly   	int)
> STORED AS ORC
> in Hawq
> select * from hcatalog.default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
>  ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception report   message   NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345 table not found)    description   The server encountered an internal error that prevented it from fulfilling this request.    exception   javax.servlet.ServletException: NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345 table not found) (libchurl.c:897)
>   Position: 15
>  Line: 1 
> Thanks
> Grant



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)