You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Dilip Joseph <di...@gmail.com> on 2010/04/07 02:16:07 UTC
Truncation error when creating table with column containing struct
with many fields
Hello,
I got the following error when creating a table with a column that has
an ARRAY of STRUCTS with many fields. It appears that there is a 128
character limit on the column definition.
FAILED: Error in metadata: javax.jdo.JDODataStoreException: Add
request failed : INSERT INTO COLUMNS
(SD_ID,COMMENT,"COLUMN_NAME",TYPE_NAME,INTEGER_IDX) VALUES (?,?,?,?,?)
NestedThrowables:
java.sql.BatchUpdateException: A truncation error was encountered
trying to shrink VARCHAR
'array<struct<id:int,fld1:bigint,fld2:int,fld3&' to length 128.
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask
I was able to get table create working after changing 128 to 256 in
/metastore/src/model/package.jdo. Does anyone know if there are any
adverse side-effects of doing so?
Dilip
Re: Truncation error when creating table with column containing
struct with many fields
Posted by Zheng Shao <zs...@gmail.com>.
That change should be fine.
Zheng
On Tue, Apr 6, 2010 at 5:16 PM, Dilip Joseph
<di...@gmail.com> wrote:
> Hello,
>
> I got the following error when creating a table with a column that has
> an ARRAY of STRUCTS with many fields. It appears that there is a 128
> character limit on the column definition.
>
> FAILED: Error in metadata: javax.jdo.JDODataStoreException: Add
> request failed : INSERT INTO COLUMNS
> (SD_ID,COMMENT,"COLUMN_NAME",TYPE_NAME,INTEGER_IDX) VALUES (?,?,?,?,?)
> NestedThrowables:
> java.sql.BatchUpdateException: A truncation error was encountered
> trying to shrink VARCHAR
> 'array<struct<id:int,fld1:bigint,fld2:int,fld3&' to length 128.
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask
>
> I was able to get table create working after changing 128 to 256 in
> /metastore/src/model/package.jdo. Does anyone know if there are any
> adverse side-effects of doing so?
>
> Dilip
>
--
Yours,
Zheng
http://www.linkedin.com/in/zshao