You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Udit Mehta <um...@groupon.com> on 2015/05/29 03:08:42 UTC

Change hive column size

Hi,

Per this ticket: https://issues.apache.org/jira/browse/HIVE-1364 , the max
column size in hive is limited to 4000 chars. But i do read that there is a
way to increase it via *mysql* which is our database for the metastore. Can
anyone point me as to how I can do this?

Our columns have deeply nested structs and easily cross the *4000* chars
limit.

Thanks,
Udit

Re: Change hive column size

Posted by Udit Mehta <um...@groupon.com>.

Also this might be relevant now:
https://issues.apache.org/jira/browse/HIVE-9815

On Thu, May 28, 2015 at 10:41 PM, Udit Mehta <um...@groupon.com> wrote:

> Hi Steve,
>
> I do see that it applies to hive 0.5. But I am facing a similar issue
> where my column of complex type is not able to hold a nested struct beyond
> a certain size(around 4000). I guessed 4000 still might be the followed
> size. Could it be a restriction imposed on the serde(which I doubt)? I use
> the json serde : https://github.com/rcongiu/Hive-JSON-Serde/tree/master
>
> Thanks,
> Udit
>
> On Thu, May 28, 2015 at 7:19 PM, Steve Howard <st...@gmail.com>
> wrote:
>
>> Hi Udit,
>>
>> That JIRA is five years old and applies to hive 0.5.  Newer releases are
>> far larger...
>>
>> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types
>>
>> Thanks,
>>
>> Steve
>>
>> Sent from my iPad
>>
>> On May 28, 2015, at 9:08 PM, Udit Mehta <um...@groupon.com> wrote:
>>
>> Hi,
>>
>> Per this ticket: https://issues.apache.org/jira/browse/HIVE-1364 , the
>> max column size in hive is limited to 4000 chars. But i do read that there
>> is a way to increase it via *mysql* which is our database for the
>> metastore. Can anyone point me as to how I can do this?
>>
>> Our columns have deeply nested structs and easily cross the *4000* chars
>> limit.
>>
>> Thanks,
>> Udit
>>
>>
>

Re: Change hive column size

Posted by Udit Mehta <um...@groupon.com>.

Hi Steve,

I do see that it applies to hive 0.5. But I am facing a similar issue where
my column of complex type is not able to hold a nested struct beyond a
certain size(around 4000). I guessed 4000 still might be the followed size.
Could it be a restriction imposed on the serde(which I doubt)? I use the
json serde : https://github.com/rcongiu/Hive-JSON-Serde/tree/master

Thanks,
Udit

On Thu, May 28, 2015 at 7:19 PM, Steve Howard <st...@gmail.com>
wrote:

> Hi Udit,
>
> That JIRA is five years old and applies to hive 0.5.  Newer releases are
> far larger...
>
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types
>
> Thanks,
>
> Steve
>
> Sent from my iPad
>
> On May 28, 2015, at 9:08 PM, Udit Mehta <um...@groupon.com> wrote:
>
> Hi,
>
> Per this ticket: https://issues.apache.org/jira/browse/HIVE-1364 , the
> max column size in hive is limited to 4000 chars. But i do read that there
> is a way to increase it via *mysql* which is our database for the
> metastore. Can anyone point me as to how I can do this?
>
> Our columns have deeply nested structs and easily cross the *4000* chars
> limit.
>
> Thanks,
> Udit
>
>

Re: Change hive column size

Posted by Steve Howard <st...@gmail.com>.

Hi Udit,

That JIRA is five years old and applies to hive 0.5.  Newer releases are far larger...

https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types

Thanks,

Steve

Sent from my iPad

> On May 28, 2015, at 9:08 PM, Udit Mehta <um...@groupon.com> wrote:
> 
> Hi,
> 
> Per this ticket: https://issues.apache.org/jira/browse/HIVE-1364 , the max column size in hive is limited to 4000 chars. But i do read that there is a way to increase it via mysql which is our database for the metastore. Can anyone point me as to how I can do this?
> 
> Our columns have deeply nested structs and easily cross the 4000 chars limit.
> 
> Thanks,
> Udit