You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Sam William <sa...@stumbleupon.com> on 2012/06/20 01:15:16 UTC
Text file with ctrl chat as delimiter
Hi,
I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ?
For instance .
create table ... blah .blah ...
row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc';
did not work .
Thanks
Sam William
sampd@stumbleupon.com
Re: Text file with ctrl chat as delimiter
Posted by Sam William <sa...@stumbleupon.com>.
Wow .. This works thanks..
Sam
On Jun 20, 2012, at 5:01 PM, Mapred Learn wrote:
> Hi Sam,
> Could you try '\001' instead of '\u0001' ?
>
> Sent from my iPhone
>
> On Jun 20, 2012, at 3:57 PM, Sam William <sa...@stumbleupon.com> wrote:
>
>>
>>
>> Mark,
>> I did not get any errors, but it seemed like the splitting was happening with u,0,1 as delimiters. My temporary fix is to define a table with one field and create a view split function on top . I dont want this additional overheard, if I can make the input format work with the ctrl char as the delimiter.
>>
>> Mapred Learn,
>>
>> Yes I did have the word 'external' in the create table statement.
>>
>>
>> Thanks,
>> Sam
>>
>> On Jun 20, 2012, at 6:24 AM, Mark Grover wrote:
>>
>>> Sam,
>>> If you can please post a row or two of your data along with any errors you are getting, that would be helpful.
>>>
>>> Mark
>>> ----- Original Message -----
>>> From: "Mapred Learn" <ma...@gmail.com>
>>> To: user@hive.apache.org
>>> Cc: user@hive.apache.org
>>> Sent: Tuesday, June 19, 2012 8:34:22 PM
>>> Subject: Re: Text file with ctrl chat as delimiter
>>>
>>>
>>> Did you add the word external in create table I.e.
>>>
>>>
>>> Create external table(...blah...blah...)
>>>
>>> Sent from my iPhone
>>>
>>> On Jun 19, 2012, at 4:15 PM, Sam William < sampd@stumbleupon.com > wrote:
>>>
>>>
>>>
>>>
>>>
>>>
>>> Hi,
>>> I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ?
>>>
>>>
>>> For instance .
>>>
>>>
>>> create table ... blah .blah ...
>>> row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc';
>>>
>>>
>>> did not work .
>>>
>>>
>>> Thanks
>>>
>>>
>>>
>>>
>>> Sam William
>>> sampd@stumbleupon.com
>>>
>>>
>>>
>>
>> Sam William
>> sampd@stumbleupon.com
>>
>>
>>
Sam William
sampd@stumbleupon.com
Re: Text file with ctrl chat as delimiter
Posted by Mapred Learn <ma...@gmail.com>.
Hi Sam,
Could you try '\001' instead of '\u0001' ?
Sent from my iPhone
On Jun 20, 2012, at 3:57 PM, Sam William <sa...@stumbleupon.com> wrote:
>
>
> Mark,
> I did not get any errors, but it seemed like the splitting was happening with u,0,1 as delimiters. My temporary fix is to define a table with one field and create a view split function on top . I dont want this additional overheard, if I can make the input format work with the ctrl char as the delimiter.
>
> Mapred Learn,
>
> Yes I did have the word 'external' in the create table statement.
>
>
> Thanks,
> Sam
>
> On Jun 20, 2012, at 6:24 AM, Mark Grover wrote:
>
>> Sam,
>> If you can please post a row or two of your data along with any errors you are getting, that would be helpful.
>>
>> Mark
>> ----- Original Message -----
>> From: "Mapred Learn" <ma...@gmail.com>
>> To: user@hive.apache.org
>> Cc: user@hive.apache.org
>> Sent: Tuesday, June 19, 2012 8:34:22 PM
>> Subject: Re: Text file with ctrl chat as delimiter
>>
>>
>> Did you add the word external in create table I.e.
>>
>>
>> Create external table(...blah...blah...)
>>
>> Sent from my iPhone
>>
>> On Jun 19, 2012, at 4:15 PM, Sam William < sampd@stumbleupon.com > wrote:
>>
>>
>>
>>
>>
>>
>> Hi,
>> I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ?
>>
>>
>> For instance .
>>
>>
>> create table ... blah .blah ...
>> row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc';
>>
>>
>> did not work .
>>
>>
>> Thanks
>>
>>
>>
>>
>> Sam William
>> sampd@stumbleupon.com
>>
>>
>>
>
> Sam William
> sampd@stumbleupon.com
>
>
>
Re: Text file with ctrl chat as delimiter
Posted by Sam William <sa...@stumbleupon.com>.
Mark,
I did not get any errors, but it seemed like the splitting was happening with u,0,1 as delimiters. My temporary fix is to define a table with one field and create a view split function on top . I dont want this additional overheard, if I can make the input format work with the ctrl char as the delimiter.
Mapred Learn,
Yes I did have the word 'external' in the create table statement.
Thanks,
Sam
On Jun 20, 2012, at 6:24 AM, Mark Grover wrote:
> Sam,
> If you can please post a row or two of your data along with any errors you are getting, that would be helpful.
>
> Mark
> ----- Original Message -----
> From: "Mapred Learn" <ma...@gmail.com>
> To: user@hive.apache.org
> Cc: user@hive.apache.org
> Sent: Tuesday, June 19, 2012 8:34:22 PM
> Subject: Re: Text file with ctrl chat as delimiter
>
>
> Did you add the word external in create table I.e.
>
>
> Create external table(...blah...blah...)
>
> Sent from my iPhone
>
> On Jun 19, 2012, at 4:15 PM, Sam William < sampd@stumbleupon.com > wrote:
>
>
>
>
>
>
> Hi,
> I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ?
>
>
> For instance .
>
>
> create table ... blah .blah ...
> row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc';
>
>
> did not work .
>
>
> Thanks
>
>
>
>
> Sam William
> sampd@stumbleupon.com
>
>
>
Sam William
sampd@stumbleupon.com
Re: Text file with ctrl chat as delimiter
Posted by Mark Grover <mg...@oanda.com>.
Sam,
If you can please post a row or two of your data along with any errors you are getting, that would be helpful.
Mark
----- Original Message -----
From: "Mapred Learn" <ma...@gmail.com>
To: user@hive.apache.org
Cc: user@hive.apache.org
Sent: Tuesday, June 19, 2012 8:34:22 PM
Subject: Re: Text file with ctrl chat as delimiter
Did you add the word external in create table I.e.
Create external table(...blah...blah...)
Sent from my iPhone
On Jun 19, 2012, at 4:15 PM, Sam William < sampd@stumbleupon.com > wrote:
Hi,
I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ?
For instance .
create table ... blah .blah ...
row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc';
did not work .
Thanks
Sam William
sampd@stumbleupon.com
Re: Text file with ctrl chat as delimiter
Posted by Mapred Learn <ma...@gmail.com>.
Did you add the word external in create table I.e.
Create external table(...blah...blah...)
Sent from my iPhone
On Jun 19, 2012, at 4:15 PM, Sam William <sa...@stumbleupon.com> wrote:
> Hi,
> I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ?
>
> For instance .
>
> create table ... blah .blah ...
> row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc';
>
> did not work .
>
> Thanks
>
>
> Sam William
> sampd@stumbleupon.com
>
>
>