You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@phoenix.apache.org by Anil <an...@gmail.com> on 2016/03/21 07:05:32 UTC

Extend CSVBulkLoadTool

Hi ,

I see CSVBulkLoadTool accepts delimiter as single character only. So i have
to customize it. do we have documentation of steps that bulk load tool
perform ?  Please share.

Thanks,
Anil

Re: Extend CSVBulkLoadTool

Posted by Sergey Soldatov <se...@gmail.com>.

Anil,
It's not necessary to use comma. You may use any other character as
the delimiter.
And you are right. Number of splits must match the number of columns.

Thanks,
Sergey

On Tue, Mar 22, 2016 at 6:31 AM, Anil <an...@gmail.com> wrote:
> Thanks Sergey for the response. i cannot change the decimeter in my file as
> comma used as valid char for my data.
>
> From my understanding of the code, number of splits in csv record must match
> with number of columns. Agree?
>
> Regards,
> Anil
>
>
>
> On 21 March 2016 at 23:52, Sergey Soldatov <se...@gmail.com> wrote:
>>
>> Hi Anil,
>> It will be really painful since CSV bulk load is using Apache common
>> CSV format tool for parsing input lines and it expects that the
>> delimiter is a single character. I would suggest to prepare files
>> before bulk load replacing the delimiter string with a single
>> character using perl/sed scripts. It will be much easier.
>>
>> Thanks,
>> Sergey
>>
>> On Sun, Mar 20, 2016 at 11:05 PM, Anil <an...@gmail.com> wrote:
>> > Hi ,
>> >
>> > I see CSVBulkLoadTool accepts delimiter as single character only. So i
>> > have
>> > to customize it. do we have documentation of steps that bulk load tool
>> > perform ?  Please share.
>> >
>> > Thanks,
>> > Anil
>> >
>> >
>> >
>> >
>> >
>
>

Re: Extend CSVBulkLoadTool

Posted by Anil <an...@gmail.com>.

Thanks Sergey for the response. i cannot change the decimeter in my file as
comma used as valid char for my data.

>From my understanding of the code, number of splits in csv record must
match with number of columns. Agree?

Regards,
Anil



On 21 March 2016 at 23:52, Sergey Soldatov <se...@gmail.com> wrote:

> Hi Anil,
> It will be really painful since CSV bulk load is using Apache common
> CSV format tool for parsing input lines and it expects that the
> delimiter is a single character. I would suggest to prepare files
> before bulk load replacing the delimiter string with a single
> character using perl/sed scripts. It will be much easier.
>
> Thanks,
> Sergey
>
> On Sun, Mar 20, 2016 at 11:05 PM, Anil <an...@gmail.com> wrote:
> > Hi ,
> >
> > I see CSVBulkLoadTool accepts delimiter as single character only. So i
> have
> > to customize it. do we have documentation of steps that bulk load tool
> > perform ?  Please share.
> >
> > Thanks,
> > Anil
> >
> >
> >
> >
> >
>

Re: Extend CSVBulkLoadTool

Posted by Sergey Soldatov <se...@gmail.com>.

Hi Anil,
It will be really painful since CSV bulk load is using Apache common
CSV format tool for parsing input lines and it expects that the
delimiter is a single character. I would suggest to prepare files
before bulk load replacing the delimiter string with a single
character using perl/sed scripts. It will be much easier.

Thanks,
Sergey

On Sun, Mar 20, 2016 at 11:05 PM, Anil <an...@gmail.com> wrote:
> Hi ,
>
> I see CSVBulkLoadTool accepts delimiter as single character only. So i have
> to customize it. do we have documentation of steps that bulk load tool
> perform ?  Please share.
>
> Thanks,
> Anil
>
>
>
>
>