You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Ajana Chandiruthil Sathian <aj...@gmail.com> on 2017/10/20 18:48:23 UTC
Can't parse input data
To whomever it may concern,
I could not fix this isseError: java.lang.RuntimeException: Can't parse
input data: ' like Gecko) Chrome/54.0.2840.71 Safari/537.36'
Below is the sqoop command.
sqoop-import --connect xxx \
--username xxx \
--password xxx \
--target-dir xxx \
--query "SELECT * FROM (SELECT cd.* , to_char(cd.META_MAINT_DT,
'yyyy-mm-dd') as filedate FROM ODS.table1 cd ') t1 WHERE \$CONDITIONS" \
--incremental lastmodified \
--check-column META_MAINT_DT \
--merge-key CNSMR_DEVICE_UID \
--split-by CNSMR_DEVICE_UID \
--fields-terminated-by '\001' \
-m 64
Any kind of help is really appreciated!
Re: Can't parse input data
Posted by Szabolcs Vasas <va...@cloudera.com>.
It seems that the root cause of the issue is the following exception:
Error: java.lang.RuntimeException: Can't parse input data:
$899110000000000000000001285548882479$878611400000000000000001303828637247�'
...
Caused by: java.lang.IllegalArgumentException: Timestamp format must be
yyyy-mm- dd
hh:mm:ss[.fffffffff]
So I think there is an invalid value in one of the timestamp columns
somehow, please check the result set of your query.
Szabolcs
On Mon, Oct 23, 2017 at 8:49 AM, Ajana Chandiruthil Sathian <
ajanacs@gmail.com> wrote:
> Hi Szabolcs,
>
> I don' t think this is the issue with the data quality. For the initial
> load it did not show any issue. Only when I tried to do merge with the
> incremental with last modified option. Please see the attached document for
> sqoop log.
>
> On Sun, Oct 22, 2017 at 7:39 AM, Szabolcs Vasas <va...@cloudera.com>
> wrote:
>
>> Hi Ajana,
>>
>> Can you please copy and paste the full Sqoop logs and the table
>> definition?
>> *'like Gecko) Chrome/54.0.2840.71 Safari/537.36' *seems to be a value in
>> the database, is it possible that there is a data quality issue and one
>> of the columns (e.g. META_MAINT_DT, CNSMR_DEVICE_UID) contains it?
>>
>> Thanks,
>> Szabolcs
>>
>> On Fri, Oct 20, 2017 at 11:48 AM, Ajana Chandiruthil Sathian <
>> ajanacs@gmail.com> wrote:
>>
>>> To whomever it may concern,
>>>
>>> I could not fix this isseError: java.lang.RuntimeException: Can't parse
>>> input data: ' like Gecko) Chrome/54.0.2840.71 Safari/537.36'
>>>
>>> Below is the sqoop command.
>>>
>>> sqoop-import --connect xxx \
>>>
>>> --username xxx \
>>>
>>> --password xxx \
>>>
>>> --target-dir xxx \
>>>
>>> --query "SELECT * FROM (SELECT cd.* , to_char(cd.META_MAINT_DT,
>>> 'yyyy-mm-dd') as filedate FROM ODS.table1 cd ') t1 WHERE \$CONDITIONS" \
>>>
>>> --incremental lastmodified \
>>>
>>> --check-column META_MAINT_DT \
>>>
>>> --merge-key CNSMR_DEVICE_UID \
>>>
>>> --split-by CNSMR_DEVICE_UID \
>>>
>>> --fields-terminated-by '\001' \
>>>
>>> -m 64
>>>
>>> Any kind of help is really appreciated!
>>>
>>
>>
>>
>> --
>> Szabolcs Vasas
>> Software Engineer
>> <http://www.cloudera.com>
>>
>
>
--
Szabolcs Vasas
Software Engineer
<http://www.cloudera.com>
Re: Can't parse input data
Posted by Ajana Chandiruthil Sathian <aj...@gmail.com>.
Hi Szabolcs,
I don' t think this is the issue with the data quality. For the initial
load it did not show any issue. Only when I tried to do merge with the
incremental with last modified option. Please see the attached document for
sqoop log.
On Sun, Oct 22, 2017 at 7:39 AM, Szabolcs Vasas <va...@cloudera.com> wrote:
> Hi Ajana,
>
> Can you please copy and paste the full Sqoop logs and the table definition?
> *'like Gecko) Chrome/54.0.2840.71 Safari/537.36' *seems to be a value in
> the database, is it possible that there is a data quality issue and one
> of the columns (e.g. META_MAINT_DT, CNSMR_DEVICE_UID) contains it?
>
> Thanks,
> Szabolcs
>
> On Fri, Oct 20, 2017 at 11:48 AM, Ajana Chandiruthil Sathian <
> ajanacs@gmail.com> wrote:
>
>> To whomever it may concern,
>>
>> I could not fix this isseError: java.lang.RuntimeException: Can't parse
>> input data: ' like Gecko) Chrome/54.0.2840.71 Safari/537.36'
>>
>> Below is the sqoop command.
>>
>> sqoop-import --connect xxx \
>>
>> --username xxx \
>>
>> --password xxx \
>>
>> --target-dir xxx \
>>
>> --query "SELECT * FROM (SELECT cd.* , to_char(cd.META_MAINT_DT,
>> 'yyyy-mm-dd') as filedate FROM ODS.table1 cd ') t1 WHERE \$CONDITIONS" \
>>
>> --incremental lastmodified \
>>
>> --check-column META_MAINT_DT \
>>
>> --merge-key CNSMR_DEVICE_UID \
>>
>> --split-by CNSMR_DEVICE_UID \
>>
>> --fields-terminated-by '\001' \
>>
>> -m 64
>>
>> Any kind of help is really appreciated!
>>
>
>
>
> --
> Szabolcs Vasas
> Software Engineer
> <http://www.cloudera.com>
>
Re: Can't parse input data
Posted by Szabolcs Vasas <va...@cloudera.com>.
Hi Ajana,
Can you please copy and paste the full Sqoop logs and the table definition?
*'like Gecko) Chrome/54.0.2840.71 Safari/537.36' *seems to be a value in
the database, is it possible that there is a data quality issue and one of
the columns (e.g. META_MAINT_DT, CNSMR_DEVICE_UID) contains it?
Thanks,
Szabolcs
On Fri, Oct 20, 2017 at 11:48 AM, Ajana Chandiruthil Sathian <
ajanacs@gmail.com> wrote:
> To whomever it may concern,
>
> I could not fix this isseError: java.lang.RuntimeException: Can't parse
> input data: ' like Gecko) Chrome/54.0.2840.71 Safari/537.36'
>
> Below is the sqoop command.
>
> sqoop-import --connect xxx \
>
> --username xxx \
>
> --password xxx \
>
> --target-dir xxx \
>
> --query "SELECT * FROM (SELECT cd.* , to_char(cd.META_MAINT_DT,
> 'yyyy-mm-dd') as filedate FROM ODS.table1 cd ') t1 WHERE \$CONDITIONS" \
>
> --incremental lastmodified \
>
> --check-column META_MAINT_DT \
>
> --merge-key CNSMR_DEVICE_UID \
>
> --split-by CNSMR_DEVICE_UID \
>
> --fields-terminated-by '\001' \
>
> -m 64
>
> Any kind of help is really appreciated!
>
--
Szabolcs Vasas
Software Engineer
<http://www.cloudera.com>