You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by su...@bt.com on 2015/08/28 08:09:45 UTC

Sqoop Merge failed

Hello Everyone,

I am trying to push incremental updates from Oracle to hdfs using sqoop import command with Merge-key option and incremental mode as "lastmodified".
I have pasted below, my sqoop command and a part of repetitive exception from my logs.

--target-dir /user/$USER/PRF_USER_IDENTITY is the same location where I have data to be merged with the latest incremental data.
Can't parse input data: 'BTCOM_MIGR_C'. This value exists in a column with VARCHAR2(20) NOT NULL

I have framed the below command based on below link
https://mail-archives.apache.org/mod_mbox/sqoop-user/201505.mbox/%3CCAMZRiGzDe9sN8+Tb_MWtLcmb8+Q=agtURNa4Xkq7skYKzu+odQ@mail.gmail.com%3E



sqoop job --create prf_user_identity_delta -- import --connect jdbc:oracle:thin:@//xxx.xx.xx.xx:xxxx/xxxxxx --username profileuserr6_0 --password-file /user/$USER/XXX/sqoop.password --table PRF_USER_IDENTITY --incremental lastmodified --check-column LAST_UPDATED_DTIME --last-value "2015-08-21 14:42:42" --merge-key PRF_USER_IDENTITY_ID --null-string '\\N' --null-non-string '\\N' --fields-terminated-by , --input-null-string '\\N' --input-null-non-string '\\N' --input-fields-terminated-by , --target-dir /user/$USER/PRF_USER_IDENTITY -m 1


15/08/27 12:46:40 INFO mapreduce.Job: Task Id : attempt_1436876041180_239087_m_000078_2, Status : FAILED
Error: java.lang.RuntimeException: Can't parse input data: 'BTCOM_MIGR_C'
        at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1164)
        at PRF_USER_IDENTITY.parse(PRF_USER_IDENTITY.java:1002)
        at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
        at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:202)
        at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1081)
        ... 11 more


Please help me...I am struggling with this error from past couple of days.


Thanks
Suman


Re:RE: Sqoop Merge failed

Posted by 行云流水 <xi...@163.com>.

 I am using sqoop-1.4.4 and import by mysql,Why I get the error:unrecognized parameter: merge-key ? 


At 2015-09-04 17:13:52, sumanchaitanya.dasari@bt.com wrote:


Thank you Abe,

 

Yes my data has a terminal character ie., the same character that I have used as sqoop delimiter.

 

 

Regards

Suman

 

From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: 04 September 2015 00:47
To:user@sqoop.apache.org
Subject: Re: Sqoop Merge failed

 

Hello,

 

It seems like there's a parsing error of some kind. Maybe there's a terminal character in your data somewhere. Could you re-run your job with --verbose and look at the task logs? There should be logs of the data being transferred. We can inspect what's going wrong in the records themselves.

 

-Abe

 

On Sun, Aug 30, 2015 at 11:23 PM <su...@bt.com> wrote:

Hi Abe,

 

PFB create statement of that table in Oracle

 

createtableXXX_XXX_XXXXXXXX
(
  XXX_XXXX_IDENTITY_ID      NUMBERnotnull,
  .....


  PRF_DOMAIN_ID             NUMBERnotnull
)

 

 

Thanks and Regards

Suman Chaitanya Dasari

 

From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: 29 August 2015 03:40
To:user@sqoop.apache.org
Subject: Re: Sqoop Merge failed

 

Hey there,

 

Could you do a "DESCRIBE PRF_USER_IDENTITY" and paste the output here? Sqoop seems to think you're importing a timestamp.

 

Also, --verbose should help you identify problems in general.

 

-Abe

 

On Thu, Aug 27, 2015 at 11:10 PM <su...@bt.com> wrote:

Hello Everyone,

 

I am trying to push incremental updates from Oracle to hdfs using sqoop import command with Merge-key option and incremental mode as "lastmodified".

I have pasted below, my sqoop command and a part of repetitive exception from my logs.

 

--target-dir /user/$USER/PRF_USER_IDENTITY is the same location where I have data to be merged with the latest incremental data.

Can't parse input data: 'BTCOM_MIGR_C'. This value exists in a column with VARCHAR2(20) NOT NULL

 

I have framed the below command based on below link

https://mail-archives.apache.org/mod_mbox/sqoop-user/201505.mbox/%3CCAMZRiGzDe9sN8+Tb_MWtLcmb8+Q=agtURNa4Xkq7skYKzu+odQ@mail.gmail.com%3E

 

 

 

sqoop job --create prf_user_identity_delta -- import --connect jdbc:oracle:thin:@//xxx.xx.xx.xx:xxxx/xxxxxx --username profileuserr6_0 --password-file /user/$USER/XXX/sqoop.password --table PRF_USER_IDENTITY --incremental lastmodified --check-column LAST_UPDATED_DTIME --last-value "2015-08-21 14:42:42" --merge-key PRF_USER_IDENTITY_ID --null-string '\\N' --null-non-string '\\N' --fields-terminated-by , --input-null-string '\\N' --input-null-non-string '\\N' --input-fields-terminated-by , --target-dir /user/$USER/PRF_USER_IDENTITY -m 1

 

 

15/08/27 12:46:40 INFO mapreduce.Job: Task Id : attempt_1436876041180_239087_m_000078_2, Status : FAILED

Error: java.lang.RuntimeException: Can't parse input data: 'BTCOM_MIGR_C'

        at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1164)

        at PRF_USER_IDENTITY.parse(PRF_USER_IDENTITY.java:1002)

        at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)

        at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)

        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)

        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

        at java.sql.Timestamp.valueOf(Timestamp.java:202)

        at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1081)

        ... 11 more

 

 

Please help me…I am struggling with this error from past couple of days.

 

 

Thanks

Suman

 

RE: Sqoop Merge failed

Posted by su...@bt.com.
Thank you Abe,

Yes my data has a terminal character ie., the same character that I have used as sqoop delimiter.


Regards
Suman

From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: 04 September 2015 00:47
To: user@sqoop.apache.org
Subject: Re: Sqoop Merge failed

Hello,

It seems like there's a parsing error of some kind. Maybe there's a terminal character in your data somewhere. Could you re-run your job with --verbose and look at the task logs? There should be logs of the data being transferred. We can inspect what's going wrong in the records themselves.

-Abe

On Sun, Aug 30, 2015 at 11:23 PM <su...@bt.com>> wrote:
Hi Abe,

PFB create statement of that table in Oracle

create table XXX_XXX_XXXXXXXX
(
  XXX_XXXX_IDENTITY_ID      NUMBER not null,
  .....

  PRF_DOMAIN_ID             NUMBER not null
)


Thanks and Regards
Suman Chaitanya Dasari

From: Abraham Elmahrek [mailto:abe@cloudera.com<ma...@cloudera.com>]
Sent: 29 August 2015 03:40
To: user@sqoop.apache.org<ma...@sqoop.apache.org>
Subject: Re: Sqoop Merge failed

Hey there,

Could you do a "DESCRIBE PRF_USER_IDENTITY" and paste the output here? Sqoop seems to think you're importing a timestamp.

Also, --verbose should help you identify problems in general.

-Abe

On Thu, Aug 27, 2015 at 11:10 PM <su...@bt.com>> wrote:
Hello Everyone,

I am trying to push incremental updates from Oracle to hdfs using sqoop import command with Merge-key option and incremental mode as "lastmodified".
I have pasted below, my sqoop command and a part of repetitive exception from my logs.

--target-dir /user/$USER/PRF_USER_IDENTITY is the same location where I have data to be merged with the latest incremental data.
Can't parse input data: 'BTCOM_MIGR_C'. This value exists in a column with VARCHAR2(20) NOT NULL

I have framed the below command based on below link
https://mail-archives.apache.org/mod_mbox/sqoop-user/201505.mbox/%3CCAMZRiGzDe9sN8+Tb_MWtLcmb8+Q=agtURNa4Xkq7skYKzu+odQ@mail.gmail.com%3E



sqoop job --create prf_user_identity_delta -- import --connect jdbc:oracle:thin:@//xxx.xx.xx.xx:xxxx/xxxxxx --username profileuserr6_0 --password-file /user/$USER/XXX/sqoop.password --table PRF_USER_IDENTITY --incremental lastmodified --check-column LAST_UPDATED_DTIME --last-value "2015-08-21 14:42:42" --merge-key PRF_USER_IDENTITY_ID --null-string '\\N' --null-non-string '\\N' --fields-terminated-by , --input-null-string '\\N' --input-null-non-string '\\N' --input-fields-terminated-by , --target-dir /user/$USER/PRF_USER_IDENTITY -m 1


15/08/27 12:46:40 INFO mapreduce.Job: Task Id : attempt_1436876041180_239087_m_000078_2, Status : FAILED
Error: java.lang.RuntimeException: Can't parse input data: 'BTCOM_MIGR_C'
        at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1164)
        at PRF_USER_IDENTITY.parse(PRF_USER_IDENTITY.java:1002)
        at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
        at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:202)
        at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1081)
        ... 11 more


Please help me…I am struggling with this error from past couple of days.


Thanks
Suman


Re: Sqoop Merge failed

Posted by Abraham Elmahrek <ab...@cloudera.com>.
Hello,

It seems like there's a parsing error of some kind. Maybe there's a
terminal character in your data somewhere. Could you re-run your job with
--verbose and look at the task logs? There should be logs of the data being
transferred. We can inspect what's going wrong in the records themselves.

-Abe

On Sun, Aug 30, 2015 at 11:23 PM <su...@bt.com> wrote:

> Hi Abe,
>
>
>
> PFB create statement of that table in Oracle
>
>
>
> *create* *table* PRF_USER_IDENTITY
> (
>   PRF_USER_IDENTITY_ID      *NUMBER* *not* *null*,
>   PRF_USER_ID               *NUMBER* *not* *null*,
>   PRF_DOMAIN_ID             *NUMBER* *not* *null*,
>   PRF_IDENTIFIER_VALUE      *VARCHAR2*(255) *not* *null*,
>   ACTIVE_IND                *CHAR*(1) *not* *null*,
>   CREATED_BY                *VARCHAR2*(20) *not* *null*,
>   CREATED_DTIME             *DATE* *not* *null*,
>   LAST_UPDATED_BY           *VARCHAR2*(20) *not* *null*,
>   LAST_UPDATED_DTIME        *DATE* *not* *null*,
>   PRF_LAST_LOGIN_DTIME      *DATE*,
>   PRF_IDENTITY_STATUS_ID    *NUMBER* *default* 5,
>   PRF_NUM_OF_FAILED_LOGINS  *NUMBER*,
>   PRF_IDENTITY_ALIAS        *VARCHAR2*(255),
>   SM_DISABLED_FLAG          *VARCHAR2*(15),
>   SM_PASSWORD_DATA          *VARCHAR2*(4000),
>   SMUCG                     *VARCHAR2*(255),
>   PRF_ALTERNATE_DOMAIN_CD   *VARCHAR2*(40),
>   SM_PIN_DATA               *VARCHAR2*(4000),
>   SM_PIN_DISABLED_FLAG      *VARCHAR2*(15),
>   AUTH_FAILURE_REASON       *VARCHAR2*(255),
>   PRF_NO_OF_LOGINS          *NUMBER*,
>   PRF_NO_PREV_FAILED_LOGINS *NUMBER*,
>   PRF_PREV_LAST_LOGIN_DATE  *DATE*
> )
>
>
>
>
>
> Thanks and Regards
>
> Suman Chaitanya Dasari
>
>
>
> *From:* Abraham Elmahrek [mailto:abe@cloudera.com]
> *Sent:* 29 August 2015 03:40
> *To:* user@sqoop.apache.org
> *Subject:* Re: Sqoop Merge failed
>
>
>
> Hey there,
>
>
>
> Could you do a "DESCRIBE PRF_USER_IDENTITY" and paste the output here?
> Sqoop seems to think you're importing a timestamp.
>
>
>
> Also, --verbose should help you identify problems in general.
>
>
>
> -Abe
>
>
>
> On Thu, Aug 27, 2015 at 11:10 PM <su...@bt.com> wrote:
>
> *Hello Everyone,*
>
>
>
> *I am trying to push incremental updates from Oracle to hdfs using sqoop
> import command with Merge-key option and incremental mode as
> "lastmodified".*
>
> *I have pasted below, my sqoop command and a part of repetitive exception
> from my logs.*
>
>
>
> *--target-dir /user/$USER/PRF_USER_IDENTITY is the same location where I
> have data to be merged with the latest incremental data.*
>
> *Can't parse input data: 'BTCOM_MIGR_C'. This value exists in a column
> with VARCHAR2(20) NOT NULL*
>
>
>
> *I have framed the below command based on below link*
>
>
> https://mail-archives.apache.org/mod_mbox/sqoop-user/201505.mbox/%3CCAMZRiGzDe9sN8+Tb_MWtLcmb8+Q=agtURNa4Xkq7skYKzu+odQ@mail.gmail.com%3E
>
>
>
>
>
>
>
> sqoop job --create prf_user_identity_delta -- import --connect
> jdbc:oracle:thin:@//xxx.xx.xx.xx:xxxx/xxxxxx --username profileuserr6_0
> --password-file /user/$USER/XXX/sqoop.password --table PRF_USER_IDENTITY
> --incremental lastmodified --check-column LAST_UPDATED_DTIME --last-value
> "2015-08-21 14:42:42" --merge-key PRF_USER_IDENTITY_ID --null-string '\\N'
> --null-non-string '\\N' --fields-terminated-by , --input-null-string '\\N'
> --input-null-non-string '\\N' --input-fields-terminated-by , *--target-dir
> /user/$USER/PRF_USER_IDENTITY* -m 1
>
>
>
>
>
> 15/08/27 12:46:40 INFO mapreduce.Job: Task Id :
> attempt_1436876041180_239087_m_000078_2, Status : FAILED
>
> Error: java.lang.RuntimeException: *Can't parse input data:
> 'BTCOM_MIGR_C'*
>
>         at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1164)
>
>         at PRF_USER_IDENTITY.parse(PRF_USER_IDENTITY.java:1002)
>
>         at
> org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
>
>         at
> org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
>
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
>
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>
>         at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
>
>         at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
>
> Caused by: java.lang.IllegalArgumentException: Timestamp format must be
> yyyy-mm-dd hh:mm:ss[.fffffffff]
>
>         at java.sql.Timestamp.valueOf(Timestamp.java:202)
>
>         at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1081)
>
>         ... 11 more
>
>
>
>
>
> *Please help me…I am struggling with this error from past couple of days.*
>
>
>
>
>
> *Thanks*
>
> *Suman*
>
>
>
>

RE: Sqoop Merge failed

Posted by su...@bt.com.
Hi Abe,

PFB create statement of that table in Oracle

create table PRF_USER_IDENTITY
(
  PRF_USER_IDENTITY_ID      NUMBER not null,
  PRF_USER_ID               NUMBER not null,
  PRF_DOMAIN_ID             NUMBER not null,
  PRF_IDENTIFIER_VALUE      VARCHAR2(255) not null,
  ACTIVE_IND                CHAR(1) not null,
  CREATED_BY                VARCHAR2(20) not null,
  CREATED_DTIME             DATE not null,
  LAST_UPDATED_BY           VARCHAR2(20) not null,
  LAST_UPDATED_DTIME        DATE not null,
  PRF_LAST_LOGIN_DTIME      DATE,
  PRF_IDENTITY_STATUS_ID    NUMBER default 5,
  PRF_NUM_OF_FAILED_LOGINS  NUMBER,
  PRF_IDENTITY_ALIAS        VARCHAR2(255),
  SM_DISABLED_FLAG          VARCHAR2(15),
  SM_PASSWORD_DATA          VARCHAR2(4000),
  SMUCG                     VARCHAR2(255),
  PRF_ALTERNATE_DOMAIN_CD   VARCHAR2(40),
  SM_PIN_DATA               VARCHAR2(4000),
  SM_PIN_DISABLED_FLAG      VARCHAR2(15),
  AUTH_FAILURE_REASON       VARCHAR2(255),
  PRF_NO_OF_LOGINS          NUMBER,
  PRF_NO_PREV_FAILED_LOGINS NUMBER,
  PRF_PREV_LAST_LOGIN_DATE  DATE
)


Thanks and Regards
Suman Chaitanya Dasari

From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: 29 August 2015 03:40
To: user@sqoop.apache.org
Subject: Re: Sqoop Merge failed

Hey there,

Could you do a "DESCRIBE PRF_USER_IDENTITY" and paste the output here? Sqoop seems to think you're importing a timestamp.

Also, --verbose should help you identify problems in general.

-Abe

On Thu, Aug 27, 2015 at 11:10 PM <su...@bt.com>> wrote:
Hello Everyone,

I am trying to push incremental updates from Oracle to hdfs using sqoop import command with Merge-key option and incremental mode as "lastmodified".
I have pasted below, my sqoop command and a part of repetitive exception from my logs.

--target-dir /user/$USER/PRF_USER_IDENTITY is the same location where I have data to be merged with the latest incremental data.
Can't parse input data: 'BTCOM_MIGR_C'. This value exists in a column with VARCHAR2(20) NOT NULL

I have framed the below command based on below link
https://mail-archives.apache.org/mod_mbox/sqoop-user/201505.mbox/%3CCAMZRiGzDe9sN8+Tb_MWtLcmb8+Q=agtURNa4Xkq7skYKzu+odQ@mail.gmail.com%3E



sqoop job --create prf_user_identity_delta -- import --connect jdbc:oracle:thin:@//xxx.xx.xx.xx:xxxx/xxxxxx --username profileuserr6_0 --password-file /user/$USER/XXX/sqoop.password --table PRF_USER_IDENTITY --incremental lastmodified --check-column LAST_UPDATED_DTIME --last-value "2015-08-21 14:42:42" --merge-key PRF_USER_IDENTITY_ID --null-string '\\N' --null-non-string '\\N' --fields-terminated-by , --input-null-string '\\N' --input-null-non-string '\\N' --input-fields-terminated-by , --target-dir /user/$USER/PRF_USER_IDENTITY -m 1


15/08/27 12:46:40 INFO mapreduce.Job: Task Id : attempt_1436876041180_239087_m_000078_2, Status : FAILED
Error: java.lang.RuntimeException: Can't parse input data: 'BTCOM_MIGR_C'
        at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1164)
        at PRF_USER_IDENTITY.parse(PRF_USER_IDENTITY.java:1002)
        at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
        at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:202)
        at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1081)
        ... 11 more


Please help me…I am struggling with this error from past couple of days.


Thanks
Suman


Re: Sqoop Merge failed

Posted by Abraham Elmahrek <ab...@cloudera.com>.
Hey there,

Could you do a "DESCRIBE PRF_USER_IDENTITY" and paste the output here?
Sqoop seems to think you're importing a timestamp.

Also, --verbose should help you identify problems in general.

-Abe

On Thu, Aug 27, 2015 at 11:10 PM <su...@bt.com> wrote:

> *Hello Everyone,*
>
>
>
> *I am trying to push incremental updates from Oracle to hdfs using sqoop
> import command with Merge-key option and incremental mode as
> "lastmodified".*
>
> *I have pasted below, my sqoop command and a part of repetitive exception
> from my logs.*
>
>
>
> *--target-dir /user/$USER/PRF_USER_IDENTITY is the same location where I
> have data to be merged with the latest incremental data.*
>
> *Can't parse input data: 'BTCOM_MIGR_C'. This value exists in a column
> with VARCHAR2(20) NOT NULL*
>
>
>
> *I have framed the below command based on below link*
>
>
> https://mail-archives.apache.org/mod_mbox/sqoop-user/201505.mbox/%3CCAMZRiGzDe9sN8+Tb_MWtLcmb8+Q=agtURNa4Xkq7skYKzu+odQ@mail.gmail.com%3E
>
>
>
>
>
>
>
> sqoop job --create prf_user_identity_delta -- import --connect
> jdbc:oracle:thin:@//xxx.xx.xx.xx:xxxx/xxxxxx --username profileuserr6_0
> --password-file /user/$USER/XXX/sqoop.password --table PRF_USER_IDENTITY
> --incremental lastmodified --check-column LAST_UPDATED_DTIME --last-value
> "2015-08-21 14:42:42" --merge-key PRF_USER_IDENTITY_ID --null-string '\\N'
> --null-non-string '\\N' --fields-terminated-by , --input-null-string '\\N'
> --input-null-non-string '\\N' --input-fields-terminated-by , *--target-dir
> /user/$USER/PRF_USER_IDENTITY* -m 1
>
>
>
>
>
> 15/08/27 12:46:40 INFO mapreduce.Job: Task Id :
> attempt_1436876041180_239087_m_000078_2, Status : FAILED
>
> Error: java.lang.RuntimeException: *Can't parse input data:
> 'BTCOM_MIGR_C'*
>
>         at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1164)
>
>         at PRF_USER_IDENTITY.parse(PRF_USER_IDENTITY.java:1002)
>
>         at
> org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
>
>         at
> org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
>
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
>
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>
>         at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
>
>         at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
>
> Caused by: java.lang.IllegalArgumentException: Timestamp format must be
> yyyy-mm-dd hh:mm:ss[.fffffffff]
>
>         at java.sql.Timestamp.valueOf(Timestamp.java:202)
>
>         at PRF_USER_IDENTITY.__loadFromFields(PRF_USER_IDENTITY.java:1081)
>
>         ... 11 more
>
>
>
>
>
> *Please help me…I am struggling with this error from past couple of days.*
>
>
>
>
>
> *Thanks*
>
> *Suman*
>
>
>