You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Kathleen Ting <ka...@apache.org> on 2014/03/13 23:02:27 UTC
Re: Oraoop_Issue
Moving to user@sqoop.apache.org (please subscribe if you haven't
already, Kartheek).
Hi Kartheek,
As mentioned in the error message "Can't export data, please check
task tracker logs," looks like there will be more helpful debugging
information contained in attempt_201403100147_0004_m_000001_1 - can
you please post the error messages from there?
Regards,
Kate
On Wed, Mar 12, 2014 at 10:22 PM, kartheek reddy
<ka...@outlook.com> wrote:
>
> Hi Kathleen ,
>
> Greeting.
>
> This is Kartheek from india. i had
> issue withe oraoop connector.while am exporting the data from hive to oracle
> database am getting follow error ...please can u help me on this.i posted
> but no body reply me.and one more query like how can i increase my
> export/import performance by using oraoop. if any parameters i have to
> change in oraoop-site.xml.if changes required please tell me what are the
> changes i do.. here am using sqoop version is apache sqopp 1.4.3 and hadoop
> 1.1.2 .
>
> 14/03/10 02:21:46 INFO mapred.JobClient: Task Id :
> attempt_201403100147_0004_m_000001_1, Status : FAILED
> java.io.IOException: Can't export data, please check task tracker logs
> at
> org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
> at
> org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> at
> org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: java.io.IOException: java.sql.SQLException:
> java.lang.NullPointerException
> at
> org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:220)
> at
> com.quest.oraoop.OraOopOutputFormatBase$OraOopDBRecordWriterBase.write(OraOopOutputFormatBase.java:507)
> at
> com.quest.oraoop.OraOopOutputFormatInsert$OraOopDBRecordWriterInsert.write(OraOopOutputFormatInsert.java:94)
> at
> com.quest.oraoop.OraOopOutputFormatBase$OraOopDBRecordWriterBase.write(OraOopOutputFormatBase.java:175)
> at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:639)
> at
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> at
> org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:84)
> ... 10 more
> Caused by: java.sql.SQLException: java.lang.NullPointerException
> at
> com.quest.oraoop.OraOopOutputFormatInsert$OraOopDBRecordWriterInsert.configurePreparedStatement(OraOopOutputFormatInsert.java:228)
> sqoop export --connect jdbc:oracle:thin:@servername:1521:grasa01 --username
> TEST --password gra --table K --export-dir /user/hive/warehouse/k --columns
> 'c_id' --input-lines-terminated-by '\n'
>
>
> Thanks & Regards
> Kartheek Reddy
Re: Oraoop_Issue
Posted by Kathleen Ting <ka...@apache.org>.
Again, moving to user@sqoop.apache.org (please subscribe if you
haven't already, Kartheek).
Kartheek, is this from attempt_201403100147_0004_m_000001_1 or one of
the failed task logs?
On Thu, Mar 13, 2014 at 9:27 PM, kartheek reddy
<ka...@outlook.com> wrote:
> i found this error in task tracker log.
> 2014-03-13 21:17:16,809 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_-669109447 given task:
> attempt_201403132057_0001_m_000001_1
> 2014-03-13 21:17:18,483 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000000_1 0.0%
> 2014-03-13 21:17:18,517 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000001_1 0.0%
> 2014-03-13 21:17:18,687 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-1511417430 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:18,711 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-669109447 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:21,690 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1
> 2014-03-13 21:17:21,713 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 2
> 2014-03-13 21:17:21,856 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000000_2 task's
> state:UNASSIGNED
> 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000001_2 task's
> state:UNASSIGNED
> 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000000_2 which needs 1 slots
> 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 2 and trying to launch
> attempt_201403132057_0001_m_000000_2 which needs 1 slots
> 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000001_2 which needs 1 slots
> 2014-03-13 21:17:21,858 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 1 and trying to launch
> attempt_201403132057_0001_m_000001_2 which needs 1 slots
> 2014-03-13 21:17:21,867 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_107561801
> 2014-03-13 21:17:21,867 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_107561801 spawned.
> 2014-03-13 21:17:21,868 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-238632827
> 2014-03-13 21:17:21,872 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_-238632827 spawned.
> 2014-03-13 21:17:21,873 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000000_2/taskjvm.sh
> 2014-03-13 21:17:21,874 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000001_2/taskjvm.sh
> 2014-03-13 21:17:22,524 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_-238632827 given task:
> attempt_201403132057_0001_m_000001_2
> 2014-03-13 21:17:22,573 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_107561801 given task:
> attempt_201403132057_0001_m_000000_2
> 2014-03-13 21:17:24,327 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000000_2 0.0%
> 2014-03-13 21:17:24,473 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000001_2 0.0%
> 2014-03-13 21:17:24,621 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_107561801 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:24,636 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-238632827 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:27,627 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1
> 2014-03-13 21:17:27,642 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 2
> 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000000_3 task's
> state:UNASSIGNED
> 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000001_3 task's
> state:UNASSIGNED
> 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000000_3 which needs 1 slots
> 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 2 and trying to launch
> attempt_201403132057_0001_m_000000_3 which needs 1 slots
> 2014-03-13 21:17:27,676 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000001_3 which needs 1 slots
> 2014-03-13 21:17:27,676 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 1 and trying to launch
> attempt_201403132057_0001_m_000001_3 which needs 1 slots
> 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-607582511
> 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_-607582511 spawned.
> 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_1970579140
> 2014-03-13 21:17:27,694 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_1970579140 spawned.
> 2014-03-13 21:17:27,694 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000000_3/taskjvm.sh
> 2014-03-13 21:17:27,696 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000001_3/taskjvm.sh
> 2014-03-13 21:17:28,389 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_-607582511 given task:
> attempt_201403132057_0001_m_000000_3
> 2014-03-13 21:17:28,434 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_1970579140 given task:
> attempt_201403132057_0001_m_000001_3
> 2014-03-13 21:17:30,045 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000000_3 0.0%
> 2014-03-13 21:17:30,117 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000001_3 0.0%
> 2014-03-13 21:17:30,162 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-607582511 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:30,267 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_1970579140 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:33,163 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1
> 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000004_0 task's
> state:UNASSIGNED
> 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000004_0 which needs 1 slots
> 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 1 and trying to launch
> attempt_201403132057_0001_m_000004_0 which needs 1 slots
> 2014-03-13 21:17:33,176 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-1874753763
> 2014-03-13 21:17:33,177 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_-1874753763 spawned.
> 2014-03-13 21:17:33,178 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000004_0/taskjvm.sh
> 2014-03-13 21:17:33,268 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1
> 2014-03-13 21:17:33,818 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_-1874753763 given task:
> attempt_201403132057_0001_m_000004_0
> 2014-03-13 21:17:34,619 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000004_0 0.0%
> 2014-03-13 21:17:34,669 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000004_0 0.0% cleanup
> 2014-03-13 21:17:34,670 INFO org.apache.hadoop.mapred.TaskTracker: Task
> attempt_201403132057_0001_m_000004_0 is done.
> 2014-03-13 21:17:34,671 INFO org.apache.hadoop.mapred.TaskTracker: reported
> output size for attempt_201403132057_0001_m_000004_0 was -1
> 2014-03-13 21:17:34,671 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 2
> 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received
> KillTaskAction for task: attempt_201403132057_0001_m_000000_3
> 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received
> KillTaskAction for task: attempt_201403132057_0001_m_000001_3
> 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received
> 'KillJobAction' for job: job_201403132057_0001
> 2014-03-13 21:17:34,814 INFO org.apache.hadoop.mapred.IndexCache: Map ID
> attempt_201403132057_0001_m_000004_0 not found in cache
> 2014-03-13 21:17:34,814 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding
> job_201403132057_0001 for user-log deletion with
> retainTimeStamp:1394857054814
> 2014-03-13 21:17:34,870 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-1874753763 exited with exit code 0. Number of tasks
> it ran: 1
>
>
> Thanks & Regards
> Kartheek Reddy
> 91-8390753543
>
>
>> From: kathleen@apache.org
>> Date: Thu, 13 Mar 2014 15:02:27 -0700
>> Subject: Re: Oraoop_Issue
>> To: kartheek.srmuni@outlook.com; user@sqoop.apache.org
>
>>
>> Moving to user@sqoop.apache.org (please subscribe if you haven't
>> already, Kartheek).
>>
>> Hi Kartheek,
>>
>> As mentioned in the error message "Can't export data, please check
>> task tracker logs," looks like there will be more helpful debugging
>> information contained in attempt_201403100147_0004_m_000001_1 - can
>> you please post the error messages from there?
>>
>> Regards,
>> Kate
>>
>> On Wed, Mar 12, 2014 at 10:22 PM, kartheek reddy
>> <ka...@outlook.com> wrote:
>> >
>> > Hi Kathleen ,
>> >
>> > Greeting.
>> >
>> > This is Kartheek from india. i had
>> > issue withe oraoop connector.while am exporting the data from hive to
>> > oracle
>> > database am getting follow error ...please can u help me on this.i
>> > posted
>> > but no body reply me.and one more query like how can i increase my
>> > export/import performance by using oraoop. if any parameters i have to
>> > change in oraoop-site.xml.if changes required please tell me what are
>> > the
>> > changes i do.. here am using sqoop version is apache sqopp 1.4.3 and
>> > hadoop
>> > 1.1.2 .
>> >
>> > 14/03/10 02:21:46 INFO mapred.JobClient: Task Id :
>> > attempt_201403100147_0004_m_000001_1, Status : FAILED
>> > java.io.IOException: Can't export data, please check task tracker logs
>> > at
>> >
>> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
>> > at
>> >
>> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
>> > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> > at
>> >
>> > org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
>> > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>> > at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at javax.security.auth.Subject.doAs(Subject.java:415)
>> > at
>> >
>> > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
>> > at org.apache.hadoop.mapred.Child.main(Child.java:249)
>> > Caused by: java.io.IOException: java.sql.SQLException:
>> > java.lang.NullPointerException
>> > at
>> >
>> > org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:220)
>> > at
>> >
>> > com.quest.oraoop.OraOopOutputFormatBase$OraOopDBRecordWriterBase.write(OraOopOutputFormatBase.java:507)
>> > at
>> >
>> > com.quest.oraoop.OraOopOutputFormatInsert$OraOopDBRecordWriterInsert.write(OraOopOutputFormatInsert.java:94)
>> > at
>> >
>> > com.quest.oraoop.OraOopOutputFormatBase$OraOopDBRecordWriterBase.write(OraOopOutputFormatBase.java:175)
>> > at
>> >
>> > org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:639)
>> > at
>> >
>> > org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
>> > at
>> >
>> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:84)
>> > ... 10 more
>> > Caused by: java.sql.SQLException: java.lang.NullPointerException
>> > at
>> >
>> > com.quest.oraoop.OraOopOutputFormatInsert$OraOopDBRecordWriterInsert.configurePreparedStatement(OraOopOutputFormatInsert.java:228)
>> > sqoop export --connect jdbc:oracle:thin:@servername:1521:grasa01
>> > --username
>> > TEST --password gra --table K --export-dir /user/hive/warehouse/k
>> > --columns
>> > 'c_id' --input-lines-terminated-by '\n'
>> >
>> >
>> > Thanks & Regards
>> > Kartheek Reddy