You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Chalcy <ch...@gmail.com> on 2012/03/29 18:58:40 UTC

Fwd: sqoop export - rpc failure

posting again after dealing with subscribe issues .

---------- Forwarded message ----------
From: Chalcy <ch...@gmail.com>
Date: Thu, Mar 29, 2012 at 9:26 AM
Subject: sqoop export - rpc failure
To: sqoop-user@cloudera.org
Cc: sqoop-user@incubator.apache.org




I am trying to do a sqoop export (data from hdfs hadoop to database). The
table I am trying to export has 2 million rows.  The table has 20 fields.
The sqoop command is successful if I did 10 rows till 95 rows.  When I try
anything more than 95, the sqoop export fails with the following error.


By googling I get that this a dbms limitation. Is there anyway to configure
to fix this error?  I am surprised that it works for few rows.



Any help is appreciated.


Thanks,
CHalcy



12/03/29 09:00:59 INFO mapred.JobClient: Task Id :
attempt_201203230811_0539_m_000000_0, Status : FAILED

java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
incoming tabular data stream (TDS) remote procedure call (RPC) protocol
stream is incorrect. Too many parameters were provided in this RPC request.
The maximum is 2100.

        at
com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)

        at
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:396)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)

        at org.apache.hadoop.mapred.Child.main(Child.java:264)

Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
tabular data stream (TDS) remote procedure call (RPC) protocol stream is
incorrect.

12/03/29 09:01:05 INFO mapred.JobClient: Task Id :
attempt_201203230811_0539_m_000000_1, Status : FAILED

java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
incoming tabular data stream (TDS) remote procedure call (RPC) protocol
stream is incorrect. Too many parameters were provided in this RPC request.
The maximum is 2100.

        at
com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)

        at
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:396)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)

        at org.apache.hadoop.mapred.Child.main(Child.java:264)

Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
tabular data stream (TDS) remote procedure call (RPC) protocol stream is
incorrect.

12/03/29 09:01:10 INFO mapred.JobClient: Task Id :
attempt_201203230811_0539_m_000000_2, Status : FAILED

java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
incoming tabular data stream (TDS) remote procedure call (RPC) protocol
stream is incorrect. Too many parameters were provided in this RPC request.
The maximum is 2100.

        at
com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)

        at
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:396)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)

        at org.apache.hadoop.mapred.Child.main(Child.java:264)