You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Chalcy <ch...@gmail.com> on 2012/04/09 19:15:07 UTC
Re: Fwd: sqoop export - rpc failure

This worked :)

Thanks, Abhijeet.   The user group is awesome.  Thanks guys for helping
out.

--Chalcy

On Fri, Mar 30, 2012 at 5:48 PM, abhijeet gaikwad <ab...@gmail.com>wrote:

> try the same value with this property :
> sqoop.export.records.per.statement
> default is 100.
>
> This should work.
>
> Thanks,
> Abhijeet Gaikwad
> On 30 Mar 2012 16:17, "Chalcy" <ch...@gmail.com> wrote:
>
>>
>> Hello,
>>
>> I am trying to do a sqoop export (data from hdfs hadoop to database). The
>> table I am trying to export has 2 million rows.  The table has 20 fields.
>> The sqoop command is successful if I did 10 rows till 95 rows.  When I try
>> anything more than 95, the sqoop export fails with the following error.
>>
>>
>> By googling I get that this a dbms limitation. Is there anyway to
>> configure to fix this error?  I am surprised that it works for few rows.
>>
>>
>>
>> Any help is appreciated.
>>
>>
>> Thanks,
>> CHalcy
>>
>>
>>
>> 12/03/29 09:00:59 INFO mapred.JobClient: Task Id :
>> attempt_201203230811_0539_m_000000_0, Status : FAILED
>>
>> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
>> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
>> stream is incorrect. Too many parameters were provided in this RPC request.
>> The maximum is 2100.
>>
>>         at
>> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>>
>>         at
>> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>>
>>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>>
>>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>>
>>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>>
>>         at java.security.AccessController.doPrivileged(Native Method)
>>
>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>>
>>         at org.apache.hadoop.mapred.Child.main(Child.java:264)
>>
>> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
>> tabular data stream (TDS) remote procedure call (RPC) protocol stream is
>> incorrect.
>>
>> 12/03/29 09:01:05 INFO mapred.JobClient: Task Id :
>> attempt_201203230811_0539_m_000000_1, Status : FAILED
>>
>> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
>> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
>> stream is incorrect. Too many parameters were provided in this RPC request.
>> The maximum is 2100.
>>
>>         at
>> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>>
>>         at
>> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>>
>>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>>
>>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>>
>>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>>
>>         at java.security.AccessController.doPrivileged(Native Method)
>>
>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>>
>>         at org.apache.hadoop.mapred.Child.main(Child.java:264)
>>
>> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
>> tabular data stream (TDS) remote procedure call (RPC) protocol stream is
>> incorrect.
>>
>> 12/03/29 09:01:10 INFO mapred.JobClient: Task Id :
>> attempt_201203230811_0539_m_000000_2, Status : FAILED
>>
>> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
>> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
>> stream is incorrect. Too many parameters were provided in this RPC request.
>> The maximum is 2100.
>>
>>         at
>> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>>
>>         at
>> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>>
>>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>>
>>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>>
>>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>>
>>         at java.security.AccessController.doPrivileged(Native Method)
>>
>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>>
>>         at org.apache.hadoop.mapred.Child.main(Child.java:264)
>>
>>