[jira] [Comment Edited] (HBASE-15831) we are running a Spark Job for scanning Hbase table getting Caused by: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException

["Anoop Sam John (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-15831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284656#comment-15284656 ] 

Anoop Sam John edited comment on HBASE-15831 at 5/16/16 2:38 PM:
-----------------------------------------------------------------

Each Job is trying to scan how many rows?  And how many rows in one RPC? (HBase scanner caching value).   Any filtering on scan job?


was (Author: anoop.hbase):
Each Job is trying to scan how many rows?  And how many rows in one RPC? (HBase scanner caching value)

> we are running a Spark Job for scanning Hbase table getting Caused by: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException
> ----------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15831
>                 URL: https://issues.apache.org/jira/browse/HBASE-15831
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Neemesh
>
> I am getting following error when I am trying to scan  hbase table in QED environment for a particular collection
> Caused by: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id: 1629041 number_of_rows: 100 close_scanner: false next_call_seq: 0
> Following is the command to execute the spark job
> spark-submit --master yarn --deploy-mode client --driver-memory 4g --queue root.ecpqedv1patents --class com.thomsonreuters.spark.hbase.HbaseSparkFinal HbaseSparkVenus.jar ecpqedv1patents:NovusDocCopy w_3rd_bonds
> even I tried running this adding following two parameter also --num-executors 200 --executor-cores 4 but even it was throwing same exception.
> I goggled and found if we add following properties we would not be getting above issue, but this property changes also did not help
> .set("hbase.client.pause","1000")
>       .set("hbase.rpc.timeout","90000")
>       .set("hbase.client.retries.number","3")
>       .set("zookeeper.recovery.retry","1")
>       .set("hbase.client.operation.timeout","30000")
>       .set("hbase.client.scanner.timeout.period","90000")
> Please let us know how to resolve this issue



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)