You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Karthik Palanisamy (Jira)" <ji...@apache.org> on 2021/03/01 08:12:00 UTC

[jira] [Updated] (HDFS-15865) Interrupt DataStreamer thread

     [ https://issues.apache.org/jira/browse/HDFS-15865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karthik Palanisamy updated HDFS-15865:
--------------------------------------
    Description: 
Have noticed HiveServer2 halts due to DataStreamer#waitForAckedSeqno. 

I think we have to interrupt DataStreamer if no packet ack(from datanodes). It likely happens with infra/network issue.
{code:java}
"HiveServer2-Background-Pool: Thread-35977576" #35977576 prio=5 os_prio=0 cpu=797.65ms elapsed=3406.28s tid=0x00007fc0c6c29800 nid=0x4198 in Object.wait()  [0x00007fc1079f3000]
    java.lang.Thread.State: TIMED_WAITING (on object monitor)
         at java.lang.Object.wait(java.base(at)11.0.5/Native Method)
         - waiting on <no object reference available>
         at org.apache.hadoop.hdfs.DataStreamer.waitForAckedSeqno(DataStreamer.java:886)
         - waiting to re-lock in wait() <0x00007fe6eda86ca0> (a java.util.LinkedList){code}

  was:
Have noticed HiveServer2 halts due to DataStreamer#waitForAckedSeqno. 

I think we have to interrupt DataStreamer if no packet ack(from datanodes). It likely happens with infra/network issue.

{code}
 "HiveServer2-Background-Pool: Thread-35977576" #35977576 prio=5 os_prio=0 cpu=797.65ms elapsed=3406.28s tid=0x00007fc0c6c29800 nid=0x4198 in Object.wait()  [0x00007fc1079f3000]
    java.lang.Thread.State: TIMED_WAITING (on object monitor)
         at java.lang.Object.wait([java.base(at)11.0.5|mailto:java.base@11.0.5]/Native Method)
         - waiting on <no object reference available>
         at org.apache.hadoop.hdfs.DataStreamer.waitForAckedSeqno(DataStreamer.java:886)
         - waiting to re-lock in wait() <0x00007fe6eda86ca0> (a java.util.LinkedList)
 \{code}

 


> Interrupt DataStreamer thread
> -----------------------------
>
>                 Key: HDFS-15865
>                 URL: https://issues.apache.org/jira/browse/HDFS-15865
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>            Reporter: Karthik Palanisamy
>            Priority: Minor
>
> Have noticed HiveServer2 halts due to DataStreamer#waitForAckedSeqno. 
> I think we have to interrupt DataStreamer if no packet ack(from datanodes). It likely happens with infra/network issue.
> {code:java}
> "HiveServer2-Background-Pool: Thread-35977576" #35977576 prio=5 os_prio=0 cpu=797.65ms elapsed=3406.28s tid=0x00007fc0c6c29800 nid=0x4198 in Object.wait()  [0x00007fc1079f3000]
>     java.lang.Thread.State: TIMED_WAITING (on object monitor)
>          at java.lang.Object.wait(java.base(at)11.0.5/Native Method)
>          - waiting on <no object reference available>
>          at org.apache.hadoop.hdfs.DataStreamer.waitForAckedSeqno(DataStreamer.java:886)
>          - waiting to re-lock in wait() <0x00007fe6eda86ca0> (a java.util.LinkedList){code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org