[jira] [Created] (HBASE-28955) Improve lease renew for FanOutOneBlockAsyncDFSOutput

["Duo Zhang (Jira)" <ji...@apache.org>]

Duo Zhang created HBASE-28955:
---------------------------------

             Summary: Improve lease renew for FanOutOneBlockAsyncDFSOutput
                 Key: HBASE-28955
                 URL: https://issues.apache.org/jira/browse/HBASE-28955
             Project: HBase
          Issue Type: Bug
            Reporter: Duo Zhang


When working with hadoop 3.4.x, we saw this in the stdout file

{noformat}
Exception in thread "LeaseRenewer:zhangduo@home" java.lang.NullPointerException: Cannot invoke "org.apache.hadoop.hdfs.DFSOutputStream.getNamespace()" because "outputStream" is null
        at org.apache.hadoop.hdfs.DFSClient.getNamespaces(DFSClient.java:596)
        at org.apache.hadoop.hdfs.DFSClient.renewLease(DFSClient.java:618)
        at org.apache.hadoop.hdfs.client.impl.LeaseRenewer.renew(LeaseRenewer.java:425)
        at org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:445)
        at org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$800(LeaseRenewer.java:77)
        at org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:336)
        at java.base/java.lang.Thread.run(Thread.java:840)
{noformat}

This is because in  newer DFSClient implementation, we need to pass namespace when renewer lease so we can not just pass null as DFSOutputStream when calling DFSClient.beginFileLease. We should find a way to deal with it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)