You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Ravuri Sushma sree (Jira)" <ji...@apache.org> on 2019/12/26 16:27:00 UTC

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

    [ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003692#comment-17003692 ] 

Ravuri Sushma sree commented on HDFS-14442:
-------------------------------------------

Hi [~xkrogen] , thank you for your inputs in simplifying the test, I have uploaded a patch implementing the same. Please review

> Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId
> ---------------------------------------------------------------------------------------
>
>                 Key: HDFS-14442
>                 URL: https://issues.apache.org/jira/browse/HDFS-14442
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 3.3.0
>            Reporter: Erik Krogen
>            Assignee: Ravuri Sushma sree
>            Priority: Major
>         Attachments: HDFS-14442.001.patch, HDFS-14442.002.patch, HDFS-14442.003.patch
>
>
> While working on HDFS-14245, we noticed a discrepancy in some proxy-handling code.
> The description of {{RpcInvocationHandler.getConnectionId()}} states:
> {code}
>   /**
>    * Returns the connection id associated with the InvocationHandler instance.
>    * @return ConnectionId
>    */
>   ConnectionId getConnectionId();
> {code}
> It does not make any claims about whether this connection ID will be an active proxy or not. Yet in {{HAUtil}} we have:
> {code}
>   /**
>    * Get the internet address of the currently-active NN. This should rarely be
>    * used, since callers of this method who connect directly to the NN using the
>    * resulting InetSocketAddress will not be able to connect to the active NN if
>    * a failover were to occur after this method has been called.
>    * 
>    * @param fs the file system to get the active address of.
>    * @return the internet address of the currently-active NN.
>    * @throws IOException if an error occurs while resolving the active NN.
>    */
>   public static InetSocketAddress getAddressOfActive(FileSystem fs)
>       throws IOException {
>     if (!(fs instanceof DistributedFileSystem)) {
>       throw new IllegalArgumentException("FileSystem " + fs + " is not a DFS.");
>     }
>     // force client address resolution.
>     fs.exists(new Path("/"));
>     DistributedFileSystem dfs = (DistributedFileSystem) fs;
>     DFSClient dfsClient = dfs.getClient();
>     return RPC.getServerAddress(dfsClient.getNamenode());
>   }
> {code}
> Where the call {{RPC.getServerAddress()}} eventually terminates into {{RpcInvocationHandler#getConnectionId()}}, via {{RPC.getServerAddress()}} -> {{RPC.getConnectionIdForProxy()}} -> {{RpcInvocationHandler#getConnectionId()}}. {{HAUtil}} appears to be making an incorrect assumption that {{RpcInvocationHandler}} will necessarily return an _active_ connection ID. {{ObserverReadProxyProvider}} demonstrates a counter-example to this, since the current connection ID may be pointing at, for example, an Observer NameNode.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org