[jira] [Updated] (HDFS-3694) QJM: Fix getEditLogManifest to fetch httpPort if necessary

["Todd Lipcon (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon updated HDFS-3694:
------------------------------

    Attachment: hdfs-3694.txt

Attached patch fixes {{getEditLogManifest}} to assign the http port member from the response. I also cleaned up the internal APIs to not pass the protobuf all the way through.

The patch includes a new unit test where one QuorumJournalManager reads while another writes. This simulates the workload of HA.
                
> QJM: Fix getEditLogManifest to fetch httpPort if necessary
> ----------------------------------------------------------
>
>                 Key: HDFS-3694
>                 URL: https://issues.apache.org/jira/browse/HDFS-3694
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Todd Lipcon
>         Attachments: hdfs-3694.txt
>
>
> This is necessary for QJM to work with HA. When the NNs start up, they start in standby state and try to read from the JournalNodes. So they call {{getEditLogManifest()}}. But they don't call {{getJournalInfo}} so the {{httpPort}} field doesn't get filled in. This means that when they try to actually fetch the remote edits, they fail since they don't know the JN's HTTP port.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira