You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Aaron T. Myers (JIRA)" <ji...@apache.org> on 2012/06/04 21:12:23 UTC
[jira] [Created] (HDFS-3501) Checkpointing with security + HA
enabled will stop working after ticket lifetime expires
Aaron T. Myers created HDFS-3501:
------------------------------------
Summary: Checkpointing with security + HA enabled will stop working after ticket lifetime expires
Key: HDFS-3501
URL: https://issues.apache.org/jira/browse/HDFS-3501
Project: Hadoop HDFS
Issue Type: Bug
Components: ha, name-node
Affects Versions: 2.0.0-alpha
Reporter: Aaron T. Myers
Assignee: Aaron T. Myers
Attachments: HDFS-3501.patch
The StandbyCheckpointer currently does the right thing in renewing its krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288883#comment-13288883 ]
Hudson commented on HDFS-3501:
------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2338 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2338/])
HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers (Revision 1346106)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346106
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/GetImageServlet.java
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.1-alpha
>
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HDFS-3501:
---------------------------------
Description: The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file. (was: The StandbyCheckpointer currently does the right thing in renewing its krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN to fetch the new merged fsimage file.)
Summary: Checkpointing with security enabled will stop working after ticket lifetime expires (was: Checkpointing with security + HA enabled will stop working after ticket lifetime expires)
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288834#comment-13288834 ]
Eli Collins commented on HDFS-3501:
-----------------------------------
+1 looks good
ATM mentioned offline that he tested doing checkpoints every 30s for 15 mins with a lowered ticket renewal.
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3501) Checkpointing with security + HA
enabled will stop working after ticket lifetime expires
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HDFS-3501:
---------------------------------
Attachment: HDFS-3501.patch
Here's a patch which fixes the issue. I tested this manually in a secure+HA setup and confirmed that it works as expected.
> Checkpointing with security + HA enabled will stop working after ticket lifetime expires
> ----------------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer currently does the right thing in renewing its krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288854#comment-13288854 ]
Hudson commented on HDFS-3501:
------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2392 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2392/])
HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers (Revision 1346106)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346106
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/GetImageServlet.java
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.1-alpha
>
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HDFS-3501:
------------------------------
Resolution: Fixed
Fix Version/s: 2.0.1-alpha
Target Version/s: (was: 2.0.1-alpha)
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
This is a 1-liner and only runs when security is enabled so new test case won't cover it.
I've committed this and merged to branch-2. Thanks ATM.
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.1-alpha
>
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed HDFS-3501.
-------------------------------
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.2-alpha
>
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289414#comment-13289414 ]
Hudson commented on HDFS-3501:
------------------------------
Integrated in Hadoop-Mapreduce-trunk #1101 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1101/])
HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers (Revision 1346106)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346106
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/GetImageServlet.java
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.1-alpha
>
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288846#comment-13288846 ]
Hudson commented on HDFS-3501:
------------------------------
Integrated in Hadoop-Common-trunk-Commit #2320 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2320/])
HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers (Revision 1346106)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346106
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/GetImageServlet.java
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.1-alpha
>
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3501) Checkpointing with security + HA
enabled will stop working after ticket lifetime expires
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HDFS-3501:
---------------------------------
Status: Patch Available (was: Open)
> Checkpointing with security + HA enabled will stop working after ticket lifetime expires
> ----------------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer currently does the right thing in renewing its krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3501) Checkpointing with security enabled
will stop working after ticket lifetime expires
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289076#comment-13289076 ]
Hudson commented on HDFS-3501:
------------------------------
Integrated in Hadoop-Hdfs-trunk #1067 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1067/])
HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers (Revision 1346106)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346106
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/GetImageServlet.java
> Checkpointing with security enabled will stop working after ticket lifetime expires
> -----------------------------------------------------------------------------------
>
> Key: HDFS-3501
> URL: https://issues.apache.org/jira/browse/HDFS-3501
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, name-node
> Affects Versions: 2.0.0-alpha
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.1-alpha
>
> Attachments: HDFS-3501.patch
>
>
> The StandbyCheckpointer and 2NN currently do the right thing in renewing their krb5 creds before attempting to perform a checkpoint to the active NN, but the active NN makes no attempt to renew its own krb5 creds before connecting to the standby NN or 2NN to fetch the new merged fsimage file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira