You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Kihwal Lee (Created) (JIRA)" <ji...@apache.org> on 2011/11/17 19:11:51 UTC

[jira] [Created] (HADOOP-7831) ConcurrentModificationException in getCurrentUser()

ConcurrentModificationException in getCurrentUser()
---------------------------------------------------

                 Key: HADOOP-7831
                 URL: https://issues.apache.org/jira/browse/HADOOP-7831
             Project: Hadoop Common
          Issue Type: Bug
          Components: security
    Affects Versions: 0.20.205.0
            Reporter: Kihwal Lee


I've seen the following exception from a job tracker log. Security/kerberos enabled.

2011-11-17 01:54:00,288 WARN org.apache.hadoop.mapred.CleanupQueue: Error deleting path
hdfs://namenode:1234/xxxx/xxxx/xxxx/job_xxxxxxxxx_xxxx
java.util.ConcurrentModificationException
        at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761)
        at java.util.LinkedList$ListItr.next(LinkedList.java:696)
        at javax.security.auth.Subject$SecureSet$1.next(Subject.java:1014)
        at javax.security.auth.Subject$ClassSet$1.run(Subject.java:1345)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject$ClassSet.populateSet(Subject.java:1342)
        at javax.security.auth.Subject$ClassSet.<init>(Subject.java:1317)
        at javax.security.auth.Subject.getPrivateCredentials(Subject.java:731)
        at org.apache.hadoop.security.UserGroupInformation.<init>(UserGroupInformation.java:379)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:398)
        at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1445)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
        at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext$1.run(CleanupQueue.java:78)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1064)
        at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext.deletePath(CleanupQueue.java:75)
        at org.apache.hadoop.mapred.CleanupQueue$PathCleanupThread.run(CleanupQueue.java:131)



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7831) ConcurrentModificationException in getCurrentUser()

Posted by "Kihwal Lee (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kihwal Lee updated HADOOP-7831:
-------------------------------

         Description: 
I've seen the following exception from a job tracker log. Security/kerberos enabled.

{noformat}
2011-11-17 01:54:00,288 WARN org.apache.hadoop.mapred.CleanupQueue: Error deleting path
hdfs://namenode:1234/xxxx/xxxx/xxxx/job_xxxxxxxxx_xxxx
java.util.ConcurrentModificationException
        at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761)
        at java.util.LinkedList$ListItr.next(LinkedList.java:696)
        at javax.security.auth.Subject$SecureSet$1.next(Subject.java:1014)
        at javax.security.auth.Subject$ClassSet$1.run(Subject.java:1345)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject$ClassSet.populateSet(Subject.java:1342)
        at javax.security.auth.Subject$ClassSet.<init>(Subject.java:1317)
        at javax.security.auth.Subject.getPrivateCredentials(Subject.java:731)
        at org.apache.hadoop.security.UserGroupInformation.<init>(UserGroupInformation.java:379)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:398)
        at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1445)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
        at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext$1.run(CleanupQueue.java:78)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1064)
        at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext.deletePath(CleanupQueue.java:75)
        at org.apache.hadoop.mapred.CleanupQueue$PathCleanupThread.run(CleanupQueue.java:131)
{noformat}


  was:
I've seen the following exception from a job tracker log. Security/kerberos enabled.

2011-11-17 01:54:00,288 WARN org.apache.hadoop.mapred.CleanupQueue: Error deleting path
hdfs://namenode:1234/xxxx/xxxx/xxxx/job_xxxxxxxxx_xxxx
java.util.ConcurrentModificationException
        at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761)
        at java.util.LinkedList$ListItr.next(LinkedList.java:696)
        at javax.security.auth.Subject$SecureSet$1.next(Subject.java:1014)
        at javax.security.auth.Subject$ClassSet$1.run(Subject.java:1345)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject$ClassSet.populateSet(Subject.java:1342)
        at javax.security.auth.Subject$ClassSet.<init>(Subject.java:1317)
        at javax.security.auth.Subject.getPrivateCredentials(Subject.java:731)
        at org.apache.hadoop.security.UserGroupInformation.<init>(UserGroupInformation.java:379)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:398)
        at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1445)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
        at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext$1.run(CleanupQueue.java:78)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1064)
        at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext.deletePath(CleanupQueue.java:75)
        at org.apache.hadoop.mapred.CleanupQueue$PathCleanupThread.run(CleanupQueue.java:131)



    Target Version/s: 0.20.205.1, 0.20.206.0  (was: 0.20.206.0, 0.20.205.1)
    
> ConcurrentModificationException in getCurrentUser()
> ---------------------------------------------------
>
>                 Key: HADOOP-7831
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7831
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.20.205.0
>            Reporter: Kihwal Lee
>
> I've seen the following exception from a job tracker log. Security/kerberos enabled.
> {noformat}
> 2011-11-17 01:54:00,288 WARN org.apache.hadoop.mapred.CleanupQueue: Error deleting path
> hdfs://namenode:1234/xxxx/xxxx/xxxx/job_xxxxxxxxx_xxxx
> java.util.ConcurrentModificationException
>         at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761)
>         at java.util.LinkedList$ListItr.next(LinkedList.java:696)
>         at javax.security.auth.Subject$SecureSet$1.next(Subject.java:1014)
>         at javax.security.auth.Subject$ClassSet$1.run(Subject.java:1345)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject$ClassSet.populateSet(Subject.java:1342)
>         at javax.security.auth.Subject$ClassSet.<init>(Subject.java:1317)
>         at javax.security.auth.Subject.getPrivateCredentials(Subject.java:731)
>         at org.apache.hadoop.security.UserGroupInformation.<init>(UserGroupInformation.java:379)
>         at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:398)
>         at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1445)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
>         at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
>         at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext$1.run(CleanupQueue.java:78)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1064)
>         at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext.deletePath(CleanupQueue.java:75)
>         at org.apache.hadoop.mapred.CleanupQueue$PathCleanupThread.run(CleanupQueue.java:131)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (HADOOP-7831) ConcurrentModificationException in getCurrentUser()

Posted by "Kihwal Lee (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kihwal Lee resolved HADOOP-7831.
--------------------------------

          Resolution: Duplicate
    Target Version/s: 0.20.205.1, 0.20.206.0  (was: 0.20.206.0, 0.20.205.1)

Duplicate of HADOOP-7854
                
> ConcurrentModificationException in getCurrentUser()
> ---------------------------------------------------
>
>                 Key: HADOOP-7831
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7831
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.20.205.0
>            Reporter: Kihwal Lee
>
> I've seen the following exception from a job tracker log. Security/kerberos enabled.
> {noformat}
> 2011-11-17 01:54:00,288 WARN org.apache.hadoop.mapred.CleanupQueue: Error deleting path
> hdfs://namenode:1234/xxxx/xxxx/xxxx/job_xxxxxxxxx_xxxx
> java.util.ConcurrentModificationException
>         at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761)
>         at java.util.LinkedList$ListItr.next(LinkedList.java:696)
>         at javax.security.auth.Subject$SecureSet$1.next(Subject.java:1014)
>         at javax.security.auth.Subject$ClassSet$1.run(Subject.java:1345)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject$ClassSet.populateSet(Subject.java:1342)
>         at javax.security.auth.Subject$ClassSet.<init>(Subject.java:1317)
>         at javax.security.auth.Subject.getPrivateCredentials(Subject.java:731)
>         at org.apache.hadoop.security.UserGroupInformation.<init>(UserGroupInformation.java:379)
>         at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:398)
>         at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1445)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
>         at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
>         at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext$1.run(CleanupQueue.java:78)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1064)
>         at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext.deletePath(CleanupQueue.java:75)
>         at org.apache.hadoop.mapred.CleanupQueue$PathCleanupThread.run(CleanupQueue.java:131)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7831) ConcurrentModificationException in getCurrentUser()

Posted by "Matt Foley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matt Foley updated HADOOP-7831:
-------------------------------

    Target Version/s:   (was: 1.0.0, 1.1.0)
    
> ConcurrentModificationException in getCurrentUser()
> ---------------------------------------------------
>
>                 Key: HADOOP-7831
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7831
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.20.205.0
>            Reporter: Kihwal Lee
>
> I've seen the following exception from a job tracker log. Security/kerberos enabled.
> {noformat}
> 2011-11-17 01:54:00,288 WARN org.apache.hadoop.mapred.CleanupQueue: Error deleting path
> hdfs://namenode:1234/xxxx/xxxx/xxxx/job_xxxxxxxxx_xxxx
> java.util.ConcurrentModificationException
>         at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761)
>         at java.util.LinkedList$ListItr.next(LinkedList.java:696)
>         at javax.security.auth.Subject$SecureSet$1.next(Subject.java:1014)
>         at javax.security.auth.Subject$ClassSet$1.run(Subject.java:1345)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject$ClassSet.populateSet(Subject.java:1342)
>         at javax.security.auth.Subject$ClassSet.<init>(Subject.java:1317)
>         at javax.security.auth.Subject.getPrivateCredentials(Subject.java:731)
>         at org.apache.hadoop.security.UserGroupInformation.<init>(UserGroupInformation.java:379)
>         at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:398)
>         at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1445)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
>         at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
>         at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext$1.run(CleanupQueue.java:78)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1064)
>         at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext.deletePath(CleanupQueue.java:75)
>         at org.apache.hadoop.mapred.CleanupQueue$PathCleanupThread.run(CleanupQueue.java:131)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira