You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Ivan Kelly (JIRA)" <ji...@apache.org> on 2012/11/06 12:56:12 UTC
[jira] [Created] (HDFS-4154) Two namenodes usng bkjm can race to
create the version znode
Ivan Kelly created HDFS-4154:
--------------------------------
Summary: Two namenodes usng bkjm can race to create the version znode
Key: HDFS-4154
URL: https://issues.apache.org/jira/browse/HDFS-4154
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Fix For: 3.0.0, 2.0.3-alpha
nd one will get the following error.
2012-11-06 10:04:00,200 INFO hidden.bkjournal.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 109-231-69-172.flexiscale.com/109.231.69.172:2181, sessionid = 0x13ad528fcfe0005, negotiated timeout = 4000
2012-11-06 10:04:00,710 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
java.lang.IllegalArgumentException: Unable to construct journal, bookkeeper://109.231.69.172:2181;109.231.69.173:2181;109.231.69.174:2181/hdfsjournal
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1251)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:226)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initSharedJournalsForRead(FSEditLog.java:206)
at org.apache.hadoop.hdfs.server.namenode.FSImage.initEditLog(FSImage.java:657)
at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:590)
at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:544)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:423)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:385)
at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:401)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:435)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:611)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:592)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1135)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1201)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1249)
... 14 more
Caused by: java.io.IOException: Error initializing zk
at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:233)
... 19 more
Caused by: hidden.bkjournal.org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /hdfsjournal/version
at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at hidden.bkjournal.org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778)
at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:222)
... 19 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-4154) Two namenodes usng bkjm can race to
create the version znode
Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uma Maheswara Rao G updated HDFS-4154:
--------------------------------------
Affects Version/s: 2.0.3-alpha
3.0.0
> Two namenodes usng bkjm can race to create the version znode
> ------------------------------------------------------------
>
> Key: HDFS-4154
> URL: https://issues.apache.org/jira/browse/HDFS-4154
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha
> Affects Versions: 3.0.0, 2.0.3-alpha
> Reporter: Ivan Kelly
> Assignee: Ivan Kelly
>
> nd one will get the following error.
> 2012-11-06 10:04:00,200 INFO hidden.bkjournal.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 109-231-69-172.flexiscale.com/109.231.69.172:2181, sessionid = 0x13ad528fcfe0005, negotiated timeout = 4000
> 2012-11-06 10:04:00,710 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
> java.lang.IllegalArgumentException: Unable to construct journal, bookkeeper://109.231.69.172:2181;109.231.69.173:2181;109.231.69.174:2181/hdfsjournal
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1251)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:226)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initSharedJournalsForRead(FSEditLog.java:206)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.initEditLog(FSImage.java:657)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:590)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:544)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:423)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:385)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:401)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:435)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:611)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:592)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1135)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1201)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1249)
> ... 14 more
> Caused by: java.io.IOException: Error initializing zk
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:233)
> ... 19 more
> Caused by: hidden.bkjournal.org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /hdfsjournal/version
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at hidden.bkjournal.org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778)
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:222)
> ... 19 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4154) BKJM: Two namenodes usng bkjm can
race to create the version znode
Posted by "Han Xiao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498530#comment-13498530 ]
Han Xiao commented on HDFS-4154:
--------------------------------
We have repair it in our internal version. I could upload the patch if no one else is doing.
> BKJM: Two namenodes usng bkjm can race to create the version znode
> ------------------------------------------------------------------
>
> Key: HDFS-4154
> URL: https://issues.apache.org/jira/browse/HDFS-4154
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha
> Affects Versions: 3.0.0, 2.0.3-alpha
> Reporter: Ivan Kelly
> Assignee: Ivan Kelly
>
> nd one will get the following error.
> 2012-11-06 10:04:00,200 INFO hidden.bkjournal.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 109-231-69-172.flexiscale.com/109.231.69.172:2181, sessionid = 0x13ad528fcfe0005, negotiated timeout = 4000
> 2012-11-06 10:04:00,710 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
> java.lang.IllegalArgumentException: Unable to construct journal, bookkeeper://109.231.69.172:2181;109.231.69.173:2181;109.231.69.174:2181/hdfsjournal
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1251)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:226)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initSharedJournalsForRead(FSEditLog.java:206)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.initEditLog(FSImage.java:657)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:590)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:544)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:423)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:385)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:401)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:435)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:611)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:592)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1135)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1201)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1249)
> ... 14 more
> Caused by: java.io.IOException: Error initializing zk
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:233)
> ... 19 more
> Caused by: hidden.bkjournal.org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /hdfsjournal/version
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at hidden.bkjournal.org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778)
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:222)
> ... 19 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-4154) BKJM: Two namenodes usng bkjm can race
to create the version znode
Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uma Maheswara Rao G updated HDFS-4154:
--------------------------------------
Summary: BKJM: Two namenodes usng bkjm can race to create the version znode (was: Two namenodes usng bkjm can race to create the version znode)
> BKJM: Two namenodes usng bkjm can race to create the version znode
> ------------------------------------------------------------------
>
> Key: HDFS-4154
> URL: https://issues.apache.org/jira/browse/HDFS-4154
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha
> Affects Versions: 3.0.0, 2.0.3-alpha
> Reporter: Ivan Kelly
> Assignee: Ivan Kelly
>
> nd one will get the following error.
> 2012-11-06 10:04:00,200 INFO hidden.bkjournal.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 109-231-69-172.flexiscale.com/109.231.69.172:2181, sessionid = 0x13ad528fcfe0005, negotiated timeout = 4000
> 2012-11-06 10:04:00,710 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
> java.lang.IllegalArgumentException: Unable to construct journal, bookkeeper://109.231.69.172:2181;109.231.69.173:2181;109.231.69.174:2181/hdfsjournal
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1251)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:226)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initSharedJournalsForRead(FSEditLog.java:206)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.initEditLog(FSImage.java:657)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:590)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:544)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:423)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:385)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:401)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:435)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:611)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:592)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1135)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1201)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1249)
> ... 14 more
> Caused by: java.io.IOException: Error initializing zk
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:233)
> ... 19 more
> Caused by: hidden.bkjournal.org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /hdfsjournal/version
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at hidden.bkjournal.org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778)
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:222)
> ... 19 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4154) Two namenodes usng bkjm can race to
create the version znode
Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13497955#comment-13497955 ]
Uma Maheswara Rao G commented on HDFS-4154:
-------------------------------------------
Yeah, Thanks Ivan for catching it. I think simply handling Node exist should be fine right?
> Two namenodes usng bkjm can race to create the version znode
> ------------------------------------------------------------
>
> Key: HDFS-4154
> URL: https://issues.apache.org/jira/browse/HDFS-4154
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha
> Affects Versions: 3.0.0, 2.0.3-alpha
> Reporter: Ivan Kelly
> Assignee: Ivan Kelly
>
> nd one will get the following error.
> 2012-11-06 10:04:00,200 INFO hidden.bkjournal.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 109-231-69-172.flexiscale.com/109.231.69.172:2181, sessionid = 0x13ad528fcfe0005, negotiated timeout = 4000
> 2012-11-06 10:04:00,710 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
> java.lang.IllegalArgumentException: Unable to construct journal, bookkeeper://109.231.69.172:2181;109.231.69.173:2181;109.231.69.174:2181/hdfsjournal
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1251)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:226)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initSharedJournalsForRead(FSEditLog.java:206)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.initEditLog(FSImage.java:657)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:590)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:544)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:423)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:385)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:401)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:435)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:611)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:592)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1135)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1201)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1249)
> ... 14 more
> Caused by: java.io.IOException: Error initializing zk
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:233)
> ... 19 more
> Caused by: hidden.bkjournal.org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /hdfsjournal/version
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at hidden.bkjournal.org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778)
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:222)
> ... 19 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4154) BKJM: Two namenodes usng bkjm can
race to create the version znode
Posted by "Ivan Kelly (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498998#comment-13498998 ]
Ivan Kelly commented on HDFS-4154:
----------------------------------
[~umamaheswararao] Yes, it's very straightforward to fix.
[~yians] It would be great if you did that :)
> BKJM: Two namenodes usng bkjm can race to create the version znode
> ------------------------------------------------------------------
>
> Key: HDFS-4154
> URL: https://issues.apache.org/jira/browse/HDFS-4154
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha
> Affects Versions: 3.0.0, 2.0.3-alpha
> Reporter: Ivan Kelly
> Assignee: Ivan Kelly
>
> nd one will get the following error.
> 2012-11-06 10:04:00,200 INFO hidden.bkjournal.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 109-231-69-172.flexiscale.com/109.231.69.172:2181, sessionid = 0x13ad528fcfe0005, negotiated timeout = 4000
> 2012-11-06 10:04:00,710 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
> java.lang.IllegalArgumentException: Unable to construct journal, bookkeeper://109.231.69.172:2181;109.231.69.173:2181;109.231.69.174:2181/hdfsjournal
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1251)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:226)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initSharedJournalsForRead(FSEditLog.java:206)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.initEditLog(FSImage.java:657)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:590)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:544)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:423)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:385)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:401)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:435)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:611)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:592)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1135)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1201)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1249)
> ... 14 more
> Caused by: java.io.IOException: Error initializing zk
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:233)
> ... 19 more
> Caused by: hidden.bkjournal.org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /hdfsjournal/version
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at hidden.bkjournal.org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778)
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:222)
> ... 19 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-4154) Two namenodes usng bkjm can race to
create the version znode
Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uma Maheswara Rao G updated HDFS-4154:
--------------------------------------
Fix Version/s: (was: 2.0.3-alpha)
(was: 3.0.0)
> Two namenodes usng bkjm can race to create the version znode
> ------------------------------------------------------------
>
> Key: HDFS-4154
> URL: https://issues.apache.org/jira/browse/HDFS-4154
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha
> Affects Versions: 3.0.0, 2.0.3-alpha
> Reporter: Ivan Kelly
> Assignee: Ivan Kelly
>
> nd one will get the following error.
> 2012-11-06 10:04:00,200 INFO hidden.bkjournal.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 109-231-69-172.flexiscale.com/109.231.69.172:2181, sessionid = 0x13ad528fcfe0005, negotiated timeout = 4000
> 2012-11-06 10:04:00,710 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
> java.lang.IllegalArgumentException: Unable to construct journal, bookkeeper://109.231.69.172:2181;109.231.69.173:2181;109.231.69.174:2181/hdfsjournal
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1251)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:226)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initSharedJournalsForRead(FSEditLog.java:206)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.initEditLog(FSImage.java:657)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:590)
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:544)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:423)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:385)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:401)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:435)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:611)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:592)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1135)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1201)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1249)
> ... 14 more
> Caused by: java.io.IOException: Error initializing zk
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:233)
> ... 19 more
> Caused by: hidden.bkjournal.org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /hdfsjournal/version
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at hidden.bkjournal.org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778)
> at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:222)
> ... 19 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira