You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Vijay Srinivasan (Created) (JIRA)" <ji...@apache.org> on 2012/03/17 23:54:38 UTC
[jira] [Created] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode doesnt
start after installing the deb package
Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
---------------------------------------------------------------------------
Key: BIGTOP-457
URL: https://issues.apache.org/jira/browse/BIGTOP-457
Project: Bigtop
Issue Type: Bug
Reporter: Vijay Srinivasan
After hadoop installation using bigtop 0.3.0, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode doesnt
start after installing the deb package
Posted by "Vijay Srinivasan (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vijay Srinivasan updated BIGTOP-457:
------------------------------------
Attachment: (was: BT457.patch)
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Attachments: BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode
doesnt start after installing the deb package
Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233505#comment-13233505 ]
Roman Shaposhnik commented on BIGTOP-457:
-----------------------------------------
+1. Commited.
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Assignee: James Page
> Attachments: BIGTOP-457.patch, BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode
doesnt start after installing the deb package
Posted by "Vijay Srinivasan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233331#comment-13233331 ]
Vijay Srinivasan commented on BIGTOP-457:
-----------------------------------------
Thanks James.. I tried with the group permission change and it works for deb packages..
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Assignee: James Page
> Attachments: BIGTOP-457.patch, BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode
doesnt start after installing the deb package
Posted by "James Page (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233323#comment-13233323 ]
James Page commented on BIGTOP-457:
-----------------------------------
Ignore my previous comment...
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Assignee: James Page
> Attachments: BIGTOP-457.patch, BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode doesnt
start after installing the deb package
Posted by "Vijay Srinivasan (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vijay Srinivasan updated BIGTOP-457:
------------------------------------
Attachment: BT457.patch
Attaching the patch to create the /var/lib/hadoop/cache/hadoop/dfs directory and set the permissions in the postinst script.. Please review..
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Attachments: BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode doesnt
start after installing the deb package
Posted by "James Page (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Page updated BIGTOP-457:
------------------------------
Attachment: BIGTOP-457.patch
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Attachments: BIGTOP-457.patch, BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode
doesnt start after installing the deb package
Posted by "James Page (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233315#comment-13233315 ]
James Page commented on BIGTOP-457:
-----------------------------------
Revised patch attached based on my previous comment.
I also tidied up the formatting in hadoop.postinst as it was a bit ugly.
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Assignee: James Page
> Attachments: BIGTOP-457.patch, BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode doesnt
start after installing the deb package
Posted by "Vijay Srinivasan (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vijay Srinivasan updated BIGTOP-457:
------------------------------------
Attachment: BT457.patch
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Attachments: BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode
doesnt start after installing the deb package
Posted by "James Page (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233322#comment-13233322 ]
James Page commented on BIGTOP-457:
-----------------------------------
You can see this in the RPM SPEC for hadoop-conf-pseudo.
%dir %attr(0755,root,hadoop) /var/lib/%{name}
Makes me wonder whether this should be done in that package instead? although this does look like a suitable postinst step for hadoop core.
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Assignee: James Page
> Attachments: BIGTOP-457.patch, BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode
doesnt start after installing the deb package
Posted by "James Page (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233518#comment-13233518 ]
James Page commented on BIGTOP-457:
-----------------------------------
Thanks Roman!
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Assignee: James Page
> Attachments: BIGTOP-457.patch, BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode doesnt
start after installing the deb package
Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-457:
------------------------------------
Fix Version/s: 0.3.0
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Assignee: James Page
> Fix For: 0.3.0
>
> Attachments: BIGTOP-457.patch, BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode
doesnt start after installing the deb package
Posted by "Vijay Srinivasan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233294#comment-13233294 ]
Vijay Srinivasan commented on BIGTOP-457:
-----------------------------------------
Following is the error seen after installing hadoop and formatting namenode:
$ sudo -u hdfs hadoop namenode -format
12/03/20 00:03:00 INFO namenode.FSNamesystem: supergroup=supergroup
12/03/20 00:03:00 INFO namenode.FSNamesystem: isPermissionEnabled=false
12/03/20 00:03:00 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100
12/03/20 00:03:00 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
12/03/20 00:03:00 INFO namenode.NameNode: Caching file names occuring more than 10 times
12/03/20 00:03:00 ERROR namenode.NameNode: java.io.IOException: Cannot create directory /var/lib/hadoop/cache/hadoop/dfs/name/current
at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:297)
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode
doesnt start after installing the deb package
Posted by "James Page (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233304#comment-13233304 ]
James Page commented on BIGTOP-457:
-----------------------------------
I think the issue is that /var/lib/hadoop/cache/hadoop is not group writable and is owned by root.
The directory should be created by the namenode -format command.
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
> Attachments: BT457.patch
>
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-457) Bigtop 0.3.0: Hadoop namenode doesnt
start after installing the deb package
Posted by "Vijay Srinivasan (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vijay Srinivasan updated BIGTOP-457:
------------------------------------
Description:
After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
was:
After hadoop installation using bigtop 0.3.0, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
> Bigtop 0.3.0: Hadoop namenode doesnt start after installing the deb package
> ---------------------------------------------------------------------------
>
> Key: BIGTOP-457
> URL: https://issues.apache.org/jira/browse/BIGTOP-457
> Project: Bigtop
> Issue Type: Bug
> Reporter: Vijay Srinivasan
>
> After hadoop installation using bigtop 0.3.0 deb package on ubuntu lucid, the /var/lib/hadoop/cache/hadoop/dfs directory wasn't created and I had to create it manually to get the namenode to start.. Dont see this directory being created in the hadoop postinstall script.. Maybe it is missing for hadoop 1.0x ?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira