You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Gautam Kowshik (JIRA)" <ji...@apache.org> on 2007/10/01 11:50:50 UTC

[jira] Created: (HADOOP-1973) NPE at JobTracker startup..

NPE at JobTracker startup..
---------------------------

                 Key: HADOOP-1973
                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.14.1
            Reporter: Gautam Kowshik



At JT startup a bunch of these were thrown..

2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_kry101692.inktomisearch.com:/127.0.0.1:40205'; reinitializing the tasktracker
2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_kry101682.inktomisearch.com:/127.0.0.1:57935'; reinitializing the tasktracker
2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_kry101898.inktomisearch.com:/127.0.0.1:46305'; reinitializing the tasktracker
2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_kry101984.inktomisearch.com:/127.0.0.1:55988'; reinitializing the tasktracker
2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from 68.180.166.169:47361: error: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
        at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)


... and the JT shutdown. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das reassigned HADOOP-1973:
-----------------------------------

    Assignee: Amareshwari Sri Ramadasu

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Amareshwari Sri Ramadasu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amareshwari Sri Ramadasu updated HADOOP-1973:
---------------------------------------------

    Attachment: patch-1973.txt

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt, patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Gautam Kowshik (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12532386 ] 

Gautam Kowshik commented on HADOOP-1973:
----------------------------------------

this was on trunk.. 

the task trackers try to fetch the FS from JobClient which in effect asks JT for it's correspoding FS.. which wasn't up yet.
This is the exception trace on teh TT

2007-10-03 14:18:21,132 INFO org.apache.hadoop.mapred.TaskTracker: Lost connection to JobTracker [[TT_address]/[TT_IP]:50020].  Retrying...
org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.NullPointerException
        at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

        at org.apache.hadoop.ipc.Client.call(Client.java:470)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
        at org.apache.hadoop.mapred.$Proxy0.getFilesystemName(Unknown Source)
        at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:773)
        at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1179)
        at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1870)


> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: Gautam Kowshik
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HADOOP-1973:
--------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I just committed this. Thanks, Amareshwari!

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt, patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-1973:
----------------------------------


The other issue is that there must be a sleep between retries.

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12535333 ] 

Owen O'Malley commented on HADOOP-1973:
---------------------------------------

I think instead of putting ensureRunning into the protocol, and requiring that the client call it. I'd propose instead that getFileSystemName should check fs == null and throw IllegalStateException. (You actually don't care if the name node is running yet, you just want to get the default file system name.)

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Amareshwari Sri Ramadasu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amareshwari Sri Ramadasu updated HADOOP-1973:
---------------------------------------------

    Status: Patch Available  (was: Open)

I dont see a reason why this caused sort to fail.
I'm submitting the patch which adds ensureRunning RPC for InterTrackerProtocol. 
Now, Tasktracker  will check for jobtracker is running. And then continue offerService.

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Amareshwari Sri Ramadasu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amareshwari Sri Ramadasu updated HADOOP-1973:
---------------------------------------------

    Attachment: patch-1973.txt

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12535521 ] 

Hudson commented on HADOOP-1973:
--------------------------------

Integrated in Hadoop-Nightly #275 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/275/])

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt, patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated HADOOP-1973:
----------------------------------

    Status: Open  (was: Patch Available)

Rather than add {{ensureRunning}} to the {{InterTrackerProtocol}} it's enough to just call {{JobTracker#ensureRunning}} from {{JobTracker#getFilesystemName}}, I'd avoid extending protocols wherever possible.

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Gautam Kowshik (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gautam Kowshik updated HADOOP-1973:
-----------------------------------

    Description: 
At JT startup a bunch of these were thrown.. and the JT shutdown. 

2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
        at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)


  was:

At JT startup a bunch of these were thrown..

2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_kry101692.inktomisearch.com:/127.0.0.1:40205'; reinitializing the tasktracker
2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_kry101682.inktomisearch.com:/127.0.0.1:57935'; reinitializing the tasktracker
2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_kry101898.inktomisearch.com:/127.0.0.1:46305'; reinitializing the tasktracker
2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_kry101984.inktomisearch.com:/127.0.0.1:55988'; reinitializing the tasktracker
2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from 68.180.166.169:47361: error: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
        at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)


... and the JT shutdown. 


> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: Gautam Kowshik
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Gautam Kowshik (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12532389 ] 

Gautam Kowshik commented on HADOOP-1973:
----------------------------------------

let me correct myself from earlier.. the JT does not shutdown after these exceptions.. this problem has no effect on the cluster's health. Only that we see bunch of exceptions till the namenode is fully up with the data nodes registered.

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: Gautam Kowshik
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Re: [jira] Commented: (HADOOP-1973) NPE at JobTracker startup..

Posted by Gautam Kowshik <ga...@yahoo-inc.com>.
Sorry.. this was on trunk.
-G.

Owen O'Malley (JIRA) wrote:
>     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531583 ] 
>
> Owen O'Malley commented on HADOOP-1973:
> ---------------------------------------
>
> Gautam, were you running 0.14 or pre-0.15 when this happened?
>
>   
>> NPE at JobTracker startup..
>> ---------------------------
>>
>>                 Key: HADOOP-1973
>>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>>             Project: Hadoop
>>          Issue Type: Bug
>>          Components: mapred
>>    Affects Versions: 0.14.1
>>            Reporter: Gautam Kowshik
>>
>> At JT startup a bunch of these were thrown.. and the JT shutdown. 
>> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
>> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
>> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
>> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
>> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
>> java.io.IOException: java.lang.NullPointerException
>>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)
>>     
>
>   


[jira] Commented: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531583 ] 

Owen O'Malley commented on HADOOP-1973:
---------------------------------------

Gautam, were you running 0.14 or pre-0.15 when this happened?

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: Gautam Kowshik
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Amareshwari Sri Ramadasu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amareshwari Sri Ramadasu updated HADOOP-1973:
---------------------------------------------

    Status: Patch Available  (was: Open)

I added check for fs==null in getFileSystemName and it throws IllegalStateException if it is null.
Retries on failures has sleep for 5secs already.

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt, patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mukund Madhugiri updated HADOOP-1973:
-------------------------------------

    Fix Version/s: 0.15.0

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Priority: Blocker
>             Fix For: 0.15.0
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mukund Madhugiri updated HADOOP-1973:
-------------------------------------

    Affects Version/s:     (was: 0.14.1)
                       0.15.0

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Priority: Blocker
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mukund Madhugiri updated HADOOP-1973:
-------------------------------------

    Priority: Blocker  (was: Major)

Marking it a blocker. I see it with the sort benchmarks, causing them to fail

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: Gautam Kowshik
>            Priority: Blocker
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1973) NPE at JobTracker startup..

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12535438 ] 

Hadoop QA commented on HADOOP-1973:
-----------------------------------

+1 overall.  Here are the results of testing the latest attachment 
http://issues.apache.org/jira/secure/attachment/12367853/patch-1973.txt
against trunk revision r585366.

    @author +1.  The patch does not contain any @author tags.

    javadoc +1.  The javadoc tool did not generate any warning messages.

    javac +1.  The applied patch does not generate any new compiler warnings.

    findbugs +1.  The patch does not introduce any new Findbugs warnings.

    core tests +1.  The patch passed core unit tests.

    contrib tests +1.  The patch passed contrib unit tests.

Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/961/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/961/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/961/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/961/console

This message is automatically generated.

> NPE at JobTracker startup..
> ---------------------------
>
>                 Key: HADOOP-1973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Gautam Kowshik
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.0
>
>         Attachments: patch-1973.txt, patch-1973.txt
>
>
> At JT startup a bunch of these were thrown.. and the JT shutdown. 
> 2007-10-01 07:48:36,501 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:40205'; reinitializing the tasktracker
> 2007-10-01 07:48:36,504 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:57935'; reinitializing the tasktracker
> 2007-10-01 07:48:36,520 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:46305'; reinitializing the tasktracker
> 2007-10-01 07:48:36,523 WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for '[tracker_address]:/127.0.0.1:55988'; reinitializing the tasktracker
> 2007-10-01 07:48:36,524 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 50020, call getFilesystemName() from [tracker_ip]:47361: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.JobTracker.getFilesystemName(JobTracker.java:1458)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.