You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Kirk True (JIRA)" <ji...@apache.org> on 2010/03/17 01:37:30 UTC
[jira] Created: (CHUKWA-465) Misconfiguration leads to
NullPointerException in code
Misconfiguration leads to NullPointerException in code
------------------------------------------------------
Key: CHUKWA-465
URL: https://issues.apache.org/jira/browse/CHUKWA-465
Project: Hadoop Chukwa
Issue Type: Bug
Components: Data Processors
Affects Versions: 0.4.0
Environment: OS:
Fedora 12
Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
Java:
java version "1.6.0_18"
Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)
Reporter: Kirk True
Priority: Minor
I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:
----------------------------------------------
2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)
2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154
----------------------------------------------
The problem is here:
String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.
*Note*: I got this code from trunk, revision 924074.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-465) Misconfiguration leads to
NullPointerException in PostProcessorManager
Posted by "Kirk True (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kirk True updated CHUKWA-465:
-----------------------------
Summary: Misconfiguration leads to NullPointerException in PostProcessorManager (was: Misconfiguration leads to NullPointerException in code)
> Misconfiguration leads to NullPointerException in PostProcessorManager
> ----------------------------------------------------------------------
>
> Key: CHUKWA-465
> URL: https://issues.apache.org/jira/browse/CHUKWA-465
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Affects Versions: 0.4.0
> Environment: OS:
> Fedora 12
> Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
> Java:
> java version "1.6.0_18"
> Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
> Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)
> Reporter: Kirk True
> Priority: Minor
>
> I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:
> ----------------------------------------------
> 2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)
> 2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154
> ----------------------------------------------
> The problem is here:
> String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
> In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.
> *Note*: I got this code from trunk, revision 924074.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-465) Misconfiguration leads to
NullPointerException in PostProcessorManager
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12846260#action_12846260 ]
Ari Rabkin commented on CHUKWA-465:
-----------------------------------
Good catch. The right fix, I think, is to add a default value for that field.
> Misconfiguration leads to NullPointerException in PostProcessorManager
> ----------------------------------------------------------------------
>
> Key: CHUKWA-465
> URL: https://issues.apache.org/jira/browse/CHUKWA-465
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Affects Versions: 0.4.0
> Environment: OS:
> Fedora 12
> Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
> Java:
> java version "1.6.0_18"
> Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
> Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)
> Reporter: Kirk True
> Priority: Minor
>
> I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:
> ----------------------------------------------
> 2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)
> 2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154
> ----------------------------------------------
> The problem is here:
> String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
> In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.
> *Note*: I got this code from trunk, revision 924074.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-465) Misconfiguration leads to
NullPointerException in PostProcessorManager
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857423#action_12857423 ]
Hudson commented on CHUKWA-465:
-------------------------------
Integrated in Chukwa-trunk #343 (See [http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/343/])
CHUKWA-465. Setup default value for Post Demux Data Loader. (Ahmed Fathalla via Eric Yang)
CHUKWA-465. Setup default value for Post Demux Data Loader. (Ahmed Fathalla via Eric Yang)
> Misconfiguration leads to NullPointerException in PostProcessorManager
> ----------------------------------------------------------------------
>
> Key: CHUKWA-465
> URL: https://issues.apache.org/jira/browse/CHUKWA-465
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Affects Versions: 0.4.0
> Environment: OS:
> Fedora 12
> Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
> Java:
> java version "1.6.0_18"
> Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
> Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)
> Reporter: Kirk True
> Priority: Minor
> Attachments: CHUKWA-465.patch
>
>
> I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:
> ----------------------------------------------
> 2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)
> 2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154
> ----------------------------------------------
> The problem is here:
> String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
> In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.
> *Note*: I got this code from trunk, revision 924074.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (CHUKWA-465) Misconfiguration leads to
NullPointerException in PostProcessorManager
Posted by "Ahmed Fathalla (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Fathalla updated CHUKWA-465:
----------------------------------
Status: Patch Available (was: Open)
Fixed the problem by changing line
String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
to
String[] classes = conf.get(POST_DEMUX_DATA_LOADER,"org.apache.hadoop.chukwa.dataloader.MetricDataLoaderPool,org.apache.hadoop.chukwa.dataloader.FSMDataLoader").split(",");
> Misconfiguration leads to NullPointerException in PostProcessorManager
> ----------------------------------------------------------------------
>
> Key: CHUKWA-465
> URL: https://issues.apache.org/jira/browse/CHUKWA-465
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Affects Versions: 0.4.0
> Environment: OS:
> Fedora 12
> Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
> Java:
> java version "1.6.0_18"
> Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
> Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)
> Reporter: Kirk True
> Priority: Minor
>
> I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:
> ----------------------------------------------
> 2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)
> 2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154
> ----------------------------------------------
> The problem is here:
> String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
> In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.
> *Note*: I got this code from trunk, revision 924074.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CHUKWA-465) Misconfiguration leads to
NullPointerException in PostProcessorManager
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857397#action_12857397 ]
Eric Yang commented on CHUKWA-465:
----------------------------------
+1 looks good.
> Misconfiguration leads to NullPointerException in PostProcessorManager
> ----------------------------------------------------------------------
>
> Key: CHUKWA-465
> URL: https://issues.apache.org/jira/browse/CHUKWA-465
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Affects Versions: 0.4.0
> Environment: OS:
> Fedora 12
> Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
> Java:
> java version "1.6.0_18"
> Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
> Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)
> Reporter: Kirk True
> Priority: Minor
> Attachments: CHUKWA-465.patch
>
>
> I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:
> ----------------------------------------------
> 2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)
> 2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154
> ----------------------------------------------
> The problem is here:
> String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
> In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.
> *Note*: I got this code from trunk, revision 924074.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (CHUKWA-465) Misconfiguration leads to
NullPointerException in PostProcessorManager
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-465:
-----------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
I just committed this, thanks Ahmed.
> Misconfiguration leads to NullPointerException in PostProcessorManager
> ----------------------------------------------------------------------
>
> Key: CHUKWA-465
> URL: https://issues.apache.org/jira/browse/CHUKWA-465
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Affects Versions: 0.4.0
> Environment: OS:
> Fedora 12
> Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
> Java:
> java version "1.6.0_18"
> Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
> Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)
> Reporter: Kirk True
> Priority: Minor
> Attachments: CHUKWA-465.patch
>
>
> I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:
> ----------------------------------------------
> 2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)
> 2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154
> ----------------------------------------------
> The problem is here:
> String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
> In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.
> *Note*: I got this code from trunk, revision 924074.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (CHUKWA-465) Misconfiguration leads to
NullPointerException in PostProcessorManager
Posted by "Ahmed Fathalla (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Fathalla updated CHUKWA-465:
----------------------------------
Attachment: CHUKWA-465.patch
Here is the patch file.
> Misconfiguration leads to NullPointerException in PostProcessorManager
> ----------------------------------------------------------------------
>
> Key: CHUKWA-465
> URL: https://issues.apache.org/jira/browse/CHUKWA-465
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Affects Versions: 0.4.0
> Environment: OS:
> Fedora 12
> Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
> Java:
> java version "1.6.0_18"
> Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
> Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)
> Reporter: Kirk True
> Priority: Minor
> Attachments: CHUKWA-465.patch
>
>
> I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:
> ----------------------------------------------
> 2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
> at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)
> 2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
> 2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154
> ----------------------------------------------
> The problem is here:
> String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");
> In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.
> *Note*: I got this code from trunk, revision 924074.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira