You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Xu Zhang (JIRA)" <ji...@apache.org> on 2008/01/09 05:52:33 UTC
[jira] Created: (PIG-57) NullPointerException occasionally
NullPointerException occasionally
---------------------------------
Key: PIG-57
URL: https://issues.apache.org/jira/browse/PIG-57
Project: Pig
Issue Type: Bug
Components: impl
Reporter: Xu Zhang
+ echo
====================================================================
====================================================================
+ echo 'Running PIG Word Count Job'
Running PIG Word Count Job
+ echo
====================================================================
====================================================================
+ echo ''
+ echo ''
+ ssh xxxxxxx 'bash -lc '\''/home/y/bin/pig -Dhod.param="-m 5" -f ~/
validation/bin/wordcount-pig ; /export/crawlspace/kryptonite/
hadoop/dfs/current/bin/hadoop dfs -copyToLocal /user/hadoopqa/
validation/data/pigWordCountOutput/part-00000 ~/validation/output/
pigWordCountOutput.txt'\'''
2008-01-08 06:14:24,558 [main] INFO org.apache.pig - Connecting to
HOD...
2008-01-08 06:14:29,732 [main] INFO org.apache.pig - HDFS Web UI:
kry-nn1.inktomisearch.com:50070
2008-01-08 06:14:29,732 [main] INFO org.apache.pig - JobTracker Web
UI: kry50541:54597
2008-01-08 06:14:29,846 [main] FATAL org.apache.pig - Could not
connect to HOD
java.lang.NullPointerException
at org.apache.pig.impl.PigContext.fixUpDomain(PigContext.java:350)
at org.apache.pig.impl.PigContext.doHod(PigContext.java:324)
at org.apache.pig.impl.PigContext.connect(PigContext.java:175)
at org.apache.pig.PigServer.<init>(PigServer.java:128)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:37)
at org.apache.pig.Main.main(Main.java:212)
+ echo ''
+ echo ''
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (PIG-57) Occasional NullPointerException in
PigContext.fixUpDomain method
Posted by "Alan Gates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alan Gates resolved PIG-57.
---------------------------
Resolution: Fixed
Issue fixed with patch provided by francisoud (thank you).
> Occasional NullPointerException in PigContext.fixUpDomain method
> ----------------------------------------------------------------
>
> Key: PIG-57
> URL: https://issues.apache.org/jira/browse/PIG-57
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Xu Zhang
> Attachments: PIG-57-v01.patch
>
>
> I occasionally see the following NPE when running a Pig job with HOD:
> 2008-01-08 06:14:24,558 [main] INFO org.apache.pig - Connecting to HOD...
> 2008-01-08 06:14:29,732 [main] INFO org.apache.pig - HDFS Web UI: nn-host:50070
> 2008-01-08 06:14:29,732 [main] INFO org.apache.pig - JobTracker Web UI: jt-host:54597
> 2008-01-08 06:14:29,846 [main] FATAL org.apache.pig - Could not connect to HOD
> java.lang.NullPointerException
> at org.apache.pig.impl.PigContext.fixUpDomain(PigContext.java:350)
> at org.apache.pig.impl.PigContext.doHod(PigContext.java:324)
> at org.apache.pig.impl.PigContext.connect(PigContext.java:175)
> at org.apache.pig.PigServer.<init>(PigServer.java:128)
> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:37)
> at org.apache.pig.Main.main(Main.java:212)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-57) Occasional NullPointerException in
PigContext.fixUpDomain method
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated PIG-57:
---------------------------
Description:
I occasionally see the following NPE when running a Pig job with HOD:
2008-01-08 06:14:24,558 [main] INFO org.apache.pig - Connecting to HOD...
2008-01-08 06:14:29,732 [main] INFO org.apache.pig - HDFS Web UI: nn-host:50070
2008-01-08 06:14:29,732 [main] INFO org.apache.pig - JobTracker Web UI: jt-host:54597
2008-01-08 06:14:29,846 [main] FATAL org.apache.pig - Could not connect to HOD
java.lang.NullPointerException
at org.apache.pig.impl.PigContext.fixUpDomain(PigContext.java:350)
at org.apache.pig.impl.PigContext.doHod(PigContext.java:324)
at org.apache.pig.impl.PigContext.connect(PigContext.java:175)
at org.apache.pig.PigServer.<init>(PigServer.java:128)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:37)
at org.apache.pig.Main.main(Main.java:212)
was:
+ echo
====================================================================
====================================================================
+ echo 'Running PIG Word Count Job'
Running PIG Word Count Job
+ echo
====================================================================
====================================================================
+ echo ''
+ echo ''
+ ssh xxxxxxx 'bash -lc '\''/home/y/bin/pig -Dhod.param="-m 5" -f ~/
validation/bin/wordcount-pig ; /export/crawlspace/kryptonite/
hadoop/dfs/current/bin/hadoop dfs -copyToLocal /user/hadoopqa/
validation/data/pigWordCountOutput/part-00000 ~/validation/output/
pigWordCountOutput.txt'\'''
2008-01-08 06:14:24,558 [main] INFO org.apache.pig - Connecting to
HOD...
2008-01-08 06:14:29,732 [main] INFO org.apache.pig - HDFS Web UI:
kry-nn1.inktomisearch.com:50070
2008-01-08 06:14:29,732 [main] INFO org.apache.pig - JobTracker Web
UI: kry50541:54597
2008-01-08 06:14:29,846 [main] FATAL org.apache.pig - Could not
connect to HOD
java.lang.NullPointerException
at org.apache.pig.impl.PigContext.fixUpDomain(PigContext.java:350)
at org.apache.pig.impl.PigContext.doHod(PigContext.java:324)
at org.apache.pig.impl.PigContext.connect(PigContext.java:175)
at org.apache.pig.PigServer.<init>(PigServer.java:128)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:37)
at org.apache.pig.Main.main(Main.java:212)
+ echo ''
+ echo ''
Summary: Occasional NullPointerException in PigContext.fixUpDomain method (was: NullPointerException occasionally)
> Occasional NullPointerException in PigContext.fixUpDomain method
> ----------------------------------------------------------------
>
> Key: PIG-57
> URL: https://issues.apache.org/jira/browse/PIG-57
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Xu Zhang
>
> I occasionally see the following NPE when running a Pig job with HOD:
> 2008-01-08 06:14:24,558 [main] INFO org.apache.pig - Connecting to HOD...
> 2008-01-08 06:14:29,732 [main] INFO org.apache.pig - HDFS Web UI: nn-host:50070
> 2008-01-08 06:14:29,732 [main] INFO org.apache.pig - JobTracker Web UI: jt-host:54597
> 2008-01-08 06:14:29,846 [main] FATAL org.apache.pig - Could not connect to HOD
> java.lang.NullPointerException
> at org.apache.pig.impl.PigContext.fixUpDomain(PigContext.java:350)
> at org.apache.pig.impl.PigContext.doHod(PigContext.java:324)
> at org.apache.pig.impl.PigContext.connect(PigContext.java:175)
> at org.apache.pig.PigServer.<init>(PigServer.java:128)
> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:37)
> at org.apache.pig.Main.main(Main.java:212)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-57) Occasional NullPointerException in
PigContext.fixUpDomain method
Posted by "Benjamin Francisoud (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benjamin Francisoud updated PIG-57:
-----------------------------------
Attachment: PIG-57-v01.patch
This patch:
* fix the NPE by returning null if parameter is null (does throwing a IllegalArgumentException seems better to you ?)
* throws an IllegalArgumentException if parameter doesn't match host:port pattern providing a better error message
* add javadoc to the method
* add a FIXME about not hardcoding ".inktomisearch.com" in the code (not sure anyone else than yahoo could be interested in this 'feature' ;) )
> Occasional NullPointerException in PigContext.fixUpDomain method
> ----------------------------------------------------------------
>
> Key: PIG-57
> URL: https://issues.apache.org/jira/browse/PIG-57
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Xu Zhang
> Attachments: PIG-57-v01.patch
>
>
> I occasionally see the following NPE when running a Pig job with HOD:
> 2008-01-08 06:14:24,558 [main] INFO org.apache.pig - Connecting to HOD...
> 2008-01-08 06:14:29,732 [main] INFO org.apache.pig - HDFS Web UI: nn-host:50070
> 2008-01-08 06:14:29,732 [main] INFO org.apache.pig - JobTracker Web UI: jt-host:54597
> 2008-01-08 06:14:29,846 [main] FATAL org.apache.pig - Could not connect to HOD
> java.lang.NullPointerException
> at org.apache.pig.impl.PigContext.fixUpDomain(PigContext.java:350)
> at org.apache.pig.impl.PigContext.doHod(PigContext.java:324)
> at org.apache.pig.impl.PigContext.connect(PigContext.java:175)
> at org.apache.pig.PigServer.<init>(PigServer.java:128)
> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:37)
> at org.apache.pig.Main.main(Main.java:212)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-57) Occasional NullPointerException in
PigContext.fixUpDomain method
Posted by "Alan Gates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alan Gates updated PIG-57:
--------------------------
Fix Version/s: 0.1.0
> Occasional NullPointerException in PigContext.fixUpDomain method
> ----------------------------------------------------------------
>
> Key: PIG-57
> URL: https://issues.apache.org/jira/browse/PIG-57
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Xu Zhang
> Fix For: 0.1.0
>
> Attachments: PIG-57-v01.patch
>
>
> I occasionally see the following NPE when running a Pig job with HOD:
> 2008-01-08 06:14:24,558 [main] INFO org.apache.pig - Connecting to HOD...
> 2008-01-08 06:14:29,732 [main] INFO org.apache.pig - HDFS Web UI: nn-host:50070
> 2008-01-08 06:14:29,732 [main] INFO org.apache.pig - JobTracker Web UI: jt-host:54597
> 2008-01-08 06:14:29,846 [main] FATAL org.apache.pig - Could not connect to HOD
> java.lang.NullPointerException
> at org.apache.pig.impl.PigContext.fixUpDomain(PigContext.java:350)
> at org.apache.pig.impl.PigContext.doHod(PigContext.java:324)
> at org.apache.pig.impl.PigContext.connect(PigContext.java:175)
> at org.apache.pig.PigServer.<init>(PigServer.java:128)
> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:37)
> at org.apache.pig.Main.main(Main.java:212)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.