You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2008/07/02 22:41:44 UTC
[jira] Created: (PIG-286) local mode is broken
local mode is broken
--------------------
Key: PIG-286
URL: https://issues.apache.org/jira/browse/PIG-286
Project: Pig
Issue Type: Bug
Affects Versions: types_branch
Reporter: Olga Natkovich
Assignee: Alan Gates
Any query I ran in the local mode fails with the following error(s):
2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-286) local mode is broken
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shravan Matthur Narayanamurthy updated PIG-286:
-----------------------------------------------
Attachment: localmode.patch
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
> Attachments: localmode.patch, TestCombiner.java
>
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-286) local mode is broken
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611331#action_12611331 ]
Olga Natkovich commented on PIG-286:
------------------------------------
did you try to run an end-to-end test on a real cluster? Maybe MiniCluster works somewhat different than real cluster
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
> Attachments: TestCombiner.java
>
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-286) local mode is broken
Posted by "Santhosh Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Santhosh Srinivasan updated PIG-286:
------------------------------------
Fix Version/s: types_branch
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: localmode.patch, TestCombiner.java
>
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-286) local mode is broken
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shravan Matthur Narayanamurthy updated PIG-286:
-----------------------------------------------
Status: Patch Available (was: Open)
The local launcher has to make sure the local filesystem is used. So the job config created should have the "fs.default.name" set to "file:///"
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
> Attachments: localmode.patch, TestCombiner.java
>
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-286) local mode is broken
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611266#action_12611266 ]
Olga Natkovich commented on PIG-286:
------------------------------------
I think you will see it if you run any end-to-end test in the local mode.
I ran the following:
a = load 'studenttab10k' as (name, age, gpa);
store a into 'bar';
and see the following error with the latest code:
2008-07-07 11:25:35,893 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
2008-07-07 11:25:37,242 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2008-07-07 11:25:37,747 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
2008-07-07 11:25:37,747 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-286) local mode is broken
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12612334#action_12612334 ]
Olga Natkovich commented on PIG-286:
------------------------------------
I am still seeing exactly the same problem
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: localmode.patch, TestCombiner.java
>
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-286) local mode is broken
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611341#action_12611341 ]
Shravan Matthur Narayanamurthy commented on PIG-286:
----------------------------------------------------
Okie... will try that and chk what the issue is
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
> Attachments: TestCombiner.java
>
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-286) local mode is broken
Posted by "Alan Gates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alan Gates updated PIG-286:
---------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Issue fixed by combiner.patch for issue PIG-331.
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: localmode.patch, TestCombiner.java
>
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (PIG-286) local mode is broken
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shravan Matthur Narayanamurthy reassigned PIG-286:
--------------------------------------------------
Assignee: Shravan Matthur Narayanamurthy (was: Alan Gates)
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-286) local mode is broken
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shravan Matthur Narayanamurthy updated PIG-286:
-----------------------------------------------
Attachment: TestCombiner.java
I think I am missing something here. I wrote the same thing in the attached file TestCombiner.java and it works.
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
> Attachments: TestCombiner.java
>
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-286) local mode is broken
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611256#action_12611256 ]
Shravan Matthur Narayanamurthy commented on PIG-286:
----------------------------------------------------
There is already a test case TestCombiner which tests the local functionality and is passing. I tried doing some other tests & could not replicate the issue. Can I get a TestCase for this?
> local mode is broken
> --------------------
>
> Key: PIG-286
> URL: https://issues.apache.org/jira/browse/PIG-286
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Shravan Matthur Narayanamurthy
>
> Any query I ran in the local mode fails with the following error(s):
> 2008-07-02 13:37:52,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2008-07-02 13:37:54,119 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2008-07-02 13:37:54,625 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-02 13:37:54,637 [main] INFO org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed 0.0% of the job
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.