You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2008/09/22 13:26:44 UTC
[jira] Created: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
[mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
----------------------------------------------------------------------------------------
Key: HADOOP-4238
URL: https://issues.apache.org/jira/browse/HADOOP-4238
Project: Hadoop Core
Issue Type: Bug
Affects Versions: 0.19.0
Reporter: Vinod K V
Fix For: 0.19.0
When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V updated HADOOP-4238:
------------------------------
Hadoop Flags: [Reviewed]
Status: Patch Available (was: Open)
+ for the patch. Running it through Hudson.
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-4238:
-------------------------------------------
Attachment: HADOOP-4238-2.patch
Attaching patch removing the JspUtil check.
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated HADOOP-4238:
-------------------------------------
Priority: Major (was: Blocker)
Fix Version/s: (was: 0.19.0)
0.20.0
This is a minor UI enhancement, and not a blocker for Hadoop 0.19, IMHO.
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V updated HADOOP-4238:
------------------------------
Fix Version/s: 0.19.0
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V updated HADOOP-4238:
------------------------------
Priority: Blocker (was: Major)
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Priority: Blocker
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Johan Oskarsson updated HADOOP-4238:
------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Just committed this. Thanks, Sreekanth!
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-4238:
-------------------------------------------
Attachment: HADOOP-4238-1.patch
Currently all the columns are tab separated. So the tab separation does not align the column in a proper manner because we are relying on the system tab width and width of the text which is being printed on to the console.
I am attaching the patch by initializing the _schedulingInfo_ in the _JobStatus_ to _NA_. So this should print _schedulingInfo_ column of jobs which have none appear as "NA"
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12633217#action_12633217 ]
Vinod K V commented on HADOOP-4238:
-----------------------------------
I meant "hadoop job -list [all]".
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.19.0
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12634375#action_12634375 ]
Vinod K V commented on HADOOP-4238:
-----------------------------------
bq. initializing the schedulingInfo in the JobStatus to NA
In that case, we can remove the empty string checks for JobStatus.schedulingInfo (JspUtil.java +146).
Irrespective of this, the output will become a lot cleaner if we fix the column alignment issue. Will file a JIRA for that.
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636528#action_12636528 ]
Vinod K V commented on HADOOP-4238:
-----------------------------------
bq. the output will become a lot cleaner if we fix the column alignment issue. Will file a JIRA for that.
The output doesn't look too bad after this patch, fixing columns is less important now; it can wait for later.
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala reassigned HADOOP-4238:
----------------------------------------
Assignee: Sreekanth Ramakrishnan
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.19.0
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636553#action_12636553 ]
Sreekanth Ramakrishnan commented on HADOOP-4238:
------------------------------------------------
The core test failing are not related to this patch. The reason why this patch does not contain any test is because it is a trivial change to scheduling info string in Job status.
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-4238:
--------------------------------
Fix Version/s: (was: 0.19.0)
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636550#action_12636550 ]
Hadoop QA commented on HADOOP-4238:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12390904/HADOOP-4238-2.patch
against trunk revision 701273.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3426/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3426/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3426/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3426/console
This message is automatically generated.
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12634385#action_12634385 ]
Sreekanth Ramakrishnan commented on HADOOP-4238:
------------------------------------------------
Fixing the column with alignment can break the existing script which might dependent on the tab delimited values which are currently being generated by the script. Making any changes or making it fixed with table would mean rewriting parsing logic which scripts might currently use today. Plus this would mean that we would have to make assumptions on length of the scheduling information on a particular job or other attributes which are currently being displayed.
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.19.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4238) [mapred] Unavailable schedulingInfo
in "hadoop list [all]" output should be marked "N/A"
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642303#action_12642303 ]
Hudson commented on HADOOP-4238:
--------------------------------
Integrated in Hadoop-trunk #640 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/640/])
> [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-4238
> URL: https://issues.apache.org/jira/browse/HADOOP-4238
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.0
>
> Attachments: HADOOP-4238-1.patch, HADOOP-4238-2.patch
>
>
> When schedulingInfo is not available for a job, "hadoop list [all]" doesn't print anything. This, combined with the fact that the columns are not aligned properly, makes it difficult to comprehend the output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.