You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2008/09/22 13:56:44 UTC
[jira] Created: (HADOOP-4239) [mapred] Job submission to an invalid
queue should fail.
[mapred] Job submission to an invalid queue should fail.
--------------------------------------------------------
Key: HADOOP-4239
URL: https://issues.apache.org/jira/browse/HADOOP-4239
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.19.0
Reporter: Vinod K V
Fix For: 0.19.0
If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4239) [mapred] Job submission to an invalid
queue should fail.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-4239:
--------------------------------
Fix Version/s: (was: 0.19.0)
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Hemanth Yamijala
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4239) [mapred] Job submission to an
invalid queue should fail.
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12648551#action_12648551 ]
Vinod K V commented on HADOOP-4239:
-----------------------------------
Why can't we just let the JobTracker reject jobs that are submitted to invalid queues? That is what is done when the situation happens with ACLs enabled. Queues reside with the core framework, so I think JT can reject them right away even before the schedulers are informed. No?
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Fix For: 0.20.0
>
> Attachments: HADOOP-4239-v2.patch
>
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-4239) [mapred] Job submission to an
invalid queue should fail.
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat reassigned HADOOP-4239:
----------------------------------
Assignee: Amar Kamat (was: Hemanth Yamijala)
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Fix For: 0.20.0
>
> Attachments: HADOOP-4239-v2.patch
>
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4239) [mapred] Job submission to an invalid
queue should fail.
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-4239:
-------------------------------
Attachment: HADOOP-4239-v2.patch
Attaching a patch that does the following
- Allows {{JobInProgressListener.jobAdded()}} to throw an exception
- If {{jobAdded}} fails for any listener then the job is failed and all the listeners are informed about it. The reason the job is _failed_ is because job files should be cleaned up and also the user can check the job's status offline.
Added a testcase to test if job submission works as expected.
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: HADOOP-4239-v2.patch
>
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4239) [mapred] Job submission to an invalid
queue should fail.
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V updated HADOOP-4239:
------------------------------
Fix Version/s: 0.19.0
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Hemanth Yamijala
> Priority: Blocker
> Fix For: 0.19.0
>
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-4239) [mapred] Job submission to an
invalid queue should fail.
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala reassigned HADOOP-4239:
----------------------------------------
Assignee: Hemanth Yamijala
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Hemanth Yamijala
> Fix For: 0.19.0
>
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4239) [mapred] Job submission to an
invalid queue should fail.
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12648560#action_12648560 ]
Amar Kamat commented on HADOOP-4239:
------------------------------------
Vinod, I have tried implementing a general way to reject jobs. There can be many reasons for not accepting a job like _invalid-queue, missing files, blacklisted users, blocked queue_ etc. In any case if a listener throws an exception the framework will simply reject the job. I thought that way the contract is clear and also the solution is generic.
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Fix For: 0.20.0
>
> Attachments: HADOOP-4239-v2.patch
>
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4239) [mapred] Job submission to an invalid
queue should fail.
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated HADOOP-4239:
-------------------------------------
Priority: Major (was: Blocker)
Fix Version/s: (was: 0.19.0)
0.20.0
This is an improvement in terms of more robust error handling. I think it need not make the Hadoop 0.19 release.
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4239) [mapred] Job submission to an invalid
queue should fail.
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V updated HADOOP-4239:
------------------------------
Priority: Blocker (was: Major)
> [mapred] Job submission to an invalid queue should fail.
> --------------------------------------------------------
>
> Key: HADOOP-4239
> URL: https://issues.apache.org/jira/browse/HADOOP-4239
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Hemanth Yamijala
> Priority: Blocker
>
> If ACLs are enabled, this case is handled, though not with a clear message to the user. Job submission to an invalid queue should be detected and dealt with. Irrespective of ACLs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.