You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sling.apache.org by "Carsten Ziegeler (JIRA)" <ji...@apache.org> on 2010/02/10 09:00:28 UTC
[jira] Created: (SLING-1365) Limit the number of parallel jobs
Limit the number of parallel jobs
---------------------------------
Key: SLING-1365
URL: https://issues.apache.org/jira/browse/SLING-1365
Project: Sling
Issue Type: New Feature
Components: Extensions
Affects Versions: Extensions Event 2.1.0
Reporter: Carsten Ziegeler
Assignee: Carsten Ziegeler
Fix For: Extensions Event 2.2.0
Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
We should change the meaning of the parallel property to:
- false: no parallel processing
- a positiv number N : parallel processing with max N jobs in parallel
- anything else: parallel processing
Currently it is:
- false: no parallel processing
- anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SLING-1365) Limit the number of parallel jobs
Posted by "Carsten Ziegeler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831982#action_12831982 ]
Carsten Ziegeler commented on SLING-1365:
-----------------------------------------
Changed the behaviour of ordered queue configuration: the first job for the queue defines if the queue is ordered - otherwise we might get into trouble if some jobs have the ordered property while others don't - revision 908489
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Closed: (SLING-1365) Limit the number of parallel jobs
Posted by "Carsten Ziegeler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carsten Ziegeler closed SLING-1365.
-----------------------------------
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SLING-1365) Limit the number of parallel jobs
Posted by "Carsten Ziegeler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832422#action_12832422 ]
Carsten Ziegeler commented on SLING-1365:
-----------------------------------------
Added more debug logging and fixed the parallel counter and the shutdown order in revision 908879
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SLING-1365) Limit the number of parallel jobs
Posted by "Carsten Ziegeler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831979#action_12831979 ]
Carsten Ziegeler commented on SLING-1365:
-----------------------------------------
Further refactoring of the rescheduling code in revision 908485
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SLING-1365) Limit the number of parallel jobs
Posted by "Carsten Ziegeler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831975#action_12831975 ]
Carsten Ziegeler commented on SLING-1365:
-----------------------------------------
First implementation improvements in revision 908478:
Move job related utility classes into own package.
Add limit check to main queue
Restructure queue handling and fix rescheduling if an error occurs (in some cases a job has been put back into the main queue instead of the job queue)
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SLING-1365) Limit the number of parallel jobs
Posted by "Carsten Ziegeler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832028#action_12832028 ]
Carsten Ziegeler commented on SLING-1365:
-----------------------------------------
Added a first implementation for job queues in revision 908544
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SLING-1365) Limit the number of parallel jobs
Posted by "Philipp Koch (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831925#action_12831925 ]
Philipp Koch commented on SLING-1365:
-------------------------------------
i assume that you make this configurable per job topic queue, right?
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (SLING-1365) Limit the number of parallel jobs
Posted by "Carsten Ziegeler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carsten Ziegeler resolved SLING-1365.
-------------------------------------
Resolution: Fixed
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SLING-1365) Limit the number of parallel jobs
Posted by "Carsten Ziegeler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SLING-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831933#action_12831933 ]
Carsten Ziegeler commented on SLING-1365:
-----------------------------------------
Yes, that's right - as before, the configuration is send with the job event (this is not the optimal way of configuration as there could be two job events with the same job topic but different configurations)
> Limit the number of parallel jobs
> ---------------------------------
>
> Key: SLING-1365
> URL: https://issues.apache.org/jira/browse/SLING-1365
> Project: Sling
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: Extensions Event 2.1.0
> Reporter: Carsten Ziegeler
> Assignee: Carsten Ziegeler
> Fix For: Extensions Event 2.2.0
>
>
> Currently jobs can either be processed in parallel or in a series (per topic). However, if parallel processing is used, as many jobs as are available are processed in parallel and there is no limit.
> We should change the meaning of the parallel property to:
> - false: no parallel processing
> - a positiv number N : parallel processing with max N jobs in parallel
> - anything else: parallel processing
> Currently it is:
> - false: no parallel processing
> - anything else: parallel processing
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.