You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Purshotam Shah (JIRA)" <ji...@apache.org> on 2015/07/29 22:34:06 UTC
[jira] [Updated] (OOZIE-2321) Disallow bulk query without jobid or
username
[ https://issues.apache.org/jira/browse/OOZIE-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Purshotam Shah updated OOZIE-2321:
----------------------------------
Description:
{code}
Class Name | Shallow Heap | Retained Heap
--------------------------------------------------------------------------------
org.apache.oozie.CoordinatorJobBean @ 0x7d8af9bf8| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af9aa0| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af9948| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af97f0| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af9698| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af9540| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af93e8| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af9290| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af4478| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af4320| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af41c8| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af4070| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af3f18| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af3dc0| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af3c68| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af3b10| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af39b8| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af3860| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af1200| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8af10a8| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8ad9ad0| 160 | 0
org.apache.oozie.CoordinatorJobBean @ 0x7d8ad9978| 160 | 0
Total: 22 of 1,220,400 entries; 1,220,378 more | |
--------------------------------------------------------------------------------
{code}
We noticed user issuing query like /oozie/v2/jobs?jobtype=coord&offset=0&len=1000000 which load 1,220,400 jobs into memory, causing memory spike.
> Disallow bulk query without jobid or username
> ---------------------------------------------
>
> Key: OOZIE-2321
> URL: https://issues.apache.org/jira/browse/OOZIE-2321
> Project: Oozie
> Issue Type: Bug
> Reporter: Purshotam Shah
>
> {code}
> Class Name | Shallow Heap | Retained Heap
> --------------------------------------------------------------------------------
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af9bf8| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af9aa0| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af9948| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af97f0| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af9698| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af9540| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af93e8| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af9290| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af4478| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af4320| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af41c8| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af4070| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af3f18| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af3dc0| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af3c68| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af3b10| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af39b8| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af3860| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af1200| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8af10a8| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8ad9ad0| 160 | 0
> org.apache.oozie.CoordinatorJobBean @ 0x7d8ad9978| 160 | 0
> Total: 22 of 1,220,400 entries; 1,220,378 more | |
> --------------------------------------------------------------------------------
> {code}
> We noticed user issuing query like /oozie/v2/jobs?jobtype=coord&offset=0&len=1000000 which load 1,220,400 jobs into memory, causing memory spike.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)