You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Brock Noland (Created) (JIRA)" <ji...@apache.org> on 2012/02/28 14:12:46 UTC
[jira] [Created] (FLUME-1007) JDBC Channel using Derby as a
provider does not scale
JDBC Channel using Derby as a provider does not scale
-----------------------------------------------------
Key: FLUME-1007
URL: https://issues.apache.org/jira/browse/FLUME-1007
Project: Flume
Issue Type: Improvement
Reporter: Brock Noland
Attachments: FLUME-1007.patch
In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel, the length it takes to drain the queue increases in a non-linear fashion.
Events 5,000
Put 2907 ms
Take 33615 ms
Events 10,000
Put 4469 ms
Take 259937 ms
Events: 15,000
Put 6590 ms
Take 643294 ms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (FLUME-1007) JDBC Channel using Derby as a
provider does not scale
Posted by "Arvind Prabhakar (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvind Prabhakar reassigned FLUME-1007:
---------------------------------------
Assignee: Arvind Prabhakar
> JDBC Channel using Derby as a provider does not scale
> -----------------------------------------------------
>
> Key: FLUME-1007
> URL: https://issues.apache.org/jira/browse/FLUME-1007
> Project: Flume
> Issue Type: Improvement
> Components: Channel
> Affects Versions: v1.0.0
> Reporter: Brock Noland
> Assignee: Arvind Prabhakar
> Attachments: FLUME-1007.patch
>
>
> In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel, the length it takes to drain the queue increases in a non-linear fashion.
> Events 5,000
> Put 2907 ms
> Take 33615 ms
> Events 10,000
> Put 4469 ms
> Take 259937 ms
> Events: 15,000
> Put 6590 ms
> Take 643294 ms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1007) JDBC Channel using Derby as a
provider does not scale
Posted by "Brock Noland (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland updated FLUME-1007:
--------------------------------
Description:
In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel increase, the length it takes to drain the queue increases in a non-linear fashion.
Events 5,000
Put 2907 ms
Take 33615 ms
Events 10,000
Put 4469 ms
Take 259937 ms
Events: 15,000
Put 6590 ms
Take 643294 ms
was:
In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel, the length it takes to drain the queue increases in a non-linear fashion.
Events 5,000
Put 2907 ms
Take 33615 ms
Events 10,000
Put 4469 ms
Take 259937 ms
Events: 15,000
Put 6590 ms
Take 643294 ms
> JDBC Channel using Derby as a provider does not scale
> -----------------------------------------------------
>
> Key: FLUME-1007
> URL: https://issues.apache.org/jira/browse/FLUME-1007
> Project: Flume
> Issue Type: Improvement
> Components: Channel
> Affects Versions: v1.0.0
> Reporter: Brock Noland
> Assignee: Arvind Prabhakar
> Attachments: FLUME-1007.patch
>
>
> In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel increase, the length it takes to drain the queue increases in a non-linear fashion.
> Events 5,000
> Put 2907 ms
> Take 33615 ms
> Events 10,000
> Put 4469 ms
> Take 259937 ms
> Events: 15,000
> Put 6590 ms
> Take 643294 ms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1007) JDBC Channel using Derby as a
provider does not scale
Posted by "Brock Noland (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland updated FLUME-1007:
--------------------------------
Component/s: Channel
Affects Version/s: v1.0.0
> JDBC Channel using Derby as a provider does not scale
> -----------------------------------------------------
>
> Key: FLUME-1007
> URL: https://issues.apache.org/jira/browse/FLUME-1007
> Project: Flume
> Issue Type: Improvement
> Components: Channel
> Affects Versions: v1.0.0
> Reporter: Brock Noland
> Attachments: FLUME-1007.patch
>
>
> In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel, the length it takes to drain the queue increases in a non-linear fashion.
> Events 5,000
> Put 2907 ms
> Take 33615 ms
> Events 10,000
> Put 4469 ms
> Take 259937 ms
> Events: 15,000
> Put 6590 ms
> Take 643294 ms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1007) JDBC Channel using Derby as a
provider does not scale
Posted by "Brock Noland (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland updated FLUME-1007:
--------------------------------
Attachment: FLUME-1007.patch
Attached demonstrates the problem. It is NOT meant for commit.
> JDBC Channel using Derby as a provider does not scale
> -----------------------------------------------------
>
> Key: FLUME-1007
> URL: https://issues.apache.org/jira/browse/FLUME-1007
> Project: Flume
> Issue Type: Improvement
> Reporter: Brock Noland
> Attachments: FLUME-1007.patch
>
>
> In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel, the length it takes to drain the queue increases in a non-linear fashion.
> Events 5,000
> Put 2907 ms
> Take 33615 ms
> Events 10,000
> Put 4469 ms
> Take 259937 ms
> Events: 15,000
> Put 6590 ms
> Take 643294 ms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira