[jira] [Commented] (APEXMALHAR-1955) Batch size should be configurable for AbstractBatchTransactionableStoreOutputOperator

["Priyanka Gugale (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/APEXMALHAR-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194972#comment-15194972 ] 

Priyanka Gugale commented on APEXMALHAR-1955:
---------------------------------------------

There is a property in cassandra configuration file, batch_size_fail_threshold_in_kb: 50. By default the max batch size is set to 50 kb. We can increase this but that may not be the right solution to resolve this problem.

> Batch size should be configurable for AbstractBatchTransactionableStoreOutputOperator
> -------------------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-1955
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-1955
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Priyanka Gugale
>            Assignee: Priyanka Gugale
>
> Some databases can't handle very large batch sizes. If input rate is high, the batch which is created between a window could be very high. There should be a way to configure max batch size.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)