You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "bright chen (JIRA)" <ji...@apache.org> on 2017/01/09 20:06:58 UTC

[jira] [Created] (APEXCORE-606) Optimise Kryo Output

bright chen created APEXCORE-606:
------------------------------------

             Summary: Optimise Kryo Output
                 Key: APEXCORE-606
                 URL: https://issues.apache.org/jira/browse/APEXCORE-606
             Project: Apache Apex Core
          Issue Type: New Feature
            Reporter: bright chen
            Assignee: bright chen


The kryo Output has some limitation
  - The size of the data is limited. kryo write data to the buffer, it will throw the overflow exception if the data exceed the size
  - The Output.toBytes() will copy the data to temporary buffer and output, it will  decrease the performance and introduce garbage collection.

When I was tuning Spillable Data structure and Manage State. I create a mechanism to share and reuse the memory to avoid above problem.  And it can be reused in core serialization with small change. Please see jira: https://issues.apache.org/jira/browse/APEXMALHAR-2190





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)