You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "bright chen (JIRA)" <ji...@apache.org> on 2017/01/09 20:06:58 UTC
[jira] [Created] (APEXCORE-606) Optimise Kryo Output
bright chen created APEXCORE-606:
------------------------------------
Summary: Optimise Kryo Output
Key: APEXCORE-606
URL: https://issues.apache.org/jira/browse/APEXCORE-606
Project: Apache Apex Core
Issue Type: New Feature
Reporter: bright chen
Assignee: bright chen
The kryo Output has some limitation
- The size of the data is limited. kryo write data to the buffer, it will throw the overflow exception if the data exceed the size
- The Output.toBytes() will copy the data to temporary buffer and output, it will decrease the performance and introduce garbage collection.
When I was tuning Spillable Data structure and Manage State. I create a mechanism to share and reuse the memory to avoid above problem. And it can be reused in core serialization with small change. Please see jira: https://issues.apache.org/jira/browse/APEXMALHAR-2190
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)