You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Ryan Blue (JIRA)" <ji...@apache.org> on 2015/03/05 00:51:39 UTC
[jira] [Commented] (PARQUET-199) Add a callback when the
MemoryManager adjusts row group size
[ https://issues.apache.org/jira/browse/PARQUET-199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347796#comment-14347796 ]
Ryan Blue commented on PARQUET-199:
-----------------------------------
This builds on PARQUET-164; see discussion on Dong's pull request: https://github.com/apache/incubator-parquet-mr/pull/120
> Add a callback when the MemoryManager adjusts row group size
> ------------------------------------------------------------
>
> Key: PARQUET-199
> URL: https://issues.apache.org/jira/browse/PARQUET-199
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
> Reporter: Ryan Blue
>
> Parquet Hive would like to increment a counter when the row group size is altered by the memory manager so that Hive can detect when there are memory problems and inform the user. I think the right way to do this is to provide a callback that will be triggered when the memory manager hits its limit.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)