[jira] [Commented] (CALCITE-603) Metadata providers for size, memory, parallelism

["Julian Hyde (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CALCITE-603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335613#comment-14335613 ] 

Julian Hyde commented on CALCITE-603:
-------------------------------------

Adding to the list of providers:

{code}
  interface Size extends Metadata {
    Double averageRowSize();
    List<Double> averageColumnSizes();
  }

  interface Parallelism extends Metadata {
    Boolean isPhaseTransition();
    Integer splitCount();
  }

  interface Memory extends Metadata {
    Double memory();
    Double cumulativeMemoryWithinPhase();
    Double cumulativeMemoryWithinPhaseSplit();
  }
{code}

See [discussion|http://mail-archives.apache.org/mod_mbox/calcite-dev/201502.mbox/%3CCAMCtme+ST-pxDT3pYyvrV4RmONYQR2_BguZY5TOMMccAH8DeCw@mail.gmail.com%3E].

> Metadata providers for size, memory, parallelism
> ------------------------------------------------
>
>                 Key: CALCITE-603
>                 URL: https://issues.apache.org/jira/browse/CALCITE-603
>             Project: Calcite
>          Issue Type: Bug
>            Reporter: Julian Hyde
>            Assignee: Julian Hyde
>
> Add a metadata provider for average row size and column size (both in bytes).
> This can be used, among other things, to determine the degree of parallelism and whether there is adequate memory to put multiple operators in the same process. (See [email thread|http://mail-archives.apache.org/mod_mbox/incubator-calcite-dev/201502.mbox/%3CCAMCtme%2BST-pxDT3pYyvrV4RmONYQR2_BguZY5TOMMccAH8DeCw%40mail.gmail.com%3E].)
> I think this should be a single interface with two methods: {code}interface Volume {
>   List<Double> averageColumnSize();
>   Double averageRowSize();
> }{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)