You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@drill.apache.org by "Steven Phillips (JIRA)" <ji...@apache.org> on 2015/04/01 22:52:53 UTC

[jira] [Updated] (DRILL-2333) Parquet writer reports negative count for very large number of records

     [ https://issues.apache.org/jira/browse/DRILL-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steven Phillips updated DRILL-2333:
-----------------------------------
    Attachment: DRILL-2333.patch

> Parquet writer reports negative count for very large number of records
> ----------------------------------------------------------------------
>
>                 Key: DRILL-2333
>                 URL: https://issues.apache.org/jira/browse/DRILL-2333
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>            Reporter: Aman Sinha
>            Assignee: Steven Phillips
>             Fix For: 0.9.0
>
>         Attachments: DRILL-2333.patch
>
>
> When doing large scale CTAS, the counter for keeping track of number of records written overflows.  See below.  The actual number of records written by each minor fragment was about 45B rows. 
>  +------------+---------------------------+
> |  Fragment  | Number of records written |
> +------------+---------------------------+
> | 1_1        | -1271142674               |
> | 1_0        | -1276497044               |
> +------------+---------------------------+



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)