You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Steven Phillips (JIRA)" <ji...@apache.org> on 2015/04/10 22:51:12 UTC
[jira] [Commented] (DRILL-2333) Parquet writer reports negative
count for very large number of records
[ https://issues.apache.org/jira/browse/DRILL-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14490343#comment-14490343 ]
Steven Phillips commented on DRILL-2333:
----------------------------------------
[~jaltekruse] please review
> Parquet writer reports negative count for very large number of records
> ----------------------------------------------------------------------
>
> Key: DRILL-2333
> URL: https://issues.apache.org/jira/browse/DRILL-2333
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Reporter: Aman Sinha
> Assignee: Jason Altekruse
> Fix For: 0.9.0
>
> Attachments: DRILL-2333.patch
>
>
> When doing large scale CTAS, the counter for keeping track of number of records written overflows. See below. The actual number of records written by each minor fragment was about 45B rows.
> +------------+---------------------------+
> | Fragment | Number of records written |
> +------------+---------------------------+
> | 1_1 | -1271142674 |
> | 1_0 | -1276497044 |
> +------------+---------------------------+
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)