You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Jacques Nadeau (JIRA)" <ji...@apache.org> on 2015/03/13 22:06:38 UTC
[jira] [Updated] (DRILL-2333) Parquet writer reports negative count
for very large number of records
[ https://issues.apache.org/jira/browse/DRILL-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacques Nadeau updated DRILL-2333:
----------------------------------
Fix Version/s: 0.9.0
> Parquet writer reports negative count for very large number of records
> ----------------------------------------------------------------------
>
> Key: DRILL-2333
> URL: https://issues.apache.org/jira/browse/DRILL-2333
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Reporter: Aman Sinha
> Assignee: Steven Phillips
> Fix For: 0.9.0
>
>
> When doing large scale CTAS, the counter for keeping track of number of records written overflows. See below. The actual number of records written by each minor fragment was about 45B rows.
> +------------+---------------------------+
> | Fragment | Number of records written |
> +------------+---------------------------+
> | 1_1 | -1271142674 |
> | 1_0 | -1276497044 |
> +------------+---------------------------+
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)