You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Aman Sinha (JIRA)" <ji...@apache.org> on 2015/02/27 03:42:04 UTC
[jira] [Created] (DRILL-2333) Parquet writer reports negative count
for very large number of records
Aman Sinha created DRILL-2333:
---------------------------------
Summary: Parquet writer reports negative count for very large number of records
Key: DRILL-2333
URL: https://issues.apache.org/jira/browse/DRILL-2333
Project: Apache Drill
Issue Type: Improvement
Components: Storage - Parquet
Reporter: Aman Sinha
Assignee: Steven Phillips
When doing large scale CTAS, the counter for keeping track of number of records written overflows. See below. The actual number of records written by each minor fragment was about 45B rows.
+------------+---------------------------+
| Fragment | Number of records written |
+------------+---------------------------+
| 1_1 | -1271142674 |
| 1_0 | -1276497044 |
+------------+---------------------------+
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)