You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by "Huaisi Xu (Code Review)" <ge...@cloudera.org> on 2016/06/21 23:00:15 UTC

[Impala-CR](cdh5-2.5.0 5.7.x) CDH-41243: Parquet scanner regression on wide tables

Huaisi Xu has uploaded a new patch set (#2).

Change subject: CDH-41243: Parquet scanner regression on wide tables
......................................................................

CDH-41243: Parquet scanner regression on wide tables

IMPALA-2473 introduced a check that prevent row batches growing
beyond 8MB, but it has a corner case that when an empty row
batch is larger than 8MB, it returns this row batch immediately
after it materialize one row, essentailly setting batch_size=1.

Revert part of "IMPALA-2473: reduce scanner memory usage":
   be/src/exec/hdfs-parquet-scanner.cc
   testdata/workloads/functional-query/queries/QueryTest/nested-types-tpch.test

Change-Id: I55a94363840c2b3804ed070c23f57f2117b4fab3
---
M be/src/exec/hdfs-parquet-scanner.cc
M testdata/workloads/functional-query/queries/QueryTest/nested-types-tpch.test
2 files changed, 0 insertions(+), 38 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/29/3429/2
-- 
To view, visit http://gerrit.cloudera.org:8080/3429
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I55a94363840c2b3804ed070c23f57f2117b4fab3
Gerrit-PatchSet: 2
Gerrit-Project: Impala
Gerrit-Branch: cdh5-2.5.0_5.7.x
Gerrit-Owner: Huaisi Xu <hx...@cloudera.com>
Gerrit-Reviewer: Huaisi Xu <hx...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>