You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by "Skye Wanderman-Milne (Code Review)" <ge...@cloudera.org> on 2016/03/16 21:16:15 UTC

[Impala-CR](cdh5-trunk) IMPALA-2853: introduce PARQUET_RESOLVE_BY_NAME query option

Skye Wanderman-Milne has uploaded a new patch set (#3).

Change subject: IMPALA-2853: introduce PARQUET_RESOLVE_BY_NAME query option
......................................................................

IMPALA-2853: introduce PARQUET_RESOLVE_BY_NAME query option

This patch introduces a new query option, PARQUET_RESOLVE_BY_NAME,
which makes Parquet files' schemas be resolved by name instead of
ordinal. The default is still by ordinal. I chose to do a query option
because it will make testing easier and also be easier to diagnose
resolution problems quickly in the field. If users want to switch the
default behavior to be by name (like Hive), they can use the
--default_query_options flag.

This patch also introduces a new test section, EXECUTE, which can be
used to execute shell commands in a .test file. This is useful for
copying files into test tables.

Change-Id: Id0c715ea23792b2a6872610839a40532aabbb5a6
---
M be/src/exec/hdfs-parquet-scanner.cc
M be/src/exec/hdfs-parquet-scanner.h
M be/src/service/query-options.cc
M be/src/service/query-options.h
M common/thrift/ImpalaInternalService.thrift
M common/thrift/ImpalaService.thrift
A testdata/workloads/functional-query/queries/QueryTest/parquet-resolution-by-name.test
M tests/common/impala_test_suite.py
M tests/query_test/test_scanners.py
M tests/util/test_file_parser.py
10 files changed, 273 insertions(+), 18 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/84/2384/3
-- 
To view, visit http://gerrit.cloudera.org:8080/2384
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Id0c715ea23792b2a6872610839a40532aabbb5a6
Gerrit-PatchSet: 3
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Skye Wanderman-Milne <sk...@cloudera.com>
Gerrit-Reviewer: Dan Hecht <dh...@cloudera.com>
Gerrit-Reviewer: Michael Ho <kw...@cloudera.com>
Gerrit-Reviewer: Silvius Rus <sr...@cloudera.com>
Gerrit-Reviewer: Skye Wanderman-Milne <sk...@cloudera.com>