You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Norbert Luksa (Code Review)" <ge...@cloudera.org> on 2019/11/29 15:12:43 UTC
[Impala-ASF-CR] WIP: IMPALA-8046: Support CREATE TABLE from an ORC file
Norbert Luksa has uploaded a new patch set (#5). ( http://gerrit.cloudera.org:8080/14811 )
Change subject: WIP: IMPALA-8046: Support CREATE TABLE from an ORC file
......................................................................
WIP: IMPALA-8046: Support CREATE TABLE from an ORC file
Impala supports creating a table using the schema of a file.
However, only Parquet is supported currently. This commit adds
support for creating tables from ORC files. The change relies on
ORC 1.5, therefore can only be used with USE_CDP_HIVE=true.
Also, the commit performs a little clean-up on the ParquetHelper
class, renaming it to ParquetSchemeExtractor and removing outdated
comments.
To create a table from an ORC file, run:
CREATE TABLE tablename LIKE ORC '/path/to/file'
Tests:
* Added analysis tests for primitive and complex types.
* Added e2e tests for creating tables from ORC files.
Change-Id: I77cd84cda2ed86516937a67eb320fd41e3f1cf2d
---
M fe/src/main/java/org/apache/impala/analysis/CreateTableLikeFileStmt.java
A fe/src/main/java/org/apache/impala/analysis/ORCSchemeExtractor.java
R fe/src/main/java/org/apache/impala/analysis/ParquetSchemeExtractor.java
M fe/src/main/java/org/apache/impala/common/FileSystemUtil.java
A fe/src/main/java/org/apache/impala/util/FileAnalysisUtil.java
M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java
A testdata/workloads/functional-query/queries/QueryTest/create-table-like-file-orc.test
M testdata/workloads/functional-query/queries/QueryTest/create-table-like-file.test
M testdata/workloads/functional-query/queries/QueryTest/create-table-like-table.test
M tests/common/skip.py
M tests/metadata/test_ddl.py
11 files changed, 418 insertions(+), 79 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/11/14811/5
--
To view, visit http://gerrit.cloudera.org:8080/14811
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I77cd84cda2ed86516937a67eb320fd41e3f1cf2d
Gerrit-Change-Number: 14811
Gerrit-PatchSet: 5
Gerrit-Owner: Norbert Luksa <no...@cloudera.com>
Gerrit-Reviewer: Csaba Ringhofer <cs...@cloudera.com>
Gerrit-Reviewer: Daniel Becker <da...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Norbert Luksa <no...@cloudera.com>
Gerrit-Reviewer: Zoltan Borok-Nagy <bo...@cloudera.com>