You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Pranay Singh (JIRA)" <ji...@apache.org> on 2017/12/12 23:03:00 UTC
[jira] [Created] (IMPALA-6312) Data load fails because of missing
table
Pranay Singh created IMPALA-6312:
------------------------------------
Summary: Data load fails because of missing table
Key: IMPALA-6312
URL: https://issues.apache.org/jira/browse/IMPALA-6312
Project: IMPALA
Issue Type: Bug
Components: Infrastructure
Affects Versions: Impala 2.11.0
Reporter: Pranay Singh
Data load fails because of missing table
impalad.INFO
---------------------------------------------------------------------
I1211 20:53:33.089735 6212 Frontend.java:909] Compiling query: CREATE EXTERNAL TABLE IF NOT EXISTS functional_text_gzip.table_with_header (
c1 int,
c2 double
)
ROW FORMAT delimited fields terminated by ',' escaped by '\\'
STORED AS TEXTFILE
LOCATION '/test-warehouse/table_with_header_text_gzip'
.
.
I1211 20:53:33.934106 6212 Frontend.java:909] Compiling query: ALTER TABLE table_with_header SET TBLPROPERTIES('skip.header.line.count'='1')
I1211 20:53:33.934623 6212 Frontend.java:831] Requesting prioritized load of table(s): functional_text_gzip.table_with_header
I1211 20:53:34.533540 6259 impala-beeswax-server.cc:52] query(): query=CREATE EXTERNAL TABLE IF NOT EXISTS functional_parquet.widetable_1000_cols (
.
.
I1211 20:53:36.961038 6212 Frontend.java:948] Compiled query.
I1211 20:53:36.961956 6212 jni-util.cc:211] org.apache.impala.common.AnalysisException: Could not resolve table reference: 'table_with_header'
at org.apache.impala.analysis.Analyzer.resolvePath(Analyzer.java:803)
at org.apache.impala.analysis.Analyzer.resolvePath(Analyzer.java:756)
at org.apache.impala.analysis.Analyzer.resolveTableRef(Analyzer.java:573)
at org.apache.impala.analysis.AlterTableStmt.analyze(AlterTableStmt.java:73)
at org.apache.impala.analysis.AlterTableSetStmt.analyze(AlterTableSetStmt.java:41)
at org.apache.impala.analysis.AlterTableSetTblProperties.analyze(AlterTableSetTblProperties.java:84)
at org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:388)
at org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:369)
at org.apache.impala.service.Frontend.analyzeStmt(Frontend.java:920)
at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1069)
at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:156)
I1211 20:53:36.966979 18064 impala-beeswax-server.cc:193] get_results_metadata(): query_id=df481c062572a1ed:6433f54300000000
I1211 20:53:36.967836 18064 impala-server.cc:698] Query id df481c062572a1ed:6433f54300000000 not found.
I1211 20:53:36.969046 18064 impala-beeswax-server.cc:235] close(): query_id=df481c062572a1ed:6433f54300000000
I1211 20:53:36.969056 18064 impala-server.cc:992] UnregisterQuery(): query_id=df481c062572a1ed:6433f54300000000
I1211 20:53:36.969065 18064 impala-server.cc:1075] Cancel(): query_id=df481c062572a1ed:6433f54300000000
I1211 20:53:36.970628 18064 impala-server.cc:1796] Connection from client 127.0.0.1:56278 closed, closing 1 associated session(s)
I1211 20:53:36.978963 18075 impala-beeswax-server.cc:52] query(): query=INSERT OVERWRITE TABLE tpch_parquet.lineitem SELECT * FROM tpch.lineitem
I1211 20:53:36.979012 18075 impala-beeswax-server.cc:426] query: Query {
01: query (string) = "INSERT OVERWRITE TABLE tpch_parquet.lineitem SELECT * FROM tpch.lineitem"
However, catalog shows that it has loaded the table_with_header
catalogd.INFO
--------------------
I1211 20:53:33.935195 2283 TableLoadingMgr.java:70] Loading metadata for table: functional_text_gzip.table_with_header
I1211 20:53:33.935276 28520 TableLoader.java:58] Loading metadata for: functional_text_gzip.table_with_header
I1211 20:53:33.954375 28520 HdfsTable.java:1206] Fetching partition metadata from the Metastore: functional_text_gzip.table_with_header
I1211 20:53:33.956279 28520 HdfsTable.java:1210] Fetched partition metadata from the Metastore: functional_text_gzip.table_with_header
I1211 20:53:33.959602 28520 HdfsTable.java:834] Loading file and block metadata for 1 paths for table functional_text_gzip.table_with_header using a thread pool of size 1
I1211 20:53:33.960515 28520 HdfsTable.java:874] Loaded file and block metadata for functional_text_gzip.table_with_header
I1211 20:53:33.960593 28520 TableLoader.java:97] Loaded metadata for: functional_text_gzip.table_with_header
I1211 20:53:35.642817 2331 catalog-server.cc:324] Publishing update: TABLE:functional_text_gzip.table_with_header@3711
I1211 20:54:59.673141 2331 catalog-server.cc:324] Publishing update: TABLE:functional_text_gzip.table_with_header@4481
I1211 21:07:41.841065 2331 catalog-server.cc:324] Publishing update: TABLE:functional_text_gzip.table_with_header@5414
I1211 21:11:55.916780 2331 catalog-server.cc:324] Publishing update: TABLE:functional_text_gzip.table_with_header@6420
Is it a race or delay in publishing the update that is causing issue here ?
Details of the table being loaded that went missing
-----------------------------------------------------------------------------------
(load-functional-query-exhaustive-impala-generated-text-gzip-block.sql):
CREATE EXTERNAL TABLE IF NOT EXISTS functional_text_gzip.table_with_header (
c1 int,
c2 double
)
ROW FORMAT delimited fields terminated by ',' escaped by '\\'
STORED AS TEXTFILE
LOCATION '/test-warehouse/table_with_header_text_gzip'
Data Loading from Impala failed with error: ImpalaBeeswaxException:
INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
MESSAGE: AnalysisException: Could not resolve table reference: 'table_with_header'
Traceback (most recent call last):
File "Impala/bin/load-data.py", line 178, in exec_impala_query_from_file
result = impala_client.execute(query)
File "Impala/tests/beeswax/impala_beeswax.py", line 173, in execute
handle = self.__execute_query(query_string.strip(), user=user)
File "Impala/tests/beeswax/impala_beeswax.py", line 339, in __execute_query
handle = self.execute_query_async(query_string, user=user)
File Impala/tests/beeswax/impala_beeswax.py", line 335, in execute_query_async
return self.__do_rpc(lambda: self.imp_service.query(query,))
File "Impala/tests/beeswax/impala_beeswax.py", line 460, in __do_rpc
raise ImpalaBeeswaxException(self.__build_error_message(b), b)
ImpalaBeeswaxException: ImpalaBeeswaxException:
INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
MESSAGE: AnalysisException: Could not resolve table reference: 'table_with_header'
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)