You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/01/25 16:12:00 UTC
[jira] [Commented] (IMPALA-8113) test_aggregation and
test_avro_primitive_in_list fail in S3
[ https://issues.apache.org/jira/browse/IMPALA-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16752397#comment-16752397 ]
ASF subversion and git services commented on IMPALA-8113:
---------------------------------------------------------
Commit 678ed162d468be53faf443e5188b3d41fe5636fd in impala's branch refs/heads/master from Michael Brown
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=678ed16 ]
IMPALA-8113: skip test_aggregation and test_avro_primitive_in_list in S3
Procedure for flaky S3 tests right now is to skip them due to eventual
consistency problems. This skips 2 more, test_aggregation and
test_avro_primitive_in_list.
Change-Id: Ica001e0237cf1eff300c6b4e8f28f48e728a0649
Reviewed-on: http://gerrit.cloudera.org:8080/12272
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> test_aggregation and test_avro_primitive_in_list fail in S3
> -----------------------------------------------------------
>
> Key: IMPALA-8113
> URL: https://issues.apache.org/jira/browse/IMPALA-8113
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.2.0
> Reporter: Michael Brown
> Assignee: Michael Brown
> Priority: Critical
>
> Likely more victims of our infra in S3.
> {noformat}
> query_test/test_aggregation.py:138: in test_aggregation
> result = self.execute_query(query, vector.get_value('exec_option'))
> common/impala_test_suite.py:597: in wrapper
> return function(*args, **kwargs)
> common/impala_test_suite.py:628: in execute_query
> return self.__execute_query(self.client, query, query_options)
> common/impala_test_suite.py:695: in __execute_query
> return impalad_client.execute(query, user=user)
> common/impala_connection.py:174: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:182: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:359: in __execute_query
> self.wait_for_finished(handle)
> beeswax/impala_beeswax.py:380: in wait_for_finished
> raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E Query aborted:Disk I/O error: Error reading from HDFS file: s3a://impala-test-uswest2-1/test-warehouse/alltypesagg_parquet/year=2010/month=1/day=8/5642b2da93dae1ad-494132e000000005_592013737_data.0.parq
> E Error(255): Unknown error 255
> E Root cause: SdkClientException: Data read has a different length than the expected: dataLength=0; expectedLength=45494; includeSkipped=true; in.getClass()=class com.amazonaws.services.s3.AmazonS3Client$2; markedSupported=false; marked=0; resetSinceLastMarked=false; markCount=0; resetCount=0
> {noformat}
> {noformat}
> query_test/test_nested_types.py:263: in test_avro_primitive_in_list
> "AvroPrimitiveInList.parquet", vector)
> query_test/test_nested_types.py:287: in __test_primitive_in_list
> result = self.execute_query("select item from %s.col1" % full_name, qopts)
> common/impala_test_suite.py:597: in wrapper
> return function(*args, **kwargs)
> common/impala_test_suite.py:628: in execute_query
> return self.__execute_query(self.client, query, query_options)
> common/impala_test_suite.py:695: in __execute_query
> return impalad_client.execute(query, user=user)
> common/impala_connection.py:174: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:182: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:359: in __execute_query
> self.wait_for_finished(handle)
> beeswax/impala_beeswax.py:380: in wait_for_finished
> raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E Query aborted:Disk I/O error: Failed to open HDFS file s3a://impala-test-uswest2-1/test-warehouse/test_avro_primitive_in_list_38f182c4.db/AvroPrimitiveInList/AvroPrimitiveInList.parquet
> E Error(2): No such file or directory
> E Root cause: FileNotFoundException: No such file or directory: s3a://impala-test-uswest2-1/test-warehouse/test_avro_primitive_in_list_38f182c4.db/AvroPrimitiveInList/AvroPrimitiveInList.parquet
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org