You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Michael Brown (JIRA)" <ji...@apache.org> on 2019/01/25 16:12:00 UTC
[jira] [Resolved] (IMPALA-8113) test_aggregation and
test_avro_primitive_in_list fail in S3
[ https://issues.apache.org/jira/browse/IMPALA-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Brown resolved IMPALA-8113.
-----------------------------------
Resolution: Fixed
Fix Version/s: Impala 3.2.0
> test_aggregation and test_avro_primitive_in_list fail in S3
> -----------------------------------------------------------
>
> Key: IMPALA-8113
> URL: https://issues.apache.org/jira/browse/IMPALA-8113
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.2.0
> Reporter: Michael Brown
> Assignee: Michael Brown
> Priority: Critical
> Fix For: Impala 3.2.0
>
>
> Likely more victims of our infra in S3.
> {noformat}
> query_test/test_aggregation.py:138: in test_aggregation
> result = self.execute_query(query, vector.get_value('exec_option'))
> common/impala_test_suite.py:597: in wrapper
> return function(*args, **kwargs)
> common/impala_test_suite.py:628: in execute_query
> return self.__execute_query(self.client, query, query_options)
> common/impala_test_suite.py:695: in __execute_query
> return impalad_client.execute(query, user=user)
> common/impala_connection.py:174: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:182: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:359: in __execute_query
> self.wait_for_finished(handle)
> beeswax/impala_beeswax.py:380: in wait_for_finished
> raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E Query aborted:Disk I/O error: Error reading from HDFS file: s3a://impala-test-uswest2-1/test-warehouse/alltypesagg_parquet/year=2010/month=1/day=8/5642b2da93dae1ad-494132e000000005_592013737_data.0.parq
> E Error(255): Unknown error 255
> E Root cause: SdkClientException: Data read has a different length than the expected: dataLength=0; expectedLength=45494; includeSkipped=true; in.getClass()=class com.amazonaws.services.s3.AmazonS3Client$2; markedSupported=false; marked=0; resetSinceLastMarked=false; markCount=0; resetCount=0
> {noformat}
> {noformat}
> query_test/test_nested_types.py:263: in test_avro_primitive_in_list
> "AvroPrimitiveInList.parquet", vector)
> query_test/test_nested_types.py:287: in __test_primitive_in_list
> result = self.execute_query("select item from %s.col1" % full_name, qopts)
> common/impala_test_suite.py:597: in wrapper
> return function(*args, **kwargs)
> common/impala_test_suite.py:628: in execute_query
> return self.__execute_query(self.client, query, query_options)
> common/impala_test_suite.py:695: in __execute_query
> return impalad_client.execute(query, user=user)
> common/impala_connection.py:174: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:182: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:359: in __execute_query
> self.wait_for_finished(handle)
> beeswax/impala_beeswax.py:380: in wait_for_finished
> raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E Query aborted:Disk I/O error: Failed to open HDFS file s3a://impala-test-uswest2-1/test-warehouse/test_avro_primitive_in_list_38f182c4.db/AvroPrimitiveInList/AvroPrimitiveInList.parquet
> E Error(2): No such file or directory
> E Root cause: FileNotFoundException: No such file or directory: s3a://impala-test-uswest2-1/test-warehouse/test_avro_primitive_in_list_38f182c4.db/AvroPrimitiveInList/AvroPrimitiveInList.parquet
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org