You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2020/02/10 17:53:58 UTC
[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #540: Hdds
2914 master
avijayanhwx opened a new pull request #540: Hdds 2914 master
URL: https://github.com/apache/hadoop-ozone/pull/540
## What changes were proposed in this pull request?
While running the TPCDS hive benchmark, certain queries are failing with the following error.
> Caused by: java.io.IOException: File o3fs://hive.warehouse.fqdn:9862/warehouse/tablespace/managed/hive/100/inventory/delta_0000001_0000001_0000/bucket_00000 should have had overlap on block starting at 0
The problem was the wrong usage of the offset field while populating Ozone's block location class. The offset field in BlockLocation refers to the block offset in an OzoneKey and not the byte offset inside the datanode file. In our case, the latter is always 0, and when we use 0 in the Block Locations, the hive ORC file splitter overwrites the blocks at '0' when there are more than 1 blocks.
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-2914
## How was this patch tested?
Manually tested by running the failed TPCDS queries again.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #540: HDDS-2914.
Certain Hive queries started to fail on generating splits
Posted by GitBox <gi...@apache.org>.
bharatviswa504 merged pull request #540: HDDS-2914. Certain Hive queries started to fail on generating splits
URL: https://github.com/apache/hadoop-ozone/pull/540
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org