You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by GitBox <gi...@apache.org> on 2023/01/03 14:03:18 UTC
[GitHub] [hive] warriersruthi opened a new pull request, #3906: HIVE-26894: After using scratchdir for staging final job, CTAS and IOW on ACID tables are failing with wrongFS exception
warriersruthi opened a new pull request, #3906:
URL: https://github.com/apache/hive/pull/3906
After using scratchdir for staging the final job, CTAS and IOW on ACID tables are failing with wrongFS exception
### What changes were proposed in this pull request?
moveAcidFiles() method in Hive.java is modified to cater to the case where the src FS and dest FS are different. Instead of rename() operation, in the above case, we need to do copy().
### Why are the changes needed?
With the Jira: HIVE-26815, we can change the hive staging directory to be the same as that of scratchdir. In that case, staging files will be in HDFS while the target location would be a blob or some other FS. In such scenarios, while creating and updating ACID tables, the final rename operation was not working fine (throws Wrong FS error) since the src and dest FS is different. This is fixed in this patch by changing the rename() operation to copy() if FS are in different encryption zones.
### Does this PR introduce any user-facing change?
Nope.
### How was this patch tested?
Tested with a patch on hive 3.1.2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org
[GitHub] [hive] sonarcloud[bot] commented on pull request #3906: HIVE-26894: After using scratchdir for staging final job, CTAS and IOW on ACID tables are failing with wrongFS exception
Posted by GitBox <gi...@apache.org>.
sonarcloud[bot] commented on PR #3906:
URL: https://github.com/apache/hive/pull/3906#issuecomment-1369902797
Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=3906)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=VULNERABILITY)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=3906&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=3906&resolved=false&types=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=3906&resolved=false&types=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=CODE_SMELL) [9 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3906&resolved=false&types=CODE_SMELL)
[](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=3906&metric=coverage&view=list) No Coverage information
[](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=3906&metric=duplicated_lines_density&view=list) No Duplication information
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org
[GitHub] [hive] warriersruthi closed pull request #3906: HIVE-26894: After using scratchdir for staging final job, CTAS and IOW on ACID tables are failing with wrongFS exception
Posted by GitBox <gi...@apache.org>.
warriersruthi closed pull request #3906: HIVE-26894: After using scratchdir for staging final job, CTAS and IOW on ACID tables are failing with wrongFS exception
URL: https://github.com/apache/hive/pull/3906
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org