You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "CookingBoy (via GitHub)" <gi...@apache.org> on 2023/06/18 11:52:38 UTC
[GitHub] [doris] CookingBoy opened a new issue, #20948: [Bug] check uri error in hive catalog
CookingBoy opened a new issue, #20948:
URL: https://github.com/apache/doris/issues/20948
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
release-1.2.4.1
### What's Wrong?
Backgroud: Hive supports setting separate paths for partitions
Bug：if the location of Hive tables is hdfs, and the setting of location for some partitions is s3 in the same table, this is an error like 'connect to hdfs failed, error: InvalidParameter: Invalid input: uri is not a valid URI type. ' when you try to read the data of these special partition. And vice versa, but the difference is that the error is like 's3 uri is invalid: hdfs://ns1/xxxx'.
### What You Expected?
read data normally from the special partitions whose location is on s3
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] morningman commented on issue #20948: [Bug] check uri error in hive catalog
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on issue #20948:
URL: https://github.com/apache/doris/issues/20948#issuecomment-1596595416
This is my wechat: morningman-cmy, could we talk on wechat for details?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] morningman closed issue #20948: [Bug] check uri error in hive catalog
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman closed issue #20948: [Bug] check uri error in hive catalog
URL: https://github.com/apache/doris/issues/20948
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] CookingBoy commented on issue #20948: [Bug] check uri error in hive catalog
Posted by "CookingBoy (via GitHub)" <gi...@apache.org>.
CookingBoy commented on issue #20948:
URL: https://github.com/apache/doris/issues/20948#issuecomment-1596441043
> So what you mean is that for hive table, some of its partitions are stored on HDFS, and some of them are stored on S3?
Example：
Hive table creation statement：
one partition location settings in same table:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] morningman commented on issue #20948: [Bug] check uri error in hive catalog
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on issue #20948:
URL: https://github.com/apache/doris/issues/20948#issuecomment-1596132633
So what you mean is that for hive table, some of its partitions are stored on HDFS, and some of them are stored on S3?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] CookingBoy commented on issue #20948: [Bug] check uri error in hive catalog
Posted by "CookingBoy (via GitHub)" <gi...@apache.org>.
CookingBoy commented on issue #20948:
URL: https://github.com/apache/doris/issues/20948#issuecomment-1596608597
> This is my wechat: morningman-cmy, could we talk on wechat for details?
I have communicated with 曹亮@selectdb on wechat，and he confirmed the issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org