You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/06/06 02:55:26 UTC
[GitHub] [incubator-doris] wyb opened a new issue #3787: [Spark load] Update hive table syntax in loadstmt
wyb opened a new issue #3787:
URL: https://github.com/apache/incubator-doris/issues/3787
1. Create an external hive table, including schema, hive db name, hive table name and load required properties (hive.metastore.uris).
Implement load from external hive table first, and report an error when querying from external hive table.
```sql
CREATE EXTERNAL TABLE example_db.broker_table (
k1 DATE,
k2 INT
)
ENGINE=hive
PROPERTIES (
"hive.metastore.uris" = "thrift://127.0.0.1:9083"
)
```
2. Load from external hive table
```sql
LOAD LABEL label0
(DATA FROM TABLE hive_external_table
INTO TABLE table0
(k1,k2,k3,v))
WITH RESOURCE "spark0"
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wyb commented on issue #3787: [Spark load] Update hive table syntax in loadstmt
Posted by GitBox <gi...@apache.org>.
wyb commented on issue #3787:
URL: https://github.com/apache/incubator-doris/issues/3787#issuecomment-641852155
> Can it support visit hive metastore by `hive-site.xml`?
Also support now.
> We submit a Spark Job and upload hive-site.xml to visit hive.
> For the case that we only need to use a hive table in Spark Load, create a external table in Doris is not necessary
We will support querying data from hive table in the future.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] imay commented on issue #3787: [Spark load] Update hive table syntax in loadstmt
Posted by GitBox <gi...@apache.org>.
imay commented on issue #3787:
URL: https://github.com/apache/incubator-doris/issues/3787#issuecomment-642054740
LGTM
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wyb edited a comment on issue #3787: [Spark load] Update hive table syntax in loadstmt
Posted by GitBox <gi...@apache.org>.
wyb edited a comment on issue #3787:
URL: https://github.com/apache/incubator-doris/issues/3787#issuecomment-641852155
> Can it support visit hive metastore by `hive-site.xml`?
Also support now.
> We submit a Spark Job and upload hive-site.xml to visit hive.
> For the case that we only need to use a hive table in Spark Load, create a external table in Doris is not necessary
We will support querying data from hive table in the future.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wyb closed issue #3787: [Spark load] Update hive table syntax in loadstmt
Posted by GitBox <gi...@apache.org>.
wyb closed issue #3787:
URL: https://github.com/apache/incubator-doris/issues/3787
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wangbo commented on issue #3787: [Spark load] Update hive table syntax in loadstmt
Posted by GitBox <gi...@apache.org>.
wangbo commented on issue #3787:
URL: https://github.com/apache/incubator-doris/issues/3787#issuecomment-640366962
Can it support visit hive metastore by ```hive-site.xml```?
We submit a Spark Job and upload hive-site.xml to visit hive.
For the case that we only need to use a hive table in Spark Load, create a external table in Doris is not necessary
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org