You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/12/07 09:22:57 UTC
[GitHub] [iceberg] zuoyebushiwo opened a new issue #1883: hive query flink sql insert data,but error.
zuoyebushiwo opened a new issue #1883:
URL: https://github.com/apache/iceberg/issues/1883
this my step:
CREATE CATALOG hive_catalog WITH (
'type'='iceberg',
'catalog-type'='hive',
'uri'='thrift://hd-node-3-41.wakedata.com:9083',
'clients'='5',
'property-version'='1',
'warehouse'='hdfs://HDFSCluster/warehouse'
);
CREATE DATABASE iceberg_db;
use CATALOG hive_catalog;
use iceberg_db;
CREATE TABLE hive_catalog.iceberg_db.sample (
id BIGINT COMMENT 'unique id',
data STRING
) ;
SET execution.type = batch;
INSERT hive_catalog.iceberg_db.sample VALUES (1, 'a');
flink sql query is ok!
I think it should be query by hive engine, so i dot it like:
add jar hdfs://HDFSCluster/user/flink/iceberg-hive-runtime-0.10.0.jar;
use iceberg_db;
select * from sample;
but error happened!
Error: java.io.IOException: java.io.IOException: Cannot create an instance of InputFormat class org.apache.hadoop.mapred.FileInputFormat as specified in mapredWork! (state=,code=0)
help me! thanks.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] zhangjun0x01 commented on issue #1883: hive query flink sql insert data,but error.
Posted by GitBox <gi...@apache.org>.
zhangjun0x01 commented on issue #1883:
URL: https://github.com/apache/iceberg/issues/1883#issuecomment-739803767
> CREATE CATALOG hive_catalog WITH (
> 'type'='iceberg',
> 'catalog-type'='hive',
> 'uri'='thrift://hd-node-3-41.wakedata.com:9083',
> 'clients'='5',
> 'property-version'='1',
> 'warehouse'='hdfs://HDFSCluster/warehouse'
> );
try use hadoop catalog instead of hive catalog to create the catalog
```
CREATE CATALOG hadoop_catalog WITH (
'type'='iceberg',
'catalog-type'='hadoop',
'warehouse'='hdfs://nn:8020/warehouse/path',
'property-version'='1'
);
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] wxy7 commented on issue #1883: hive query flink sql insert data,but error.
Posted by GitBox <gi...@apache.org>.
wxy7 commented on issue #1883:
URL: https://github.com/apache/iceberg/issues/1883#issuecomment-888047164
@zuoyebushiwo have you solved now ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] wxy7 edited a comment on issue #1883: hive query flink sql insert data,but error.
Posted by GitBox <gi...@apache.org>.
wxy7 edited a comment on issue #1883:
URL: https://github.com/apache/iceberg/issues/1883#issuecomment-888047164
@zuoyebushiwo have you solved now ? if yes, can you tell me how to solve this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] zuoyebushiwo closed issue #1883: hive query flink sql insert data,but error.
Posted by GitBox <gi...@apache.org>.
zuoyebushiwo closed issue #1883:
URL: https://github.com/apache/iceberg/issues/1883
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] zuoyebushiwo commented on issue #1883: hive query flink sql insert data,but error.
Posted by GitBox <gi...@apache.org>.
zuoyebushiwo commented on issue #1883:
URL: https://github.com/apache/iceberg/issues/1883#issuecomment-740346305
> > CREATE CATALOG hive_catalog WITH (
> > 'type'='iceberg',
> > 'catalog-type'='hive',
> > 'uri'='thrift://hd-node-3-41.wakedata.com:9083',
> > 'clients'='5',
> > 'property-version'='1',
> > 'warehouse'='hdfs://HDFSCluster/warehouse'
> > );
>
> try use hadoop catalog instead of hive catalog to create the catalog
>
> ```
> CREATE CATALOG hadoop_catalog WITH (
> 'type'='iceberg',
> 'catalog-type'='hadoop',
> 'warehouse'='hdfs://nn:8020/warehouse/path',
> 'property-version'='1'
> );
> ```
i think it should create by catalog-type=hive
and it should query by hive engine by add jar hdfs://HDFSCluster/user/flink/iceberg-hive-runtime-0.10.0.jar in hive shell command;
how can id dot?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] zuoyebushiwo commented on issue #1883: hive query flink sql insert data,but error.
Posted by GitBox <gi...@apache.org>.
zuoyebushiwo commented on issue #1883:
URL: https://github.com/apache/iceberg/issues/1883#issuecomment-740352781
> > CREATE CATALOG hive_catalog WITH (
> > 'type'='iceberg',
> > 'catalog-type'='hive',
> > 'uri'='thrift://hd-node-3-41.wakedata.com:9083',
> > 'clients'='5',
> > 'property-version'='1',
> > 'warehouse'='hdfs://HDFSCluster/warehouse'
> > );
>
> try use hadoop catalog instead of hive catalog to create the catalog
>
> ```
> CREATE CATALOG hadoop_catalog WITH (
> 'type'='iceberg',
> 'catalog-type'='hadoop',
> 'warehouse'='hdfs://nn:8020/warehouse/path',
> 'property-version'='1'
> );
> ```
i see! this can do this with create hive external table for hive engine query.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] zuoyebushiwo removed a comment on issue #1883: hive query flink sql insert data,but error.
Posted by GitBox <gi...@apache.org>.
zuoyebushiwo removed a comment on issue #1883:
URL: https://github.com/apache/iceberg/issues/1883#issuecomment-740346305
> > CREATE CATALOG hive_catalog WITH (
> > 'type'='iceberg',
> > 'catalog-type'='hive',
> > 'uri'='thrift://hd-node-3-41.wakedata.com:9083',
> > 'clients'='5',
> > 'property-version'='1',
> > 'warehouse'='hdfs://HDFSCluster/warehouse'
> > );
>
> try use hadoop catalog instead of hive catalog to create the catalog
>
> ```
> CREATE CATALOG hadoop_catalog WITH (
> 'type'='iceberg',
> 'catalog-type'='hadoop',
> 'warehouse'='hdfs://nn:8020/warehouse/path',
> 'property-version'='1'
> );
> ```
i think it should create by catalog-type=hive
and it should query by hive engine by add jar hdfs://HDFSCluster/user/flink/iceberg-hive-runtime-0.10.0.jar in hive shell command;
how can id dot?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org