You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/05/27 10:10:23 UTC

[GitHub] [iceberg] user-GitHub-user opened a new issue, #4883: hive MR insert change iceberg table(create by spark) FORMAT

user-GitHub-user opened a new issue, #4883:
URL: https://github.com/apache/iceberg/issues/4883

   hive：3.1.2
   spark: 3.2.1
   
   i set iceberg.engine.hive.enabled=true in my spark hive-site.xml  ,create table by spark:
     CREATE TABLE test (
     `id` INT NOT NULL COMMENT 'id')
   USING iceberg;
   
   before insert data by hive, hive create table show :
   
   CREATE EXTERNAL TABLE `default.test`(
     `id` int COMMENT 'id')
   ROW FORMAT SERDE 
     'org.apache.iceberg.mr.hive.HiveIcebergSerDe' 
   STORED BY 
     'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler' 
   
   after hive execute:
   insert into test values(1);
   
   hive create table show :
   CREATE EXTERNAL TABLE `default.test`(
     `id` int COMMENT 'id')
   ROW FORMAT SERDE 
     'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' 
   STORED AS INPUTFORMAT 
     'org.apache.hadoop.mapred.FileInputFormat' 
   OUTPUTFORMAT 
     'org.apache.hadoop.mapred.FileOutputFormat'
   
   format change,and hive select throw exception:
   Output Format must implement HiveOutputFormat, otherwise it should be either IgnoreKeyTextOutputFormat or SequenceFileOutputFormat
   
   if i create table like this:
     CREATE TABLE test (
     `id` INT NOT NULL COMMENT 'id')
   USING iceberg
   TBLPROPERTIES(
     'engine.hive.enabled' = 'true');
   
   This problem does not occur，so engine.hive.enabled is diff set iceberg.engine.hive.enabled=true?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] user-GitHub-user commented on issue #4883: hive MR insert change iceberg table(create by spark) FORMAT

Posted by GitBox <gi...@apache.org>.
user-GitHub-user commented on issue #4883:
URL: https://github.com/apache/iceberg/issues/4883#issuecomment-1157401841

   > You should set the `iceberg.engine.hive.enabled` to `true` in Hive too
   
   thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] pvary commented on issue #4883: hive MR insert change iceberg table(create by spark) FORMAT

Posted by GitBox <gi...@apache.org>.
pvary commented on issue #4883:
URL: https://github.com/apache/iceberg/issues/4883#issuecomment-1142104267

   You should set the `iceberg.engine.hive.enabled` to `true` in Hive too


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] user-GitHub-user closed issue #4883: hive MR insert change iceberg table(create by spark) FORMAT

Posted by GitBox <gi...@apache.org>.
user-GitHub-user closed issue #4883: hive MR insert change iceberg table(create by spark) FORMAT 
URL: https://github.com/apache/iceberg/issues/4883


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org