You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "yaowanli (via GitHub)" <gi...@apache.org> on 2023/05/23 01:28:53 UTC

[GitHub] [incubator-paimon] yaowanli opened a new issue, #1203: [Bug] drop table in hive and then rebuild table error

yaowanli opened a new issue, #1203:
URL: https://github.com/apache/incubator-paimon/issues/1203

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Paimon version
   
   0.5-SNAPSHOT
   
   ### Compute Engine
   
   Flink-1.17.0
   Hive-3.1.0
   
   ### Minimal reproduce step
   
   1.In flink,create a table like :
   CREATE CATALOG ods WITH (
   'type' = 'paimon',
   'metastore' = 'hive',
   'uri' = 'thrift://IP:9083',
   'warehouse' = 'hdfs://IP/warehouse/tablespace/managed/hive'
   );
   use catalog ods;
   create table test1(
   id bigint,
   create_time string,
   update_time string,
   delete_flag int,
   version int,
   PRIMARY KEY (id) NOT ENFORCED
   )
   WITH (
   'bucket' = '32',
   'write-mode' = 'change-log',
   'snapshot.time-retained' = '1h'
   );
   2.And then ,drop table in Hive,like:
   drop table test1;
   Hive will return "Updated Rows:-1"
   3.After that,create the same table in Flink,like step 1, Flink will throw Exception,and can't create the same table .
   
   ### What doesn't meet your expectations?
   
   [ERROR] Could not execute SQL statement. Reason:
   java.lang.IllegalStateException: Schema in filesystem exists, please use updating, latest schema is: Optional[{
     "id" : 0,
     "fields" : [ {
       "id" : 0,
       "name" : "id",
       "type" : "BIGINT NOT NULL"
     }, {
       "id" : 1,
       "name" : "create_time",
       "type" : "STRING"
     }, {
       "id" : 2,
       "name" : "update_time",
       "type" : "STRING"
     }, {
       "id" : 3,
       "name" : "delete_flag",
       "type" : "INT"
     }, {
       "id" : 4,
       "name" : "version",
       "type" : "INT"
     } ],
     "highestFieldId" : 4,
     "partitionKeys" : [ ],
     "primaryKeys" : [ "id" ],
     "options" : {
       "bucket" : "32",
       "write-mode" : "change-log",
       "snapshot.time-retained" : "1h"
     }
   }]
   
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] zhuangchong commented on issue #1203: [Bug] drop table in hive and then rebuild table error

Posted by "zhuangchong (via GitHub)" <gi...@apache.org>.
zhuangchong commented on issue #1203:
URL: https://github.com/apache/incubator-paimon/issues/1203#issuecomment-1713158329

   I will close this issue first. If you still have questions, you can open this issue again.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] zhuangchong commented on issue #1203: [Bug] drop table in hive and then rebuild table error

Posted by "zhuangchong (via GitHub)" <gi...@apache.org>.
zhuangchong commented on issue #1203:
URL: https://github.com/apache/incubator-paimon/issues/1203#issuecomment-1560606078

   @yaowanli 
   I tested to create a table in flink, drop this table in hive, it can be deleted normally, can you confirm whether there is any exception log when you use hive to drop the table?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] zhuangchong closed issue #1203: [Bug] drop table in hive and then rebuild table error

Posted by "zhuangchong (via GitHub)" <gi...@apache.org>.
zhuangchong closed issue #1203: [Bug] drop table in hive and then rebuild table error
URL: https://github.com/apache/incubator-paimon/issues/1203


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] zhuangchong commented on issue #1203: [Bug] drop table in hive and then rebuild table error

Posted by "zhuangchong (via GitHub)" <gi...@apache.org>.
zhuangchong commented on issue #1203:
URL: https://github.com/apache/incubator-paimon/issues/1203#issuecomment-1558354560

   Can you assign it to me?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org