You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zzcclp (via GitHub)" <gi...@apache.org> on 2024/03/31 03:58:37 UTC
[I] [CH]Fix the table metadata sync issue for the CH backend [incubator-gluten]
zzcclp opened a new issue, #5219:
URL: https://github.com/apache/incubator-gluten/issues/5219
### Backend
CH (ClickHouse)
### Bug description
[CH]Fix the table metadata sync issue for the CH backend.
The CH backend receives the table metadata by the substrait plan when executing create table and query, but now there is no version info to represent the table metadata, when it meets the below case, it will execute failed:
```
1. create a table_1 with the path1, insert data
2. query from the table_1
3. drop the table_1 and re-create a table named table_1, but the table path is path2;
4. insert data, will be found that the inserted data will be located in the path1 but not in the path2;
```
So add a timestamp field to represent the version of the table metadata, this timestamp will be get from the Delta snapshot. The CH backend will update the table metadata according to this timestamp.
### Spark version
None
### Spark configurations
_No response_
### System information
_No response_
### Relevant logs
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CH]Fix the table metadata sync issue for the CH backend [incubator-gluten]
Posted by "zzcclp (via GitHub)" <gi...@apache.org>.
zzcclp closed issue #5219: [CH]Fix the table metadata sync issue for the CH backend
URL: https://github.com/apache/incubator-gluten/issues/5219
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org