You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "LinMingQiang (via GitHub)" <gi...@apache.org> on 2024/09/03 02:14:09 UTC
[PR] [doc] Fix clustering is only supported the bucket unaware append table. [paimon]
LinMingQiang opened a new pull request, #4114:
URL: https://github.com/apache/paimon/pull/4114
<!-- Please specify the module before the PR name: [core] ... or [flink] ... -->
### Purpose
According to the code display that clustering is only supported the bucket unaware append table.
<img width="988" alt="image" src="https://github.com/user-attachments/assets/d958ced2-20bf-457d-a68a-aafa577fd41b">
<!-- Linking this pull request to the issue -->
Linked issue: close #xxx
<!-- What is the purpose of the change -->
### Tests
<!-- List UT and IT cases to verify this change -->
### API and Format
<!-- Does this change affect API or storage format -->
### Documentation
<!-- Does this change introduce a new feature -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [doc] Fix clustering is only supported the bucket unaware append table. [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on code in PR #4114:
URL: https://github.com/apache/paimon/pull/4114#discussion_r1741471664
##########
docs/content/flink/sql-write.md:
##########
@@ -53,7 +53,7 @@ For multiple jobs to write the same table, you can refer to [dedicated compactio
In Paimon, clustering is a feature that allows you to cluster data in your [Append Table]({{< ref "append-table/overview" >}})
based on the values of certain columns during the write process. This organization of data can significantly enhance the efficiency of downstream
-tasks when reading the data, as it enables faster and more targeted data retrieval. This feature is only supported for [Append Table]({{< ref "append-table/overview" >}})
+tasks when reading the data, as it enables faster and more targeted data retrieval. This feature is only supported for the [bucket unaware]({{< ref "primary-key-table/data-distribution#dynamic-bucket" >}}) [Append Table]({{< ref "append-table/overview" >}})
Review Comment:
Wrong link.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [doc] Fix clustering is only supported the bucket unaware append table. [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #4114:
URL: https://github.com/apache/paimon/pull/4114#issuecomment-2325481673
Hi @LinMingQiang , bucket unaware is the append table. dynamic bucket is for primary key table. You can take a look to `org.apache.paimon.table.BucketMode`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [doc] Fix clustering is only supported the bucket unaware append table. [paimon]
Posted by "LinMingQiang (via GitHub)" <gi...@apache.org>.
LinMingQiang commented on PR #4114:
URL: https://github.com/apache/paimon/pull/4114#issuecomment-2325860652
> Can you just modify this to `append table (bucket = -1)`?
done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [doc] Fix clustering is only supported the bucket unaware append table. [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #4114:
URL: https://github.com/apache/paimon/pull/4114
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [doc] Fix clustering is only supported the bucket unaware append table. [paimon]
Posted by "LinMingQiang (via GitHub)" <gi...@apache.org>.
LinMingQiang commented on PR #4114:
URL: https://github.com/apache/paimon/pull/4114#issuecomment-2325494571
> Hi @LinMingQiang , bucket unaware is the append table. dynamic bucket is for primary key table. You can take a look to `org.apache.paimon.table.BucketMode`.
If an Append table in HASH_FIXED bucket mode, clustering will not take effect. So it should be indicated in the doc that only BUCKET_UNAWARE bucketMode is supported.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [doc] Fix clustering is only supported the bucket unaware append table. [paimon]
Posted by "LinMingQiang (via GitHub)" <gi...@apache.org>.
LinMingQiang commented on PR #4114:
URL: https://github.com/apache/paimon/pull/4114#issuecomment-2325719818
Refer to the description of parameter ```sink.clustering.by-columns```:
<img width="858" alt="image" src="https://github.com/user-attachments/assets/c519c46f-799a-41b1-ae46-04da1a353ff5">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [doc] Fix clustering is only supported the bucket unaware append table. [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #4114:
URL: https://github.com/apache/paimon/pull/4114#issuecomment-2325821113
Can you just modify this to `append table (bucket = -1)`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org