You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "ColdL (via GitHub)" <gi...@apache.org> on 2026/01/12 10:21:03 UTC
[PR] Introduce a new vector data type [paimon]
ColdL opened a new pull request, #7012:
URL: https://github.com/apache/paimon/pull/7012
<!-- Please specify the module before the PR name: [core] ... or [flink] ... -->
### Purpose
<!-- Linking this pull request to the issue -->
Linked issue: close #7011
<!-- What is the purpose of the change -->
### Tests
<!-- List UT and IT cases to verify this change -->
### API and Format
<!-- Does this change affect API or storage format -->
### Documentation
<!-- Does this change introduce a new feature -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Introduce a new vector data type [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #7012:
URL: https://github.com/apache/paimon/pull/7012#issuecomment-3839481123
Suggest splitting the PR to multiple PRs for quick advancement.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Introduce a new vector data type [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on code in PR #7012:
URL: https://github.com/apache/paimon/pull/7012#discussion_r2757525734
##########
docs/layouts/shortcodes/generated/core_configuration.html:
##########
@@ -1446,6 +1446,24 @@
<td>String</td>
<td>The Variant shredding schema for writing.</td>
</tr>
+ <tr>
+ <td><h5>vector-store.fields</h5></td>
+ <td style="word-wrap: break-word;">(none)</td>
+ <td>String</td>
+ <td>Specify the vector store fields.</td>
+ </tr>
+ <tr>
+ <td><h5>vector-store.format</h5></td>
+ <td style="word-wrap: break-word;">(none)</td>
+ <td>String</td>
+ <td>Specify the vector store file format.</td>
+ </tr>
+ <tr>
+ <td><h5>vector-store.target-file-size</h5></td>
Review Comment:
vector.target-file-size
##########
docs/layouts/shortcodes/generated/core_configuration.html:
##########
@@ -1446,6 +1446,24 @@
<td>String</td>
<td>The Variant shredding schema for writing.</td>
</tr>
+ <tr>
+ <td><h5>vector-store.fields</h5></td>
+ <td style="word-wrap: break-word;">(none)</td>
+ <td>String</td>
+ <td>Specify the vector store fields.</td>
+ </tr>
+ <tr>
+ <td><h5>vector-store.format</h5></td>
Review Comment:
vector.file.format
##########
paimon-core/src/main/java/org/apache/paimon/append/dataevolution/DataEvolutionCompactTask.java:
##########
@@ -89,11 +92,33 @@ public CommitMessage doCompact(FileStoreTable table, String commitUser) throws E
table = table.copy(DYNAMIC_WRITE_OPTIONS);
long firstRowId = compactBefore.get(0).nonNullFirstRowId();
- RowType readWriteType =
+ List<String> vectorStoreFieldNames = table.coreOptions().vectorStoreFieldNames();
Review Comment:
Why here need to deal with `vectorStoreFieldNames`? If you take a look to blob-field, only engines need to handle it.
##########
docs/layouts/shortcodes/generated/core_configuration.html:
##########
@@ -1446,6 +1446,24 @@
<td>String</td>
<td>The Variant shredding schema for writing.</td>
</tr>
+ <tr>
+ <td><h5>vector-store.fields</h5></td>
Review Comment:
vector-field
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org