You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "Xuanwo (via GitHub)" <gi...@apache.org> on 2024/07/08 12:24:51 UTC

[I] [Feature] Improve Paimon Spec [paimon]

Xuanwo opened a new issue, #3704:
URL: https://github.com/apache/paimon/issues/3704

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   I'm working on [paimon-rust](https://github.com/apache/paimon-rust) now. I found paimon's specifications to be neither accurate nor detailed.
   
   Take `Schema` as an example, the current spec only have:
   
   
   > The version of the schema file starts from 0 and currently retains all versions of the schema. There may be old files that rely on the old schema version, so its deletion should be done with caution.
   >
   > Schema File is JSON, it includes:
   >
   > fields: data field list, data field contains id, name, type, field id is used to support schema evolution.
   > partitionKeys: partition definition of the table, it cannot be modified.
   > primaryKeys: primary key definition of the table, it cannot be modified.
   > options: options of the table, including a lot of capabilities and optimizations.
   
   I will have the following questions:
   
   - What's the detailed json format of `Schema`? 
   - What's field? 
   - What's `partition definition`?
   - What's `primary key definition`?
   - How `options` is stored? What's it key/value type? Should it be ordered?
   
   ### Solution
   
   Please provide more detailed specifications for Paimon, possibly including pseudocode examples.
   
   ### Anything else?
   
   None
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature] Improve Paimon Spec [paimon]

Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo closed issue #3704: [Feature] Improve Paimon Spec
URL: https://github.com/apache/paimon/issues/3704


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature] Improve Paimon Spec [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on issue #3704:
URL: https://github.com/apache/paimon/issues/3704#issuecomment-2216314621

   I will do this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org