You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "JingsongLi (via GitHub)" <gi...@apache.org> on 2023/03/29 03:09:51 UTC

[GitHub] [incubator-paimon] JingsongLi opened a new issue, #750: [Feature] Don't store redundant primary key fields

JingsongLi opened a new issue, #750:
URL: https://github.com/apache/incubator-paimon/issues/750

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   We are currently storing the primary key redundantly in the file, we can directly use the primary key field in the original fields to avoid redundant storage
   
   
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] JingsongLi commented on issue #750: [Feature] Don't store redundant primary key fields

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on issue #750:
URL: https://github.com/apache/incubator-paimon/issues/750#issuecomment-1498446261

   When storing as a parquet or orc file, there is no need to store the pk fields.
   We can find pk fields from table fields in reading.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] legendtkl commented on issue #750: [Feature] Don't store redundant primary key fields

Posted by "legendtkl (via GitHub)" <gi...@apache.org>.
legendtkl commented on issue #750:
URL: https://github.com/apache/incubator-paimon/issues/750#issuecomment-1494155802

   Hi, @JingsongLi  
   
   I'm not sure if I am on the right way. Just to confirm that the redundant storage means TableSchema#toString() ? But the deserialization will use this primaryKey field. 
   
   Would you help give more clue about this tickets? Thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] legendtkl commented on issue #750: [Feature] Don't store redundant primary key fields

Posted by "legendtkl (via GitHub)" <gi...@apache.org>.
legendtkl commented on issue #750:
URL: https://github.com/apache/incubator-paimon/issues/750#issuecomment-1487975503

   Hi, @JingsongLi  , would you assign this task to me? thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org