[GitHub] [incubator-paimon] nonggialiang opened a new issue, #778: [Feature]

["nonggialiang (via GitHub)" <gi...@apache.org>]

nonggialiang opened a new issue, #778:
URL: https://github.com/apache/incubator-paimon/issues/778

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   For now, a paimon table can keep log both in file store and external log system at the same time , by setting log.system=kafka and changelog-producer=input/full-compaction at the same time.
   But at the source side, if log.system=kafka is set, the continues read is bound to kafka, and file store log will be ignored. 
   Since log of file store can support some feature that external log system doesn't support, like full-changelog, I think it's reasonable to provide a option for user to chose which log to read from.
   
   ### Solution
   
   Provide a flink option scan.log.from=external/internal, or sth like that to expose both choices.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] SteNicholas closed issue #778: [Feature] provide a flink option to chose which log to read from

["SteNicholas (via GitHub)" <gi...@apache.org>]

SteNicholas closed issue #778: [Feature] provide a flink option to chose which log to read from
URL: https://github.com/apache/incubator-paimon/issues/778


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] Alibaba-HZY commented on issue #778: [Feature] provide a flink option to chose which log to read from

["Alibaba-HZY (via GitHub)" <gi...@apache.org>]

Alibaba-HZY commented on issue #778:
URL: https://github.com/apache/incubator-paimon/issues/778#issuecomment-1490114897

   I have interest to work for this issue. Please assign this issue to me.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org