You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "jk47 (via GitHub)" <gi...@apache.org> on 2024/05/28 18:46:06 UTC

[I] [Question] What are the risks associated with the Java API? [paimon]

jk47 opened a new issue, #3420:
URL: https://github.com/apache/paimon/issues/3420

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   https://paimon.apache.org/docs/0.8/program-api/java-api/ comes with a warning at the top
   
   >     We do not recommend using the Paimon API naked, unless you are a professional downstream ecosystem developer, and even if you do, there will be significant difficulties.
   > 
   >     If you are only using Paimon, we strongly recommend using computing engines such as Flink SQL or Spark SQL.
   > 
   >     The following documents are not detailed and are for reference only.
   >
   
   Can you elaborate on the difficulties that will be encountered? 
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Question] What are the risks associated with the Java API? [paimon]

Posted by "tsreaper (via GitHub)" <gi...@apache.org>.
tsreaper commented on issue #3420:
URL: https://github.com/apache/paimon/issues/3420#issuecomment-2240948060

   The main difficulty is to decide where you should use each class and call each method.
   
   For example, consider a distributed system with one master node and several workers node. `TableScan` should only be used in master, while `TableRead` and `TableWrite` should only be used in workers. Also you need to design how to distribute `Split`s generated from `TableScan` to the workers. You also need to be careful on `TableCommit` because it can only run with 1 parallelism (otherwise the consistency guarantee is broken).
   
   All in all, these things are exactly what you need to concern when designing a distributed system.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Question] What are the risks associated with the Java API? [paimon]

Posted by "jk47 (via GitHub)" <gi...@apache.org>.
jk47 closed issue #3420: [Question] What are the risks associated with the Java API?
URL: https://github.com/apache/paimon/issues/3420


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org