You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "qics1982 (via GitHub)" <gi...@apache.org> on 2023/03/31 08:51:41 UTC

[GitHub] [incubator-paimon] qics1982 opened a new issue, #802: [Feature] support alluxio filesystem in paimon

qics1982 opened a new issue, #802:
URL: https://github.com/apache/incubator-paimon/issues/802

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   alluxio is a data orchestration technology(https://docs.alluxio.io/os/user/stable/en/Overview.html),
   we mainly use alluxio to speet up hot (hive/iceberg) tables which are frequenty accessed for lookup join or ad-hot query via trino.
   
   similar to hdfs, we can create and  use paimon catalogs in alluxio,
   
   alluxio releted configurations can be configured in hdfs core-site.xml or in catalog propreties
   
   create catalog in flink:
   CREATE CATALOG my_catalog WITH (
       'type' = 'paimon',
       'warehouse' = 'alluxio://path/to/warehouse'
   );
   USE CATALOG my_catalog;
   
   then  wen can create/write to paimon tables in Flink/Spark, and read paimon tables  in Flink/Spark/Trino side
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] zhuangchong commented on issue #802: [Feature] support alluxio filesystem in paimon

Posted by "zhuangchong (via GitHub)" <gi...@apache.org>.
zhuangchong commented on issue #802:
URL: https://github.com/apache/incubator-paimon/issues/802#issuecomment-1493203066

   Related PR: #797
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] SteNicholas closed issue #802: [Feature] support alluxio filesystem in paimon

Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas closed issue #802: [Feature] support alluxio filesystem in paimon
URL: https://github.com/apache/incubator-paimon/issues/802


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org