You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/02/17 05:25:48 UTC
[GitHub] [kyuubi] SteNicholas opened a new issue, #4355: [Umbrella] Suppors LakeSoul integration
SteNicholas opened a new issue, #4355:
URL: https://github.com/apache/kyuubi/issues/4355
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues) and found no similar issues.
### Describe the proposal
[LakeSoul](https://github.com/meta-soul/LakeSoul) implements incremental upserts for both row and column and allows concurrent updates. LakeSoul uses LSM-Tree like structure to support updates on hash partitioning table with primary key, and achieve very high write throughput (30MB/s/core) on cloud object store like S3 while providing optimized merge on read performance. LakeSoul scales metadata management and achieves ACID control by using PostgreSQL. LakeSoul provides tools to ingest CDC and log streams automatically in a zero-ETL style. Kyuubi could support the integration with LakeSoul.
### Task list
Suppors LakeSoul integration.
### Are you willing to submit PR?
- [ ] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
- [X] No. I cannot submit a PR at this time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [Umbrella] Suppors LakeSoul integration [kyuubi]
Posted by "Asakiny (via GitHub)" <gi...@apache.org>.
Asakiny commented on issue #4355:
URL: https://github.com/apache/kyuubi/issues/4355#issuecomment-1759297254
Hi, @SteNicholas LakeSoul can be integrated in Kyuubi now, both support Spark and Flink SQL Query Engine.
Please refer to : https://lakesoul-io.github.io/docs/Usage%20Docs/setup-kyuubi,
Maybe we could add docs to Kyuubi.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [Umbrella] Suppors LakeSoul integration [kyuubi]
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on issue #4355:
URL: https://github.com/apache/kyuubi/issues/4355#issuecomment-1759305261
@Asakiny, could you add document of LakeSoul integration in Kyuubi docs?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org