You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kyuubi.apache.org by GitBox <gi...@apache.org> on 2022/02/15 12:07:49 UTC
[GitHub] [incubator-kyuubi] zinking opened a new issue #1915: [FEATURE] invoke tpcds from sql
zinking opened a new issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues.
### Describe the feature
using sql extensions to create and run tpcds sql benchmarks
```
call spark.system.create_tpcds(sf=10, db='tpcds_sf10', fmt='parquet', parallel=20)
call spark.system.run_tpcds(db='tpcds_sf10', filter='q1-v2.4')
```
### Motivation
users with no dev background can create and run tpcds datasets
### Describe the solution
```
call spark.system.create_tpcds(sf=10, db='tpcds_sf10', fmt='parquet', parallel=20)
call spark.system.run_tpcds(db='tpcds_sf10', filter='q1-v2.4')
```
### Additional context
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] zinking commented on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
zinking commented on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064859975
nothing really changes from the user side, it's just they can now issue these *control* command from the beeline.
implementation side we will introduce store procedure like routines, which I think is perfect for this task. also more control commands could be supported from this on.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] zinking commented on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
zinking commented on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064892655
> we currently support scala operation like `spark.sql(...)/ spark.udf.`, why we need the `call` prefix
that's true, now kyuubi is supporting scala code, `call` is less relevant from a developer context. but at the time of writing, I was more thinking of doing this in pure sql context.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064856830
I am OK, can you detail a little about the user behavior, what are we gonna change?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
pan3793 edited a comment on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064863524
Tips: currently the tpcds moudle can not be shipped with the official release because of license, we may need to replace it by a Apache licensed one https://github.com/Teradata/tpcds
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
pan3793 edited a comment on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064863524
Tips: currently the tpcds moudle can not be shipped with the official release because of license, we may need to replace it by an Apache licensed one https://github.com/Teradata/tpcds
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
pan3793 commented on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064863524
Tips: currently the tpcds moudle can not be ship with the official release because of license, we may need to replace it by a Apache licensed one https://github.com/Teradata/tpcds
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] zinking removed a comment on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
zinking removed a comment on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1069821514
> Tips: currently the tpcds moudle can not be shipped with the official release because of license, we may need to replace it by an Apache licensed one https://github.com/Teradata/tpcds
@pan3793 I did remember there are some packages related to tpcds in kyuubi before, seems no longer there anymore? when is it removed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
pan3793 commented on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1069826623
We have no plan to remove the TPC-DS related classes/modules, but it can NOT be included into the official source/binary release bundle because of the license.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] zinking commented on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
zinking commented on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064851157
@yaooqinn if you are okay with this approach, I will spend sometime and contribute a patch
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064890101
we currently support scala operation like `spark.sql(...)/ spark.udf.`, why we need the `call` prefix
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] zinking edited a comment on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
zinking edited a comment on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1064892655
> we currently support scala operation like `spark.sql(...)/ spark.udf.`, why we need the `call` prefix
that's true, now kyuubi is supporting scala code, `call` is less relevant from a developer context. but at the time of writing, I was more thinking of doing this in pure sql context.
besides, more mangement routines could supported through this `call` place holder.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] zinking commented on issue #1915: [FEATURE] invoke tpcds from sql
Posted by GitBox <gi...@apache.org>.
zinking commented on issue #1915:
URL: https://github.com/apache/incubator-kyuubi/issues/1915#issuecomment-1069821514
> Tips: currently the tpcds moudle can not be shipped with the official release because of license, we may need to replace it by an Apache licensed one https://github.com/Teradata/tpcds
@pan3793 I did remember there are some packages related to tpcds in kyuubi before, seems no longer there anymore? when is it removed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org