You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by GitBox <gi...@apache.org> on 2023/01/06 02:36:17 UTC
[GitHub] [kyuubi] bowenliang123 opened a new issue, #4106: [FEATURE] Support upload jar file in POST /batches
bowenliang123 opened a new issue, #4106:
URL: https://github.com/apache/kyuubi/issues/4106
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no similar issues.
### Describe the feature
Currently In REST Api, `POST /batches` (https://kyuubi.readthedocs.io/en/latest/client/rest/rest_api.html#post-batches) only
supports executing a path to the resource in external storage (eg. hdfs, s3 and etc).
Supporting uploading the jar file in this API will help users avoid uploading the jar file to other external storage first.
- support upload jar file in POST request (but it may violate the JSON mediaType, need to add a new API maybe)
- put jar file in temporary folder on server
- submit job using the local path on server to jar file in above
- clean up temp jar file after submission or finishing execution
### Motivation
_No response_
### Describe the solution
_No response_
### Additional context
_No response_
### Are you willing to submit PR?
- [ ] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
- [X] No. I cannot submit a PR at this time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi] bowenliang123 commented on issue #4106: [FEATURE] Support upload jar file in POST /batches
Posted by GitBox <gi...@apache.org>.
bowenliang123 commented on issue #4106:
URL: https://github.com/apache/kyuubi/issues/4106#issuecomment-1378265635
I am having trouble in implementing upload files by adding `MULTIPART_FORM_DATA` in @Consumes.
` @Consumes(Array(MediaType.MULTIPART_FORM_DATA, MediaType.APPLICATION_JSON))`
or ` @Consumes(Array(MediaType.APPLICATION_JSON))`.
`MultiPartFeature` is registered in both client and server, referring to Jersey docs https://eclipse-ee4j.github.io/jersey.github.io/documentation/latest/user-guide.html#multipart
Having HTTP code 415 `Unsupported Media Type` in response in a unit test.
Also, it seems Livy doesn't support uploading jars. (`POST /sessions`
https://livy.incubator.apache.org/docs/latest/rest-api.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi] bowenliang123 commented on issue #4106: [FEATURE] Support upload jar file in POST /batches
Posted by GitBox <gi...@apache.org>.
bowenliang123 commented on issue #4106:
URL: https://github.com/apache/kyuubi/issues/4106#issuecomment-1373068628
Do you have any ideas or suggestions for this? Especially for step 1, how extending the facade of this JSON Restful Api for uploading jar file, or adding new Api for it.
cc @turboFei @pan3793
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi] bowenliang123 closed issue #4106: [FEATURE] Support upload app jar file in POST /batches
Posted by "bowenliang123 (via GitHub)" <gi...@apache.org>.
bowenliang123 closed issue #4106: [FEATURE] Support upload app jar file in POST /batches
URL: https://github.com/apache/kyuubi/issues/4106
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi] turboFei commented on issue #4106: [FEATURE] Support upload jar file in POST /batches
Posted by GitBox <gi...@apache.org>.
turboFei commented on issue #4106:
URL: https://github.com/apache/kyuubi/issues/4106#issuecomment-1373080544
have no experience for this, maybe you can refer the implementation of livy.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi] bowenliang123 commented on issue #4106: [FEATURE] Support upload jar file in POST /batches
Posted by GitBox <gi...@apache.org>.
bowenliang123 commented on issue #4106:
URL: https://github.com/apache/kyuubi/issues/4106#issuecomment-1373084669
ok, i will try to put multiple media types to @Consumes .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org