You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/08/11 22:59:28 UTC

[GitHub] [arrow-datafusion] andygrove opened a new issue #861: Implement Python bindings for BallistaContext

andygrove opened a new issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861


   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   We have Python bindings for DataFusion's ExecutionContext. It would be good to also support Ballista's BallistaContext so that we can use Python to run distributed queries.
   
   **Describe the solution you'd like**
   Probably something like this?
   
   ```python
   import ballista
   
   ctx = ballista.BallistaContext
   df = ctx.read_parquet(...)
   ```
   
   **Describe alternatives you've considered**
   N/A
   
   **Additional context**
   N/A


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] djKooks commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
djKooks commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-907532458


   @alamb @jorgecarleitao @andygrove thanks for suggestion 🙇 
   
   > do the bindings come with the client and executors, or just the client?
   
   I think it will be enough to do with client only in first step, but do you have any more suggestion?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] alamb commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-907762576


   I do not have any more to add here -- since I don't use the python bindings myself I don't have a lot to offer with specifics


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] andygrove commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
andygrove commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899082043


   Thank you @djKooks that would be great


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] djKooks commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
djKooks commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-917403397


   @andygrove  @alamb @jorgecarleitao thanks for comment.
   Will start implementation in following branch https://github.com/apache/arrow-datafusion/pull/988
   (will request for review when ready 🙇 )


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] andygrove commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
andygrove commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899483312


   Yes, I think that makes sense.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] andygrove commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
andygrove commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899483693


   I would be interested to hear what others think though. @alamb @Dandandan @jorgecarleitao @houqp do you have an opinion on this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] djKooks commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
djKooks commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899036686


   @andygrove hope to work on this, if you don't have any other plan.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] djKooks edited a comment on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
djKooks edited a comment on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899453613


   @andygrove 
   Would it be okay to put like following?
   ```
   ...
   ballista/
      - rust/
      - ui/
      - python/     <- create binding here
   datafusion/
   datafusion-cli/
   ...
   ```
   
   or should I update current datafusion python binding inside existing `python/` directory?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] djKooks commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
djKooks commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899453613


   @andygrove 
   Would it be okay to put like following?
   ```
   ...
   ballista/
      - rust/
      - ui/
      - python/     <- create binding here
   datafusion/
   datafusion-cli/
   ...
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] jorgecarleitao commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
jorgecarleitao commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899490741


   I agree that this makes the most sense 👍
   
   Out of curiosity, do the bindings come with the client and executors, or just the client?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] alamb commented on issue #861: Implement Python bindings for BallistaContext

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #861:
URL: https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899816612


   I agree having a separate python binding for Ballista in the location suggested by @djKooks  in https://github.com/apache/arrow-datafusion/issues/861#issuecomment-899453613 makes sense to me


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org