You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/09/29 01:44:05 UTC
[GitHub] [arrow-ballista] andygrove opened a new issue, #292: User Guide: Document using HDFS and S3
andygrove opened a new issue, #292:
URL: https://github.com/apache/arrow-ballista/issues/292
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
Once https://github.com/apache/arrow-ballista/pull/290 and https://github.com/apache/arrow-ballista/pull/274 are merged, add a section on HDFS and S3.
**Describe the solution you'd like**
**Describe alternatives you've considered**
**Additional context**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-ballista] saikrishna1-bidgely commented on issue #292: User Guide: Document using HDFS and S3
Posted by GitBox <gi...@apache.org>.
saikrishna1-bidgely commented on issue #292:
URL: https://github.com/apache/arrow-ballista/issues/292#issuecomment-1371369847
Is loading the data from S3 possible with a distributed setup right now? If so, can you provide a small example?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-ballista] nate-kuhl commented on issue #292: User Guide: Document using HDFS and S3
Posted by GitBox <gi...@apache.org>.
nate-kuhl commented on issue #292:
URL: https://github.com/apache/arrow-ballista/issues/292#issuecomment-1367029807
@andygrove do you know if there is documentation anywhere on how to declare an object store (s3 or HDFS) in Ballista?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] User Guide: Document using HDFS and S3 [datafusion-ballista]
Posted by "milenkovicm (via GitHub)" <gi...@apache.org>.
milenkovicm closed issue #292: User Guide: Document using HDFS and S3
URL: https://github.com/apache/datafusion-ballista/issues/292
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
[GitHub] [arrow-ballista] onthebridgetonowhere commented on issue #292: User Guide: Document using HDFS and S3
Posted by GitBox <gi...@apache.org>.
onthebridgetonowhere commented on issue #292:
URL: https://github.com/apache/arrow-ballista/issues/292#issuecomment-1264678080
Probably we need to also document using GCS and Azure, once #308 is merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] User Guide: Document using HDFS and S3 [datafusion-ballista]
Posted by "milenkovicm (via GitHub)" <gi...@apache.org>.
milenkovicm commented on issue #292:
URL: https://github.com/apache/datafusion-ballista/issues/292#issuecomment-2814098167
We have examples which cover this issue: https://github.com/apache/datafusion-ballista/blob/main/examples/examples/custom-executor.rs
Will close this issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org