You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "dfinninger (via GitHub)" <gi...@apache.org> on 2025/06/18 22:50:41 UTC
[I] Was GCS support removed? [datafusion-ballista]
dfinninger opened a new issue, #1274:
URL: https://github.com/apache/datafusion-ballista/issues/1274
Hi, we're trying to make Ballista read parquet files in Google Cloud Storage. It looks like support for GCS was added in 2023: https://github.com/apache/datafusion-ballista/pull/805. However, I can't find a reference to that anymore and there's nothing in the commit log about removing support for GCS.
I see the comments in the `object_store.rs` file about S3 support being a template for extensions. Are we expected to write our own implementation for GCS then build the binaries ourselves? Or has that been left to the community to build a version of Ballista that supports each cloud provider's blob storage?
I'm not necessarily asking for GCS support, but clarification around the current state and thoughts on the future.
Thanks for all of y'alls work building a cool query system!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Was GCS support removed? [datafusion-ballista]
Posted by "milenkovicm (via GitHub)" <gi...@apache.org>.
milenkovicm commented on issue #1274:
URL: https://github.com/apache/datafusion-ballista/issues/1274#issuecomment-2988967946
I'll close this issue if ok with you @dfinninger
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Was GCS support removed? [datafusion-ballista]
Posted by "milenkovicm (via GitHub)" <gi...@apache.org>.
milenkovicm commented on issue #1274:
URL: https://github.com/apache/datafusion-ballista/issues/1274#issuecomment-2985986246
In short users should extend ballista to support object store they need. S3 is a bit special case.
You can find more details how to do that in the examples.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Was GCS support removed? [datafusion-ballista]
Posted by "milenkovicm (via GitHub)" <gi...@apache.org>.
milenkovicm commented on issue #1274:
URL: https://github.com/apache/datafusion-ballista/issues/1274#issuecomment-2987246404
Built in object store registry has been removed in #1114 and #1230 brought back s3 as make sense to have some object store to provide users easy way to test ballista without need to configure it (s3 was chosen as with minio it was easiest store to get started)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Was GCS support removed? [datafusion-ballista]
Posted by "milenkovicm (via GitHub)" <gi...@apache.org>.
milenkovicm closed issue #1274: Was GCS support removed?
URL: https://github.com/apache/datafusion-ballista/issues/1274
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org