You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 21:53:52 UTC
[GitHub] [beam] damccorm opened a new issue, #21218: Zstandard codec for Avro
damccorm opened a new issue, #21218:
URL: https://github.com/apache/beam/issues/21218
Currently AvroSource supports only snappy, deflate, bzip2 and xz codecs.
Avro library allows to write files with Zstandard codec too. Also BEAM-6365 added support of the codec but only for Text files.
Would be helpful to have Zstandard for Avro as well.
Imported from Jira [BEAM-13319](https://issues.apache.org/jira/browse/BEAM-13319). Original Jira may contain additional context.
Reported by: splix.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] yyy1000 commented on issue #21218: Zstandard codec for Avro
Posted by GitBox <gi...@apache.org>.
yyy1000 commented on issue #21218:
URL: https://github.com/apache/beam/issues/21218#issuecomment-1363464596
OK, I will find other tasks to do first. :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] yyy1000 commented on issue #21218: Zstandard codec for Avro
Posted by GitBox <gi...@apache.org>.
yyy1000 commented on issue #21218:
URL: https://github.com/apache/beam/issues/21218#issuecomment-1362566315
Interested in this!
I'm new to this and may have misunderstanding. :)
When I checked the original Jira, I found this PR(https://github.com/apache/beam/pull/16271) is still Work In Progress.
Could this task can be done before that?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] RustedBones commented on issue #21218: Zstandard codec for Avro
Posted by "RustedBones (via GitHub)" <gi...@apache.org>.
RustedBones commented on issue #21218:
URL: https://github.com/apache/beam/issues/21218#issuecomment-1580232513
I think this can be closed since there is new avro extension module is released
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] aromanenko-dev commented on issue #21218: Zstandard codec for Avro
Posted by GitBox <gi...@apache.org>.
aromanenko-dev commented on issue #21218:
URL: https://github.com/apache/beam/issues/21218#issuecomment-1363011528
I think it's blocked by current old Avro version that Beam support. We are working on extracting Avro into a separate extension and add a support of multiple Avro versions there (more details here https://github.com/apache/beam/issues/24292).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #21218: Zstandard codec for Avro
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #21218:
URL: https://github.com/apache/beam/issues/21218#issuecomment-1362887632
@RustedBones @kennknowles @aromanenko-dev @mosche could one of you comment here? (FYI, I imagine responses may be delayed as we're in the midst of holiday season)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] mosche closed issue #21218: Zstandard codec for Avro
Posted by "mosche (via GitHub)" <gi...@apache.org>.
mosche closed issue #21218: Zstandard codec for Avro
URL: https://github.com/apache/beam/issues/21218
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org