You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/11/13 14:22:47 UTC
[GitHub] [spark] melin opened a new pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
melin opened a new pull request #30369:
URL: https://github.com/apache/spark/pull/30369
update parquet version 1.11.1 and avro version 1.9.2，iceberg rely on these versions
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun closed pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun closed pull request #30369:
URL: https://github.com/apache/spark/pull/30369
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #30369:
URL: https://github.com/apache/spark/pull/30369#issuecomment-726794317
Can one of the admins verify this patch?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] srowen commented on pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
srowen commented on pull request #30369:
URL: https://github.com/apache/spark/pull/30369#issuecomment-727584535
I think this has more implications for compatibility with other libraries.
There are already JIRAs for this.
You need to update the deps/ files too.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #30369:
URL: https://github.com/apache/spark/pull/30369#issuecomment-726794317
Can one of the admins verify this patch?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] gemelen commented on pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
gemelen commented on pull request #30369:
URL: https://github.com/apache/spark/pull/30369#issuecomment-729798444
@melin there is one more place to upgrade Avro dependency version, in project/plugins.sbt
Please, see https://github.com/apache/spark/blob/master/project/plugins.sbt#L37
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #30369:
URL: https://github.com/apache/spark/pull/30369#issuecomment-726813452
cc @sunchao
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #30369:
URL: https://github.com/apache/spark/pull/30369#issuecomment-726794944
Can one of the admins verify this patch?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #30369:
URL: https://github.com/apache/spark/pull/30369#issuecomment-731922960
Thank you for making a PR, @melin . For now, I'll close this PR in favor of the prior approaches.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] sunchao commented on pull request #30369: update parquet version 1.11.1 and avro version 1.9.2
Posted by GitBox <gi...@apache.org>.
sunchao commented on pull request #30369:
URL: https://github.com/apache/spark/pull/30369#issuecomment-729918635
Sorry for the late reply. Yes @melin : there's ongoing effort on this. Please see #27609 and #26804 for details.
To make the migration smooth we'll also need to upgrade Hive because 2.3.7 is using an old Avro version with incompatible API usage against Avro 1.9+. Therefore we're fixing that in Hive branch-2.3 and plan to do a new release after that. The details is in https://issues.apache.org/jira/browse/HIVE-21737.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org