You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2023/09/27 20:14:57 UTC
[GitHub] [iceberg] aokolnychyi opened a new pull request, #8667: Spark 3.5: Requested advisory partition size must respect Spark config
aokolnychyi opened a new pull request, #8667:
URL: https://github.com/apache/iceberg/pull/8667
This PR adjusts the requested advisory partition size to be at least as big as the configured built-in Spark value. This is needed to avoid breaking pipelines where this property was configured big enough manually.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] singhpk234 commented on pull request #8667: Spark 3.5: Requested advisory partition size must respect Spark config
Posted by "singhpk234 (via GitHub)" <gi...@apache.org>.
singhpk234 commented on PR #8667:
URL: https://github.com/apache/iceberg/pull/8667#issuecomment-1738108256
+1 sounds like a good idea !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi merged pull request #8667: Spark 3.5: Requested advisory partition size must respect Spark config
Posted by "aokolnychyi (via GitHub)" <gi...@apache.org>.
aokolnychyi merged PR #8667:
URL: https://github.com/apache/iceberg/pull/8667
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] rdblue commented on pull request #8667: Spark 3.5: Requested advisory partition size must respect Spark config
Posted by "rdblue (via GitHub)" <gi...@apache.org>.
rdblue commented on PR #8667:
URL: https://github.com/apache/iceberg/pull/8667#issuecomment-1738060071
I think it's a good idea to make sure we don't lower the advisory size if it is set in the Spark conf.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi commented on pull request #8667: Spark 3.5: Requested advisory partition size must respect Spark config
Posted by "aokolnychyi (via GitHub)" <gi...@apache.org>.
aokolnychyi commented on PR #8667:
URL: https://github.com/apache/iceberg/pull/8667#issuecomment-1738122515
Thanks, @rdblue @singhpk234!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org