You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/12/10 12:29:09 UTC
[GitHub] [iceberg] aokolnychyi opened a new pull request #1903: Spark: Speed up tests for extensions
aokolnychyi opened a new pull request #1903:
URL: https://github.com/apache/iceberg/pull/1903
There are quite some tests that perform shuffles so it makes sense to reduce the number of shuffle partitions to speed up tests.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] rymurr commented on pull request #1903: Spark: Speed up tests for extensions
Posted by GitBox <gi...@apache.org>.
rymurr commented on pull request #1903:
URL: https://github.com/apache/iceberg/pull/1903#issuecomment-742580227
interestingly this doesn't seem to have affected the run time for the CI job on master. Could be related to the load on the CI servers but the long job (java 8) actually took fractionally longer compared to last master run.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi commented on pull request #1903: Spark: Speed up tests for extensions
Posted by GitBox <gi...@apache.org>.
aokolnychyi commented on pull request #1903:
URL: https://github.com/apache/iceberg/pull/1903#issuecomment-742606904
Hm, it did reduce the time to execute tests for expire snapshots procedure from 44 s to 20s on my machine.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi commented on pull request #1903: Spark: Speed up tests for extensions
Posted by GitBox <gi...@apache.org>.
aokolnychyi commented on pull request #1903:
URL: https://github.com/apache/iceberg/pull/1903#issuecomment-742526994
I am going to merge this one as @rymurr approved it. It should reduce the verification time for PRs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi merged pull request #1903: Spark: Speed up tests for extensions
Posted by GitBox <gi...@apache.org>.
aokolnychyi merged pull request #1903:
URL: https://github.com/apache/iceberg/pull/1903
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer commented on pull request #1903: Spark: Speed up tests for extensions
Posted by GitBox <gi...@apache.org>.
RussellSpitzer commented on pull request #1903:
URL: https://github.com/apache/iceberg/pull/1903#issuecomment-742588390
I think the biggest issue with the CI server is that every suite still runs
in serial :/
On Thu, Dec 10, 2020 at 9:10 AM Ryan Murray <no...@github.com>
wrote:
> interestingly this doesn't seem to have affected the run time for the CI
> job on master. Could be related to the load on the CI servers but the long
> job (java 8) actually took fractionally longer compared to last master run.
>
> —
> You are receiving this because you are subscribed to this thread.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/iceberg/pull/1903#issuecomment-742580227>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AADE2YJ3QJ2QQ4IFUPHP5KTSUDQE5ANCNFSM4UU6KF7Q>
> .
>
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org