You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/01/07 04:57:53 UTC
[GitHub] [arrow] kou opened a new pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs
kou opened a new pull request #9120:
URL: https://github.com/apache/arrow/pull/9120
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #9120:
URL: https://github.com/apache/arrow/pull/9120#issuecomment-756615443
1. It seems that we need to speed up integration test job. (Caching built binaries and reusing not changed binaries?)
2. https://github.com/apache/arrow/graphs/commit-activity shows that we have about 10 pushes in apache/arrow master per day. If we can fix 1., this may not be a critical.
3. It seems that we need auto cancel feature that exists on Travis CI and AppVeyor.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #9120:
URL: https://github.com/apache/arrow/pull/9120#issuecomment-755885833
https://issues.apache.org/jira/browse/ARROW-11159
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #9120:
URL: https://github.com/apache/arrow/pull/9120#issuecomment-755957446
This may not address the slow queue... We don't know without try...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou closed pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs
Posted by GitBox <gi...@apache.org>.
kou closed pull request #9120:
URL: https://github.com/apache/arrow/pull/9120
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorgecarleitao commented on pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs
Posted by GitBox <gi...@apache.org>.
jorgecarleitao commented on pull request #9120:
URL: https://github.com/apache/arrow/pull/9120#issuecomment-755962940
My hypothesis for a slow queue is that it is driven by cost: we simply have too many expensive (but unnecessary) jobs running.
1. Every push triggers a 30m+ job (integration tests). Only about 5m of this job is the actual testing
2. jobs are not canceled if there is a push after the push that triggered the job, even though those jobs are very likely not relevant once there is a new commit / rebase.
3. there are jobs from language X running on very push to a user's repo, even when code for X does not change.
These 3 aspects very quickly fill any queue.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #9120:
URL: https://github.com/apache/arrow/pull/9120#issuecomment-755884354
Demo: https://github.com/kou/arrow/pull/10
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #9120:
URL: https://github.com/apache/arrow/pull/9120#issuecomment-756615443
1. It seems that we need to speed up integration test job. (Caching built binaries and reusing not changed binaries?)
2. https://github.com/apache/arrow/graphs/commit-activity shows that we have about 10 pushes in apache/arrow master per day. If we can fix 1., this may not be a critical.
3. It seems that we need auto cancel feature that exists on Travis CI and AppVeyor.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org