You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/01/07 08:22:38 UTC

[GitHub] [arrow] jorgecarleitao commented on pull request #9120: ARROW-11159: [Developer] Consolidate pull request related jobs

jorgecarleitao commented on pull request #9120:
URL: https://github.com/apache/arrow/pull/9120#issuecomment-755962940


   My hypothesis for a slow queue is that it is driven by cost: we simply have too many expensive (but unnecessary) jobs running.
   
   1. Every push triggers a 30m+ job (integration tests). Only about 5m of this job is the actual testing
   2. jobs are not canceled if there is a push after the push that triggered the job, even though those jobs are very likely not relevant once there is a new commit / rebase.
   3. there are jobs from language X running on very push to a user's repo, even when code for X does not change.
   
   These 3 aspects very quickly fill any queue.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org