You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/01/06 06:04:18 UTC
[GitHub] [arrow] jorgecarleitao opened a new pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
jorgecarleitao opened a new pull request #9111:
URL: https://github.com/apache/arrow/pull/9111
I removed all workflows so that they do not get triggered on this PR, as there will be a lot of experimenting and I do not want to trigger those flows.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kszucs commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-755296467
I set up a pipeline for Rust. You can see the available pipelines here https://buildkite.com/apache-arrow
The dispatcher is responsible to trigger other pipelines, it uses the following configuration:
```yml
steps:
# if push then compare to the previous commit
- label: "Triggering pipelines"
# if pull request
plugins:
- chronotc/monorepo-diff#v1.2.0:
diff: .buildkite/pull-request-diff.sh ${BUILDKITE_PULL_REQUEST_BASE_BRANCH} ${BUILDKITE_COMMIT}
watch:
- path: go/
config:
trigger: arrow-go
- path: rust/
config:
trigger: arrow-rust
- path: cpp
config:
trigger: arrow-c-plus-plus
- path: python/
config:
trigger: arrow-python
```
Since we have no agents running at the moment you won't be able to trigger builds.
I'll try to configure a machine in the upcoming days, but we have network provider issues with our self hosted workers.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kszucs commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-756953345
Preferably, of course it comes with a maintenance cost.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kszucs commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-756953345
Preferably, of course it comes with a maintenance cost.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kszucs commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-756747506
Note that this has a downside, buildkite won't be available for apache/arrow forks.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-755101831
https://issues.apache.org/jira/browse/ARROW-11140
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] mqy commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
mqy commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-756740275
I can't wait for this! Current CI is slower than little snails!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] alamb commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
alamb commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-789646411
@jorgecarleitao I am closing this PR for the time being to clean up the Rust/Arrow PR backlog. Please let me know if this is a mistake
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorgecarleitao commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
jorgecarleitao commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-765638937
@wesm , is there any update around this? If we do not plan to pursue this, please let me know and we close this PR.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kszucs commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-756747506
Note that this has a downside, buildkite won't be available for apache/arrow forks.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kszucs edited a comment on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
kszucs edited a comment on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-755296467
I set up a pipeline for Rust. You can see the available pipelines here https://buildkite.com/apache-arrow
The dispatcher is responsible to trigger other pipelines, it uses the following configuration:
```yaml
steps:
- label: "Triggering pipelines"
plugins:
- chronotc/monorepo-diff#v1.2.0:
diff: .buildkite/pull-request-diff.sh ${BUILDKITE_PULL_REQUEST_BASE_BRANCH} ${BUILDKITE_COMMIT}
watch:
- path: go/
config:
trigger: arrow-go
- path: rust/
config:
trigger: arrow-rust
- path: cpp
config:
trigger: arrow-c-plus-plus
- path: python/
config:
trigger: arrow-python
```
The rust pipeline loads the `rust.yml`:
```yaml
steps:
- command: buildkite-agent pipeline upload .buildkite/rust.yml
```
Since we have no agents running at the moment you won't be able to trigger builds.
I'll try to configure a machine in the upcoming days, but we have network provider issues with our self hosted workers.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kszucs edited a comment on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
kszucs edited a comment on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-755296467
I set up a pipeline for Rust. You can see the available pipelines here https://buildkite.com/apache-arrow
The dispatcher is responsible to trigger other pipelines, it uses the following configuration:
```yaml
steps:
# if push then compare to the previous commit
- label: "Triggering pipelines"
# if pull request
plugins:
- chronotc/monorepo-diff#v1.2.0:
diff: .buildkite/pull-request-diff.sh ${BUILDKITE_PULL_REQUEST_BASE_BRANCH} ${BUILDKITE_COMMIT}
watch:
- path: go/
config:
trigger: arrow-go
- path: rust/
config:
trigger: arrow-rust
- path: cpp
config:
trigger: arrow-c-plus-plus
- path: python/
config:
trigger: arrow-python
```
The rust pipeline loads the `rust.yml`:
```yaml
steps:
- command: buildkite-agent pipeline upload .buildkite/rust.yml
```
Since we have no agents running at the moment you won't be able to trigger builds.
I'll try to configure a machine in the upcoming days, but we have network provider issues with our self hosted workers.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] alamb closed pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
alamb closed pull request #9111:
URL: https://github.com/apache/arrow/pull/9111
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorgecarleitao commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
jorgecarleitao commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-756901698
> Note that this has a downside, buildkite won't be available for apache/arrow forks.
Yeap. That is a downside. But we plan to have them running for open PRs, right?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] alamb commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
alamb commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-778610934
@jorgecarleitao
What is the status of this PR?
As part of trying to clean up the backlog of Rust PRs in this repo, I am going through seemingly stale PRs and pinging the authors to see if there are any plans to continue the work or conversation.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] mqy commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
mqy commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-756740275
I can't wait for this! Current CI is slower than little snails!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorgecarleitao commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
jorgecarleitao commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-755766760
Ok, I think that this is now ready for a spin. It took a bit more than I antecipated, but the core work is ready. This basically deprecates all our rust jobs on github, replacing them by equivalents on buildkite.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorgecarleitao commented on pull request #9111: ARROW-11140: [Rust] [CI] Experimenting with Buildkite
Posted by GitBox <gi...@apache.org>.
jorgecarleitao commented on pull request #9111:
URL: https://github.com/apache/arrow/pull/9111#issuecomment-756901698
> Note that this has a downside, buildkite won't be available for apache/arrow forks.
Yeap. That is a downside. But we plan to have them running for open PRs, right?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org