You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "kou (via GitHub)" <gi...@apache.org> on 2023/06/22 01:02:58 UTC

[GitHub] [arrow] kou opened a new pull request, #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

kou opened a new pull request, #36230:
URL: https://github.com/apache/arrow/pull/36230

   ### Rationale for this change
   
   Our build requires many disk space.
   
   ### What changes are included in this PR?
   
   Remove unused files.
   
   ### Are these changes tested?
   
   Yes.
   
   ### Are there any user-facing changes?
   
   No.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1606842803

   Thanks!
   (You can push to this branch directly. :-)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] pitrou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1602917144

   > Wow! I didn't notice that the big size was caused by debug option. I'll use the approach.
   
   Can we find a way to do that on all debug CI builds?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] github-actions[bot] commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1601876895

   Revision: 93273d5ac9b056269a8587c46c58a4dd0f8fcfc7
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-ab7776eab9](https://github.com/ursacomputing/crossbow/branches/all?query=actions-ab7776eab9)
   
   |Task|Status|
   |----|------|
   |almalinux-8-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-almalinux-8-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340462171/jobs/9680303874)|
   |almalinux-8-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-almalinux-8-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340461873/jobs/9680303223)|
   |almalinux-9-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-almalinux-9-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340463976/jobs/9680307667)|
   |almalinux-9-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-almalinux-9-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340462996/jobs/9680305574)|
   |amazon-linux-2-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-amazon-linux-2-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340463126/jobs/9680305811)|
   |amazon-linux-2-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-amazon-linux-2-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340463644/jobs/9680306985)|
   |amazon-linux-2023-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-amazon-linux-2023-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340462317/jobs/9680304166)|
   |amazon-linux-2023-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-amazon-linux-2023-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340461601/jobs/9680302719)|
   |centos-7-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-centos-7-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340461482/jobs/9680302473)|
   |centos-8-stream-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-centos-8-stream-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340462830/jobs/9680305204)|
   |centos-8-stream-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-centos-8-stream-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340464770/jobs/9680309191)|
   |centos-9-stream-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-centos-9-stream-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340464301/jobs/9680308340)|
   |centos-9-stream-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-centos-9-stream-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340463806/jobs/9680307299)|
   |debian-bookworm-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-debian-bookworm-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340463517/jobs/9680306694)|
   |debian-bookworm-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-debian-bookworm-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340463342/jobs/9680306360)|
   |debian-bullseye-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-debian-bullseye-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340465362/jobs/9680310343)|
   |debian-bullseye-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-debian-bullseye-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340462024/jobs/9680303531)|
   |preview-docs|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-preview-docs)](https://github.com/ursacomputing/crossbow/actions/runs/5340464197/jobs/9680308130)|
   |ubuntu-focal-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-ubuntu-focal-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340464966/jobs/9680309585)|
   |ubuntu-focal-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-ubuntu-focal-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340462671/jobs/9680304885)|
   |ubuntu-jammy-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-ubuntu-jammy-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340465182/jobs/9680309973)|
   |ubuntu-jammy-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-ubuntu-jammy-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340462489/jobs/9680304506)|
   |ubuntu-kinetic-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-ubuntu-kinetic-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5340463239/jobs/9680306117)|
   |ubuntu-kinetic-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-ab7776eab9-github-ubuntu-kinetic-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5340461714/jobs/9680302939)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] github-actions[bot] commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1602070776

   Revision: 622882503369ab81905d0144c229adb3b1ddfaaa
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-360c4a7a3a](https://github.com/ursacomputing/crossbow/branches/all?query=actions-360c4a7a3a)
   
   |Task|Status|
   |----|------|
   |preview-docs|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-360c4a7a3a-github-preview-docs)](https://github.com/ursacomputing/crossbow/actions/runs/5342268715/jobs/9683909026)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] pitrou commented on a diff in pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on code in PR #36230:
URL: https://github.com/apache/arrow/pull/36230#discussion_r1238349417


##########
dev/tasks/docs/github.linux.yml:
##########
@@ -21,13 +21,59 @@
 
 jobs:
   test:
-    name: Docs Preview 
+    name: Docs Preview
     runs-on: ubuntu-latest
 {{ macros.github_set_env(env) }}
     steps:
       {{ macros.github_checkout_arrow(fetch_depth=fetch_depth|default(1))|indent }}
       {{ macros.github_install_archery()|indent }}
 
+      - name: Free up disk space

Review Comment:
   Is it possible to add some kind of macro for this step instead of repeating it in two different files?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1606908548

   @thisisnic Sorry. Could you also check this?
   
   https://github.com/apache/arrow/actions/runs/5374927859/jobs/9750784797?pr=36230#step:4:9
   
   ```text
   Error! Scalar-class
   schema-class missing from ./r/_pkgdown.yml
   ```
   
   (You can push a fix to this branch directly.)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1608293998

   Thanks! Rebased.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] github-actions[bot] commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1601875133

   :warning: GitHub issue #36200 **has been automatically assigned in GitHub** to PR creator.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1601937995

   @github-actions crossbow submit preview-docs


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] pitrou commented on a diff in pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on code in PR #36230:
URL: https://github.com/apache/arrow/pull/36230#discussion_r1238348118


##########
dev/tasks/linux-packages/github.linux.yml:
##########
@@ -72,6 +82,7 @@ jobs:
           # 376MB
           sudo rm -rf /opt/hostedtoolcache/node || :
           df -h
+          df -h

Review Comment:
   Why twice?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] thisisnic commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1607095482

   @kou The failing step is due to a technicality on how we check for missing sections in the doc.  Since we implemented the check in 2021, the pkgdown package now already does this check and their method is better than the one I implemented for us to do in CI.  I've opened #36300 to remove it, so once that's passed CI and merged, you'll need to rebase from that.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] thisisnic commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1606817188

   @kou Having issues trying to add fix commit to your branch; here's a PR: https://github.com/kou/arrow/pull/13


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1602068671

   @github-actions crossbow submit preview-docs


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] pitrou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1602457889

   @kou The C++ build directory takes more than 8GB in this build, which is insane (partly due to building bundled gRPC and google-cloud-cpp with *static* libraries).
   
   This can be trimmed down significantly by reducing the size of debug information (which isn't very useful on CI anyway). If I do:
   ```
   export ARROW_C_FLAGS_DEBUG=-g1
   export ARROW_CXX_FLAGS_DEBUG=-g1
   ```
   then the size of the build directory goes down from 8GB to 5GB...
   
   We should probably do so on all gcc-based builds.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] github-actions[bot] commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1605882981

   Revision: 3c78e3929a785010354c196d02c8ce7987e66b4a
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-1328ed330f](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1328ed330f)
   
   |Task|Status|
   |----|------|
   |almalinux-8-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-almalinux-8-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074870/jobs/9738677340)|
   |almalinux-8-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-almalinux-8-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074045/jobs/9738676031)|
   |almalinux-9-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-almalinux-9-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368073932/jobs/9738675683)|
   |almalinux-9-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-almalinux-9-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368075016/jobs/9738677609)|
   |amazon-linux-2-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-amazon-linux-2-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074337/jobs/9738676395)|
   |amazon-linux-2-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-amazon-linux-2-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074207/jobs/9738676165)|
   |amazon-linux-2023-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-amazon-linux-2023-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074762/jobs/9738677157)|
   |amazon-linux-2023-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-amazon-linux-2023-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074669/jobs/9738677006)|
   |centos-7-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-centos-7-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074151/jobs/9738676089)|
   |centos-8-stream-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-centos-8-stream-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074945/jobs/9738677469)|
   |centos-8-stream-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-centos-8-stream-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368075265/jobs/9738677987)|
   |centos-9-stream-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-centos-9-stream-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074559/jobs/9738676739)|
   |centos-9-stream-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-centos-9-stream-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368075390/jobs/9738678178)|
   |debian-bookworm-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-debian-bookworm-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074836/jobs/9738677267)|
   |debian-bookworm-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-debian-bookworm-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074398/jobs/9738676498)|
   |debian-bullseye-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-debian-bullseye-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074640/jobs/9738676948)|
   |debian-bullseye-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-debian-bullseye-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368075342/jobs/9738678106)|
   |preview-docs|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-preview-docs)](https://github.com/ursacomputing/crossbow/actions/runs/5368074498/jobs/9738676612)|
   |ubuntu-focal-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-ubuntu-focal-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074598/jobs/9738676823)|
   |ubuntu-focal-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-ubuntu-focal-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074255/jobs/9738676267)|
   |ubuntu-jammy-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-ubuntu-jammy-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368073870/jobs/9738675618)|
   |ubuntu-jammy-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-ubuntu-jammy-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074275/jobs/9738676305)|
   |ubuntu-lunar-amd64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-ubuntu-lunar-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/5368075170/jobs/9738677868)|
   |ubuntu-lunar-arm64|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1328ed330f-github-ubuntu-lunar-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/5368074715/jobs/9738677088)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1603737496

   Or we just don't use `-g1` for Python jobs. Our GDB plugin's tests are only run in Python jobs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1601874881

   @github-actions crossbow submit preview-docs -g linux


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] github-actions[bot] commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1601939445

   Revision: bcf5d0bc90a7fa8f1b3dcccdb7848330965ca5fa
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-1e753ff3c0](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1e753ff3c0)
   
   |Task|Status|
   |----|------|
   |preview-docs|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-1e753ff3c0-github-preview-docs)](https://github.com/ursacomputing/crossbow/actions/runs/5341031751/jobs/9681458183)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] pitrou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1602918366

   Also, it might make compilation caching more efficient (since the cached files may be smaller)...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on a diff in pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on code in PR #36230:
URL: https://github.com/apache/arrow/pull/36230#discussion_r1238536474


##########
dev/tasks/linux-packages/github.linux.yml:
##########
@@ -72,6 +82,7 @@ jobs:
           # 376MB
           sudo rm -rf /opt/hostedtoolcache/node || :
           df -h
+          df -h

Review Comment:
   Oh, it's garbage.



##########
dev/tasks/docs/github.linux.yml:
##########
@@ -21,13 +21,59 @@
 
 jobs:
   test:
-    name: Docs Preview 
+    name: Docs Preview
     runs-on: ubuntu-latest
 {{ macros.github_set_env(env) }}
     steps:
       {{ macros.github_checkout_arrow(fetch_depth=fetch_depth|default(1))|indent }}
       {{ macros.github_install_archery()|indent }}
 
+      - name: Free up disk space

Review Comment:
   Yes. But the debug option approach is better.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1610943380

   The "R / AMD64 Ubuntu 20.04 R 4.2 Force-Tests true" failure is caused by #36346. So I want to merge this.
   
   If nobody objects it, I'll merge this tomorrow.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1603734668

   > Can we find a way to do that on all debug CI builds (except if MSVC is used, probably)?
   
   We can detect whether on GitHub Actions or not by `GITHUB_ACTIONS=true`. So we can use `-g1` by default on GItHub Actions.
   
   But... we can't use `-g1` for GDB plugin tests...
   https://github.com/apache/arrow/actions/runs/5353229013/jobs/9708905231?pr=36230#step:6:6529
   
   ```text
   _______________________________ test_arrays_heap _______________________________
   
   gdb_arrow = <pyarrow.tests.test_gdb.GdbSession object at 0x7f460d9a1910>
   
       def test_arrays_heap(gdb_arrow):
           # Null
   >       check_heap_repr(
               gdb_arrow, "heap_null_array",
               "arrow::NullArray of length 2, offset 0, null count 2")
   
   opt/conda/envs/arrow/lib/python3.9/site-packages/pyarrow/tests/test_gdb.py:770: 
   _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
   
   gdb = <pyarrow.tests.test_gdb.GdbSession object at 0x7f460d9a1910>
   expr = 'heap_null_array'
   expected = 'arrow::NullArray of length 2, offset 0, null count 2'
   
       def check_heap_repr(gdb, expr, expected):
           """
           Check printing a heap-located value, given its address.
           """
           s = gdb.print_value(f"*{expr}")
           # GDB may prefix the value with an address or type specification
           if s != expected:
   >           assert s.endswith(f" {expected}")
   E           AssertionError: assert False
   E            +  where False = <built-in method endswith of str object at 0x55e0685ce330>(' arrow::NullArray of length 2, offset 0, null count 2')
   E            +    where <built-in method endswith of str object at 0x55e0685ce330> = '(std::__shared_ptr_access<arrow::Array, (__gnu_cxx::_Lock_policy)2, false, false>::element_type &) @0x55d33eb43a70: {...ields>}, _M_ptr = 0x55d33eb54bc0, _M_refcount = {_M_pi = 0x55d33eb54bb0}}, <No data fields>}, null_bitmap_data_ = 0x0}'.endswith
   
   opt/conda/envs/arrow/lib/python3.9/site-packages/pyarrow/tests/test_gdb.py:245: AssertionError
   ----------------------------- Captured stdout call -----------------------------
   p *heap_null_array
   $36 = (std::__shared_ptr_access<arrow::Array, (__gnu_cxx::_Lock_policy)2, false, false>::element_type &) @0x55d33eb43a70: {_vptr.Array = 0x7fa4501a6ff8 <vtable for arrow::NullArray+16>, data_ = {<std::__shared_ptr<arrow::ArrayData, (__gnu_cxx::_Lock_policy)2>> = {<std::__shared_ptr_access<arrow::ArrayData, (__gnu_cxx::_Lock_policy)2, false, false>> = {<No data fields>}, _M_ptr = 0x55d33eb54bc0, _M_refcount = {_M_pi = 0x55d33eb54bb0}}, <No data fields>}, null_bitmap_data_ = 0x0}
   (gdb) 
   ----------------------------- Captured stderr call -----------------------------
   Python Exception <class 'gdb.error'>: There is no member named id_.
   ```
   
   Hmm. We may need to use `-g1` only for bundled dependencies...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1606846595

   @github-actions crossbow submit preview-docs


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] conbench-apache-arrow[bot] commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "conbench-apache-arrow[bot] (via GitHub)" <gi...@apache.org>.
conbench-apache-arrow[bot] commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1618157957

   Conbench analyzed the 5 benchmark runs on commit `63b8091d`.
   
   There were 7 benchmark results indicating a performance regression:
   
   - Commit Run on `arm64-m6g-linux-compute` at [2023-06-29 05:41:30Z](http://conbench.ursa.dev/compare/runs/3c1a9e0bf8504ebcadb8c45680344ae9...92ba446c783649bdb423fc6dc23fa9ad/)
     - [params=real_time, source=cpp-micro, suite=arrow-io-file-benchmark](http://conbench.ursa.dev/compare/benchmarks/0649cd6c24967c09800009adc8dde0ee...0649d19d518171878000e812f12c9b85)
   
   - Commit Run on `arm64-t4g-linux-compute` at [2023-06-29 05:48:29Z](http://conbench.ursa.dev/compare/runs/10d992acb2a24fbe82b3f684bb892d6f...0b9cc102e09c4bfe9631b4cb225b1a54/)
     - [params=complex_expression/batch_size:100000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmark](http://conbench.ursa.dev/compare/benchmarks/0649cd905d2c749e8000eedeec1f38f3...0649d1b863397af68000ef4b5a239816)
   - and 5 more (see the report linked below)
   
   The [full Conbench report](https://github.com/apache/arrow/runs/14737615759) has more details.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1605882557

   @github-actions crossbow submit -g linux preview-docs


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1612394581

   Merged.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou merged pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou merged PR #36230:
URL: https://github.com/apache/arrow/pull/36230


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] github-actions[bot] commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1606851445

   Revision: 60bd46610a1732ce838ab91b0a413dcd0a1b31d8
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-8c79fd8f2e](https://github.com/ursacomputing/crossbow/branches/all?query=actions-8c79fd8f2e)
   
   |Task|Status|
   |----|------|
   |preview-docs|[![Github Actions](https://github.com/ursacomputing/crossbow/workflows/Crossbow/badge.svg?branch=actions-8c79fd8f2e-github-preview-docs)](https://github.com/ursacomputing/crossbow/actions/runs/5374980907/jobs/9750897499)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] kou commented on pull request #36230: GH-36200: [CI][Docs] Avoid "No space left on device"

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #36230:
URL: https://github.com/apache/arrow/pull/36230#issuecomment-1606717771

   The preview-docs job failure isn't "No space left on device".
   It's a R document generation failure.
   @thisisnic Could you check this failure?
   
   https://github.com/ursacomputing/crossbow/actions/runs/5368074498/jobs/9738676612#step:6:10165
   
   ```text
   -- Building function reference -------------------------------------------------
   Error: 
   ! in callr subprocess.
   Caused by error in `map2(.x, vec_index(.x), .f, ...)`:
   ! In index: 4.
   ---
   Standard output:
   == Building pkgdown site =======================================================
   Reading from: '/arrow/r'
   Writing to:   '/arrow/r/docs'
   -- Initialising site -----------------------------------------------------------
   Copying '../../usr/local/lib/R/site-library/pkgdown/BS5/assets/link.svg' to 'link.svg'
   Copying '../../usr/local/lib/R/site-library/pkgdown/BS5/assets/pkgdown.js' to 'pkgdown.js'
   Copying 'pkgdown/extra.js' to 'extra.js'
   Copying 'pkgdown/assets/versions.html' to 'versions.html'
   Copying 'pkgdown/assets/versions.json' to 'versions.json'
   Copying 'pkgdown/favicon/apple-touch-icon-120x120.png' to 'apple-touch-icon-120x120.png'
   Copying 'pkgdown/favicon/apple-touch-icon-152x152.png' to 'apple-touch-icon-152x152.png'
   Copying 'pkgdown/favicon/apple-touch-icon-180x180.png' to 'apple-touch-icon-180x180.png'
   Copying 'pkgdown/favicon/apple-touch-icon-60x60.png' to 'apple-touch-icon-60x60.png'
   Copying 'pkgdown/favicon/apple-touch-icon-76x76.png' to 'apple-touch-icon-76x76.png'
   Copying 'pkgdown/favicon/apple-touch-icon.png' to 'apple-touch-icon.png'
   Copying 'pkgdown/favicon/favicon-16x16.png' to 'favicon-16x16.png'
   Copying 'pkgdown/favicon/favicon-32x32.png' to 'favicon-32x32.png'
   Copying 'pkgdown/favicon/favicon.ico' to 'favicon.ico'
   -- Building home ---------------------------------------------------------------
   Writing 'authors.html'
   Reading 'PACKAGING.md'
   Writing 'PACKAGING.html'
   Reading 'STYLE.md'
   Writing 'STYLE.html'
   Writing '404.html'
   -- Building function reference -------------------------------------------------
   ---
   Backtrace:
   1. pkgdown::build_site(install = FALSE)
   2. pkgdown:::build_site_external(pkg = pkg, examples = examples, run_dont_run = run_d...
   3. callr::r(function(..., cli_colors, pkgdown_internet) { ...
   4. callr:::get_result(output = out, options)
   5. callr:::throw(callr_remote_error(remerr, output), parent = fix_msg(remerr[[3]]))
   ---
   Subprocess backtrace:
    1. pkgdown::build_site(...)
    2. pkgdown:::build_site_local(pkg = pkg, examples = examples, run_dont_run = run_dont...
    3. pkgdown::build_reference(pkg, lazy = lazy, examples = examples, run_dont_run = ru...
    4. pkgdown::build_reference_index(pkg)
    5. pkgdown::render_page(pkg, "reference-index", data = data_reference_index(pkg), ...
    6. pkgdown:::render_page_html(pkg, name = name, data = data, depth = depth)
    7. utils::modifyList(data_template(pkg, depth = depth), data)
    8. base::stopifnot(is.list(x), is.list(val))
    9. pkgdown:::data_reference_index(pkg)
   10. meta %>% purrr::imap(data_reference_index_rows, pkg = pkg) %>% ...
   11. base::unlist(., recursive = FALSE)
   12. purrr::compact(.)
   13. purrr::discard(.x, function(x) is_empty(.f(x)))
   14. purrr:::where_if(.x, .p, ...)
   15. purrr:::map_(.x, .p, ..., .type = "logical", .purrr_error_call = .purrr_error_call)
   16. purrr:::vctrs_vec_compat(.x, .purrr_user_env)
   17. purrr::imap(., data_reference_index_rows, pkg = pkg)
   18. purrr::map2(.x, vec_index(.x), .f, ...)
   19. purrr:::map2_("list", .x, .y, .f, ..., .progress = .progress)
   20. purrr:::with_indexed_errors(i = i, names = names, error_call = .purrr_error_call...
   21. base::withCallingHandlers(expr, error = function(cnd) { ...
   22. purrr:::call_with_cleanup(map2_impl, environment(), .type, .progress, ...
   23. local .f(.x[[i]], .y[[i]], ...)
   24. pkgdown:::section_topics(section$contents, pkg$topics, pkg$src_path)
   25. topics[select_topics(match_strings, topics), , ]
   26. `[.tbl_df`(topics, select_topics(match_strings, topics), , )
   27. pkgdown:::select_topics(match_strings, topics)
   28. purrr::map(match_strings, match_eval, env = match_env(topics))
   29. purrr:::map_("list", .x, .f, ..., .progress = .progress)
   30. purrr:::with_indexed_errors(i = i, names = names, error_call = .purrr_error_call...
   31. base::withCallingHandlers(expr, error = function(cnd) { ...
   32. purrr:::call_with_cleanup(map_impl, environment(), .type, .progress, ...
   33. local .f(.x[[i]], ...)
   34. base::tryCatch(eval(expr, env), error = function(e) { ...
   35. base::tryCatchList(expr, classes, parentenv, handlers)
   36. base::tryCatchOne(expr, names, parentenv, handlers[[1L]])
   37. value[[3L]](cond)
   38. pkgdown:::topic_must("be a known selector function", string, parent = e)
   39. rlang::abort(c(paste0("In '_pkgdown.yml', topic must ", message), x = paste0("N...
   40. | rlang:::signal_abort(cnd, .file)
   41. | base::signalCondition(cnd)
   42. (function (cnd) ...
   43. cli::cli_abort(message, location = i, name = name, parent = cnd, ...
   44. | rlang::abort(message, ..., call = call, use_cli_format = TRUE, ...
   45. | rlang:::signal_abort(cnd, .file)
   46. | base::signalCondition(cnd)
   47. (function (cnd) ...
   48. cli::cli_abort(message, location = i, name = name, parent = cnd, ...
   49. | rlang::abort(message, ..., call = call, use_cli_format = TRUE, ...
   50. | rlang:::signal_abort(cnd, .file)
   51. | base::signalCondition(cnd)
   52. global (function (e) ...
   Execution halted
   1
   ```
    


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org