You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "westonpace (via GitHub)" <gi...@apache.org> on 2023/06/02 05:02:14 UTC

[GitHub] [arrow] westonpace commented on issue #35730: [Python] write_dataset does not preserve non-nullable columns in schema

westonpace commented on issue #35730:
URL: https://github.com/apache/arrow/issues/35730#issuecomment-1573147552

   @raulcd 
   
   The error is a bit of a red herring.  It is not building Arrow-C++.  Instead it is downloading Arrow-C++.  If you look at a passing build (e.g. from the nightly tests) you can see:
   
   ```
   2023-05-30T01:07:19.3429074Z * installing *source* package ‘arrow’ ...
   2023-05-30T01:07:19.3429654Z ** using staged installation
   2023-05-30T01:07:19.3429994Z *** Found libcurl and OpenSSL >= 1.1
   2023-05-30T01:07:19.3430691Z trying URL 'https://nightlies.apache.org/arrow/r/libarrow/bin/linux-openssl-1.1/arrow-12.0.0.9000.zip'
   2023-05-30T01:07:19.3431226Z Error in download.file(from_url, to_file, quiet = hush) : 
   2023-05-30T01:07:19.3431942Z   cannot open URL 'https://nightlies.apache.org/arrow/r/libarrow/bin/linux-openssl-1.1/arrow-12.0.0.9000.zip'
   2023-05-30T01:07:19.3432612Z *** Downloading libarrow binary failed for version 12.0.0.9000 (linux-openssl-1.1)
   2023-05-30T01:07:19.3433276Z     at https://nightlies.apache.org/arrow/r/libarrow/bin/linux-openssl-1.1/arrow-12.0.0.9000.zip
   2023-05-30T01:07:19.3433789Z *** Found local C++ source: '/arrow/cpp'
   2023-05-30T01:07:19.3434126Z *** Building libarrow from source
   2023-05-30T01:07:19.3434552Z     For build options and troubleshooting, see the install guide:
   2023-05-30T01:07:19.3435014Z     https://arrow.apache.org/docs/r/articles/install.html
   ```
   
   On the other hand, if you look at these failing builds, you see:
   
   ```
   2023-06-01T22:45:52.2820480Z * installing *source* package ‘arrow’ ...
   2023-06-01T22:45:52.2820835Z ** using staged installation
   2023-06-01T22:45:52.2826960Z **** pkg-config not installed, setting ARROW_DEPENDENCY_SOURCE=BUNDLED
   2023-06-01T22:45:52.2827523Z *** Found libcurl and OpenSSL >= 1.1
   2023-06-01T22:45:52.2830096Z trying URL 'https://apache.jfrog.io/artifactory/arrow/r/12.0.0/libarrow/bin/linux-openssl-1.1/arrow-12.0.0.zip'
   2023-06-01T22:45:52.2830790Z Content type 'application/zip' length 40016664 bytes (38.2 MB)
   2023-06-01T22:45:52.2831184Z ==================================================
   2023-06-01T22:45:52.2835569Z downloaded 38.2 MB
   2023-06-01T22:45:52.2835774Z 
   2023-06-01T22:45:52.2836129Z *** Successfully retrieved C++ binaries (linux-openssl-1.1)
   ```
   
   So the nightly test looks for `12.0.0.9000` which, of course, doesn't exist.  Then it falls back to building from source.  This is what we want.
   
   The test build you've shared is looking for `12.0.0` (shouldn't this be `12.0.1`?)  It finds it, and then it doesn't build Arrow-C++ from source.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org