You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "paleolimbot (via GitHub)" <gi...@apache.org> on 2023/10/09 02:08:16 UTC
[PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
paleolimbot opened a new pull request, #38143:
URL: https://github.com/apache/arrow/pull/38143
### Rationale for this change
The NEWS file needs updating for 14.0.0.
### What changes are included in this PR?
The NEWS file is updated with commits since 13.0.0.
### Are these changes tested?
N/A
### Are there any user-facing changes?
No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350081101
##########
r/NEWS.md:
##########
@@ -19,6 +19,37 @@
# arrow 13.0.0.9000
+## Breaking changes
+
+## New features
+
+* Can't read in partitioning column in CSV datasets when both (non-hive) partition and schema supplied (#37658)
+* Add write_csv_dataset (#36436)
+* Add quoted_na argument to open_delim_dataset() (#37828)
+
+## Minor improvements and fixes
+
+* Add default descriptions in CsvParseOptions$create() docs (#37909)
+
+* Use `SafeCallIntoR()` to call garbage collector after a failed allocation (#37565)
+* Use RunWithCapturedR for reading Parquet files (#37274)
+* stringr helper functions drop calling environment when evaluating (#36784)
+* Expose Parquet ReaderProperties (#36992)
+* Split out R6 classes and convenience functions (#36394)
+* Documentation for read_parquet() et al needs updating (#37020)
+* calling read_parquet on S3 connections results in error message being ignored (#37024)
+* CRAN failures due to "invalid non-character version specification" (#37387)
+* Improve error message around add_filename (#37372)
+* Implement infer_schema.data.frame() (#37843)
+
+## Installation
+
+* Move macOS build system to nixlibs.R (#37684)
+* Add a message if we detect running under emulation (#37777)
+* Use currrently running R binary to compile test program (nix install) (#37225)
+* Provide extra output for failed builds (#37727)
Review Comment:
```suggestion
* Provide extra output for failed builds (@amoeba, #37727)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38143:
URL: https://github.com/apache/arrow/pull/38143#issuecomment-1752257957
:warning: GitHub issue #38142 **has been automatically assigned in GitHub** to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355177548
##########
r/NEWS.md:
##########
@@ -19,6 +19,51 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* Added `write_csv_dataset()` as a friendlier alternative to the existing
+ dataset writer (@dgreiss, #36436).
+* Added `quoted_na` argument to `open_delim_dataset()` (#37828).
Review Comment:
```suggestion
* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355232269
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
Review Comment:
```suggestion
```
Let's ditch this, users don't need to know we do a better job of not swallowing error messages in this bit of code.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350084405
##########
r/NEWS.md:
##########
@@ -19,6 +19,37 @@
# arrow 13.0.0.9000
+## Breaking changes
+
+## New features
+
+* Can't read in partitioning column in CSV datasets when both (non-hive) partition and schema supplied (#37658)
Review Comment:
A bit torn on this, as this felt more like a bugfix than a new feature, though happy to leave it in here from a messaging point-of-view (I guess technically we'd never implemented it in the first place...)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355183426
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
Review Comment:
```suggestion
* CSVs with a comma or other character as decimal mark can now be read in by the dataset
reading functions and new function `read_csv2_arrow()` (#38002).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355174880
##########
r/NEWS.md:
##########
@@ -19,6 +19,51 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* Added `write_csv_dataset()` as a friendlier alternative to the existing
+ dataset writer (@dgreiss, #36436).
+* Added `quoted_na` argument to `open_delim_dataset()` (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
Review Comment:
```suggestion
* `schema()` can now be called on `data.frame` objects to retrieve their inferred Arrow schema (#37843).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350525212
##########
r/NEWS.md:
##########
@@ -19,6 +19,46 @@
# arrow 13.0.0.9000
+## New features
+
+* The `schema` argument to `open_dataset()` is now supported when reading CSV
+ datasets (#37658).
Review Comment:
```suggestion
* When reading partitioned CSV datasets and supplying a schema to `open_dataset()`, the partition variables are now included in the resulting dataset (#37658).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350078459
##########
r/NEWS.md:
##########
@@ -19,6 +19,37 @@
# arrow 13.0.0.9000
+## Breaking changes
+
+## New features
+
+* Can't read in partitioning column in CSV datasets when both (non-hive) partition and schema supplied (#37658)
+* Add write_csv_dataset (#36436)
+* Add quoted_na argument to open_delim_dataset() (#37828)
+
+## Minor improvements and fixes
+
+* Add default descriptions in CsvParseOptions$create() docs (#37909)
+
+* Use `SafeCallIntoR()` to call garbage collector after a failed allocation (#37565)
+* Use RunWithCapturedR for reading Parquet files (#37274)
+* stringr helper functions drop calling environment when evaluating (#36784)
+* Expose Parquet ReaderProperties (#36992)
+* Split out R6 classes and convenience functions (#36394)
+* Documentation for read_parquet() et al needs updating (#37020)
+* calling read_parquet on S3 connections results in error message being ignored (#37024)
+* CRAN failures due to "invalid non-character version specification" (#37387)
+* Improve error message around add_filename (#37372)
Review Comment:
```suggestion
* Improve error message around add_filename (@amoeba, #37372)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355193788
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
+* Updated use of R's version compare functionality to align with updates to
+ R-devel (#37387).
Review Comment:
OK, I can't find it, but I think it's too minor to include here (or retrospectively add it in) as it's not at all user-facing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355183426
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
Review Comment:
```suggestion
* CSVs with comma or other character as decimal mark can now be read in by the dataset
reading functions and new function `read_csv2_arrow()` (#38002).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1354391570
##########
r/NEWS.md:
##########
@@ -19,6 +19,51 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* Added `write_csv_dataset()` as a friendlier alternative to the existing
+ dataset writer (#36436).
Review Comment:
```suggestion
dataset writer (@dgreiss, #36436).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355191773
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
+* Updated use of R's version compare functionality to align with updates to
+ R-devel (#37387).
Review Comment:
```suggestion
```
This is (should be, if it's not already?) in the changelog notes for that release, so isn't needed here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355185176
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
+* Updated use of R's version compare functionality to align with updates to
+ R-devel (#37387).
+* Improved error message that occurred when calling `add_filename()`
+ (@amoeba, #37372).
+
+## Installation
+
+* MacOS builds now use the same installation pathway as on Linux (@assignUser,
+ #37684).
+* Added a warning message on package load when running under emulation
+ on MacOS (i.e., use of x86 installation of R on M1/aarch64) on MacOS (#37777).
Review Comment:
```suggestion
* A warning message is now issued on package load when running under emulation
on MacOS (i.e., use of x86 installation of R on M1/aarch64) on MacOS (#37777).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355215257
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
Review Comment:
```suggestion
* Documentation for `CsvParseOptions` object creation now contains more information about
default values (@angela-li, #37909).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355227414
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
Review Comment:
```suggestion
* Thift string and container size limits can now be configured via newly exposed ParquetReaderProperties, allowing users to work with Parquet files with unusually large metadata (#36992).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot merged PR #38143:
URL: https://github.com/apache/arrow/pull/38143
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355186518
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
+* Updated use of R's version compare functionality to align with updates to
+ R-devel (#37387).
+* Improved error message that occurred when calling `add_filename()`
+ (@amoeba, #37372).
+
+## Installation
+
+* MacOS builds now use the same installation pathway as on Linux (@assignUser,
+ #37684).
+* Added a warning message on package load when running under emulation
+ on MacOS (i.e., use of x86 installation of R on M1/aarch64) on MacOS (#37777).
+* Improve installation configuration when using an installation of R that
+ is not on PATH (@meztez, #37225).
Review Comment:
Can we explain more explicitly about in what way it's been improved?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350078984
##########
r/NEWS.md:
##########
@@ -19,6 +19,37 @@
# arrow 13.0.0.9000
+## Breaking changes
+
+## New features
+
+* Can't read in partitioning column in CSV datasets when both (non-hive) partition and schema supplied (#37658)
+* Add write_csv_dataset (#36436)
+* Add quoted_na argument to open_delim_dataset() (#37828)
+
+## Minor improvements and fixes
+
+* Add default descriptions in CsvParseOptions$create() docs (#37909)
+
+* Use `SafeCallIntoR()` to call garbage collector after a failed allocation (#37565)
+* Use RunWithCapturedR for reading Parquet files (#37274)
+* stringr helper functions drop calling environment when evaluating (#36784)
+* Expose Parquet ReaderProperties (#36992)
+* Split out R6 classes and convenience functions (#36394)
+* Documentation for read_parquet() et al needs updating (#37020)
+* calling read_parquet on S3 connections results in error message being ignored (#37024)
+* CRAN failures due to "invalid non-character version specification" (#37387)
+* Improve error message around add_filename (#37372)
+* Implement infer_schema.data.frame() (#37843)
+
+## Installation
+
+* Move macOS build system to nixlibs.R (#37684)
Review Comment:
```suggestion
* Move macOS build system to nixlibs.R (@assignUser, #37684)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350261135
##########
r/NEWS.md:
##########
@@ -19,6 +19,37 @@
# arrow 13.0.0.9000
+## Breaking changes
+
+## New features
+
+* Can't read in partitioning column in CSV datasets when both (non-hive) partition and schema supplied (#37658)
Review Comment:
I'm in the process of rephrasing these, but I think it's a feature ("`open_dataset()` now supports...")
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "conbench-apache-arrow[bot] (via GitHub)" <gi...@apache.org>.
conbench-apache-arrow[bot] commented on PR #38143:
URL: https://github.com/apache/arrow/pull/38143#issuecomment-1763254394
After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit e085b98dc48ee4e198378a129c03c60fbb9042e1.
There were 8 benchmark results indicating a performance regression:
- Commit Run on `ursa-i9-9960x` at [2023-10-12 13:24:03Z](https://conbench.ursa.dev/compare/runs/8538c42b61e24b8f897eecba8ab51084...461fd9038239478199c4ce554783b107/)
- [`file-read` (R) with compression=lz4, dataset=fanniemae_2016Q4, file_type=feather, language=R, output_type=table](https://conbench.ursa.dev/compare/benchmarks/06527dbe7cbb7a1c800084fb568650a8...06527fe898487be280009e4889f32e1f)
- [`file-read` (R) with compression=uncompressed, dataset=nyctaxi_2010-01, file_type=feather, language=R, output_type=dataframe](https://conbench.ursa.dev/compare/benchmarks/06527dc3b77f77c080005e06ef440608...06527ff0201c7a95800030cd1566096b)
- and 6 more (see the report linked below)
The [full Conbench report](https://github.com/apache/arrow/runs/17710548395) has more details. It also includes information about 2 possible false positives for unstable benchmarks that are known to sometimes produce them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355227414
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
Review Comment:
```suggestion
* Thrift string and container size limits can now be configured via newly exposed ParquetReaderProperties, allowing users to work with Parquet files with unusually large metadata (#36992).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350521375
##########
r/NEWS.md:
##########
@@ -19,6 +19,46 @@
# arrow 13.0.0.9000
+## New features
+
+* The `schema` argument to `open_dataset()` is now supported when reading CSV
+ datasets (#37658).
+* Added `write_csv_dataset()` as a friendlier alternative to the existing
+ dataset writer (#36436).
+* Added `quoted_na` argument to `open_delim_dataset()` (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
Review Comment:
```suggestion
* Implemented `infer_schema()` method for `data.frame` (#37843).
* Added functionality to read CSVs with comma or other character as decimal mark both in
dataset reading functions and new function `read_csv2_arrow()` (#38002).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355172860
##########
r/NEWS.md:
##########
@@ -19,6 +19,51 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* Added `write_csv_dataset()` as a friendlier alternative to the existing
+ dataset writer (@dgreiss, #36436).
Review Comment:
```suggestion
* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355193788
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
+* Updated use of R's version compare functionality to align with updates to
+ R-devel (#37387).
Review Comment:
OK, I can't find it, but I think it's too minor to include here as it's not at all user-facing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355197429
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
Review Comment:
```suggestion
```
Too minor to include IMO as it's not from an external contributor and is just me moving stuff around to make it look nicer :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355206947
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
Review Comment:
```suggestion
* Bindings to stringr helpers (e.g., `fixed()`, `regex()` etc) now allow variables to be used in their
arguments (#36784).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350077499
##########
r/NEWS.md:
##########
@@ -19,6 +19,37 @@
# arrow 13.0.0.9000
+## Breaking changes
+
+## New features
+
+* Can't read in partitioning column in CSV datasets when both (non-hive) partition and schema supplied (#37658)
+* Add write_csv_dataset (#36436)
+* Add quoted_na argument to open_delim_dataset() (#37828)
+
+## Minor improvements and fixes
+
+* Add default descriptions in CsvParseOptions$create() docs (#37909)
Review Comment:
```suggestion
* Add default descriptions in CsvParseOptions$create() docs (@angela-li, #37909)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1350080335
##########
r/NEWS.md:
##########
@@ -19,6 +19,37 @@
# arrow 13.0.0.9000
+## Breaking changes
+
+## New features
+
+* Can't read in partitioning column in CSV datasets when both (non-hive) partition and schema supplied (#37658)
+* Add write_csv_dataset (#36436)
+* Add quoted_na argument to open_delim_dataset() (#37828)
+
+## Minor improvements and fixes
+
+* Add default descriptions in CsvParseOptions$create() docs (#37909)
+
+* Use `SafeCallIntoR()` to call garbage collector after a failed allocation (#37565)
+* Use RunWithCapturedR for reading Parquet files (#37274)
+* stringr helper functions drop calling environment when evaluating (#36784)
+* Expose Parquet ReaderProperties (#36992)
+* Split out R6 classes and convenience functions (#36394)
+* Documentation for read_parquet() et al needs updating (#37020)
+* calling read_parquet on S3 connections results in error message being ignored (#37024)
+* CRAN failures due to "invalid non-character version specification" (#37387)
+* Improve error message around add_filename (#37372)
+* Implement infer_schema.data.frame() (#37843)
+
+## Installation
+
+* Move macOS build system to nixlibs.R (#37684)
+* Add a message if we detect running under emulation (#37777)
+* Use currrently running R binary to compile test program (nix install) (#37225)
Review Comment:
```suggestion
* Use currrently running R binary to compile test program (nix install) (@meztez, #37225)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355188368
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
+* Updated use of R's version compare functionality to align with updates to
+ R-devel (#37387).
+* Improved error message that occurred when calling `add_filename()`
+ (@amoeba, #37372).
+
+## Installation
+
+* MacOS builds now use the same installation pathway as on Linux (@assignUser,
+ #37684).
+* Added a warning message on package load when running under emulation
+ on MacOS (i.e., use of x86 installation of R on M1/aarch64) on MacOS (#37777).
+* Improve installation configuration when using an installation of R that
+ is not on PATH (@meztez, #37225).
+* Add extra output for failed builds (@amoeba, #37727).
Review Comment:
```suggestion
* Failed libarrow builds now return more detailed output (@amoeba, #37727).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355185176
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
+* Updated use of R's version compare functionality to align with updates to
+ R-devel (#37387).
+* Improved error message that occurred when calling `add_filename()`
+ (@amoeba, #37372).
+
+## Installation
+
+* MacOS builds now use the same installation pathway as on Linux (@assignUser,
+ #37684).
+* Added a warning message on package load when running under emulation
+ on MacOS (i.e., use of x86 installation of R on M1/aarch64) on MacOS (#37777).
Review Comment:
```suggestion
* A warning message is issued on package load when running under emulation
on MacOS (i.e., use of x86 installation of R on M1/aarch64) on MacOS (#37777).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355189374
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
+* Exposed Parquet ReaderProperties to improve testing of Parquet reading
+ functionality (#36992).
+* Improved documentation of R6 classes and helper functions (#36394).
+* Improved error reporting to certain types of errors that occurred when
+ calling `read_parquet()` (#37024)
+* Updated use of R's version compare functionality to align with updates to
+ R-devel (#37387).
+* Improved error message that occurred when calling `add_filename()`
+ (@amoeba, #37372).
+
+## Installation
+
+* MacOS builds now use the same installation pathway as on Linux (@assignUser,
+ #37684).
+* Added a warning message on package load when running under emulation
+ on MacOS (i.e., use of x86 installation of R on M1/aarch64) on MacOS (#37777).
+* Improve installation configuration when using an installation of R that
+ is not on PATH (@meztez, #37225).
+* Add extra output for failed builds (@amoeba, #37727).
+* Fixed an error that occured within `create_package_with_all_dependencies()`
+ on Windows (#37226).
Review Comment:
```suggestion
* `create_package_with_all_dependencies()` now properly escape paths on Windows (#37226).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-38142: [R] Add NEWS for 14.0.0 [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on code in PR #38143:
URL: https://github.com/apache/arrow/pull/38143#discussion_r1355206947
##########
r/NEWS.md:
##########
@@ -19,6 +19,50 @@
# arrow 13.0.0.9000
+## New features
+
+* When reading partitioned CSV datasets and supplying a schema to
+ `open_dataset()`, the partition variables are now included in the resulting
+ dataset (#37658).
+* New function `write_csv_dataset()` now wraps `write_dataset()` and mirrors the syntax of `write_csv_arrow()` (@dgreiss, #36436).
+* `open_delim_dataset()` now accepts `quoted_na` argument to empty strings to be parsed as NA values (#37828).
+* Implemented `infer_schema()` method for `data.frame` (#37843).
+* Added functionality to read CSVs with comma or other character as decimal
+ mark both in dataset reading functions and new function `read_csv2_arrow()`
+ (#38002).
+
+## Minor improvements and fixes
+
+* Added default descriptions in `CsvParseOptions$create()` docs (@angela-li,
+ #37909).
+* Fixed a code path which may have resulted in R code being called from a
+ non-R thread after a failed allocation (#37565).
+* Fixed a bug where large Parquet files could not be read from R connections
+ (#37274).
+* Implemented more robust evaluation of stringr helpers (e.g., `fixed()`
+ `regex()` when using variables to parameterize arguments (#36784).
Review Comment:
```suggestion
* bindings to stringr helpers (e.g., `fixed()`, `regex()` etc) now allow variables to be used in their
arguments (#36784).
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org