You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "thisisnic (via GitHub)" <gi...@apache.org> on 2023/12/18 11:38:39 UTC
[I] [R] Add `schema` argument to `write_parquet()` [arrow]
thisisnic opened a new issue, #39275:
URL: https://github.com/apache/arrow/issues/39275
### Describe the enhancement requested
There is no `schema` argument in `write_parquet()`, though this would be useful in cases where we want to write a data frame to disk, but do not want the default data type conversion.
### Component(s)
R
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Add `schema` argument to `write_parquet()` [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #39275:
URL: https://github.com/apache/arrow/issues/39275#issuecomment-3921994174
This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Add `schema` argument to `write_parquet()` [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #39275:
URL: https://github.com/apache/arrow/issues/39275#issuecomment-1891073711
It's fine, doesn't need to be assigned, it's yours. Yeah, solution should be along those lines!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Add `schema` argument to `write_parquet()` [arrow]
Posted by "ShaiviAgarwal2 (via GitHub)" <gi...@apache.org>.
ShaiviAgarwal2 commented on issue #39275:
URL: https://github.com/apache/arrow/issues/39275#issuecomment-1881188625
@thisisnic Is this issue resolved? If not, I want to contribute to it!!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Add `schema` argument to `write_parquet()` [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #39275:
URL: https://github.com/apache/arrow/issues/39275#issuecomment-1881536383
It unresolved, feel free to take it, @ShaiviAgarwal2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Add `schema` argument to `write_parquet()` [arrow]
Posted by "ShaiviAgarwal2 (via GitHub)" <gi...@apache.org>.
ShaiviAgarwal2 commented on issue #39275:
URL: https://github.com/apache/arrow/issues/39275#issuecomment-1882751040
@thisisnic
According to my understanding, if the `schema` is present, we should use it to write the parquet file. If it's not present, we'll use the default data type conversion.
Below is the code that I tried to write which shows the same thing. The code contains `arrow` package which provides the functionality for working with Parquet files
```r
library(arrow)
write_parquet <- function(data, file, schema = NULL) {
# Check if schema argument is provided
if (!is.null(schema)) {
# Use the provided schema for writing the parquet file
data <- arrow::Table$create(data, schema = schema)
arrow::write_parquet(data, file)
} else {
# Use the default data type conversion for writing the parquet file
arrow::write_parquet(data, file)
}
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Add `schema` argument to `write_parquet()` [arrow]
Posted by "ShaiviAgarwal2 (via GitHub)" <gi...@apache.org>.
ShaiviAgarwal2 commented on issue #39275:
URL: https://github.com/apache/arrow/issues/39275#issuecomment-1890401113
@thisisnic Could you please assign this task to me? I want to work on it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Add `schema` argument to `write_parquet()` [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #39275:
URL: https://github.com/apache/arrow/issues/39275#issuecomment-4194933268
Nobody's implemented this or expressed interest in it, so I'm closing - feel free to open a new issue if this isn't the case
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Add `schema` argument to `write_parquet()` [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic closed issue #39275: [R] Add `schema` argument to `write_parquet()`
URL: https://github.com/apache/arrow/issues/39275
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org