You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/03/14 15:46:37 UTC

[GitHub] [arrow] paleolimbot opened a new pull request #12623: ARROW-15875: [R][C++] Include md5sum in S3 method for GetFileInfo()

paleolimbot opened a new pull request #12623:
URL: https://github.com/apache/arrow/pull/12623


   This PR exposes `RandomAccessFile::GetFileInfo()`, which is particularly useful for S3 files which carry some extra information that is useful to know without reading the whole file.
   
   ``` r
   # remotes::install_github("paleolimbot/arrow/r@r-file-metadata")
   library(arrow, warn.conflicts = FALSE)
   
   bucket <- s3_bucket("ursa-labs-taxi-data")
   file <- bucket$OpenInputFile("2019/06/data.parquet")
   file$ReadMetadata()
   #> $`Content-Length`
   #> [1] "120790979"
   #> 
   #> $`Content-Type`
   #> [1] "application/x-www-form-urlencoded; charset=utf-8"
   #> 
   #> $ETag
   #> [1] "\"f1efd5d76cb82861e1542117bfa52b90-8\""
   #> 
   #> $`Last-Modified`
   #> [1] "2020-01-17T16:26:28Z"
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #12623: ARROW-15875: [R][C++] Include md5sum in S3 method for GetFileInfo()

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #12623:
URL: https://github.com/apache/arrow/pull/12623#issuecomment-1067085673






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] ursabot edited a comment on pull request #12623: ARROW-15875: [R] Expose ReadMetadata for input streams

Posted by GitBox <gi...@apache.org>.
ursabot edited a comment on pull request #12623:
URL: https://github.com/apache/arrow/pull/12623#issuecomment-1072725780


   Benchmark runs are scheduled for baseline = 93ea682a93988ce1d38e4c6839fd4a1062984b13 and contender = 74200f57eb15892f8ff5676db16e078f4406b528. 74200f57eb15892f8ff5676db16e078f4406b528 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
   Conbench compare runs links:
   [Finished :arrow_down:0.0% :arrow_up:0.0%] [ec2-t3-xlarge-us-east-2](https://conbench.ursa.dev/compare/runs/2aac5be70caa45ccbd2e296d8ade2cef...0e36d19cbbf7440b9777ad5d0cbbcde6/)
   [Scheduled] [test-mac-arm](https://conbench.ursa.dev/compare/runs/1847d47b812845cc8c99f384365b3f66...e01fddc5e04c432089c7110fb70efe8d/)
   [Scheduled] [ursa-i9-9960x](https://conbench.ursa.dev/compare/runs/d68455f1cb1d4373bfc9ebad717e3649...3082c09c65674cd69d0a8fc62160805b/)
   [Scheduled] [ursa-thinkcentre-m75q](https://conbench.ursa.dev/compare/runs/7f36ccb0bee54a1c89147883ee48c5dd...15aec12df3e346f98adc29989289094e/)
   Supported benchmarks:
   ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python. Runs only benchmarks with cloud = True
   test-mac-arm: Supported benchmark langs: C++, Python, R
   ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
   ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] ursabot edited a comment on pull request #12623: ARROW-15875: [R] Expose ReadMetadata for input streams

Posted by GitBox <gi...@apache.org>.
ursabot edited a comment on pull request #12623:
URL: https://github.com/apache/arrow/pull/12623#issuecomment-1072725780


   Benchmark runs are scheduled for baseline = 93ea682a93988ce1d38e4c6839fd4a1062984b13 and contender = 74200f57eb15892f8ff5676db16e078f4406b528. 74200f57eb15892f8ff5676db16e078f4406b528 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
   Conbench compare runs links:
   [Finished :arrow_down:0.0% :arrow_up:0.0%] [ec2-t3-xlarge-us-east-2](https://conbench.ursa.dev/compare/runs/2aac5be70caa45ccbd2e296d8ade2cef...0e36d19cbbf7440b9777ad5d0cbbcde6/)
   [Finished :arrow_down:0.29% :arrow_up:0.0%] [test-mac-arm](https://conbench.ursa.dev/compare/runs/1847d47b812845cc8c99f384365b3f66...e01fddc5e04c432089c7110fb70efe8d/)
   [Scheduled] [ursa-i9-9960x](https://conbench.ursa.dev/compare/runs/d68455f1cb1d4373bfc9ebad717e3649...3082c09c65674cd69d0a8fc62160805b/)
   [Finished :arrow_down:0.17% :arrow_up:0.04%] [ursa-thinkcentre-m75q](https://conbench.ursa.dev/compare/runs/7f36ccb0bee54a1c89147883ee48c5dd...15aec12df3e346f98adc29989289094e/)
   Supported benchmarks:
   ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python. Runs only benchmarks with cloud = True
   test-mac-arm: Supported benchmark langs: C++, Python, R
   ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
   ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] jonkeane closed pull request #12623: ARROW-15875: [R] Expose ReadMetadata for input streams

Posted by GitBox <gi...@apache.org>.
jonkeane closed pull request #12623:
URL: https://github.com/apache/arrow/pull/12623


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] ursabot commented on pull request #12623: ARROW-15875: [R] Expose ReadMetadata for input streams

Posted by GitBox <gi...@apache.org>.
ursabot commented on pull request #12623:
URL: https://github.com/apache/arrow/pull/12623#issuecomment-1072725780


   Benchmark runs are scheduled for baseline = 93ea682a93988ce1d38e4c6839fd4a1062984b13 and contender = 74200f57eb15892f8ff5676db16e078f4406b528. 74200f57eb15892f8ff5676db16e078f4406b528 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
   Conbench compare runs links:
   [Scheduled] [ec2-t3-xlarge-us-east-2](https://conbench.ursa.dev/compare/runs/2aac5be70caa45ccbd2e296d8ade2cef...0e36d19cbbf7440b9777ad5d0cbbcde6/)
   [Scheduled] [test-mac-arm](https://conbench.ursa.dev/compare/runs/1847d47b812845cc8c99f384365b3f66...e01fddc5e04c432089c7110fb70efe8d/)
   [Scheduled] [ursa-i9-9960x](https://conbench.ursa.dev/compare/runs/d68455f1cb1d4373bfc9ebad717e3649...3082c09c65674cd69d0a8fc62160805b/)
   [Scheduled] [ursa-thinkcentre-m75q](https://conbench.ursa.dev/compare/runs/7f36ccb0bee54a1c89147883ee48c5dd...15aec12df3e346f98adc29989289094e/)
   Supported benchmarks:
   ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python. Runs only benchmarks with cloud = True
   test-mac-arm: Supported benchmark langs: C++, Python, R
   ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
   ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] ursabot edited a comment on pull request #12623: ARROW-15875: [R] Expose ReadMetadata for input streams

Posted by GitBox <gi...@apache.org>.
ursabot edited a comment on pull request #12623:
URL: https://github.com/apache/arrow/pull/12623#issuecomment-1072725780


   Benchmark runs are scheduled for baseline = 93ea682a93988ce1d38e4c6839fd4a1062984b13 and contender = 74200f57eb15892f8ff5676db16e078f4406b528. 74200f57eb15892f8ff5676db16e078f4406b528 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
   Conbench compare runs links:
   [Finished :arrow_down:0.0% :arrow_up:0.0%] [ec2-t3-xlarge-us-east-2](https://conbench.ursa.dev/compare/runs/2aac5be70caa45ccbd2e296d8ade2cef...0e36d19cbbf7440b9777ad5d0cbbcde6/)
   [Finished :arrow_down:0.29% :arrow_up:0.0%] [test-mac-arm](https://conbench.ursa.dev/compare/runs/1847d47b812845cc8c99f384365b3f66...e01fddc5e04c432089c7110fb70efe8d/)
   [Failed :arrow_down:0.71% :arrow_up:0.0%] [ursa-i9-9960x](https://conbench.ursa.dev/compare/runs/d68455f1cb1d4373bfc9ebad717e3649...3082c09c65674cd69d0a8fc62160805b/)
   [Finished :arrow_down:0.17% :arrow_up:0.04%] [ursa-thinkcentre-m75q](https://conbench.ursa.dev/compare/runs/7f36ccb0bee54a1c89147883ee48c5dd...15aec12df3e346f98adc29989289094e/)
   Supported benchmarks:
   ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python. Runs only benchmarks with cloud = True
   test-mac-arm: Supported benchmark langs: C++, Python, R
   ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
   ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org