You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@orc.apache.org by GitBox <gi...@apache.org> on 2022/04/08 07:15:59 UTC
[GitHub] [orc] liangrui1988 opened a new issue, #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
liangrui1988 opened a new issue, #1083:
URL: https://github.com/apache/orc/issues/1083
Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
```
File length: 548692248 bytes
Padding length: 2381182 bytes
Padding ratio: 0.43%
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@orc.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [orc] liangrui1988 commented on issue #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
Posted by GitBox <gi...@apache.org>.
liangrui1988 commented on issue #1083:
URL: https://github.com/apache/orc/issues/1083#issuecomment-1092768015
Does reading and writing different versions of ORC matter?For example, 1.5.12 to write files, 1.5.5 to read files?thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@orc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [orc] dongjoon-hyun closed issue #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun closed issue #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
URL: https://github.com/apache/orc/issues/1083
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@orc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [orc] liangrui1988 commented on issue #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
Posted by GitBox <gi...@apache.org>.
liangrui1988 commented on issue #1083:
URL: https://github.com/apache/orc/issues/1083#issuecomment-1092764983
Mine is a private cluster deployment, on disk, will this matter?Does it affect the application's ability to read the file?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@orc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [orc] liangrui1988 commented on issue #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
Posted by GitBox <gi...@apache.org>.
liangrui1988 commented on issue #1083:
URL: https://github.com/apache/orc/issues/1083#issuecomment-1216066199
This is caused by the ORC parameter problem, not the cluster problem. The writer reduces the stripe of the ORC and restores it to 256MB.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@orc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [orc] dongjoon-hyun commented on issue #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on issue #1083:
URL: https://github.com/apache/orc/issues/1083#issuecomment-1093398921
Sorry but why don't you test your actual private cluster? We have no recommendations for private cluster deployments because we don't know what you are using it, @liangrui1988 .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@orc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [orc] dongjoon-hyun commented on issue #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on issue #1083:
URL: https://github.com/apache/orc/issues/1083#issuecomment-1092540527
Hi, @liangrui1988 . Please refer ORC spec in our official website.
Here is the formula we use. It exists simply to match the underlying file system's block size historically. If you are using S3, your program will not read that part at all. So, there is no impact in the modern cloud infra.
https://github.com/apache/orc/blob/6b053d4ba4df036e2691f84331bd407354a7c3b2/java/tools/src/java/org/apache/orc/tools/FileDump.java#L771-L780
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@orc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [orc] dongjoon-hyun commented on issue #1083: Padding length and Padding ratio What does it stand for?If there's a number on it, does it affect the program from reading this file,
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on issue #1083:
URL: https://github.com/apache/orc/issues/1083#issuecomment-1217089816
Could you provide some reproducible example, @liangrui1988 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@orc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org