You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "mapleFU (via GitHub)" <gi...@apache.org> on 2023/08/18 09:30:55 UTC

[GitHub] [arrow] mapleFU opened a new issue, #37242: [Python][Parquet] Parquet Support write and validate CRC

mapleFU opened a new issue, #37242:
URL: https://github.com/apache/arrow/issues/37242

   ### Describe the enhancement requested
   
   Now, C++ Parquet API already supports CRC in reading and write.
   
   Though system like S3 will ensure the storage data works well. But some data storage like HDD or SSD might corrupt. And network might provide bad result. So having CRC would helps.
   
   Now it's better to has crc in Python code.
   
   ### Component(s)
   
   Parquet, Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Python][Parquet] Parquet Support write and validate CRC [arrow]

Posted by "AlenkaF (via GitHub)" <gi...@apache.org>.
AlenkaF closed issue #37242: [Python][Parquet] Parquet Support write and validate CRC
URL: https://github.com/apache/arrow/issues/37242


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] pitrou commented on issue #37242: [Python][Parquet] Parquet Support write and validate CRC

Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #37242:
URL: https://github.com/apache/arrow/issues/37242#issuecomment-1688547395

   @danepitkin @AlenkaF This seems useful to expose in Python indeed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Python][Parquet] Parquet Support write and validate CRC [arrow]

Posted by "mapleFU (via GitHub)" <gi...@apache.org>.
mapleFU commented on issue #37242:
URL: https://github.com/apache/arrow/issues/37242#issuecomment-1778611828

   @frazar Would you mind "take" here?
   
   Github can only assign issue to the one replied to the issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Python][Parquet] Parquet Support write and validate CRC [arrow]

Posted by "frazar (via GitHub)" <gi...@apache.org>.
frazar commented on issue #37242:
URL: https://github.com/apache/arrow/issues/37242#issuecomment-1818352794

   I'll take this!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org