You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "tustvold (via GitHub)" <gi...@apache.org> on 2023/01/25 12:53:07 UTC
[GitHub] [arrow-datafusion] tustvold commented on issue #5041: "corrupt deflate stream" when inferring schema from CSV file during CREATE EXTERNAL TABLE
tustvold commented on issue #5041:
URL: https://github.com/apache/arrow-datafusion/issues/5041#issuecomment-1403560954
It looks like the schema inference logic is applying the newline delimiting chunking before applying the decompression, it should be a case of reversing the order of these two. In particular using `FileCompressionType::convert_stream` instead of `FileCompressionType::convert_read`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org