dev@parquet.apache.org, 2019-08

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: zstd codec - posted by "Driesprong, Fokko" <fo...@driesprong.frl> on 2019/08/01 11:47:05 UTC, 0 replies.
- [C++][Python] Direct Arrow DictionaryArray reads from Parquet files - posted by Wes McKinney <we...@gmail.com> on 2019/08/02 15:55:02 UTC, 2 replies.
- Re: [VOTE] Parquet Bloom filter spec sign-off - posted by Ryan Blue <rb...@netflix.com.INVALID> on 2019/08/03 20:42:10 UTC, 8 replies.
- [jira] [Created] (PARQUET-1630) Resolve Bloom filter spec concerns - posted by "Junjie Chen (JIRA)" <ji...@apache.org> on 2019/08/04 14:14:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1630) Resolve Bloom filter spec concerns - posted by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/08/04 14:16:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1630) Resolve Bloom filter spec concerns - posted by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/08/04 14:16:00 UTC, 7 replies.
- [jira] [Updated] (PARQUET-1627) Update specification so that legacy timestamp logical types can be written for local semantics as well - posted by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/08/05 09:11:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1627) Update specification so that legacy timestamp logical types can be written for local semantics as well - posted by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/08/05 09:11:00 UTC, 1 replies.
- [jira] [Created] (PARQUET-1631) [C++] ParquetInputWrapper::GetSize always returns 0 - posted by "Zherui Cao (JIRA)" <ji...@apache.org> on 2019/08/05 20:07:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1385) [C++] bloom_filter-test is very slow under valgrind - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/05 20:54:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1036) parquet file created via pyarrow 0.4.0 ; version 1.0 - incompatible with Spark - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/05 20:54:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1159) [C++] Compatibility with C++ iterators - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/05 20:54:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1199) [C++] Support writing (and test reading) boolean values with RLE encoding - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/05 20:54:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1631) [C++] ParquetInputWrapper::GetSize always returns 0 - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/05 20:54:00 UTC, 1 replies.
- [jira] [Updated] (PARQUET-1169) [C++] Segment fault when using NextBatch of parquet::arrow::ColumnReader in parquet-cpp - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/05 20:54:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1631) [C++] ParquetInputWrapper::GetSize always returns 0 - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/05 20:54:00 UTC, 1 replies.
- [jira] [Assigned] (PARQUET-1631) [C++] ParquetInputWrapper::GetSize always returns 0 - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/05 21:29:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-1632) Negative initial size when writing large values in parquet-mr - posted by "Ivan Sadikov (JIRA)" <ji...@apache.org> on 2019/08/06 12:50:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-1633) Integer overflow in ParquetFileReader.ConsecutiveChunkList - posted by "Ivan Sadikov (JIRA)" <ji...@apache.org> on 2019/08/06 13:00:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1632) Negative initial size when writing large values in parquet-mr - posted by "Ivan Sadikov (JIRA)" <ji...@apache.org> on 2019/08/06 13:00:03 UTC, 1 replies.
- [jira] [Resolved] (PARQUET-1631) [C++] ParquetInputWrapper::GetSize always returns 0 - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/06 19:08:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-1634) [C++] Factor out data/dictionary page writes to allow for page buffering - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/06 21:39:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-458) [C++] Implement support for DataPageV2 - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/06 21:42:00 UTC, 3 replies.
- [jira] [Commented] (PARQUET-1626) [C++] Ability to concat parquet files - posted by "David Lee (JIRA)" <ji...@apache.org> on 2019/08/06 22:04:00 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-1632) Negative initial size when writing large values in parquet-mr - posted by "Junjie Chen (JIRA)" <ji...@apache.org> on 2019/08/07 08:47:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1632) Negative initial size when writing large values in parquet-mr - posted by "Junjie Chen (JIRA)" <ji...@apache.org> on 2019/08/07 08:47:00 UTC, 5 replies.
- [jira] [Commented] (PARQUET-1633) Integer overflow in ParquetFileReader.ConsecutiveChunkList - posted by "Gabor Szadovszky (JIRA)" <ji...@apache.org> on 2019/08/07 10:39:00 UTC, 2 replies.
- [jira] [Commented] (PARQUET-1634) [C++] Factor out data/dictionary page writes to allow for page buffering - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/07 17:55:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-1635) [C++] Key rotation tool - posted by "Gidon Gershinsky (JIRA)" <ji...@apache.org> on 2019/08/08 06:25:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1632) Negative initial size when writing large values in parquet-mr - posted by "Junjie Chen (JIRA)" <ji...@apache.org> on 2019/08/08 09:31:01 UTC, 0 replies.
- [jira] [Created] (PARQUET-1636) [C++] Incompatibility due to moving from Parquet to Arrow IO interfaces - posted by "Deepak Majeti (JIRA)" <ji...@apache.org> on 2019/08/08 14:23:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1636) [C++] Incompatibility due to moving from Parquet to Arrow IO interfaces - posted by "Deepak Majeti (JIRA)" <ji...@apache.org> on 2019/08/08 14:42:00 UTC, 8 replies.
- [jira] [Comment Edited] (PARQUET-1632) Negative initial size when writing large values in parquet-mr - posted by "Ivan Sadikov (JIRA)" <ji...@apache.org> on 2019/08/08 15:44:00 UTC, 1 replies.
- [jira] [Reopened] (PARQUET-1632) Negative initial size when writing large values in parquet-mr - posted by "Ivan Sadikov (JIRA)" <ji...@apache.org> on 2019/08/08 15:57:00 UTC, 0 replies.
- [jira] [Comment Edited] (PARQUET-1636) [C++] Incompatibility due to moving from Parquet to Arrow IO interfaces - posted by "Zherui Cao (JIRA)" <ji...@apache.org> on 2019/08/08 18:15:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (PARQUET-1636) [C++] Incompatibility due to moving from Parquet to Arrow IO interfaces - posted by "Zherui Cao (JIRA)" <ji...@apache.org> on 2019/08/08 20:02:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1228) parquet-format-structures encryption - posted by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/08/09 14:30:00 UTC, 2 replies.
- [jira] [Created] (PARQUET-1637) Builds are failing because default jdk changed to openjdk11 on Travis - posted by "Nandor Kollar (JIRA)" <ji...@apache.org> on 2019/08/10 08:46:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1636) [C++] Incompatibility due to moving from Parquet to Arrow IO interfaces - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/14 14:55:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-1638) ParquetFileReader.readFooter may be hang - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2019/08/15 07:40:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter may be hang - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2019/08/15 07:42:00 UTC, 4 replies.
- [jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2019/08/15 07:45:00 UTC, 3 replies.
- [jira] [Commented] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2019/08/15 07:51:00 UTC, 1 replies.
- [jira] [Resolved] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2019/08/15 13:52:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1637) Builds are failing because default jdk changed to openjdk11 on Travis - posted by "Nandor Kollar (JIRA)" <ji...@apache.org> on 2019/08/15 14:05:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1637) Builds are failing because default jdk changed to openjdk11 on Travis - posted by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/08/15 14:05:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1637) Builds are failing because default jdk changed to openjdk11 on Travis - posted by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/08/15 14:05:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1636) [C++] Incompatibility due to moving from Parquet to Arrow IO interfaces - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:46:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1567) [C++][Parquet] Bad initialization in statistics computation - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:47:00 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-1567) [C++][Parquet] Bad initialization in statistics computation - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:47:00 UTC, 0 replies.
- [jira] [Comment Edited] (PARQUET-644) [C++] Add API for writing boolean values as a packed bitmap - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:51:00 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-924) [C++] Persist original type metadata from Arrow schemas - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:51:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-644) [C++] Add API for writing boolean values as a packed bitmap - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:51:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-924) [C++] Persist original type metadata from Arrow schemas - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:52:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1370) [C++] Read consecutive column chunks in a single scan - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:55:00 UTC, 0 replies.
- [jira] [Closed] (PARQUET-1370) [C++] Read consecutive column chunks in a single scan - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/15 16:56:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-1639) [C++] Remove regex dependency for parsing ApplicationVersion - posted by "Hatem Helal (JIRA)" <ji...@apache.org> on 2019/08/16 13:17:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-800) [C++] Provide public API to access dictionary-encoded indices and values - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 13:56:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1567) [C++][Parquet] Bad initialization in statistics computation - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 13:56:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1169) [C++] Segment fault when using NextBatch of parquet::arrow::ColumnReader in parquet-cpp - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:05:00 UTC, 0 replies.
- [jira] [Closed] (PARQUET-1169) [C++] Segment fault when using NextBatch of parquet::arrow::ColumnReader in parquet-cpp - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:05:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-481) [C++] Refactor and expand reader-test - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:06:00 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-481) [C++] Refactor and expand reader-test - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:06:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-924) [C++] Persist original type metadata from Arrow schemas - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:06:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-552) [C++] Estimate dynamic memory usage using FileMetadata - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:06:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-481) [C++] Refactor and expand reader-test - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:06:00 UTC, 0 replies.
- [jira] [Closed] (PARQUET-481) [C++] Refactor and expand reader-test - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:06:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1547) [C++] Detect parquet-mr style dictionary_page - posted by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/08/16 14:07:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1640) [C++] parquet-encoding-benchmark crashes - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2019/08/19 16:50:00 UTC, 2 replies.
- [jira] [Commented] (PARQUET-1640) [C++] parquet-encoding-benchmark crashes - posted by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2019/08/19 16:52:00 UTC, 9 replies.
- [jira] [Assigned] (PARQUET-1640) [C++] parquet-encoding-benchmark crashes - posted by "Wes McKinney (Jira)" <ji...@apache.org> on 2019/08/19 17:50:00 UTC, 1 replies.
- [jira] [Comment Edited] (PARQUET-1640) [C++] parquet-encoding-benchmark crashes - posted by "Wes McKinney (Jira)" <ji...@apache.org> on 2019/08/19 18:35:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1640) [C++] parquet-encoding-benchmark crashes - posted by "Wes McKinney (Jira)" <ji...@apache.org> on 2019/08/19 21:27:00 UTC, 0 replies.
- [jira] [Created] (PARQUET-1641) Parquet pages for different columns cannot be read in parallel - posted by "Samarth Jain (Jira)" <ji...@apache.org> on 2019/08/20 21:20:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1641) Parquet pages for different columns cannot be read in parallel - posted by "Samarth Jain (Jira)" <ji...@apache.org> on 2019/08/20 21:22:00 UTC, 1 replies.
- [jira] [Commented] (PARQUET-1641) Parquet pages for different columns cannot be read in parallel - posted by "Samarth Jain (Jira)" <ji...@apache.org> on 2019/08/20 21:27:00 UTC, 3 replies.
- [jira] [Comment Edited] (PARQUET-722) Building with JDK 8 fails over a maven bug - posted by "Ryan Blue (Jira)" <ji...@apache.org> on 2019/08/20 23:00:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-722) Building with JDK 8 fails over a maven bug - posted by "Ryan Blue (Jira)" <ji...@apache.org> on 2019/08/20 23:00:00 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-1597) Fix parquet-cli's wrong or missing usage examples - posted by "Nandor Kollar (Jira)" <ji...@apache.org> on 2019/08/22 14:23:00 UTC, 0 replies.
- Re: [DISCUSS][JAVA][C++] Add a new floating-point Encoding and/or Compression algorithm to Parquet Format - posted by "Radev, Martin" <ma...@tum.de> on 2019/08/23 11:33:54 UTC, 0 replies.
- [jira] [Created] (PARQUET-1642) [C++] Provide for readahead-buffering in column readers - posted by "Wes McKinney (Jira)" <ji...@apache.org> on 2019/08/23 21:26:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1591) Remove @author tags from the source - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/08/26 23:29:00 UTC, 0 replies.
- [VOTE] Add BYTE_STREAM_SPLIT encoding to Apache Parquet - posted by "Radev, Martin" <ma...@tum.de> on 2019/08/27 12:29:44 UTC, 1 replies.
- [jira] [Commented] (PARQUET-1286) Crypto package in parquet-mr - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/08/27 13:40:00 UTC, 1 replies.
- [jira] [Created] (PARQUET-1643) Use airlift non-native implementations for GZIP, LZ0 and LZ4 codecs - posted by "Samarth Jain (Jira)" <ji...@apache.org> on 2019/08/28 18:22:00 UTC, 0 replies.
- [jira] [Updated] (PARQUET-1643) Use airlift non-native implementations for GZIP, LZ0 and LZ4 codecs - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/08/28 18:25:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1643) Use airlift non-native implementations for GZIP, LZ0 and LZ4 codecs - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/08/28 18:25:00 UTC, 2 replies.
- [jira] [Commented] (PARQUET-1621) [C++] Add encrypted parquet files to apache parquet-testing repository - posted by "Micah Kornfield (Jira)" <ji...@apache.org> on 2019/08/29 05:30:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1621) [C++] Add encrypted parquet files to apache parquet-testing repository - posted by "Gidon Gershinsky (Jira)" <ji...@apache.org> on 2019/08/29 05:41:00 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-1643) Use airlift non-native implementations for GZIP, LZ0 and LZ4 codecs - posted by "Nandor Kollar (Jira)" <ji...@apache.org> on 2019/08/29 09:48:01 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-1641) Parquet pages for different columns cannot be read in parallel - posted by "Nandor Kollar (Jira)" <ji...@apache.org> on 2019/08/29 09:48:01 UTC, 0 replies.
- [jira] [Created] (PARQUET-1644) Benchmark module needs some attention. - posted by "Ryan Skraba (Jira)" <ji...@apache.org> on 2019/08/29 13:47:00 UTC, 0 replies.
- parquet-benchmarks cleanup - posted by Ryan Skraba <ry...@skraba.com> on 2019/08/29 14:02:06 UTC, 1 replies.
- [jira] [Assigned] (PARQUET-1630) Resolve Bloom filter spec concerns - posted by "Junjie Chen (Jira)" <ji...@apache.org> on 2019/08/31 01:52:00 UTC, 0 replies.
- [jira] [Assigned] (PARQUET-1592) update hash naming of bloom filter - posted by "Junjie Chen (Jira)" <ji...@apache.org> on 2019/08/31 01:52:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1630) Resolve Bloom filter spec concerns - posted by "Junjie Chen (Jira)" <ji...@apache.org> on 2019/08/31 01:52:00 UTC, 0 replies.
- [jira] [Resolved] (PARQUET-1592) update hash naming of bloom filter - posted by "Junjie Chen (Jira)" <ji...@apache.org> on 2019/08/31 01:52:00 UTC, 0 replies.
- [jira] [Commented] (PARQUET-1570) Publish 1.11.0 to maven central - posted by "Oleksii Duzhyi (Jira)" <ji...@apache.org> on 2019/08/31 12:03:00 UTC, 0 replies.