You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Julien Le Dem (JIRA)" <ji...@apache.org> on 2016/08/03 21:16:20 UTC
[jira] [Resolved] (PARQUET-668) Provide option to disable auto crop
feature in DumpCommand output
[ https://issues.apache.org/jira/browse/PARQUET-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Julien Le Dem resolved PARQUET-668.
-----------------------------------
Resolution: Fixed
Fix Version/s: 1.9.0
Issue resolved by pull request 358
[https://github.com/apache/parquet-mr/pull/358]
> Provide option to disable auto crop feature in DumpCommand output
> -----------------------------------------------------------------
>
> Key: PARQUET-668
> URL: https://issues.apache.org/jira/browse/PARQUET-668
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-mr
> Reporter: Daniel Harper
> Priority: Trivial
> Fix For: 1.9.0
>
>
> *Problem*
> When using the {{dump}} command in {{parquet-tools}}, the output will sometimes be truncated based on the width of your console, especially on smaller displays.
> Example:
> {code}
> row group 0
> --------------------------------------------------------------------------------
> id: INT32 SNAPPY DO:0 FPO:4 SZ:44668/920538/20.61 VC:7240100 [more]...
> name: BINARY SNAPPY DO:0 FPO:44672 SZ:89464018/1031768430/11.53 [more]...
> event_time: INT64 SNAPPY DO:0 FPO:89508690 SZ:43600235/57923935/1.33 VC:7240100 [more]...
> id TV=7240100 RL=0 DL=0 DS: 2 DE:PLAIN_DICTIONARY
> ----------------------------------------------------------------------------
> page 0: DLE:BIT_PACKED RLE:BIT_PACKED VLE:PLA [more]... SZ:33291
> {code}
> This is especially annoying if you pipe the output to a file as the truncation remains in place.
> *Proposed fix*
> Provide the flag {{--disable-crop}} for the dump command. Truncation is enabled by default and will only be disabled when this flag is provided,
> This will output the full content to standard out, for example:
> {code}
> row group 0
> --------------------------------------------------------------------------------
> id: INT32 SNAPPY DO:0 FPO:4 SZ:44668/920538/20.61 VC:7240100 ENC:BIT_PACKED,PLAIN_DICTIONARY
> name: BINARY SNAPPY DO:0 FPO:44672 SZ:89464018/1031768430/11.53 VC:7240100 ENC:PLAIN,BIT_PACKED
> event_time: INT64 SNAPPY DO:0 FPO:89508690 SZ:43600235/57923935/1.33 VC:7240100 ENC:PLAIN,BIT_PACKED,RLE
> id TV=7240100 RL=0 DL=0 DS: 2 DE:PLAIN_DICTIONARY
> ----------------------------------------------------------------------------
> page 0: DLE:BIT_PACKED RLE:BIT_PACKED VLE:PLAIN_DICTIONARY ST:[min: 0, max: 1, num_nulls: 0] SZ:33291 VC:262146
> page 1: DLE:BIT_PACKED RLE:BIT_PACKED VLE:PLAIN_DICTIONARY ST:[min: 0, max: 1, num_nulls: 0] SZ:33291 VC:262145
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)