You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/03/11 14:19:00 UTC

[jira] [Commented] (PARQUET-1534) [parquet-cli] Argument error: Illegal character in opaque part at index 2 on Windows

    [ https://issues.apache.org/jira/browse/PARQUET-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789619#comment-16789619 ] 

ASF GitHub Bot commented on PARQUET-1534:
-----------------------------------------

masayuki038 commented on pull request #627: PARQUET-1534:  [parquet-cli] Argument error: Illegal character in opaque part at index 2 on Windows
URL: https://github.com/apache/parquet-mr/pull/627
 
 
   Some commands of parquet-cli don't work on Windows.
   
   ```
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main schema C:\Users\masayuki\Downloads\test.parquet                                                               Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet          
                                       
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main csv-schema C:\Users\masayuki\Downloads\test.csv --record-name Test                                              
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.csv              
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main convert-csv C:\Users\masayuki\Downlo ads\test.csv -o C:\Users\masayuki\Downloads\test-csv.parquet
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.csv
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main convert C:\Users\masayuki\Downloads\ userdata1.avro -o C:\Users\masayuki\Downloads\userdata1.parquet
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\userdata1.avro
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main to-avro C:\Users\masayuki\Downloads\ test.parquet -o C:\Users\masayuki\Downloads\test.avro
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main cat C:\Users\masayuki\Downloads\test.parquet
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main head -n 10 C:\Users\masayuki\Downloa ds\test.parquet
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
   ```
   
   Calling BaseCommand#qualifiedURI with Windows file path,  java.net.URI.create throws IllegalArgumentException and the command execution is aborted.
   
   This PR fixes the issue. With this PR, parquet-cli will work all commands on Windows.
   
   parquet-cli has no tests. I created PR to add simple tests for each command at https://github.com/apache/parquet-mr/pull/625. Could you review that first?
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> [parquet-cli] Argument error: Illegal character in opaque part at index 2 on Windows
> ------------------------------------------------------------------------------------
>
>                 Key: PARQUET-1534
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1534
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-mr
>    Affects Versions: 1.11.0
>            Reporter: Masayuki Takahashi
>            Assignee: Masayuki Takahashi
>            Priority: Major
>              Labels: pull-request-available
>
> Some commands of parquet-cli don't work on Windows.
> {code}
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main schema C:\Users\masayuki\Downloads\test.parquet                                                               Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet          
>                                     
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main csv-schema C:\Users\masayuki\Downloads\test.csv --record-name Test                                              
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.csv              
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main convert-csv C:\Users\masayuki\Downlo ads\test.csv -o C:\Users\masayuki\Downloads\test-csv.parquet
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.csv
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main convert C:\Users\masayuki\Downloads\ userdata1.avro -o C:\Users\masayuki\Downloads\userdata1.parquet
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\userdata1.avro
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main to-avro C:\Users\masayuki\Downloads\ test.parquet -o C:\Users\masayuki\Downloads\test.avro
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main cat C:\Users\masayuki\Downloads\test.parquet
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main head -n 10 C:\Users\masayuki\Downloa ds\test.parquet
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
> {code}
> The following commands work on Windows.
> * meta
> * pages
> * check-stats
> * column-index



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)