You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Raviv M-G (JIRA)" <ji...@apache.org> on 2010/09/15 18:37:32 UTC

[jira] Created: (HIVE-1637) String partitions that start with spaces or numbers cause errors

String partitions that start with spaces or numbers cause errors
----------------------------------------------------------------

                 Key: HIVE-1637
                 URL: https://issues.apache.org/jira/browse/HIVE-1637
             Project: Hadoop Hive
          Issue Type: Bug
    Affects Versions: 0.7.0
         Environment: java 1.6
            Reporter: Raviv M-G
            Priority: Minor


When a string partition starts with a space or with a number joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://nber9.nber.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1637) String partitions that are equal to "" or start with spaces or contains periods or asterisks cause errors

Posted by "Raviv M-G (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raviv M-G updated HIVE-1637:
----------------------------

        Summary: String partitions that are equal to "" or start with spaces or contains periods or asterisks cause errors  (was: String partitions that are equal to "" or start with spaces or numbers cause errors)
    Description: 
When a string partition is equal to "" (the empty string) or starts with a space or contains periods or asterisks joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)



  was:
When a string partition is equal to "" (the empty string) or starts with a space or with a number joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)




> String partitions that are equal to "" or start with spaces or contains periods or asterisks cause errors
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1637
>                 URL: https://issues.apache.org/jira/browse/HIVE-1637
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>         Environment: java 1.6
>            Reporter: Raviv M-G
>            Priority: Minor
>
> When a string partition is equal to "" (the empty string) or starts with a space or contains periods or asterisks joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.
>     > select UT from researchaddress limit 10;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
> java.lang.IllegalArgumentException: Can not create a Path from an empty string
> 	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
> 	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
> 	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
> 	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
> 	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
> 	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
> 	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
> Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'
> And attempting to rename a table with such a partition causes:
> hive> alter table researchaddress rename to researchaddress2;
> Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1637) String partitions that are equal to "" or start with spaces or numbers cause errors

Posted by "Raviv M-G (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raviv M-G updated HIVE-1637:
----------------------------

        Summary: String partitions that are equal to "" or start with spaces or numbers cause errors  (was: String partitions that start with spaces or numbers cause errors)
    Description: 
When a string partition is equal to "" (the empty string) or starts with a space or with a number joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)



  was:
When a string partition starts with a space or with a number joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)




> String partitions that are equal to "" or start with spaces or numbers cause errors
> -----------------------------------------------------------------------------------
>
>                 Key: HIVE-1637
>                 URL: https://issues.apache.org/jira/browse/HIVE-1637
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>         Environment: java 1.6
>            Reporter: Raviv M-G
>            Priority: Minor
>
> When a string partition is equal to "" (the empty string) or starts with a space or with a number joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.
>     > select UT from researchaddress limit 10;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
> java.lang.IllegalArgumentException: Can not create a Path from an empty string
> 	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
> 	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
> 	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
> 	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
> 	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
> 	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
> 	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
> Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'
> And attempting to rename a table with such a partition causes:
> hive> alter table researchaddress rename to researchaddress2;
> Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1637) String partitions that start with spaces or numbers cause errors

Posted by "Raviv M-G (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raviv M-G updated HIVE-1637:
----------------------------

    Description: 
When a string partition starts with a space or with a number joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)



  was:
When a string partition starts with a space or with a number joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://nber9.nber.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)




> String partitions that start with spaces or numbers cause errors
> ----------------------------------------------------------------
>
>                 Key: HIVE-1637
>                 URL: https://issues.apache.org/jira/browse/HIVE-1637
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>         Environment: java 1.6
>            Reporter: Raviv M-G
>            Priority: Minor
>
> When a string partition starts with a space or with a number joins on that table or selecting one field from that table will cause errors.  You can, however, still perform partition specific queries without a problem.
>     > select UT from researchaddress limit 10;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
> java.lang.IllegalArgumentException: Can not create a Path from an empty string
> 	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
> 	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
> 	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
> 	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
> 	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
> 	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
> 	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
> Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a Path from an empty string)'
> And attempting to rename a table with such a partition causes:
> hive> alter table researchaddress rename to researchaddress2;
> Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0 DENMARK)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.