You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Kai Voigt (JIRA)" <ji...@apache.org> on 2012/08/08 16:24:19 UTC
[jira] [Created] (SQOOP-543) -hive-import not working with
uppercase hostname
Kai Voigt created SQOOP-543:
-------------------------------
Summary: -hive-import not working with uppercase hostname
Key: SQOOP-543
URL: https://issues.apache.org/jira/browse/SQOOP-543
Project: Sqoop
Issue Type: Bug
Components: hive-integration
Affects Versions: 1.3.0
Environment: CDH3
Reporter: Kai Voigt
When running the following command, the import fails:
$ sqoop import --username training --password training --connect jdbc:mysql://Localhost/training --hive-import --fields-terminated-by '\001' --table Movies
The error message towards the end reads like this:
12/08/08 07:12:32 INFO hive.HiveImport: OK
12/08/08 07:12:32 INFO hive.HiveImport: Time taken: 4.098 seconds
12/08/08 07:12:32 INFO hive.HiveImport: FAILED: Error in semantic analysis: Line 2:17 Path is not legal 'hdfs://Localhost/user/training/Movies': Move from: hdfs://Localhost/user/training/Movies to: hdfs://localhost/user/hive/warehouse/movies is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.
12/08/08 07:12:32 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Hive exited with status 10
at com.cloudera.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:349)
at com.cloudera.sqoop.hive.HiveImport.executeScript(HiveImport.java:299)
at com.cloudera.sqoop.hive.HiveImport.importTable(HiveImport.java:241)
at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:394)
at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:455)
at com.cloudera.sqoop.Sqoop.run(Sqoop.java:146)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:182)
at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:221)
at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:230)
at com.cloudera.sqoop.Sqoop.main(Sqoop.java:239)
Using "localhost" instead of "Localhost" in the command completes the import.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (SQOOP-543) -hive-import not working with
uppercase hostname
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheolsoo Park resolved SQOOP-543.
---------------------------------
Resolution: Won't Fix
> -hive-import not working with uppercase hostname
> ------------------------------------------------
>
> Key: SQOOP-543
> URL: https://issues.apache.org/jira/browse/SQOOP-543
> Project: Sqoop
> Issue Type: Bug
> Components: hive-integration
> Affects Versions: 1.3.0
> Environment: CDH3
> Reporter: Kai Voigt
>
> When running the following command, the import fails:
> $ sqoop import --username training --password training --connect jdbc:mysql://Localhost/training --hive-import --fields-terminated-by '\001' --table Movies
> The error message towards the end reads like this:
> 12/08/08 07:12:32 INFO hive.HiveImport: OK
> 12/08/08 07:12:32 INFO hive.HiveImport: Time taken: 4.098 seconds
> 12/08/08 07:12:32 INFO hive.HiveImport: FAILED: Error in semantic analysis: Line 2:17 Path is not legal 'hdfs://Localhost/user/training/Movies': Move from: hdfs://Localhost/user/training/Movies to: hdfs://localhost/user/hive/warehouse/movies is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.
> 12/08/08 07:12:32 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Hive exited with status 10
> at com.cloudera.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:349)
> at com.cloudera.sqoop.hive.HiveImport.executeScript(HiveImport.java:299)
> at com.cloudera.sqoop.hive.HiveImport.importTable(HiveImport.java:241)
> at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:394)
> at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:455)
> at com.cloudera.sqoop.Sqoop.run(Sqoop.java:146)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:182)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:221)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:230)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:239)
> Using "localhost" instead of "Localhost" in the command completes the import.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-543) -hive-import not working with
uppercase hostname
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13448239#comment-13448239 ]
Cheolsoo Park commented on SQOOP-543:
-------------------------------------
Hi Kai,
What sqoop does for hive import is simply invoking the installed hive binaries at the end of import job. The exception that you're seeing is thrown by hive because it thinks that hostname must be lower-case, which is along the line with internet standards:
{quote}
The Internet standards (Request for Comments) for protocols mandate that component hostname labels may contain only the ASCII letters 'a' through 'z' (in a case-insensitive manner), the digits '0' through '9', and the hyphen ('-').
{quote}
http://en.wikipedia.org/wiki/Hostname
We could possibly make sqoop explicitly lowercase hostname before passing it to hive. But given that the error message which is descriptive as I see it, I think that it is ok as is. Do you think that lowercasing hostname at Sqoop would be useful?
> -hive-import not working with uppercase hostname
> ------------------------------------------------
>
> Key: SQOOP-543
> URL: https://issues.apache.org/jira/browse/SQOOP-543
> Project: Sqoop
> Issue Type: Bug
> Components: hive-integration
> Affects Versions: 1.3.0
> Environment: CDH3
> Reporter: Kai Voigt
>
> When running the following command, the import fails:
> $ sqoop import --username training --password training --connect jdbc:mysql://Localhost/training --hive-import --fields-terminated-by '\001' --table Movies
> The error message towards the end reads like this:
> 12/08/08 07:12:32 INFO hive.HiveImport: OK
> 12/08/08 07:12:32 INFO hive.HiveImport: Time taken: 4.098 seconds
> 12/08/08 07:12:32 INFO hive.HiveImport: FAILED: Error in semantic analysis: Line 2:17 Path is not legal 'hdfs://Localhost/user/training/Movies': Move from: hdfs://Localhost/user/training/Movies to: hdfs://localhost/user/hive/warehouse/movies is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.
> 12/08/08 07:12:32 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Hive exited with status 10
> at com.cloudera.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:349)
> at com.cloudera.sqoop.hive.HiveImport.executeScript(HiveImport.java:299)
> at com.cloudera.sqoop.hive.HiveImport.importTable(HiveImport.java:241)
> at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:394)
> at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:455)
> at com.cloudera.sqoop.Sqoop.run(Sqoop.java:146)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:182)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:221)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:230)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:239)
> Using "localhost" instead of "Localhost" in the command completes the import.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-543) -hive-import not working with
uppercase hostname
Posted by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449838#comment-13449838 ]
Jarek Jarcec Cecho commented on SQOOP-543:
------------------------------------------
No objections on my end.
Jarcec
> -hive-import not working with uppercase hostname
> ------------------------------------------------
>
> Key: SQOOP-543
> URL: https://issues.apache.org/jira/browse/SQOOP-543
> Project: Sqoop
> Issue Type: Bug
> Components: hive-integration
> Affects Versions: 1.3.0
> Environment: CDH3
> Reporter: Kai Voigt
>
> When running the following command, the import fails:
> $ sqoop import --username training --password training --connect jdbc:mysql://Localhost/training --hive-import --fields-terminated-by '\001' --table Movies
> The error message towards the end reads like this:
> 12/08/08 07:12:32 INFO hive.HiveImport: OK
> 12/08/08 07:12:32 INFO hive.HiveImport: Time taken: 4.098 seconds
> 12/08/08 07:12:32 INFO hive.HiveImport: FAILED: Error in semantic analysis: Line 2:17 Path is not legal 'hdfs://Localhost/user/training/Movies': Move from: hdfs://Localhost/user/training/Movies to: hdfs://localhost/user/hive/warehouse/movies is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.
> 12/08/08 07:12:32 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Hive exited with status 10
> at com.cloudera.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:349)
> at com.cloudera.sqoop.hive.HiveImport.executeScript(HiveImport.java:299)
> at com.cloudera.sqoop.hive.HiveImport.importTable(HiveImport.java:241)
> at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:394)
> at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:455)
> at com.cloudera.sqoop.Sqoop.run(Sqoop.java:146)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:182)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:221)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:230)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:239)
> Using "localhost" instead of "Localhost" in the command completes the import.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-543) -hive-import not working with
uppercase hostname
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449831#comment-13449831 ]
Cheolsoo Park commented on SQOOP-543:
-------------------------------------
Unless anyone has objections, I'd like to mark this as "won't fix". Please let me know.
Thanks!
> -hive-import not working with uppercase hostname
> ------------------------------------------------
>
> Key: SQOOP-543
> URL: https://issues.apache.org/jira/browse/SQOOP-543
> Project: Sqoop
> Issue Type: Bug
> Components: hive-integration
> Affects Versions: 1.3.0
> Environment: CDH3
> Reporter: Kai Voigt
>
> When running the following command, the import fails:
> $ sqoop import --username training --password training --connect jdbc:mysql://Localhost/training --hive-import --fields-terminated-by '\001' --table Movies
> The error message towards the end reads like this:
> 12/08/08 07:12:32 INFO hive.HiveImport: OK
> 12/08/08 07:12:32 INFO hive.HiveImport: Time taken: 4.098 seconds
> 12/08/08 07:12:32 INFO hive.HiveImport: FAILED: Error in semantic analysis: Line 2:17 Path is not legal 'hdfs://Localhost/user/training/Movies': Move from: hdfs://Localhost/user/training/Movies to: hdfs://localhost/user/hive/warehouse/movies is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.
> 12/08/08 07:12:32 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Hive exited with status 10
> at com.cloudera.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:349)
> at com.cloudera.sqoop.hive.HiveImport.executeScript(HiveImport.java:299)
> at com.cloudera.sqoop.hive.HiveImport.importTable(HiveImport.java:241)
> at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:394)
> at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:455)
> at com.cloudera.sqoop.Sqoop.run(Sqoop.java:146)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:182)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:221)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:230)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:239)
> Using "localhost" instead of "Localhost" in the command completes the import.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira