You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Alan Gates (JIRA)" <ji...@apache.org> on 2009/04/29 22:59:30 UTC
[jira] Created: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Setting fs.default.name incorrectly leads to meaningless error message
----------------------------------------------------------------------
Key: HIVE-458
URL: https://issues.apache.org/jira/browse/HIVE-458
Project: Hadoop Hive
Issue Type: Bug
Components: Configuration
Affects Versions: 0.3.0
Reporter: Alan Gates
Priority: Minor
In my hadoop-site.xml I accidentally set fs.default.name to
http://wilbur21.labs.corp.sp1.yahoo.com:8020
instead of the proper:
hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
The result was
{code}
hive> show tables;
FAILED: Unknown exception : null
FAILED: Unknown exception : null
Time taken: 0.035 seconds
hive>
{code}
It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zheng Shao updated HIVE-458:
----------------------------
Priority: Blocker (was: Minor)
Fix Version/s: 0.5.0
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Priority: Blocker
> Fix For: 0.5.0
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-458:
---------------------------
Attachment: HIVE-458.1.patch
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
> Attachments: HIVE-458.1.patch
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796951#action_12796951 ]
Zheng Shao commented on HIVE-458:
---------------------------------
Looks good. Will commit if test passes.
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
> Attachments: HIVE-458.1.patch, HIVE-458.2.patch
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793390#action_12793390 ]
Paul Yang commented on HIVE-458:
--------------------------------
Right, that does reproduce the error.
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793513#action_12793513 ]
Namit Jain commented on HIVE-458:
---------------------------------
Also, can you add a negative test for the same ?
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
> Attachments: HIVE-458.1.patch
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793496#action_12793496 ]
Zheng Shao commented on HIVE-458:
---------------------------------
Can we put the original exception as the second parameter when creating RuntimeException object?
That is usually a good idea because it will show all the stacktraces.
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
> Attachments: HIVE-458.1.patch
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang reassigned HIVE-458:
------------------------------
Assignee: Paul Yang
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793480#action_12793480 ]
Paul Yang commented on HIVE-458:
--------------------------------
Actually, for the error to be reproduced, the fs.default.name string has to be malformed in a particular way for the exception to be thrown.
{code}
{code}
The attached patch shows better error messages when improper characters in fs.default.name cause an exception to be thrown.
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793387#action_12793387 ]
Zheng Shao commented on HIVE-458:
---------------------------------
'blahblah' is not a valid URI so we detected in URI checking.
Can you try with "http://wilbur21.labs.corp.sp1.yahoo.com:8020" ?
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792752#action_12792752 ]
Paul Yang commented on HIVE-458:
--------------------------------
Not entirely sure how to reproduce this issue -
I tried:
{code}
Hive history file=/tmp/pyang/hive_job_log_pyang_200912181710_705362980.txt
hive> set fs.default.name='blahblah';
hive> show tables 'tmp_pyang_t';
OK
tmp_pyang_t
Time taken: 2.73 seconds
hive> SELECT * FROM src LIMIT 1;
FAILED: Unknown exception: java.io.IOException: Incomplete HDFS URI, no host: hdfs://'blahblah'/tmp/hive-pyang/1632153075
{code}
Alan, is this still a problem?
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-458:
---------------------------
Attachment: HIVE-458.2.patch
* Added original exception as the cause parameter for RuntimeException
* Added negative tests
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
> Attachments: HIVE-458.1.patch, HIVE-458.2.patch
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zheng Shao resolved HIVE-458.
-----------------------------
Resolution: Fixed
Release Note: HIVE-458. Better error messages for fs.default.name. (Paul Yang via zshao)
Hadoop Flags: [Reviewed]
Committed. Thanks Paul!
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
> Attachments: HIVE-458.1.patch, HIVE-458.2.patch
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-458) Setting fs.default.name incorrectly
leads to meaningless error message
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793483#action_12793483 ]
Paul Yang commented on HIVE-458:
--------------------------------
Missing example from above:
{code}
hive> set fs.default.name=http://wilbur21.labs.corp.sp1.yahoo.com:8020;
hive> show tables 'tmp_pyang_*';
OK
tmp_pyang_dim_api_data
tmp_pyang_lv
tmp_pyang_null
tmp_pyang_output
tmp_pyang_t
Time taken: 0.235 seconds
hive> set fs.default.name=|http://wilbur21.labs.corp.sp1.yahoo.com:8020;
hive> show tables 'tmp_pyang_*';
FAILED: Unknown exception: null
hive> set fs.default.name='http://wilbur21.labs.corp.sp1.yahoo.com:8020;
hive> show tables 'tmp_pyang_*';
FAILED: Unknown exception: null
{code}
(behavior is dependent on URI.create() )
> Setting fs.default.name incorrectly leads to meaningless error message
> ----------------------------------------------------------------------
>
> Key: HIVE-458
> URL: https://issues.apache.org/jira/browse/HIVE-458
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Paul Yang
> Priority: Blocker
> Fix For: 0.5.0
>
>
> In my hadoop-site.xml I accidentally set fs.default.name to
> http://wilbur21.labs.corp.sp1.yahoo.com:8020
> instead of the proper:
> hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020
> The result was
> {code}
> hive> show tables;
> FAILED: Unknown exception : null
> FAILED: Unknown exception : null
> Time taken: 0.035 seconds
> hive>
> {code}
> It should give a meaningful error message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.