You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org> on 2009/01/23 22:48:00 UTC
[jira] Created: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
load data local is not defaulting to 'file' as schema for source path
---------------------------------------------------------------------
Key: HIVE-248
URL: https://issues.apache.org/jira/browse/HIVE-248
Project: Hadoop Hive
Issue Type: Bug
Components: Clients
Reporter: Joydeep Sen Sarma
Priority: Critical
Jeff'e email:
I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Prasad Chakka updated HIVE-248:
-------------------------------
Attachment: hive-248.patch
modified error messages to be more descriptive.
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Prasad Chakka
> Priority: Critical
> Attachments: hive-248.patch, hive-248.patch, hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Prasad Chakka updated HIVE-248:
-------------------------------
Assignee: Joydeep Sen Sarma
Hadoop Flags: [Reviewed]
Status: Patch Available (was: Open)
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Prasad Chakka updated HIVE-248:
-------------------------------
Attachment: hive-248.patch
i am not sure why would users want to specify scheme but not authority but I added it anyways.
I don't think one can specify authority without the scheme though so I am not handling that case.
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hive-248.patch, hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Thusoo updated HIVE-248:
-------------------------------
Resolution: Fixed
Fix Version/s: 0.2.0
Status: Resolved (was: Patch Available)
committed. Thanks Prasad!!
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Prasad Chakka
> Priority: Critical
> Fix For: 0.2.0
>
> Attachments: hive-248.patch, hive-248.patch, hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666832#action_12666832 ]
Joydeep Sen Sarma commented on HIVE-248:
----------------------------------------
+1
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hive-248.patch, hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667542#action_12667542 ]
Ashish Thusoo commented on HIVE-248:
------------------------------------
Running tests right now. Will commit once they are done.
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Prasad Chakka
> Priority: Critical
> Attachments: hive-248.patch, hive-248.patch, hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-248:
--------------------------------
Fix Version/s: 0.3.0
(was: 0.6.0)
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Prasad Chakka
> Priority: Critical
> Fix For: 0.3.0
>
> Attachments: hive-248.patch, hive-248.patch, hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667390#action_12667390 ]
Joydeep Sen Sarma commented on HIVE-248:
----------------------------------------
+1
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Prasad Chakka
> Priority: Critical
> Attachments: hive-248.patch, hive-248.patch, hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Prasad Chakka updated HIVE-248:
-------------------------------
Attachment: hive-248.patch
cleaned up the whole function. now it is a lot less code.
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma updated HIVE-248:
-----------------------------------
Assignee: Prasad Chakka (was: Joydeep Sen Sarma)
hey - can u also add a more informative message regarding source and destination file systems when they don't match up. pretty sick of answering emails about this and this should help people figure out things somewhat (perhaps also a help message - 'check locations using describe extended and fs.default.name'.
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Prasad Chakka
> Priority: Critical
> Attachments: hive-248.patch, hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-248) load data local is not defaulting to
'file' as schema for source path
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666829#action_12666829 ]
Joydeep Sen Sarma commented on HIVE-248:
----------------------------------------
one small thing - in the previous code - we used to fill in the namenode automatically in case scheme was specified and the authority was not:
if(fromScheme.equals("hdfs")) {
URI defaultURI = FileSystem.get(conf).getUri();
fromAuthority = StringUtils.isEmpty(fromURI.getAuthority()) ? fromScheme = defaultURI.getScheme();
fs.getUri().getAuthority() : fromURI.getAuthority();
we can restore this ..
> load data local is not defaulting to 'file' as schema for source path
> ---------------------------------------------------------------------
>
> Key: HIVE-248
> URL: https://issues.apache.org/jira/browse/HIVE-248
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hive-248.patch
>
>
> Jeff'e email:
> I've executed this "LOAD DATA" statement a number of times before and never had this issue. When I drop into the shell, I can see the file I'm trying to load. Hive can't, however; any ideas on what's going on? I'd love to get tips on how to debug this problem as well.
> hive > LOAD DATA LOCAL INPATH 'ml-data/u.data' OVERWRITE INTO TABLE u_data;
> FAILED: Error in semantic analysis: line 3:23 Invalid Path 'ml-data/u.data': No files matching path
> hive > !ls ml-data;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.