You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Jarek Jarcec Cecho (Created) (JIRA)" <ji...@apache.org> on 2012/03/15 17:23:39 UTC
[jira] [Created] (SQOOP-464) Warn when user is importing data into
/user/hive/warehouse with flag --hive-import
Warn when user is importing data into /user/hive/warehouse with flag --hive-import
----------------------------------------------------------------------------------
Key: SQOOP-464
URL: https://issues.apache.org/jira/browse/SQOOP-464
Project: Sqoop
Issue Type: Improvement
Reporter: Jarek Jarcec Cecho
Assignee: Jarek Jarcec Cecho
I've recently seen couple of users who were trying to import data into hive (--hive-import) with --target-dir or --warehouse-dir set to /user/hive/warehouse. Sqoop wasn't designed to directly import data into hive warehouse directory. Instead we're importing data into temporary directory first and then by hive call "LOAD DATA" we're instructing hive to do actual load (move to /user/hive/warehouse).
I would suggest to warn user when he is trying to import data into default hive warehouse directory.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-464) Warn when user is importing data
into /user/hive/warehouse with flag --hive-import
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236035#comment-13236035 ]
Hudson commented on SQOOP-464:
------------------------------
Integrated in Sqoop-ant-jdk-1.6 #100 (See [https://builds.apache.org/job/Sqoop-ant-jdk-1.6/100/])
SQOOP-464. Warn when user is importing data into /user/hive/warehouse with flag --hive-import.
(Jarek Jarcec Cecho via Arvind Prabhakar) (Revision 1304026)
Result = SUCCESS
arvind : http://svn.apache.org/viewvc/?view=rev&rev=1304026
Files :
* /incubator/sqoop/trunk/src/java/org/apache/sqoop/tool/BaseSqoopTool.java
> Warn when user is importing data into /user/hive/warehouse with flag --hive-import
> ----------------------------------------------------------------------------------
>
> Key: SQOOP-464
> URL: https://issues.apache.org/jira/browse/SQOOP-464
> Project: Sqoop
> Issue Type: Improvement
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 1.4.2-incubating
>
> Attachments: SQOOP-464.patch
>
>
> I've recently seen couple of users who were trying to import data into hive (--hive-import) with --target-dir or --warehouse-dir set to /user/hive/warehouse. Sqoop wasn't designed to directly import data into hive warehouse directory. Instead we're importing data into temporary directory first and then by hive call "LOAD DATA" we're instructing hive to do actual load (move to /user/hive/warehouse).
> I would suggest to warn user when he is trying to import data into default hive warehouse directory.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-464) Warn when user is importing data
into /user/hive/warehouse with flag --hive-import
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235967#comment-13235967 ]
jiraposter@reviews.apache.org commented on SQOOP-464:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4364/#review6252
-----------------------------------------------------------
Ship it!
+1
- Arvind
On 2012-03-15 16:24:38, Jarek Cecho wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/4364/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2012-03-15 16:24:38)
bq.
bq.
bq. Review request for Sqoop, Arvind Prabhakar and Bilung Lee.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. I've add parameter validation fragment that is looking for this incorrect usage and warning user.
bq.
bq.
bq. This addresses bug SQOOP-464.
bq. https://issues.apache.org/jira/browse/SQOOP-464
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. /src/java/org/apache/sqoop/tool/BaseSqoopTool.java 1300633
bq.
bq. Diff: https://reviews.apache.org/r/4364/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. * ant test -Dhadoopversion={20,23,100}
bq. * On live CDH based cluster
bq.
bq.
bq. Thanks,
bq.
bq. Jarek
bq.
bq.
> Warn when user is importing data into /user/hive/warehouse with flag --hive-import
> ----------------------------------------------------------------------------------
>
> Key: SQOOP-464
> URL: https://issues.apache.org/jira/browse/SQOOP-464
> Project: Sqoop
> Issue Type: Improvement
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Attachments: SQOOP-464.patch
>
>
> I've recently seen couple of users who were trying to import data into hive (--hive-import) with --target-dir or --warehouse-dir set to /user/hive/warehouse. Sqoop wasn't designed to directly import data into hive warehouse directory. Instead we're importing data into temporary directory first and then by hive call "LOAD DATA" we're instructing hive to do actual load (move to /user/hive/warehouse).
> I would suggest to warn user when he is trying to import data into default hive warehouse directory.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-464) Warn when user is importing data
into /user/hive/warehouse with flag --hive-import
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230271#comment-13230271 ]
jiraposter@reviews.apache.org commented on SQOOP-464:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4364/
-----------------------------------------------------------
Review request for Sqoop, Arvind Prabhakar and Bilung Lee.
Summary
-------
I've add parameter validation fragment that is looking for this incorrect usage and warning user.
This addresses bug SQOOP-464.
https://issues.apache.org/jira/browse/SQOOP-464
Diffs
-----
/src/java/org/apache/sqoop/tool/BaseSqoopTool.java 1300633
Diff: https://reviews.apache.org/r/4364/diff
Testing
-------
* ant test -Dhadoopversion={20,23,100}
* On live CDH based cluster
Thanks,
Jarek
> Warn when user is importing data into /user/hive/warehouse with flag --hive-import
> ----------------------------------------------------------------------------------
>
> Key: SQOOP-464
> URL: https://issues.apache.org/jira/browse/SQOOP-464
> Project: Sqoop
> Issue Type: Improvement
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
>
> I've recently seen couple of users who were trying to import data into hive (--hive-import) with --target-dir or --warehouse-dir set to /user/hive/warehouse. Sqoop wasn't designed to directly import data into hive warehouse directory. Instead we're importing data into temporary directory first and then by hive call "LOAD DATA" we're instructing hive to do actual load (move to /user/hive/warehouse).
> I would suggest to warn user when he is trying to import data into default hive warehouse directory.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (SQOOP-464) Warn when user is importing data into
/user/hive/warehouse with flag --hive-import
Posted by "Arvind Prabhakar (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvind Prabhakar resolved SQOOP-464.
------------------------------------
Resolution: Fixed
Fix Version/s: 1.4.2-incubating
Patch committed. Thanks Jarcec!
> Warn when user is importing data into /user/hive/warehouse with flag --hive-import
> ----------------------------------------------------------------------------------
>
> Key: SQOOP-464
> URL: https://issues.apache.org/jira/browse/SQOOP-464
> Project: Sqoop
> Issue Type: Improvement
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 1.4.2-incubating
>
> Attachments: SQOOP-464.patch
>
>
> I've recently seen couple of users who were trying to import data into hive (--hive-import) with --target-dir or --warehouse-dir set to /user/hive/warehouse. Sqoop wasn't designed to directly import data into hive warehouse directory. Instead we're importing data into temporary directory first and then by hive call "LOAD DATA" we're instructing hive to do actual load (move to /user/hive/warehouse).
> I would suggest to warn user when he is trying to import data into default hive warehouse directory.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (SQOOP-464) Warn when user is importing data into
/user/hive/warehouse with flag --hive-import
Posted by "Jarek Jarcec Cecho (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jarek Jarcec Cecho updated SQOOP-464:
-------------------------------------
Attachment: SQOOP-464.patch
> Warn when user is importing data into /user/hive/warehouse with flag --hive-import
> ----------------------------------------------------------------------------------
>
> Key: SQOOP-464
> URL: https://issues.apache.org/jira/browse/SQOOP-464
> Project: Sqoop
> Issue Type: Improvement
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Attachments: SQOOP-464.patch
>
>
> I've recently seen couple of users who were trying to import data into hive (--hive-import) with --target-dir or --warehouse-dir set to /user/hive/warehouse. Sqoop wasn't designed to directly import data into hive warehouse directory. Instead we're importing data into temporary directory first and then by hive call "LOAD DATA" we're instructing hive to do actual load (move to /user/hive/warehouse).
> I would suggest to warn user when he is trying to import data into default hive warehouse directory.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira