You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Leonid Furman (JIRA)" <ji...@apache.org> on 2009/12/29 02:52:29 UTC
[jira] Created: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Sqoop should have an option to create hive tables and skip the table import step
--------------------------------------------------------------------------------
Key: MAPREDUCE-1341
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
Project: Hadoop Map/Reduce
Issue Type: New Feature
Components: contrib/sqoop
Affects Versions: 0.22.0
Reporter: Leonid Furman
Priority: Minor
Fix For: 0.22.0
In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
--hive-create-only
which would omit the time consuming table import step, generate hive create table statements and run them.
If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829556#action_12829556 ]
Hadoop QA commented on MAPREDUCE-1341:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12434770/MAPREDUCE-1341.2.patch
against trunk revision 906228.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 24 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/300/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/300/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/300/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/300/console
This message is automatically generated.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated MAPREDUCE-1341:
---------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I've just committed this. Thanks Leonid!
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832000#action_12832000 ]
Hadoop QA commented on MAPREDUCE-1341:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12435365/MAPREDUCE-1341.5.patch
against trunk revision 908321.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 21 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/311/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/311/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/311/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/311/console
This message is automatically generated.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Attachment: MAPREDUCE-1341.3.patch
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831717#action_12831717 ]
Leonid Furman commented on MAPREDUCE-1341:
------------------------------------------
Never mind, it is there now. Thank you!
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829772#action_12829772 ]
Hadoop QA commented on MAPREDUCE-1341:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12434833/MAPREDUCE-1341.3.patch
against trunk revision 906228.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 27 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/435/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/435/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/435/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/435/console
This message is automatically generated.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Attachment: MAPREDUCE-1341.5.patch
For the purpose of updating the hudson build queue, I am uploading another copy of the patch - MAPREDUCE-1341.5.patch, which is the same as the previous one - MAPREDUCE-1341.4.patch.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Attachment: MAPREDUCE-1341.2.patch
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831697#action_12831697 ]
Leonid Furman commented on MAPREDUCE-1341:
------------------------------------------
It looks like the hudson build hasn't picked up the latest patch - MAPREDUCE-1341.4.patch. Should I flip the ticket status in order to restart the build?
Thanks!
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Open (was: Patch Available)
Cycling patch to retrigger hudson build.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832705#action_12832705 ]
Hadoop QA commented on MAPREDUCE-1341:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12435484/MAPREDUCE-1341.6.patch
against trunk revision 908321.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 27 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/314/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/314/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/314/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/314/console
This message is automatically generated.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833050#action_12833050 ]
Hudson commented on MAPREDUCE-1341:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #233 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/233/])
. Sqoop should have an option to create hive tables and skip the table import step. Contributed by Leonid Furman.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Open (was: Patch Available)
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Open (was: Patch Available)
The patch contains external directories specific to my local development machine.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Attachment: MAPREDUCE-1341.patch
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797328#action_12797328 ]
Aaron Kimball commented on MAPREDUCE-1341:
------------------------------------------
Please submit a patch for this
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Attachment: MAPREDUCE-1341.6.patch
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Patch Available (was: Open)
Added two command line options to Sqoop:
1. --hive-create-only
This option ensures that tables are created in hive without loading data from database to HDFS
2. -- hive-overwrite
This option indicates that existing Hive tables will be replaced with new ones.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Open (was: Patch Available)
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Patch Available (was: Open)
Aaron,
Thank you for your feedback. I have made the following changes to the patch:
1. In SqoopOptions class, renamed the variables to createHiveTableOnly and overwriteHiveTable, as well as their corresponding getter methods.
2. Modified the documentation in src/contrib/sqoop/doc/Sqoop-manpage.txt and hive.txt files. Please let me know if the updated instructions are clear.
3. Sqoop.java shouldn't have tab characters anymore. I use IntelliJ IDEA for my development, and it's possible that last time it didn't convert tabs to spaces properly. Let me know if you still see the occurrences of tab characters, and I will resubmit the patch.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Attachment: MAPREDUCE-1341.4.patch
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829888#action_12829888 ]
Aaron Kimball commented on MAPREDUCE-1341:
------------------------------------------
Patch looks pretty good -- just a couple of small issues:
Sqoop.java -- Please use spaces not tabs.
SqoopOptions.doCreateTableOnly(), doOverwriteTable(): maybe call these doCreateHiveTableOnly / doOverwriteHiveTable? There are a lot of "tables" floating around... the field names include "Hive" which is good. Getters should reflect that too.
Please add --hive-create-only, --hive-overwrite to the documentation in src/contrib/sqoop/doc/Sqoop-manpage.txt and hive.txt. These files are in ASCIIDOC format -- see http://powerman.name/doc/asciidoc and http://www.methods.co.nz/asciidoc/userguide.html if you need syntax help here.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832797#action_12832797 ]
Aaron Kimball commented on MAPREDUCE-1341:
------------------------------------------
+1; patch #6 looks good to me. If someone could commit this, that'd be superb.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831704#action_12831704 ]
Aaron Kimball commented on MAPREDUCE-1341:
------------------------------------------
I don't see the patch listed in http://hudson.zones.apache.org/hudson/view/Hadoop/job/Mapreduce-Patch-Admin/lastSuccessfulBuild/artifact/MAPREDUCE_PatchQueue.html so yea, go through cancel patch / submit patch again.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832944#action_12832944 ]
Hudson commented on MAPREDUCE-1341:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #235 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/235/])
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Open (was: Patch Available)
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Assignee: Leonid Furman
Status: Patch Available (was: Open)
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831714#action_12831714 ]
Leonid Furman commented on MAPREDUCE-1341:
------------------------------------------
Aaron, it doesn't seem to populate the queue - does it usually happen immediately or after some time?
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Patch Available (was: Open)
Fixed the unit test TestTableDefWriter and uploaded a new patch: MAPREDUCE-1341.3.patch.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Patch Available (was: Open)
Uploaded new patch - MAPREDUCE-1341.6.patch, this should fix the most recent problems with build.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832803#action_12832803 ]
Leonid Furman commented on MAPREDUCE-1341:
------------------------------------------
Thanks, Aaron!
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Assignee: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.3.patch, MAPREDUCE-1341.4.patch, MAPREDUCE-1341.5.patch, MAPREDUCE-1341.6.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to
create hive tables and skip the table import step
Posted by "Leonid Furman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonid Furman updated MAPREDUCE-1341:
-------------------------------------
Status: Patch Available (was: Open)
New patch has been uploaded - it contains no external directories that could break the build.
> Sqoop should have an option to create hive tables and skip the table import step
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1341
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1341
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Affects Versions: 0.22.0
> Reporter: Leonid Furman
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1341.2.patch, MAPREDUCE-1341.patch
>
>
> In case the client only needs to create tables in hive, it would be helpful if Sqoop had an optional parameter:
> --hive-create-only
> which would omit the time consuming table import step, generate hive create table statements and run them.
> If this feature seems useful, I can generate the patch. I have modified the Sqoop code and built it on my development machine, and it seems to be working well.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.