You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Ning Zhang (JIRA)" <ji...@apache.org> on 2010/02/12 22:48:28 UTC
[jira] Created: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Eclipse launchtemplate changes to enable debugging
--------------------------------------------------
Key: HIVE-1163
URL: https://issues.apache.org/jira/browse/HIVE-1163
Project: Hadoop Hive
Issue Type: Bug
Reporter: Ning Zhang
Assignee: Ning Zhang
Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833264#action_12833264 ]
Ning Zhang commented on HIVE-1163:
----------------------------------
Carl, JAVA_HOME is required by the hadoop script, but not any Hive script. It is used for any hadoop related command, so I think we don't need to set JAVA_HOME specific for eclipse. Do you see any specific unit test failed because of this (given that the JAVA_HOME environment variable is set correctly)?
As for README.txt, I don't quite understand your point. I compared the current version and previous revision, and it seems no much difference (eg. changes like /xxx/hive_trunk/common/src/java to /path_to_hive_trunk/common/src/java). Also I've been able to import Hive/Hadoop projects using Eclipse after 'ant eclipse-files', without this manual editing .project file. So I guess that instruction was for some older version of Eclipse?
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833289#action_12833289 ]
Carl Steinbach commented on HIVE-1163:
--------------------------------------
I'm working on a mac running OS X, and am launching Eclipse by double-clicking on
an icon. I have JAVA_HOME set in my .bashrc file, but clearly this is not getting
picked up by Eclipse, which is not a big surprise since I'm not launching Eclipse from
Bash.
I did some digging and found this: http://stackoverflow.com/questions/135688/setting-environment-variables-in-os-x
Looks like if I set JAVA_HOME in ~/.launchd.conf and reboot my computer I will be
in business, but I anticipate that a lot of other Hive/Mac users will run into the same
problem and would rather not see this question repeated on the hive-user list. Setting
JAVA_HOME in the launch configuration ensures that this will work for Mac users
and I doubt that it will interfere with people running the tests on other platforms. I think
it makes sense to add it to the launch configuration.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833234#action_12833234 ]
Carl Steinbach commented on HIVE-1163:
--------------------------------------
Various tests in TestCliDriver fail because the launch configuration does
not define the environment variable JAVA_HOME. Seems like build.xml
should set java.home based on the value of $JAVA_HOME, and then make this
available to the launch configurations by defining @JAVAHOME@ in the eclipse-files
target.
Also, the directions in README.txt for importing the project into Eclipse are
incorrect and need to be updated. I think the last person who updated the directions
was confused -- the older directions were actually more accurate. You can probably
just revert them.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ning Zhang updated HIVE-1163:
-----------------------------
Attachment: HIVE-1163_2.patch
According to Zheng's suggestion, removing the hard-coded version number in hive-exec.0.6.0.jar and get it during 'ant eclipse-files' and passing it to Test*.launch files.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833246#action_12833246 ]
Carl Steinbach commented on HIVE-1163:
--------------------------------------
Setting JAVA_HOME to ${system_property:java.home} seems to fix
some of the TestCliDriver problems.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833281#action_12833281 ]
Ning Zhang commented on HIVE-1163:
----------------------------------
Carl, I ran alter3.q and binary_output_format.q in eclipse debug mode with my patch and both work fine. Can you confirm you are running eclipse with the JAVA_HOME set correctly in environment variable?
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ning Zhang updated HIVE-1163:
-----------------------------
Affects Version/s: 0.6.0
Status: Patch Available (was: Open)
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833302#action_12833302 ]
Carl Steinbach commented on HIVE-1163:
--------------------------------------
I just noticed that you can set the launch configuration booleanAttribute key
org.eclipse.debug.core.appendEnvironmentVariables to false in the launch configuration
in order to prevent Eclipse from appending its own environment to the
environment of the launched process. I think it would be a good idea to do this
in order to make it explicit which env vars are required as well as to provide isolation
from the user's dotfiles/platform.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zheng Shao updated HIVE-1163:
-----------------------------
Status: Open (was: Patch Available)
Cancelling patch until we get a consensus on Carl's comment.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ning Zhang updated HIVE-1163:
-----------------------------
Attachment: HIVE-1163.patch
This patch changes the eclipse-template/Test*.launchtemplate to add some variables reflecting the changes in build.xml and build-common.xml. The change in data/conf/hive-site.xml reflects the jar file naming convention change.
Side notes: if you have done ant eclipse-files previously, you need to run it again to refresh Test*.launch from these launchtemplate changes after applying the patch.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12834661#action_12834661 ]
Ning Zhang commented on HIVE-1163:
----------------------------------
+1. Changes look good. JAVA_HOME works on Linux as well.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.4.patch, HIVE-1163.patch, HIVE-1163_2.patch, HIVE-1163_3.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ning Zhang updated HIVE-1163:
-----------------------------
Attachment: HIVE-1163_3.patch
Hi Carl, I've made the changes JAVA_HOME and README.txt suggested by you. I tested the JAVA_HOME change in Linux and it doesn't seem to work (unset JAVA_HOME and launch Eclipse for debugging). Can you try it on Mac and see if it works?
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch, HIVE-1163_3.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-1163:
---------------------------------
Attachment: HIVE-1163.4.patch
* Fixed the JAVA_HOME problem.
* Disabled automatic appending of Eclipse system environment to test environment.
* Adjusted the formatting in README.txt and tweaked the Eclipse instructions.
* Added a HiveCLI launch configuration for running the CLI from within Eclipse.
I'm running the tests right now. Things look good so far.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.4.patch, HIVE-1163.patch, HIVE-1163_2.patch, HIVE-1163_3.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zheng Shao resolved HIVE-1163.
------------------------------
Resolution: Fixed
Fix Version/s: 0.6.0
Release Note: HIVE-1163. Eclipse launchtemplate changes to enable debugging. (Ning Zhang and Carl Steinbach via zshao)
Hadoop Flags: [Reviewed]
Committed. Thanks Ning and Carl!
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1163.4.patch, HIVE-1163.patch, HIVE-1163_2.patch, HIVE-1163_3.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-1163:
---------------------------------
Component/s: Build Infrastructure
Affects Version/s: (was: 0.6.0)
Release Note: (was: HIVE-1163. Eclipse launchtemplate changes to enable debugging. (Ning Zhang and Carl Steinbach via zshao))
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hive
> Issue Type: Task
> Components: Build Infrastructure
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1163.4.patch, HIVE-1163.patch, HIVE-1163_2.patch, HIVE-1163_3.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833345#action_12833345 ]
Ning Zhang commented on HIVE-1163:
----------------------------------
I see. I will set the JAVA_HOME in eclipse launchtemplate file.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-1163:
---------------------------------
Issue Type: Task (was: Bug)
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Task
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1163.4.patch, HIVE-1163.patch, HIVE-1163_2.patch, HIVE-1163_3.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1163) Eclipse launchtemplate changes to
enable debugging
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12833271#action_12833271 ]
Carl Steinbach commented on HIVE-1163:
--------------------------------------
Ning, when I run the TestCliDriver run configuration from within Eclipse I see
failures in alter3, binary_output_format, binary_sortable_1, etc. alter3 throws
the following error:
{noformat}
insert overwrite table alter3 partition (pCol1='test_part', pcol2='test_part') select col1 from alter3_src
10/02/12 16:51:02 ERROR SessionState: PREHOOK: query: insert overwrite table alter3 partition (pCol1='test_part', pcol2='test_part') select col1 from alter3_src
10/02/12 16:51:02 ERROR SessionState: PREHOOK: type: QUERY
10/02/12 16:51:02 ERROR SessionState: PREHOOK: Input: default@alter3_src
10/02/12 16:51:02 ERROR SessionState: PREHOOK: Output: default@alter3@pcol1=test_part/pcol2=test_part
10/02/12 16:51:02 INFO ql.Driver: Total MapReduce jobs = 2
10/02/12 16:51:02 INFO ql.Driver: Launching Job 1 out of 2
10/02/12 16:51:02 INFO exec.MapRedTask: Generating plan file /Users/carl/Projects/hive/svn/hive/build/ql/scratchdir/plan4897842523376893870.xml
10/02/12 16:51:02 INFO exec.MapRedTask: Executing: /Users/carl/Projects/hive/svn/hive/build/hadoopcore/hadoop-0.20.0/bin/hadoop jar /Users/carl/Projects/hive/svn/hive/build/ql/hive-exec-0.6.0.jar org.apache.hadoop.hive.ql.exec.ExecDriver -plan /Users/carl/Projects/hive/svn/hive/build/ql/scratchdir/plan4897842523376893870.xml -jobconf hive.exec.script.allow.partial.consumption=false -jobconf hive.query.id=carl_20100212165151 -jobconf hive.hwi.listen.port=9999 -jobconf hive.map.aggr=true -jobconf hive.map.aggr.hash.min.reduction=0.5 -jobconf hive.exec.reducers.bytes.per.reducer=1000000000 -jobconf hive.optimize.cp=true -jobconf hive.merge.size.smallfiles.avgsize=16000000 -jobconf hive.script.serde=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe -jobconf hive.optimize.ppd=true -jobconf hive.optimize.groupby=true -jobconf javax.jdo.option.ConnectionUserName=APP -jobconf hive.mapred.reduce.tasks.speculative.execution=true -jobconf mapred.job.name=insert+overwrite+table+alter3+p...alter3_src%28Stage-1%29 -jobconf javax.jdo.option.DetachAllOnCommit=true -jobconf hive.mapred.local.mem=0 -jobconf hive.session.id=carl_201002121651 -jobconf hive.script.operator.id.env.var=HIVE_SCRIPT_OPERATOR_ID -jobconf hadoop.job.ugi=carl%2Cstaff%2Ccom.apple.sharepoint.group.1%2C_lpadmin%2Ccom.apple.sharepoint.group.2%2C_appserveradm%2C_appserverusr%2Cadmin -jobconf test.src.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Fsrc%2Ftest -jobconf hive.udtf.auto.progress=false -jobconf datanucleus.validateTables=false -jobconf hive.exec.compress.output=false -jobconf hive.test.mode.prefix=test_ -jobconf test.log.dir=%24%7Bbuild.dir%7D%2Ftest%2Flogs -jobconf test.data.files=%24%7Buser.dir%7D%2F..%2Fdata%2Ffiles -jobconf datanucleus.validateConstraints=false -jobconf mapred.reduce.tasks=-1 -jobconf hive.query.string=%0A%0Ainsert+overwrite+table+alter3+partition+%28pCol1%3D%27test_part%27%2C+pcol2%3D%27test_part%27%29+select+col1+from+alter3_src+ -jobconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat -jobconf hive.task.progress=false -jobconf hive.jar.path=%24%7Bbuild.dir.hive%7D%2Fql%2Fhive-exec-%24%7Bversion%7D.jar -jobconf datanuclues.cache.level2=true -jobconf javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.skewjoin.mapjoin.map.tasks=10000 -jobconf hive.mapjoin.maxsize=100000 -jobconf hive.exec.pre.hooks=org.apache.hadoop.hive.ql.hooks.PreExecutePrinter -jobconf hive.optimize.skewjoin=false -jobconf hive.groupby.mapaggr.checkinterval=100000 -jobconf hive.test.mode=false -jobconf hive.exec.parallel=false -jobconf datanuclues.cache.level2.type=SOFT -jobconf hive.default.fileformat=TextFile -jobconf hive.test.mode.samplefreq=32 -jobconf javax.jdo.option.NonTransactionalRead=true -jobconf hive.script.auto.progress=false -jobconf hive.merge.mapredfiles=false -jobconf fs.scheme.class=dfs -jobconf javax.jdo.option.ConnectionURL=jdbc%3Aderby%3A%3BdatabaseName%3D..%2Fbuild%2Ftest%2Fjunit_metastore_db%3Bcreate%3Dtrue -jobconf hive.exec.compress.intermediate=false -jobconf hive.metastore.rawstore.impl=org.apache.hadoop.hive.metastore.ObjectStore -jobconf hive.map.aggr.hash.percentmemory=0.5 -jobconf hive.hwi.listen.host=0.0.0.0 -jobconf hive.merge.size.per.task=256000000 -jobconf datanucleus.autoCreateSchema=true -jobconf hive.exec.post.hooks=org.apache.hadoop.hive.ql.hooks.PostExecutePrinter -jobconf hive.groupby.skewindata=false -jobconf hive.metastore.local=true -jobconf hive.skewjoin.mapjoin.min.split=33554432 -jobconf hadoop.tmp.dir=%24%7Bbuild.dir.hive%7D%2Ftest%2Fhadoop-%24%7Buser.name%7D -jobconf hive.mapred.mode=nonstrict -jobconf hive.optimize.pruner=true -jobconf hive.skewjoin.key=100000 -jobconf datanucleus.validateColumns=false -jobconf hive.querylog.location=%24%7Bbuild.dir%7D%2Ftmp -jobconf datancucleus.transactionIsolation=read-committed -jobconf hive.exec.reducers.max=999 -jobconf javax.jdo.PersistenceManagerFactoryClass=org.datanucleus.jdo.JDOPersistenceManagerFactory -jobconf hive.heartbeat.interval=1000 -jobconf hive.metastore.warehouse.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Ftest%2Fdata%2Fwarehouse%2F -jobconf datanucleus.autoStartMechanismMode=checked -jobconf javax.jdo.option.ConnectionPassword=mine -jobconf hive.metastore.connect.retries=5 -jobconf hive.mapjoin.cache.numrows=25000 -jobconf hive.exec.parallel.thread.number=8 -jobconf datanucleus.storeManagerType=rdbms -jobconf hive.script.recordreader=org.apache.hadoop.hive.ql.exec.TextRecordReader -jobconf hive.exec.scratchdir=%24%7Bbuild.dir%7D%2Fscratchdir -jobconf hive.metastore.metadb.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Ftest%2Fdata%2Fmetadb%2F -jobconf hive.script.recordwriter=org.apache.hadoop.hive.ql.exec.TextRecordWriter -jobconf hive.merge.mapfiles=true -jobconf hive.exec.script.maxerrsize=100000 -jobconf test.query.file1=file%3A%2F%2F%24%7Buser.dir%7D%2F..%2Fql%2Fsrc%2Ftest%2Forg%2Fapache%2Fhadoop%2Fhive%2Fql%2Finput2.q -jobconf hive.join.emit.interval=1000 -jobconf hive.added.jars.path= -jobconf mapred.system.dir=%2FUsers%2Fcarl%2FProjects%2Fhive%2Fsvn%2Fhive%2Fbuild%2Ftest%2Fhadoop-carl%2Fmapred%2Fsystem%2F-1496122043 -jobconf mapred.local.dir=%2FUsers%2Fcarl%2FProjects%2Fhive%2Fsvn%2Fhive%2Fbuild%2Ftest%2Fhadoop-carl%2Fmapred%2Flocal%2F-462613887
Error: JAVA_HOME is not set.
10/02/12 16:51:02 ERROR exec.MapRedTask: Execution failed with exit status: 1
10/02/12 16:51:02 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
Exception: Client Execution failed with error code = 9
junit.framework.AssertionFailedError: Client Execution failed with error code = 9
at junit.framework.Assert.fail(Assert.java:47)
at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter3(TestCliDriver.java:1146)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:154)
at junit.framework.TestCase.runBare(TestCase.java:127)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:118)
at org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(JUnit3TestReference.java:130)
at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
{noformat}
Setting JAVA_HOME=${system_property:java.home} in the configuration fixes this problem.
bq. Also I've been able to import Hive/Hadoop projects using Eclipse after 'ant eclipse-files', without this manual editing .project file. So I guess that instruction was for some older version of Eclipse?
Right. steps 4-7 are unnecessary, and you can skip step 3 if
you run 'ant gen-test' in the ql directory. I think the directions should
instead tell you to do the following:
{noformat}
% ant package
% cd metastore
% ant model-jar
% cd ../ql
% ant gen-test
% cd ..
% ant eclipse-files
{noformat}
# Launch Eclipse.
# File->Import->General->Existing Projects into Workspace and select the root of your Hive directory.
> Eclipse launchtemplate changes to enable debugging
> --------------------------------------------------
>
> Key: HIVE-1163
> URL: https://issues.apache.org/jira/browse/HIVE-1163
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1163.patch, HIVE-1163_2.patch
>
>
> Some recent changes in the build.xml and build-common.xml breaks the debugging functionality in eclipse. Some system defined properties were missing when running eclipse debugger.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.