You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Carl Steinbach <cw...@apache.org> on 2011/12/09 01:11:34 UTC

[VOTE] Apache Hive 0.8.0 Release Candidate 3

Apache Hive 0.8.0 Release Candidate 3 is available here:

http://people.apache.org/~cws/hive-0.8.0-candidate-3/

Changes since RC2:
* HIVE-2634 revert HIVE-2566

Please test and vote.

Thanks.

Carl

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Edward Capriolo <ed...@gmail.com>.
If we do another release candidate can we include..

https://issues.apache.org/jira/browse/HIVE-2645

.not critical since it is just an error message but it might be nice.

So my two blockers are running ant package, and hive service startup. I did
run numerous commands from the CLI, create a tables, group bys etc. That
all looks good.


On Sat, Dec 10, 2011 at 1:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> Also I know I have been out of the game for a minute but..
> extract-functions:
>     [mkdir] Created dir: /home/edward/branch-0.8-r2/build/builtins/metadata
>      [xslt] java.lang.ClassNotFoundException:
> org.apache.tools.ant.taskdefs.optional.TraXLiaison
>      [xslt]     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>      [xslt]     at java.security.AccessController.doPrivileged(Native
> Method)
>      [xslt]     at
> java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>      [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>      [xslt]     at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>      [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
>      [xslt]     at java.lang.Class.forName0(Native Method)
>      [xslt]     at java.lang.Class.forName(Class.java:169)
>      [xslt]     at
> org.apache.tools.ant.taskdefs.XSLTProcess.loadClass(XSLTProcess.java:548)
>      [xslt]     at
> org.apache.tools.ant.taskdefs.XSLTProcess.resolveProcessor(XSLTProcess.java:533)
>      [xslt]     at
> org.apache.tools.ant.taskdefs.XSLTProcess.getLiaison(XSLTProcess.java:785)
>      [xslt]     at
> org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:300)
>      [xslt]     at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>      [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> Source)
>      [xslt]     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>      [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>      [xslt]     at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>      [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>      [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>      [xslt]     at
> org.apache.tools.ant.Target.performTasks(Target.java:385)
>      [xslt]     at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>      [xslt]     at
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
>      [xslt]     at
> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>      [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
>      [xslt]     at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>      [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> Source)
>      [xslt]     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>      [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>      [xslt]     at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>      [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>      [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>      [xslt]     at
> org.apache.tools.ant.Target.performTasks(Target.java:385)
>      [xslt]     at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>      [xslt]     at
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
>      [xslt]     at
> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>      [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
>      [xslt]     at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>      [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> Source)
>      [xslt]     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>      [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>      [xslt]     at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>      [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>      [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>      [xslt]     at
> org.apache.tools.ant.Target.performTasks(Target.java:385)
>      [xslt]     at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>      [xslt]     at
> org.apache.tools.ant.Project.executeTarget(Project.java:1306)
>      [xslt]     at
> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
>      [xslt]     at
> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>      [xslt]     at org.apache.tools.ant.Main.runBuild(Main.java:758)
>      [xslt]     at org.apache.tools.ant.Main.startAnt(Main.java:217)
>      [xslt]     at
> org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
>      [xslt]     at
> org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
>
> BUILD FAILED
> /home/edward/branch-0.8-r2/build.xml:525: The following error occurred
> while executing this line:
> /home/edward/branch-0.8-r2/builtins/build.xml:37: The following error
> occurred while executing this line:
> /home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
> java.lang.ClassNotFoundException:
> org.apache.tools.ant.taskdefs.optional.TraXLiaison
>
> Do I need a newer ant or more optional packages?
>
> [edward@tablitha branch-0.8-r2]$ ant -version
> Apache Ant version 1.7.1 compiled on April 16 2010
>
>
>
> On Sat, Dec 10, 2011 at 12:45 PM, Edward Capriolo <ed...@gmail.com>wrote:
>
>> I have
>> hive-0.8.0-candidate-3with hadoop in local mode against hadoop 0.20.2.
>> Looks like hive server is not launching.
>>
>> [edward@tablitha hive-0.8.0-bin]$ bin/hive --service hiveserver
>> Starting Hive Thrift Server
>> Exception in thread "main" java.lang.NoSuchMethodError:
>> org.apache.thrift.server.TThreadPoolServer.<init>(Lorg/apache/thrift/server/TThreadPoolServer$Args;)V
>>     at org.apache.hadoop.hive.service.HiveServer.main(HiveServer.java:676)
>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>     at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>     at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>     at java.lang.reflect.Method.invoke(Method.java:597)
>>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>>
>>
>>
>> On Sat, Dec 10, 2011 at 7:37 AM, Carl Steinbach <ca...@cloudera.com>wrote:
>>
>>> Hi Jakob and Ashutosh,
>>>
>>> I posted a patch for HIVE-2643. Please try it out and let me know if it
>>> doesn't fix the problem.
>>>
>>> Thanks.
>>>
>>> Carl
>>>
>>> On Fri, Dec 9, 2011 at 9:40 PM, Ashutosh Chauhan <hashutosh@apache.org
>>> >wrote:
>>>
>>> > I saw this issue on trunk too in today's checkout. Hive always thinks
>>> its
>>> > running in local mode because hadoop conf xmls are not getting loaded
>>> up.
>>> >
>>> > Ashutosh
>>> > On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com> wrote:
>>> >
>>> > > -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
>>> > > submission on a security-enabled 204 grid that I've traced back to
>>> > > HIVE-2362:
>>> > > The wrong staging directories are being specified:
>>> > > RC2: /user/jhoman-667872320/.staging
>>> > >
>>> > > This is because the Hadoop confs aren't being loaded and the system
>>> > > thinks its running in local mode, so calls in the LocalJobRunner,
>>> > > which builds staging directories in this manner.  Running set shows
>>> > > that none of the usual hdfs/mapred settings have been defined, so
>>> it's
>>> > > also defaulting to the local filesystem.
>>> > >
>>> > > Once I reverted 2362, everything worked again.
>>> > >
>>> > > I've opened HIVE-2643.
>>> > >
>>> > > On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com>
>>> > wrote:
>>> > > > +1
>>> > > >
>>> > > > What I did:
>>> > > > * Built source tarball and imported into Eclipse. Verified that
>>> test
>>> > > cases
>>> > > > run.
>>> > > > * Ran tests from command line.
>>> > > > * Ran through tutorial exercises.
>>> > > >
>>> > > > We need one more +1 vote in order to release. PMC members: Please
>>> Vote!
>>> > > >
>>> > > > On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
>>> > > >
>>> > > >> Tests passed, +1 from me!
>>> > > >>
>>> > > >> JVS
>>> > > >>
>>> > > >> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
>>> > > >>
>>> > > >> > Apache Hive 0.8.0 Release Candidate 3 is available here:
>>> > > >> >
>>> > > >> > http://people.apache.org/~cws/hive-0.8.0-candidate-3/
>>> > > >> >
>>> > > >> > Changes since RC2:
>>> > > >> > * HIVE-2634 revert HIVE-2566
>>> > > >> >
>>> > > >> > Please test and vote.
>>> > > >> >
>>> > > >> > Thanks.
>>> > > >> >
>>> > > >> > Carl
>>> > > >>
>>> > > >>
>>> > >
>>> >
>>>
>>
>>
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Carl Steinbach <ca...@cloudera.com>.
Quick update: Ed and I chatted on IRC and determined that HiveServer
problem was a result of some thrift-0.5.0 JARs that he copied onto his
classpath. Also, the build failure was resolved by using Ant 1.8.2 and
setting ANT_HOME.

As for the configuration problems mentioned by Jakob and Ashutosh, it looks
like these are resolved by the patch for HIVE-2643. I will cut another RC
after this gets committed/backported.

Thanks.

Carl

On Mon, Dec 12, 2011 at 2:01 AM, Carl Steinbach <ca...@cloudera.com> wrote:

> Hi Ed,
>
> I downloaded the latest stable binary ant from apache.org unpacked it into
>> a directory and added it to my path. I never have needed any optional
>> packages up until now, but I that it is not a big deal.
>
>
> Which Ant target were you running when you encountered this error?
> Also, what happens if you pass the '-nouserlib' argument to Ant?
>
> I think the hive
>> thrift server not starting is. Many people use that.
>>
>
> I agree. It looks like the problem you're running into with hiveserver is
> a result of the wrong version of thrift appearing first on the classpath.
> Can you please run the following command to dump the classpath and report
> back with the results?
>
> % hive -e 'set system:java.class.path'
>
> Thanks.
>
> Carl
>
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Carl Steinbach <ca...@cloudera.com>.
Hi Ed,

I downloaded the latest stable binary ant from apache.org unpacked it into
> a directory and added it to my path. I never have needed any optional
> packages up until now, but I that it is not a big deal.


Which Ant target were you running when you encountered this error?
Also, what happens if you pass the '-nouserlib' argument to Ant?

I think the hive
> thrift server not starting is. Many people use that.
>

I agree. It looks like the problem you're running into with hiveserver is a
result of the wrong version of thrift appearing first on the classpath. Can
you please run the following command to dump the classpath and report back
with the results?

% hive -e 'set system:java.class.path'

Thanks.

Carl

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Edward Capriolo <ed...@gmail.com>.
I downloaded the latest stable binary ant from apache.org unpacked it into
a directory and added it to my path. I never have needed any optional
packages up until now, but I that it is not a big deal. I think the hive
thrift server not starting is. Many people use that.

On Sun, Dec 11, 2011 at 1:00 PM, John Sichi <js...@fb.com> wrote:

> OK, not sure how you installed ant, but googling for that exception brings
> up this:
>
>
> http://groovy.329449.n5.nabble.com/Solved-org-apache-tools-ant-taskdefs-optional-TraXLiaison-notFoundException-td355638.html
>
> JVS
>
> On Dec 11, 2011, at 8:22 AM, Edward Capriolo wrote:
>
> > Same issue.
> >
> > /home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
> > java.lang.ClassNotFoundException:
> > org.apache.tools.ant.taskdefs.optional.TraXLiaison
> >
> > Total time: 1 minute 35 seconds
> > [edward@tablitha branch-0.8-r2]$ which ant
> > ~/apache-ant-1.8.2/bin/ant
> >
> >
> > On Sat, Dec 10, 2011 at 3:12 PM, John Sichi <js...@fb.com> wrote:
> >
> >> You need ant 1.8.x
> >>
> >> JVS
> >>
> >> On Dec 10, 2011, at 10:11 AM, Edward Capriolo wrote:
> >>
> >>> Also I know I have been out of the game for a minute but..
> >>> extract-functions:
> >>>   [mkdir] Created dir:
> >> /home/edward/branch-0.8-r2/build/builtins/metadata
> >>>    [xslt] java.lang.ClassNotFoundException:
> >>> org.apache.tools.ant.taskdefs.optional.TraXLiaison
> >>>    [xslt]     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >>>    [xslt]     at java.security.AccessController.doPrivileged(Native
> >>> Method)
> >>>    [xslt]     at
> >>> java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >>>    [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> >>>    [xslt]     at
> >>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >>>    [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
> >>>    [xslt]     at java.lang.Class.forName0(Native Method)
> >>>    [xslt]     at java.lang.Class.forName(Class.java:169)
> >>>    [xslt]     at
> >>>
> org.apache.tools.ant.taskdefs.XSLTProcess.loadClass(XSLTProcess.java:548)
> >>>    [xslt]     at
> >>>
> >>
> org.apache.tools.ant.taskdefs.XSLTProcess.resolveProcessor(XSLTProcess.java:533)
> >>>    [xslt]     at
> >>>
> >>
> org.apache.tools.ant.taskdefs.XSLTProcess.getLiaison(XSLTProcess.java:785)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:300)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
> >>>    [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> >>> Source)
> >>>    [xslt]     at
> >>>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>>    [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
> >>>    [xslt]     at
> >>>
> >>
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> >>>    [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
> >>>    [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
> >>>    [xslt]     at
> >> org.apache.tools.ant.Target.performTasks(Target.java:385)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
> >>>    [xslt]     at
> >>>
> >>
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
> >>>    [xslt]     at
> org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
> >>>    [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> >>> Source)
> >>>    [xslt]     at
> >>>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>>    [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
> >>>    [xslt]     at
> >>>
> >>
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> >>>    [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
> >>>    [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
> >>>    [xslt]     at
> >> org.apache.tools.ant.Target.performTasks(Target.java:385)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
> >>>    [xslt]     at
> >>>
> >>
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
> >>>    [xslt]     at
> org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
> >>>    [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> >>> Source)
> >>>    [xslt]     at
> >>>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>>    [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
> >>>    [xslt]     at
> >>>
> >>
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> >>>    [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
> >>>    [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
> >>>    [xslt]     at
> >> org.apache.tools.ant.Target.performTasks(Target.java:385)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.Project.executeTarget(Project.java:1306)
> >>>    [xslt]     at
> >>>
> >>
> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
> >>>    [xslt]     at org.apache.tools.ant.Main.runBuild(Main.java:758)
> >>>    [xslt]     at org.apache.tools.ant.Main.startAnt(Main.java:217)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
> >>>    [xslt]     at
> >>> org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
> >>>
> >>> BUILD FAILED
> >>> /home/edward/branch-0.8-r2/build.xml:525: The following error occurred
> >>> while executing this line:
> >>> /home/edward/branch-0.8-r2/builtins/build.xml:37: The following error
> >>> occurred while executing this line:
> >>> /home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
> >>> java.lang.ClassNotFoundException:
> >>> org.apache.tools.ant.taskdefs.optional.TraXLiaison
> >>>
> >>> Do I need a newer ant or more optional packages?
> >>>
> >>> [edward@tablitha branch-0.8-r2]$ ant -version
> >>> Apache Ant version 1.7.1 compiled on April 16 2010
> >>>
> >>>
> >>>
> >>> On Sat, Dec 10, 2011 at 12:45 PM, Edward Capriolo <
> edlinuxguru@gmail.com
> >>> wrote:
> >>>
> >>>> I have
> >>>> hive-0.8.0-candidate-3with hadoop in local mode against hadoop 0.20.2.
> >>>> Looks like hive server is not launching.
> >>>>
> >>>> [edward@tablitha hive-0.8.0-bin]$ bin/hive --service hiveserver
> >>>> Starting Hive Thrift Server
> >>>> Exception in thread "main" java.lang.NoSuchMethodError:
> >>>>
> >>
> org.apache.thrift.server.TThreadPoolServer.<init>(Lorg/apache/thrift/server/TThreadPoolServer$Args;)V
> >>>>   at
> >> org.apache.hadoop.hive.service.HiveServer.main(HiveServer.java:676)
> >>>>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>>>   at
> >>>>
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >>>>   at
> >>>>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>>>   at java.lang.reflect.Method.invoke(Method.java:597)
> >>>>   at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> >>>>
> >>>>
> >>>>
> >>>> On Sat, Dec 10, 2011 at 7:37 AM, Carl Steinbach <ca...@cloudera.com>
> >> wrote:
> >>>>
> >>>>> Hi Jakob and Ashutosh,
> >>>>>
> >>>>> I posted a patch for HIVE-2643. Please try it out and let me know if
> it
> >>>>> doesn't fix the problem.
> >>>>>
> >>>>> Thanks.
> >>>>>
> >>>>> Carl
> >>>>>
> >>>>> On Fri, Dec 9, 2011 at 9:40 PM, Ashutosh Chauhan <
> hashutosh@apache.org
> >>>>>> wrote:
> >>>>>
> >>>>>> I saw this issue on trunk too in today's checkout. Hive always
> thinks
> >>>>> its
> >>>>>> running in local mode because hadoop conf xmls are not getting
> loaded
> >>>>> up.
> >>>>>>
> >>>>>> Ashutosh
> >>>>>> On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com>
> wrote:
> >>>>>>
> >>>>>>> -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
> >>>>>>> submission on a security-enabled 204 grid that I've traced back to
> >>>>>>> HIVE-2362:
> >>>>>>> The wrong staging directories are being specified:
> >>>>>>> RC2: /user/jhoman-667872320/.staging
> >>>>>>>
> >>>>>>> This is because the Hadoop confs aren't being loaded and the system
> >>>>>>> thinks its running in local mode, so calls in the LocalJobRunner,
> >>>>>>> which builds staging directories in this manner.  Running set shows
> >>>>>>> that none of the usual hdfs/mapred settings have been defined, so
> >> it's
> >>>>>>> also defaulting to the local filesystem.
> >>>>>>>
> >>>>>>> Once I reverted 2362, everything worked again.
> >>>>>>>
> >>>>>>> I've opened HIVE-2643.
> >>>>>>>
> >>>>>>> On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <carl@cloudera.com
> >
> >>>>>> wrote:
> >>>>>>>> +1
> >>>>>>>>
> >>>>>>>> What I did:
> >>>>>>>> * Built source tarball and imported into Eclipse. Verified that
> test
> >>>>>>> cases
> >>>>>>>> run.
> >>>>>>>> * Ran tests from command line.
> >>>>>>>> * Ran through tutorial exercises.
> >>>>>>>>
> >>>>>>>> We need one more +1 vote in order to release. PMC members: Please
> >>>>> Vote!
> >>>>>>>>
> >>>>>>>> On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com>
> wrote:
> >>>>>>>>
> >>>>>>>>> Tests passed, +1 from me!
> >>>>>>>>>
> >>>>>>>>> JVS
> >>>>>>>>>
> >>>>>>>>> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
> >>>>>>>>>
> >>>>>>>>>> Apache Hive 0.8.0 Release Candidate 3 is available here:
> >>>>>>>>>>
> >>>>>>>>>> http://people.apache.org/~cws/hive-0.8.0-candidate-3/
> >>>>>>>>>>
> >>>>>>>>>> Changes since RC2:
> >>>>>>>>>> * HIVE-2634 revert HIVE-2566
> >>>>>>>>>>
> >>>>>>>>>> Please test and vote.
> >>>>>>>>>>
> >>>>>>>>>> Thanks.
> >>>>>>>>>>
> >>>>>>>>>> Carl
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>>
> >>
> >>
>
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by John Sichi <js...@fb.com>.
OK, not sure how you installed ant, but googling for that exception brings up this:

http://groovy.329449.n5.nabble.com/Solved-org-apache-tools-ant-taskdefs-optional-TraXLiaison-notFoundException-td355638.html

JVS

On Dec 11, 2011, at 8:22 AM, Edward Capriolo wrote:

> Same issue.
> 
> /home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
> java.lang.ClassNotFoundException:
> org.apache.tools.ant.taskdefs.optional.TraXLiaison
> 
> Total time: 1 minute 35 seconds
> [edward@tablitha branch-0.8-r2]$ which ant
> ~/apache-ant-1.8.2/bin/ant
> 
> 
> On Sat, Dec 10, 2011 at 3:12 PM, John Sichi <js...@fb.com> wrote:
> 
>> You need ant 1.8.x
>> 
>> JVS
>> 
>> On Dec 10, 2011, at 10:11 AM, Edward Capriolo wrote:
>> 
>>> Also I know I have been out of the game for a minute but..
>>> extract-functions:
>>>   [mkdir] Created dir:
>> /home/edward/branch-0.8-r2/build/builtins/metadata
>>>    [xslt] java.lang.ClassNotFoundException:
>>> org.apache.tools.ant.taskdefs.optional.TraXLiaison
>>>    [xslt]     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>>    [xslt]     at java.security.AccessController.doPrivileged(Native
>>> Method)
>>>    [xslt]     at
>>> java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>>    [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>    [xslt]     at
>>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>    [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
>>>    [xslt]     at java.lang.Class.forName0(Native Method)
>>>    [xslt]     at java.lang.Class.forName(Class.java:169)
>>>    [xslt]     at
>>> org.apache.tools.ant.taskdefs.XSLTProcess.loadClass(XSLTProcess.java:548)
>>>    [xslt]     at
>>> 
>> org.apache.tools.ant.taskdefs.XSLTProcess.resolveProcessor(XSLTProcess.java:533)
>>>    [xslt]     at
>>> 
>> org.apache.tools.ant.taskdefs.XSLTProcess.getLiaison(XSLTProcess.java:785)
>>>    [xslt]     at
>>> org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:300)
>>>    [xslt]     at
>>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>>>    [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
>>> Source)
>>>    [xslt]     at
>>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>    [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>>>    [xslt]     at
>>> 
>> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>>>    [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>>>    [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>>>    [xslt]     at
>> org.apache.tools.ant.Target.performTasks(Target.java:385)
>>>    [xslt]     at
>>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>>>    [xslt]     at
>>> 
>> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
>>>    [xslt]     at
>>> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>>>    [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
>>>    [xslt]     at
>>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>>>    [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
>>> Source)
>>>    [xslt]     at
>>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>    [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>>>    [xslt]     at
>>> 
>> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>>>    [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>>>    [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>>>    [xslt]     at
>> org.apache.tools.ant.Target.performTasks(Target.java:385)
>>>    [xslt]     at
>>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>>>    [xslt]     at
>>> 
>> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
>>>    [xslt]     at
>>> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>>>    [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
>>>    [xslt]     at
>>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>>>    [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
>>> Source)
>>>    [xslt]     at
>>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>    [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>>>    [xslt]     at
>>> 
>> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>>>    [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>>>    [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>>>    [xslt]     at
>> org.apache.tools.ant.Target.performTasks(Target.java:385)
>>>    [xslt]     at
>>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>>>    [xslt]     at
>>> org.apache.tools.ant.Project.executeTarget(Project.java:1306)
>>>    [xslt]     at
>>> 
>> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
>>>    [xslt]     at
>>> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>>>    [xslt]     at org.apache.tools.ant.Main.runBuild(Main.java:758)
>>>    [xslt]     at org.apache.tools.ant.Main.startAnt(Main.java:217)
>>>    [xslt]     at
>>> org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
>>>    [xslt]     at
>>> org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
>>> 
>>> BUILD FAILED
>>> /home/edward/branch-0.8-r2/build.xml:525: The following error occurred
>>> while executing this line:
>>> /home/edward/branch-0.8-r2/builtins/build.xml:37: The following error
>>> occurred while executing this line:
>>> /home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
>>> java.lang.ClassNotFoundException:
>>> org.apache.tools.ant.taskdefs.optional.TraXLiaison
>>> 
>>> Do I need a newer ant or more optional packages?
>>> 
>>> [edward@tablitha branch-0.8-r2]$ ant -version
>>> Apache Ant version 1.7.1 compiled on April 16 2010
>>> 
>>> 
>>> 
>>> On Sat, Dec 10, 2011 at 12:45 PM, Edward Capriolo <edlinuxguru@gmail.com
>>> wrote:
>>> 
>>>> I have
>>>> hive-0.8.0-candidate-3with hadoop in local mode against hadoop 0.20.2.
>>>> Looks like hive server is not launching.
>>>> 
>>>> [edward@tablitha hive-0.8.0-bin]$ bin/hive --service hiveserver
>>>> Starting Hive Thrift Server
>>>> Exception in thread "main" java.lang.NoSuchMethodError:
>>>> 
>> org.apache.thrift.server.TThreadPoolServer.<init>(Lorg/apache/thrift/server/TThreadPoolServer$Args;)V
>>>>   at
>> org.apache.hadoop.hive.service.HiveServer.main(HiveServer.java:676)
>>>>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>   at
>>>> 
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>   at
>>>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>   at java.lang.reflect.Method.invoke(Method.java:597)
>>>>   at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>>>> 
>>>> 
>>>> 
>>>> On Sat, Dec 10, 2011 at 7:37 AM, Carl Steinbach <ca...@cloudera.com>
>> wrote:
>>>> 
>>>>> Hi Jakob and Ashutosh,
>>>>> 
>>>>> I posted a patch for HIVE-2643. Please try it out and let me know if it
>>>>> doesn't fix the problem.
>>>>> 
>>>>> Thanks.
>>>>> 
>>>>> Carl
>>>>> 
>>>>> On Fri, Dec 9, 2011 at 9:40 PM, Ashutosh Chauhan <hashutosh@apache.org
>>>>>> wrote:
>>>>> 
>>>>>> I saw this issue on trunk too in today's checkout. Hive always thinks
>>>>> its
>>>>>> running in local mode because hadoop conf xmls are not getting loaded
>>>>> up.
>>>>>> 
>>>>>> Ashutosh
>>>>>> On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com> wrote:
>>>>>> 
>>>>>>> -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
>>>>>>> submission on a security-enabled 204 grid that I've traced back to
>>>>>>> HIVE-2362:
>>>>>>> The wrong staging directories are being specified:
>>>>>>> RC2: /user/jhoman-667872320/.staging
>>>>>>> 
>>>>>>> This is because the Hadoop confs aren't being loaded and the system
>>>>>>> thinks its running in local mode, so calls in the LocalJobRunner,
>>>>>>> which builds staging directories in this manner.  Running set shows
>>>>>>> that none of the usual hdfs/mapred settings have been defined, so
>> it's
>>>>>>> also defaulting to the local filesystem.
>>>>>>> 
>>>>>>> Once I reverted 2362, everything worked again.
>>>>>>> 
>>>>>>> I've opened HIVE-2643.
>>>>>>> 
>>>>>>> On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com>
>>>>>> wrote:
>>>>>>>> +1
>>>>>>>> 
>>>>>>>> What I did:
>>>>>>>> * Built source tarball and imported into Eclipse. Verified that test
>>>>>>> cases
>>>>>>>> run.
>>>>>>>> * Ran tests from command line.
>>>>>>>> * Ran through tutorial exercises.
>>>>>>>> 
>>>>>>>> We need one more +1 vote in order to release. PMC members: Please
>>>>> Vote!
>>>>>>>> 
>>>>>>>> On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
>>>>>>>> 
>>>>>>>>> Tests passed, +1 from me!
>>>>>>>>> 
>>>>>>>>> JVS
>>>>>>>>> 
>>>>>>>>> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
>>>>>>>>> 
>>>>>>>>>> Apache Hive 0.8.0 Release Candidate 3 is available here:
>>>>>>>>>> 
>>>>>>>>>> http://people.apache.org/~cws/hive-0.8.0-candidate-3/
>>>>>>>>>> 
>>>>>>>>>> Changes since RC2:
>>>>>>>>>> * HIVE-2634 revert HIVE-2566
>>>>>>>>>> 
>>>>>>>>>> Please test and vote.
>>>>>>>>>> 
>>>>>>>>>> Thanks.
>>>>>>>>>> 
>>>>>>>>>> Carl
>>>>>>>>> 
>>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>>> 
>> 
>> 


Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Edward Capriolo <ed...@gmail.com>.
Same issue.

/home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
java.lang.ClassNotFoundException:
org.apache.tools.ant.taskdefs.optional.TraXLiaison

Total time: 1 minute 35 seconds
[edward@tablitha branch-0.8-r2]$ which ant
~/apache-ant-1.8.2/bin/ant


On Sat, Dec 10, 2011 at 3:12 PM, John Sichi <js...@fb.com> wrote:

> You need ant 1.8.x
>
> JVS
>
> On Dec 10, 2011, at 10:11 AM, Edward Capriolo wrote:
>
> > Also I know I have been out of the game for a minute but..
> > extract-functions:
> >    [mkdir] Created dir:
> /home/edward/branch-0.8-r2/build/builtins/metadata
> >     [xslt] java.lang.ClassNotFoundException:
> > org.apache.tools.ant.taskdefs.optional.TraXLiaison
> >     [xslt]     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >     [xslt]     at java.security.AccessController.doPrivileged(Native
> > Method)
> >     [xslt]     at
> > java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >     [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> >     [xslt]     at
> > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >     [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
> >     [xslt]     at java.lang.Class.forName0(Native Method)
> >     [xslt]     at java.lang.Class.forName(Class.java:169)
> >     [xslt]     at
> > org.apache.tools.ant.taskdefs.XSLTProcess.loadClass(XSLTProcess.java:548)
> >     [xslt]     at
> >
> org.apache.tools.ant.taskdefs.XSLTProcess.resolveProcessor(XSLTProcess.java:533)
> >     [xslt]     at
> >
> org.apache.tools.ant.taskdefs.XSLTProcess.getLiaison(XSLTProcess.java:785)
> >     [xslt]     at
> > org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:300)
> >     [xslt]     at
> > org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
> >     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> > Source)
> >     [xslt]     at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
> >     [xslt]     at
> >
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> >     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
> >     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
> >     [xslt]     at
> org.apache.tools.ant.Target.performTasks(Target.java:385)
> >     [xslt]     at
> > org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
> >     [xslt]     at
> >
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
> >     [xslt]     at
> > org.apache.tools.ant.Project.executeTargets(Project.java:1189)
> >     [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
> >     [xslt]     at
> > org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
> >     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> > Source)
> >     [xslt]     at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
> >     [xslt]     at
> >
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> >     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
> >     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
> >     [xslt]     at
> org.apache.tools.ant.Target.performTasks(Target.java:385)
> >     [xslt]     at
> > org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
> >     [xslt]     at
> >
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
> >     [xslt]     at
> > org.apache.tools.ant.Project.executeTargets(Project.java:1189)
> >     [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
> >     [xslt]     at
> > org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
> >     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> > Source)
> >     [xslt]     at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
> >     [xslt]     at
> >
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> >     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
> >     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
> >     [xslt]     at
> org.apache.tools.ant.Target.performTasks(Target.java:385)
> >     [xslt]     at
> > org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
> >     [xslt]     at
> > org.apache.tools.ant.Project.executeTarget(Project.java:1306)
> >     [xslt]     at
> >
> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
> >     [xslt]     at
> > org.apache.tools.ant.Project.executeTargets(Project.java:1189)
> >     [xslt]     at org.apache.tools.ant.Main.runBuild(Main.java:758)
> >     [xslt]     at org.apache.tools.ant.Main.startAnt(Main.java:217)
> >     [xslt]     at
> > org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
> >     [xslt]     at
> > org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
> >
> > BUILD FAILED
> > /home/edward/branch-0.8-r2/build.xml:525: The following error occurred
> > while executing this line:
> > /home/edward/branch-0.8-r2/builtins/build.xml:37: The following error
> > occurred while executing this line:
> > /home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
> > java.lang.ClassNotFoundException:
> > org.apache.tools.ant.taskdefs.optional.TraXLiaison
> >
> > Do I need a newer ant or more optional packages?
> >
> > [edward@tablitha branch-0.8-r2]$ ant -version
> > Apache Ant version 1.7.1 compiled on April 16 2010
> >
> >
> >
> > On Sat, Dec 10, 2011 at 12:45 PM, Edward Capriolo <edlinuxguru@gmail.com
> >wrote:
> >
> >> I have
> >> hive-0.8.0-candidate-3with hadoop in local mode against hadoop 0.20.2.
> >> Looks like hive server is not launching.
> >>
> >> [edward@tablitha hive-0.8.0-bin]$ bin/hive --service hiveserver
> >> Starting Hive Thrift Server
> >> Exception in thread "main" java.lang.NoSuchMethodError:
> >>
> org.apache.thrift.server.TThreadPoolServer.<init>(Lorg/apache/thrift/server/TThreadPoolServer$Args;)V
> >>    at
> org.apache.hadoop.hive.service.HiveServer.main(HiveServer.java:676)
> >>    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>    at
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >>    at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>    at java.lang.reflect.Method.invoke(Method.java:597)
> >>    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> >>
> >>
> >>
> >> On Sat, Dec 10, 2011 at 7:37 AM, Carl Steinbach <ca...@cloudera.com>
> wrote:
> >>
> >>> Hi Jakob and Ashutosh,
> >>>
> >>> I posted a patch for HIVE-2643. Please try it out and let me know if it
> >>> doesn't fix the problem.
> >>>
> >>> Thanks.
> >>>
> >>> Carl
> >>>
> >>> On Fri, Dec 9, 2011 at 9:40 PM, Ashutosh Chauhan <hashutosh@apache.org
> >>>> wrote:
> >>>
> >>>> I saw this issue on trunk too in today's checkout. Hive always thinks
> >>> its
> >>>> running in local mode because hadoop conf xmls are not getting loaded
> >>> up.
> >>>>
> >>>> Ashutosh
> >>>> On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com> wrote:
> >>>>
> >>>>> -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
> >>>>> submission on a security-enabled 204 grid that I've traced back to
> >>>>> HIVE-2362:
> >>>>> The wrong staging directories are being specified:
> >>>>> RC2: /user/jhoman-667872320/.staging
> >>>>>
> >>>>> This is because the Hadoop confs aren't being loaded and the system
> >>>>> thinks its running in local mode, so calls in the LocalJobRunner,
> >>>>> which builds staging directories in this manner.  Running set shows
> >>>>> that none of the usual hdfs/mapred settings have been defined, so
> it's
> >>>>> also defaulting to the local filesystem.
> >>>>>
> >>>>> Once I reverted 2362, everything worked again.
> >>>>>
> >>>>> I've opened HIVE-2643.
> >>>>>
> >>>>> On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com>
> >>>> wrote:
> >>>>>> +1
> >>>>>>
> >>>>>> What I did:
> >>>>>> * Built source tarball and imported into Eclipse. Verified that test
> >>>>> cases
> >>>>>> run.
> >>>>>> * Ran tests from command line.
> >>>>>> * Ran through tutorial exercises.
> >>>>>>
> >>>>>> We need one more +1 vote in order to release. PMC members: Please
> >>> Vote!
> >>>>>>
> >>>>>> On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
> >>>>>>
> >>>>>>> Tests passed, +1 from me!
> >>>>>>>
> >>>>>>> JVS
> >>>>>>>
> >>>>>>> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
> >>>>>>>
> >>>>>>>> Apache Hive 0.8.0 Release Candidate 3 is available here:
> >>>>>>>>
> >>>>>>>> http://people.apache.org/~cws/hive-0.8.0-candidate-3/
> >>>>>>>>
> >>>>>>>> Changes since RC2:
> >>>>>>>> * HIVE-2634 revert HIVE-2566
> >>>>>>>>
> >>>>>>>> Please test and vote.
> >>>>>>>>
> >>>>>>>> Thanks.
> >>>>>>>>
> >>>>>>>> Carl
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>>
> >>
> >>
>
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by John Sichi <js...@fb.com>.
You need ant 1.8.x

JVS

On Dec 10, 2011, at 10:11 AM, Edward Capriolo wrote:

> Also I know I have been out of the game for a minute but..
> extract-functions:
>    [mkdir] Created dir: /home/edward/branch-0.8-r2/build/builtins/metadata
>     [xslt] java.lang.ClassNotFoundException:
> org.apache.tools.ant.taskdefs.optional.TraXLiaison
>     [xslt]     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>     [xslt]     at java.security.AccessController.doPrivileged(Native
> Method)
>     [xslt]     at
> java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>     [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>     [xslt]     at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>     [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
>     [xslt]     at java.lang.Class.forName0(Native Method)
>     [xslt]     at java.lang.Class.forName(Class.java:169)
>     [xslt]     at
> org.apache.tools.ant.taskdefs.XSLTProcess.loadClass(XSLTProcess.java:548)
>     [xslt]     at
> org.apache.tools.ant.taskdefs.XSLTProcess.resolveProcessor(XSLTProcess.java:533)
>     [xslt]     at
> org.apache.tools.ant.taskdefs.XSLTProcess.getLiaison(XSLTProcess.java:785)
>     [xslt]     at
> org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:300)
>     [xslt]     at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> Source)
>     [xslt]     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>     [xslt]     at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>     [xslt]     at org.apache.tools.ant.Target.performTasks(Target.java:385)
>     [xslt]     at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>     [xslt]     at
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
>     [xslt]     at
> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>     [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
>     [xslt]     at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> Source)
>     [xslt]     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>     [xslt]     at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>     [xslt]     at org.apache.tools.ant.Target.performTasks(Target.java:385)
>     [xslt]     at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>     [xslt]     at
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
>     [xslt]     at
> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>     [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
>     [xslt]     at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
> Source)
>     [xslt]     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
>     [xslt]     at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
>     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
>     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
>     [xslt]     at org.apache.tools.ant.Target.performTasks(Target.java:385)
>     [xslt]     at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
>     [xslt]     at
> org.apache.tools.ant.Project.executeTarget(Project.java:1306)
>     [xslt]     at
> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
>     [xslt]     at
> org.apache.tools.ant.Project.executeTargets(Project.java:1189)
>     [xslt]     at org.apache.tools.ant.Main.runBuild(Main.java:758)
>     [xslt]     at org.apache.tools.ant.Main.startAnt(Main.java:217)
>     [xslt]     at
> org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
>     [xslt]     at
> org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
> 
> BUILD FAILED
> /home/edward/branch-0.8-r2/build.xml:525: The following error occurred
> while executing this line:
> /home/edward/branch-0.8-r2/builtins/build.xml:37: The following error
> occurred while executing this line:
> /home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
> java.lang.ClassNotFoundException:
> org.apache.tools.ant.taskdefs.optional.TraXLiaison
> 
> Do I need a newer ant or more optional packages?
> 
> [edward@tablitha branch-0.8-r2]$ ant -version
> Apache Ant version 1.7.1 compiled on April 16 2010
> 
> 
> 
> On Sat, Dec 10, 2011 at 12:45 PM, Edward Capriolo <ed...@gmail.com>wrote:
> 
>> I have
>> hive-0.8.0-candidate-3with hadoop in local mode against hadoop 0.20.2.
>> Looks like hive server is not launching.
>> 
>> [edward@tablitha hive-0.8.0-bin]$ bin/hive --service hiveserver
>> Starting Hive Thrift Server
>> Exception in thread "main" java.lang.NoSuchMethodError:
>> org.apache.thrift.server.TThreadPoolServer.<init>(Lorg/apache/thrift/server/TThreadPoolServer$Args;)V
>>    at org.apache.hadoop.hive.service.HiveServer.main(HiveServer.java:676)
>>    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>    at java.lang.reflect.Method.invoke(Method.java:597)
>>    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>> 
>> 
>> 
>> On Sat, Dec 10, 2011 at 7:37 AM, Carl Steinbach <ca...@cloudera.com> wrote:
>> 
>>> Hi Jakob and Ashutosh,
>>> 
>>> I posted a patch for HIVE-2643. Please try it out and let me know if it
>>> doesn't fix the problem.
>>> 
>>> Thanks.
>>> 
>>> Carl
>>> 
>>> On Fri, Dec 9, 2011 at 9:40 PM, Ashutosh Chauhan <hashutosh@apache.org
>>>> wrote:
>>> 
>>>> I saw this issue on trunk too in today's checkout. Hive always thinks
>>> its
>>>> running in local mode because hadoop conf xmls are not getting loaded
>>> up.
>>>> 
>>>> Ashutosh
>>>> On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com> wrote:
>>>> 
>>>>> -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
>>>>> submission on a security-enabled 204 grid that I've traced back to
>>>>> HIVE-2362:
>>>>> The wrong staging directories are being specified:
>>>>> RC2: /user/jhoman-667872320/.staging
>>>>> 
>>>>> This is because the Hadoop confs aren't being loaded and the system
>>>>> thinks its running in local mode, so calls in the LocalJobRunner,
>>>>> which builds staging directories in this manner.  Running set shows
>>>>> that none of the usual hdfs/mapred settings have been defined, so it's
>>>>> also defaulting to the local filesystem.
>>>>> 
>>>>> Once I reverted 2362, everything worked again.
>>>>> 
>>>>> I've opened HIVE-2643.
>>>>> 
>>>>> On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com>
>>>> wrote:
>>>>>> +1
>>>>>> 
>>>>>> What I did:
>>>>>> * Built source tarball and imported into Eclipse. Verified that test
>>>>> cases
>>>>>> run.
>>>>>> * Ran tests from command line.
>>>>>> * Ran through tutorial exercises.
>>>>>> 
>>>>>> We need one more +1 vote in order to release. PMC members: Please
>>> Vote!
>>>>>> 
>>>>>> On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
>>>>>> 
>>>>>>> Tests passed, +1 from me!
>>>>>>> 
>>>>>>> JVS
>>>>>>> 
>>>>>>> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
>>>>>>> 
>>>>>>>> Apache Hive 0.8.0 Release Candidate 3 is available here:
>>>>>>>> 
>>>>>>>> http://people.apache.org/~cws/hive-0.8.0-candidate-3/
>>>>>>>> 
>>>>>>>> Changes since RC2:
>>>>>>>> * HIVE-2634 revert HIVE-2566
>>>>>>>> 
>>>>>>>> Please test and vote.
>>>>>>>> 
>>>>>>>> Thanks.
>>>>>>>> 
>>>>>>>> Carl
>>>>>>> 
>>>>>>> 
>>>>> 
>>>> 
>>> 
>> 
>> 


Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Edward Capriolo <ed...@gmail.com>.
Also I know I have been out of the game for a minute but..
extract-functions:
    [mkdir] Created dir: /home/edward/branch-0.8-r2/build/builtins/metadata
     [xslt] java.lang.ClassNotFoundException:
org.apache.tools.ant.taskdefs.optional.TraXLiaison
     [xslt]     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
     [xslt]     at java.security.AccessController.doPrivileged(Native
Method)
     [xslt]     at
java.net.URLClassLoader.findClass(URLClassLoader.java:190)
     [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
     [xslt]     at
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
     [xslt]     at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
     [xslt]     at java.lang.Class.forName0(Native Method)
     [xslt]     at java.lang.Class.forName(Class.java:169)
     [xslt]     at
org.apache.tools.ant.taskdefs.XSLTProcess.loadClass(XSLTProcess.java:548)
     [xslt]     at
org.apache.tools.ant.taskdefs.XSLTProcess.resolveProcessor(XSLTProcess.java:533)
     [xslt]     at
org.apache.tools.ant.taskdefs.XSLTProcess.getLiaison(XSLTProcess.java:785)
     [xslt]     at
org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:300)
     [xslt]     at
org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
Source)
     [xslt]     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
     [xslt]     at
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
     [xslt]     at org.apache.tools.ant.Target.performTasks(Target.java:385)
     [xslt]     at
org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
     [xslt]     at
org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
     [xslt]     at
org.apache.tools.ant.Project.executeTargets(Project.java:1189)
     [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
     [xslt]     at
org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
Source)
     [xslt]     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
     [xslt]     at
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
     [xslt]     at org.apache.tools.ant.Target.performTasks(Target.java:385)
     [xslt]     at
org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
     [xslt]     at
org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
     [xslt]     at
org.apache.tools.ant.Project.executeTargets(Project.java:1189)
     [xslt]     at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
     [xslt]     at
org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
     [xslt]     at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown
Source)
     [xslt]     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
     [xslt]     at java.lang.reflect.Method.invoke(Method.java:597)
     [xslt]     at
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
     [xslt]     at org.apache.tools.ant.Task.perform(Task.java:348)
     [xslt]     at org.apache.tools.ant.Target.execute(Target.java:357)
     [xslt]     at org.apache.tools.ant.Target.performTasks(Target.java:385)
     [xslt]     at
org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
     [xslt]     at
org.apache.tools.ant.Project.executeTarget(Project.java:1306)
     [xslt]     at
org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
     [xslt]     at
org.apache.tools.ant.Project.executeTargets(Project.java:1189)
     [xslt]     at org.apache.tools.ant.Main.runBuild(Main.java:758)
     [xslt]     at org.apache.tools.ant.Main.startAnt(Main.java:217)
     [xslt]     at
org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
     [xslt]     at
org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)

BUILD FAILED
/home/edward/branch-0.8-r2/build.xml:525: The following error occurred
while executing this line:
/home/edward/branch-0.8-r2/builtins/build.xml:37: The following error
occurred while executing this line:
/home/edward/branch-0.8-r2/pdk/scripts/build-plugin.xml:107:
java.lang.ClassNotFoundException:
org.apache.tools.ant.taskdefs.optional.TraXLiaison

Do I need a newer ant or more optional packages?

[edward@tablitha branch-0.8-r2]$ ant -version
Apache Ant version 1.7.1 compiled on April 16 2010



On Sat, Dec 10, 2011 at 12:45 PM, Edward Capriolo <ed...@gmail.com>wrote:

> I have
> hive-0.8.0-candidate-3with hadoop in local mode against hadoop 0.20.2.
> Looks like hive server is not launching.
>
> [edward@tablitha hive-0.8.0-bin]$ bin/hive --service hiveserver
> Starting Hive Thrift Server
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.thrift.server.TThreadPoolServer.<init>(Lorg/apache/thrift/server/TThreadPoolServer$Args;)V
>     at org.apache.hadoop.hive.service.HiveServer.main(HiveServer.java:676)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
>
>
> On Sat, Dec 10, 2011 at 7:37 AM, Carl Steinbach <ca...@cloudera.com> wrote:
>
>> Hi Jakob and Ashutosh,
>>
>> I posted a patch for HIVE-2643. Please try it out and let me know if it
>> doesn't fix the problem.
>>
>> Thanks.
>>
>> Carl
>>
>> On Fri, Dec 9, 2011 at 9:40 PM, Ashutosh Chauhan <hashutosh@apache.org
>> >wrote:
>>
>> > I saw this issue on trunk too in today's checkout. Hive always thinks
>> its
>> > running in local mode because hadoop conf xmls are not getting loaded
>> up.
>> >
>> > Ashutosh
>> > On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com> wrote:
>> >
>> > > -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
>> > > submission on a security-enabled 204 grid that I've traced back to
>> > > HIVE-2362:
>> > > The wrong staging directories are being specified:
>> > > RC2: /user/jhoman-667872320/.staging
>> > >
>> > > This is because the Hadoop confs aren't being loaded and the system
>> > > thinks its running in local mode, so calls in the LocalJobRunner,
>> > > which builds staging directories in this manner.  Running set shows
>> > > that none of the usual hdfs/mapred settings have been defined, so it's
>> > > also defaulting to the local filesystem.
>> > >
>> > > Once I reverted 2362, everything worked again.
>> > >
>> > > I've opened HIVE-2643.
>> > >
>> > > On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com>
>> > wrote:
>> > > > +1
>> > > >
>> > > > What I did:
>> > > > * Built source tarball and imported into Eclipse. Verified that test
>> > > cases
>> > > > run.
>> > > > * Ran tests from command line.
>> > > > * Ran through tutorial exercises.
>> > > >
>> > > > We need one more +1 vote in order to release. PMC members: Please
>> Vote!
>> > > >
>> > > > On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
>> > > >
>> > > >> Tests passed, +1 from me!
>> > > >>
>> > > >> JVS
>> > > >>
>> > > >> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
>> > > >>
>> > > >> > Apache Hive 0.8.0 Release Candidate 3 is available here:
>> > > >> >
>> > > >> > http://people.apache.org/~cws/hive-0.8.0-candidate-3/
>> > > >> >
>> > > >> > Changes since RC2:
>> > > >> > * HIVE-2634 revert HIVE-2566
>> > > >> >
>> > > >> > Please test and vote.
>> > > >> >
>> > > >> > Thanks.
>> > > >> >
>> > > >> > Carl
>> > > >>
>> > > >>
>> > >
>> >
>>
>
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Edward Capriolo <ed...@gmail.com>.
I have
hive-0.8.0-candidate-3with hadoop in local mode against hadoop 0.20.2.
Looks like hive server is not launching.

[edward@tablitha hive-0.8.0-bin]$ bin/hive --service hiveserver
Starting Hive Thrift Server
Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.thrift.server.TThreadPoolServer.<init>(Lorg/apache/thrift/server/TThreadPoolServer$Args;)V
    at org.apache.hadoop.hive.service.HiveServer.main(HiveServer.java:676)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)



On Sat, Dec 10, 2011 at 7:37 AM, Carl Steinbach <ca...@cloudera.com> wrote:

> Hi Jakob and Ashutosh,
>
> I posted a patch for HIVE-2643. Please try it out and let me know if it
> doesn't fix the problem.
>
> Thanks.
>
> Carl
>
> On Fri, Dec 9, 2011 at 9:40 PM, Ashutosh Chauhan <hashutosh@apache.org
> >wrote:
>
> > I saw this issue on trunk too in today's checkout. Hive always thinks its
> > running in local mode because hadoop conf xmls are not getting loaded up.
> >
> > Ashutosh
> > On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com> wrote:
> >
> > > -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
> > > submission on a security-enabled 204 grid that I've traced back to
> > > HIVE-2362:
> > > The wrong staging directories are being specified:
> > > RC2: /user/jhoman-667872320/.staging
> > >
> > > This is because the Hadoop confs aren't being loaded and the system
> > > thinks its running in local mode, so calls in the LocalJobRunner,
> > > which builds staging directories in this manner.  Running set shows
> > > that none of the usual hdfs/mapred settings have been defined, so it's
> > > also defaulting to the local filesystem.
> > >
> > > Once I reverted 2362, everything worked again.
> > >
> > > I've opened HIVE-2643.
> > >
> > > On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com>
> > wrote:
> > > > +1
> > > >
> > > > What I did:
> > > > * Built source tarball and imported into Eclipse. Verified that test
> > > cases
> > > > run.
> > > > * Ran tests from command line.
> > > > * Ran through tutorial exercises.
> > > >
> > > > We need one more +1 vote in order to release. PMC members: Please
> Vote!
> > > >
> > > > On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
> > > >
> > > >> Tests passed, +1 from me!
> > > >>
> > > >> JVS
> > > >>
> > > >> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
> > > >>
> > > >> > Apache Hive 0.8.0 Release Candidate 3 is available here:
> > > >> >
> > > >> > http://people.apache.org/~cws/hive-0.8.0-candidate-3/
> > > >> >
> > > >> > Changes since RC2:
> > > >> > * HIVE-2634 revert HIVE-2566
> > > >> >
> > > >> > Please test and vote.
> > > >> >
> > > >> > Thanks.
> > > >> >
> > > >> > Carl
> > > >>
> > > >>
> > >
> >
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Carl Steinbach <ca...@cloudera.com>.
Hi Jakob and Ashutosh,

I posted a patch for HIVE-2643. Please try it out and let me know if it
doesn't fix the problem.

Thanks.

Carl

On Fri, Dec 9, 2011 at 9:40 PM, Ashutosh Chauhan <ha...@apache.org>wrote:

> I saw this issue on trunk too in today's checkout. Hive always thinks its
> running in local mode because hadoop conf xmls are not getting loaded up.
>
> Ashutosh
> On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com> wrote:
>
> > -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
> > submission on a security-enabled 204 grid that I've traced back to
> > HIVE-2362:
> > The wrong staging directories are being specified:
> > RC2: /user/jhoman-667872320/.staging
> >
> > This is because the Hadoop confs aren't being loaded and the system
> > thinks its running in local mode, so calls in the LocalJobRunner,
> > which builds staging directories in this manner.  Running set shows
> > that none of the usual hdfs/mapred settings have been defined, so it's
> > also defaulting to the local filesystem.
> >
> > Once I reverted 2362, everything worked again.
> >
> > I've opened HIVE-2643.
> >
> > On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com>
> wrote:
> > > +1
> > >
> > > What I did:
> > > * Built source tarball and imported into Eclipse. Verified that test
> > cases
> > > run.
> > > * Ran tests from command line.
> > > * Ran through tutorial exercises.
> > >
> > > We need one more +1 vote in order to release. PMC members: Please Vote!
> > >
> > > On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
> > >
> > >> Tests passed, +1 from me!
> > >>
> > >> JVS
> > >>
> > >> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
> > >>
> > >> > Apache Hive 0.8.0 Release Candidate 3 is available here:
> > >> >
> > >> > http://people.apache.org/~cws/hive-0.8.0-candidate-3/
> > >> >
> > >> > Changes since RC2:
> > >> > * HIVE-2634 revert HIVE-2566
> > >> >
> > >> > Please test and vote.
> > >> >
> > >> > Thanks.
> > >> >
> > >> > Carl
> > >>
> > >>
> >
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Ashutosh Chauhan <ha...@apache.org>.
I saw this issue on trunk too in today's checkout. Hive always thinks its
running in local mode because hadoop conf xmls are not getting loaded up.

Ashutosh
On Fri, Dec 9, 2011 at 20:59, Jakob Homan <jg...@gmail.com> wrote:

> -1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
> submission on a security-enabled 204 grid that I've traced back to
> HIVE-2362:
> The wrong staging directories are being specified:
> RC2: /user/jhoman-667872320/.staging
>
> This is because the Hadoop confs aren't being loaded and the system
> thinks its running in local mode, so calls in the LocalJobRunner,
> which builds staging directories in this manner.  Running set shows
> that none of the usual hdfs/mapred settings have been defined, so it's
> also defaulting to the local filesystem.
>
> Once I reverted 2362, everything worked again.
>
> I've opened HIVE-2643.
>
> On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com> wrote:
> > +1
> >
> > What I did:
> > * Built source tarball and imported into Eclipse. Verified that test
> cases
> > run.
> > * Ran tests from command line.
> > * Ran through tutorial exercises.
> >
> > We need one more +1 vote in order to release. PMC members: Please Vote!
> >
> > On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
> >
> >> Tests passed, +1 from me!
> >>
> >> JVS
> >>
> >> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
> >>
> >> > Apache Hive 0.8.0 Release Candidate 3 is available here:
> >> >
> >> > http://people.apache.org/~cws/hive-0.8.0-candidate-3/
> >> >
> >> > Changes since RC2:
> >> > * HIVE-2634 revert HIVE-2566
> >> >
> >> > Please test and vote.
> >> >
> >> > Thanks.
> >> >
> >> > Carl
> >>
> >>
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Jakob Homan <jg...@gmail.com>.
-1.  We're seeing a problem with RC2 and RC3, but not RC1 in job
submission on a security-enabled 204 grid that I've traced back to
HIVE-2362:
The wrong staging directories are being specified:
RC2: /user/jhoman-667872320/.staging

This is because the Hadoop confs aren't being loaded and the system
thinks its running in local mode, so calls in the LocalJobRunner,
which builds staging directories in this manner.  Running set shows
that none of the usual hdfs/mapred settings have been defined, so it's
also defaulting to the local filesystem.

Once I reverted 2362, everything worked again.

I've opened HIVE-2643.

On Fri, Dec 9, 2011 at 11:16 AM, Carl Steinbach <ca...@cloudera.com> wrote:
> +1
>
> What I did:
> * Built source tarball and imported into Eclipse. Verified that test cases
> run.
> * Ran tests from command line.
> * Ran through tutorial exercises.
>
> We need one more +1 vote in order to release. PMC members: Please Vote!
>
> On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:
>
>> Tests passed, +1 from me!
>>
>> JVS
>>
>> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
>>
>> > Apache Hive 0.8.0 Release Candidate 3 is available here:
>> >
>> > http://people.apache.org/~cws/hive-0.8.0-candidate-3/
>> >
>> > Changes since RC2:
>> > * HIVE-2634 revert HIVE-2566
>> >
>> > Please test and vote.
>> >
>> > Thanks.
>> >
>> > Carl
>>
>>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by Carl Steinbach <ca...@cloudera.com>.
+1

What I did:
* Built source tarball and imported into Eclipse. Verified that test cases
run.
* Ran tests from command line.
* Ran through tutorial exercises.

We need one more +1 vote in order to release. PMC members: Please Vote!

On Thu, Dec 8, 2011 at 11:40 PM, John Sichi <js...@fb.com> wrote:

> Tests passed, +1 from me!
>
> JVS
>
> On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:
>
> > Apache Hive 0.8.0 Release Candidate 3 is available here:
> >
> > http://people.apache.org/~cws/hive-0.8.0-candidate-3/
> >
> > Changes since RC2:
> > * HIVE-2634 revert HIVE-2566
> >
> > Please test and vote.
> >
> > Thanks.
> >
> > Carl
>
>

Re: [VOTE] Apache Hive 0.8.0 Release Candidate 3

Posted by John Sichi <js...@fb.com>.
Tests passed, +1 from me!

JVS

On Dec 8, 2011, at 4:11 PM, Carl Steinbach wrote:

> Apache Hive 0.8.0 Release Candidate 3 is available here:
> 
> http://people.apache.org/~cws/hive-0.8.0-candidate-3/
> 
> Changes since RC2:
> * HIVE-2634 revert HIVE-2566
> 
> Please test and vote.
> 
> Thanks.
> 
> Carl