You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by pandees waran <pa...@gmail.com> on 2013/08/07 15:09:26 UTC
Join issue in 0.11
Hi,
I am facing the same issue as mentioned in the below JIRA:
https://issues.apache.org/jira/browse/HIVE-3872
I am using amazon EMR with hive 0.11.
Do i need to apply any patch on top of 0.11 to fix this NPE issue.?
--
Thanks,
Pandeeswaran
Re: Join issue in 0.11
Posted by pandees waran <pa...@gmail.com>.
Hi,
Can someone try to reproduce and confirm whether this is an issue in 0.11
a)Create a view with some UDAF in the definition(i tried with
https://github.com/scribd/hive-udaf-maxrow)
b)Join this view with some other table
I am getting the below exception:
Examining task ID: task_201308070831_0010_m_000052 (and more) from job
job_201308070831_0010
Exception in thread "Thread-98" java.lang.ClassFormatError: Absent
Code attribute in method that is not native or abstract in class file
javax/servlet/http/HttpServlet
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at
org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49)
at
org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190)
at
org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146)
at java.lang.Thread.run(Thread.java:662)
Counters:
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
MapReduce Jobs Launched:
Job 0: Map: 67 Reduce: 1 Cumulative CPU: 4172.93 sec HDFS Read:
43334 HDFS Write: 12982162918 SUCCESS
Job 1: Map: 51 HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 days 1 hours 9 minutes 32 seconds 930 msec
The same works fine in 0.8.1.6. After creating the view, i am able to query
the view successfully.
Only when i join with other table, it throws the above exceptions.
Thanks,
Pandeeswaran
On Fri, Aug 9, 2013 at 4:37 PM, pandees waran <pa...@gmail.com> wrote:
> Hi Nitin,
>
> I have executed few test cases and here are my observations.
>
> a) i am not using any utilities for upgrading to 0.11. Just executing the
> same hql which work in 0.8.1.6 in 0.11
>
> b)In my join i am having a view which has an UDAF. (
> https://github.com/scribd/hive-udaf-maxrow)
> When i try to join this view(with UDAF) it another table, i am
> getting the below errors:
>
>
> java.lang.InstantiationException:
> org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
> Continuing ...
> java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new();
> Continuing ...
> java.lang.InstantiationException:
> org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
> Continuing ...
> java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new();
> Continuing ...
> java.lang.InstantiationException:
> org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
> Continuing ...
> java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new();
> Continuing ...
> java.lang.InstantiationException:
> org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
> Continuing ...
> java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new();
>
> ----------------------------------------------------------------------------------------
>
> My query looks like:
>
> select v.* from view1 v join table1 t on t.col1=v.col1
>
> The same query works in in 0.8.1.6 without any issues.
> This query works in 0.11 , if i remove UDAF from the view.
>
> Do i need to rebuild the UDAF separately for 0.11?
> In general, i expect the hql which works in 0.8.1.6 should work in 0.11
> without having any code changes. please correct me , if my assumption is
> incorrect.
>
> Thanks,
> Pandeeswaran
>
>
>
> On Wed, Aug 7, 2013 at 9:00 PM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> Will it be possible for you to share your query ? and if you are using
>> any custom udf then the java code for the same ?
>>
>> how are you upgrading from hive-0.8 to hive-0.11?
>>
>> aws announced that EMR supports hive 0.11 and that was 4 days ago. Can
>> you check if you need to see if you need to change something on EMR side ?
>>
>>
>> On Wed, Aug 7, 2013 at 8:28 PM, pandees waran <pa...@gmail.com> wrote:
>>
>>> Hi Nitin,
>>>
>>> Nope! it ended up with below error messages:
>>>
>>> Examining task ID: task_201308070831_0010_m_000052 (and more) from job
>>> job_201308070831_0010
>>> Exception in thread "Thread-98" java.lang.ClassFormatError: Absent
>>> Code attribute in method that is not native or abstract in class file
>>> javax/servlet/http/HttpServlet
>>> at java.lang.ClassLoader.defineClass1(Native Method)
>>> at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
>>> at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
>>> at
>>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
>>> at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>> at java.lang.ClassLoader.defineClass1(Native Method)
>>> at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
>>> at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
>>> at
>>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
>>> at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>> at
>>> org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49)
>>> at
>>> org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190)
>>> at
>>> org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146)
>>> at java.lang.Thread.run(Thread.java:662)
>>> Counters:
>>> FAILED: Execution Error, return code 2 from
>>> org.apache.hadoop.hive.ql.exec.MapRedTask
>>> MapReduce Jobs Launched:
>>> Job 0: Map: 67 Reduce: 1 Cumulative CPU: 4172.93 sec HDFS Read:
>>> 43334 HDFS Write: 12982162918 SUCCESS
>>> Job 1: Map: 51 HDFS Read: 0 HDFS Write: 0 FAIL
>>> Total MapReduce CPU Time Spent: 0 days 1 hours 9 minutes 32 seconds 930
>>> msec
>>>
>>>
>>> But, the same query works fine in hive 0.8.1.6 without any issues.
>>> i am working on the 0.11 upgrade and facing this issue.
>>>
>>> Thanks,
>>> Pandeeswaran
>>>
>>> On 8/7/13, Nitin Pawar <ni...@gmail.com> wrote:
>>> > before applying patch,
>>> >
>>> > can you confirm that map join query worked fine and gave the results
>>> you
>>> > wanted?
>>> >
>>> >
>>> > On Wed, Aug 7, 2013 at 6:46 PM, Sathya Narayanan K <ks...@live.com>
>>> > wrote:
>>> >
>>> >> Hi,****
>>> >>
>>> >> ** **
>>> >>
>>> >> I am also facing the same issue. Could anyone please suggest whether
>>> we
>>> >> can apply any patch?****
>>> >>
>>> >> ** **
>>> >>
>>> >> Thanks,****
>>> >>
>>> >> Sathya Narayanan ****
>>> >>
>>> >> ** **
>>> >>
>>> >> *From:* pandees waran [mailto:pandeesh@gmail.com]
>>> >> *Sent:* Wednesday, August 07, 2013 6:39 PM
>>> >> *To:* user@hive.apache.org
>>> >> *Subject:* Join issue in 0.11****
>>> >>
>>> >> ** **
>>> >>
>>> >> Hi,
>>> >>
>>> >> I am facing the same issue as mentioned in the below JIRA:
>>> >>
>>> >> https://issues.apache.org/jira/browse/HIVE-3872****
>>> >>
>>> >> I am using amazon EMR with hive 0.11. ****
>>> >>
>>> >> Do i need to apply any patch on top of 0.11 to fix this NPE issue.?
>>> >> ****
>>> >>
>>> >>
>>> >> -- ****
>>> >>
>>> >> Thanks,****
>>> >>
>>> >> Pandeeswaran****
>>> >>
>>> >
>>> >
>>> >
>>> > --
>>> > Nitin Pawar
>>> >
>>>
>>>
>>> --
>>> Thanks,
>>> Pandeeswaran
>>>
>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
>
> --
> Thanks,
> Pandeeswaran
>
--
Thanks,
Pandeeswaran
Re: Join issue in 0.11
Posted by pandees waran <pa...@gmail.com>.
Hi Nitin,
I have executed few test cases and here are my observations.
a) i am not using any utilities for upgrading to 0.11. Just executing the
same hql which work in 0.8.1.6 in 0.11
b)In my join i am having a view which has an UDAF. (
https://github.com/scribd/hive-udaf-maxrow)
When i try to join this view(with UDAF) it another table, i am getting
the below errors:
java.lang.InstantiationException:
org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
Continuing ...
java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new();
Continuing ...
java.lang.InstantiationException:
org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
Continuing ...
java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new();
Continuing ...
java.lang.InstantiationException:
org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
Continuing ...
java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new();
Continuing ...
java.lang.InstantiationException:
org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
Continuing ...
java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new();
----------------------------------------------------------------------------------------
My query looks like:
select v.* from view1 v join table1 t on t.col1=v.col1
The same query works in in 0.8.1.6 without any issues.
This query works in 0.11 , if i remove UDAF from the view.
Do i need to rebuild the UDAF separately for 0.11?
In general, i expect the hql which works in 0.8.1.6 should work in 0.11
without having any code changes. please correct me , if my assumption is
incorrect.
Thanks,
Pandeeswaran
On Wed, Aug 7, 2013 at 9:00 PM, Nitin Pawar <ni...@gmail.com> wrote:
> Will it be possible for you to share your query ? and if you are using any
> custom udf then the java code for the same ?
>
> how are you upgrading from hive-0.8 to hive-0.11?
>
> aws announced that EMR supports hive 0.11 and that was 4 days ago. Can
> you check if you need to see if you need to change something on EMR side ?
>
>
> On Wed, Aug 7, 2013 at 8:28 PM, pandees waran <pa...@gmail.com> wrote:
>
>> Hi Nitin,
>>
>> Nope! it ended up with below error messages:
>>
>> Examining task ID: task_201308070831_0010_m_000052 (and more) from job
>> job_201308070831_0010
>> Exception in thread "Thread-98" java.lang.ClassFormatError: Absent
>> Code attribute in method that is not native or abstract in class file
>> javax/servlet/http/HttpServlet
>> at java.lang.ClassLoader.defineClass1(Native Method)
>> at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
>> at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
>> at
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
>> at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> at java.lang.ClassLoader.defineClass1(Native Method)
>> at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
>> at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
>> at
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
>> at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> at
>> org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49)
>> at
>> org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190)
>> at
>> org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146)
>> at java.lang.Thread.run(Thread.java:662)
>> Counters:
>> FAILED: Execution Error, return code 2 from
>> org.apache.hadoop.hive.ql.exec.MapRedTask
>> MapReduce Jobs Launched:
>> Job 0: Map: 67 Reduce: 1 Cumulative CPU: 4172.93 sec HDFS Read:
>> 43334 HDFS Write: 12982162918 SUCCESS
>> Job 1: Map: 51 HDFS Read: 0 HDFS Write: 0 FAIL
>> Total MapReduce CPU Time Spent: 0 days 1 hours 9 minutes 32 seconds 930
>> msec
>>
>>
>> But, the same query works fine in hive 0.8.1.6 without any issues.
>> i am working on the 0.11 upgrade and facing this issue.
>>
>> Thanks,
>> Pandeeswaran
>>
>> On 8/7/13, Nitin Pawar <ni...@gmail.com> wrote:
>> > before applying patch,
>> >
>> > can you confirm that map join query worked fine and gave the results you
>> > wanted?
>> >
>> >
>> > On Wed, Aug 7, 2013 at 6:46 PM, Sathya Narayanan K <ks...@live.com>
>> > wrote:
>> >
>> >> Hi,****
>> >>
>> >> ** **
>> >>
>> >> I am also facing the same issue. Could anyone please suggest whether we
>> >> can apply any patch?****
>> >>
>> >> ** **
>> >>
>> >> Thanks,****
>> >>
>> >> Sathya Narayanan ****
>> >>
>> >> ** **
>> >>
>> >> *From:* pandees waran [mailto:pandeesh@gmail.com]
>> >> *Sent:* Wednesday, August 07, 2013 6:39 PM
>> >> *To:* user@hive.apache.org
>> >> *Subject:* Join issue in 0.11****
>> >>
>> >> ** **
>> >>
>> >> Hi,
>> >>
>> >> I am facing the same issue as mentioned in the below JIRA:
>> >>
>> >> https://issues.apache.org/jira/browse/HIVE-3872****
>> >>
>> >> I am using amazon EMR with hive 0.11. ****
>> >>
>> >> Do i need to apply any patch on top of 0.11 to fix this NPE issue.?
>> >> ****
>> >>
>> >>
>> >> -- ****
>> >>
>> >> Thanks,****
>> >>
>> >> Pandeeswaran****
>> >>
>> >
>> >
>> >
>> > --
>> > Nitin Pawar
>> >
>>
>>
>> --
>> Thanks,
>> Pandeeswaran
>>
>
>
>
> --
> Nitin Pawar
>
--
Thanks,
Pandeeswaran
Re: Join issue in 0.11
Posted by Nitin Pawar <ni...@gmail.com>.
Will it be possible for you to share your query ? and if you are using any
custom udf then the java code for the same ?
how are you upgrading from hive-0.8 to hive-0.11?
aws announced that EMR supports hive 0.11 and that was 4 days ago. Can you
check if you need to see if you need to change something on EMR side ?
On Wed, Aug 7, 2013 at 8:28 PM, pandees waran <pa...@gmail.com> wrote:
> Hi Nitin,
>
> Nope! it ended up with below error messages:
>
> Examining task ID: task_201308070831_0010_m_000052 (and more) from job
> job_201308070831_0010
> Exception in thread "Thread-98" java.lang.ClassFormatError: Absent
> Code attribute in method that is not native or abstract in class file
> javax/servlet/http/HttpServlet
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
> at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
> at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> at
> org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49)
> at
> org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190)
> at
> org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146)
> at java.lang.Thread.run(Thread.java:662)
> Counters:
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.MapRedTask
> MapReduce Jobs Launched:
> Job 0: Map: 67 Reduce: 1 Cumulative CPU: 4172.93 sec HDFS Read:
> 43334 HDFS Write: 12982162918 SUCCESS
> Job 1: Map: 51 HDFS Read: 0 HDFS Write: 0 FAIL
> Total MapReduce CPU Time Spent: 0 days 1 hours 9 minutes 32 seconds 930
> msec
>
>
> But, the same query works fine in hive 0.8.1.6 without any issues.
> i am working on the 0.11 upgrade and facing this issue.
>
> Thanks,
> Pandeeswaran
>
> On 8/7/13, Nitin Pawar <ni...@gmail.com> wrote:
> > before applying patch,
> >
> > can you confirm that map join query worked fine and gave the results you
> > wanted?
> >
> >
> > On Wed, Aug 7, 2013 at 6:46 PM, Sathya Narayanan K <ks...@live.com>
> > wrote:
> >
> >> Hi,****
> >>
> >> ** **
> >>
> >> I am also facing the same issue. Could anyone please suggest whether we
> >> can apply any patch?****
> >>
> >> ** **
> >>
> >> Thanks,****
> >>
> >> Sathya Narayanan ****
> >>
> >> ** **
> >>
> >> *From:* pandees waran [mailto:pandeesh@gmail.com]
> >> *Sent:* Wednesday, August 07, 2013 6:39 PM
> >> *To:* user@hive.apache.org
> >> *Subject:* Join issue in 0.11****
> >>
> >> ** **
> >>
> >> Hi,
> >>
> >> I am facing the same issue as mentioned in the below JIRA:
> >>
> >> https://issues.apache.org/jira/browse/HIVE-3872****
> >>
> >> I am using amazon EMR with hive 0.11. ****
> >>
> >> Do i need to apply any patch on top of 0.11 to fix this NPE issue.?
> >> ****
> >>
> >>
> >> -- ****
> >>
> >> Thanks,****
> >>
> >> Pandeeswaran****
> >>
> >
> >
> >
> > --
> > Nitin Pawar
> >
>
>
> --
> Thanks,
> Pandeeswaran
>
--
Nitin Pawar
Re: Join issue in 0.11
Posted by pandees waran <pa...@gmail.com>.
Hi Nitin,
Nope! it ended up with below error messages:
Examining task ID: task_201308070831_0010_m_000052 (and more) from job
job_201308070831_0010
Exception in thread "Thread-98" java.lang.ClassFormatError: Absent
Code attribute in method that is not native or abstract in class file
javax/servlet/http/HttpServlet
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49)
at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190)
at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146)
at java.lang.Thread.run(Thread.java:662)
Counters:
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
MapReduce Jobs Launched:
Job 0: Map: 67 Reduce: 1 Cumulative CPU: 4172.93 sec HDFS Read:
43334 HDFS Write: 12982162918 SUCCESS
Job 1: Map: 51 HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 days 1 hours 9 minutes 32 seconds 930 msec
But, the same query works fine in hive 0.8.1.6 without any issues.
i am working on the 0.11 upgrade and facing this issue.
Thanks,
Pandeeswaran
On 8/7/13, Nitin Pawar <ni...@gmail.com> wrote:
> before applying patch,
>
> can you confirm that map join query worked fine and gave the results you
> wanted?
>
>
> On Wed, Aug 7, 2013 at 6:46 PM, Sathya Narayanan K <ks...@live.com>
> wrote:
>
>> Hi,****
>>
>> ** **
>>
>> I am also facing the same issue. Could anyone please suggest whether we
>> can apply any patch?****
>>
>> ** **
>>
>> Thanks,****
>>
>> Sathya Narayanan ****
>>
>> ** **
>>
>> *From:* pandees waran [mailto:pandeesh@gmail.com]
>> *Sent:* Wednesday, August 07, 2013 6:39 PM
>> *To:* user@hive.apache.org
>> *Subject:* Join issue in 0.11****
>>
>> ** **
>>
>> Hi,
>>
>> I am facing the same issue as mentioned in the below JIRA:
>>
>> https://issues.apache.org/jira/browse/HIVE-3872****
>>
>> I am using amazon EMR with hive 0.11. ****
>>
>> Do i need to apply any patch on top of 0.11 to fix this NPE issue.?
>> ****
>>
>>
>> -- ****
>>
>> Thanks,****
>>
>> Pandeeswaran****
>>
>
>
>
> --
> Nitin Pawar
>
--
Thanks,
Pandeeswaran
Re: Join issue in 0.11
Posted by Nitin Pawar <ni...@gmail.com>.
before applying patch,
can you confirm that map join query worked fine and gave the results you
wanted?
On Wed, Aug 7, 2013 at 6:46 PM, Sathya Narayanan K <ks...@live.com> wrote:
> Hi,****
>
> ** **
>
> I am also facing the same issue. Could anyone please suggest whether we
> can apply any patch?****
>
> ** **
>
> Thanks,****
>
> Sathya Narayanan ****
>
> ** **
>
> *From:* pandees waran [mailto:pandeesh@gmail.com]
> *Sent:* Wednesday, August 07, 2013 6:39 PM
> *To:* user@hive.apache.org
> *Subject:* Join issue in 0.11****
>
> ** **
>
> Hi,
>
> I am facing the same issue as mentioned in the below JIRA:
>
> https://issues.apache.org/jira/browse/HIVE-3872****
>
> I am using amazon EMR with hive 0.11. ****
>
> Do i need to apply any patch on top of 0.11 to fix this NPE issue.?
> ****
>
>
> -- ****
>
> Thanks,****
>
> Pandeeswaran****
>
--
Nitin Pawar
RE: Join issue in 0.11
Posted by Sathya Narayanan K <ks...@live.com>.
Hi,
I am also facing the same issue. Could anyone please suggest whether we can apply any patch?
Thanks,
Sathya Narayanan
From: pandees waran [mailto:pandeesh@gmail.com]
Sent: Wednesday, August 07, 2013 6:39 PM
To: user@hive.apache.org
Subject: Join issue in 0.11
Hi,
I am facing the same issue as mentioned in the below JIRA:
https://issues.apache.org/jira/browse/HIVE-3872
I am using amazon EMR with hive 0.11.
Do i need to apply any patch on top of 0.11 to fix this NPE issue.?
--
Thanks,
Pandeeswaran