You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Kristen Hardwick <kh...@spryinc.com> on 2014/12/15 19:13:23 UTC
issue with Tez execution engine in HDP 2.2
Hi all,
We recently created a new Amazon cluster with an installation of GA HDP 2.2
from the Hortonworks website. One of the main reasons we wanted to try this
version was to use Hive with Tez with the new cost based optimizer.
However, running simple queries with Tez as the execution engine does not
work.
I created a single line file, created the Hive table for it, and ran this
query to confirm proper data load:
select * from test;
No issues, so I ran this query with the "mr" execution engine, and had
success:
select count(*) from test; -- 1
Then I ran the same query with the "tez" execution engine, and had no
success. I got the following error:
Status: Running (Executing on YARN cluster with App id
application_1418140477139_0067)
--------------------------------------------------------------------------------
VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
--------------------------------------------------------------------------------
Map 1 FAILED 1 0 0 1 4 0
Reducer 2 KILLED 1 0 0 1 0 1
--------------------------------------------------------------------------------
VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 9.61 s
--------------------------------------------------------------------------------
Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1418140477139_0067_1_00,
diagnostics=[Task failed, taskId=task_1418140477139_0067_1_00_000000,
diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running
task:java.lang.IllegalArgumentException
at
com.google.common.base.Preconditions.checkArgument(Preconditions.java:72)
at
org.apache.tez.runtime.common.resources.MemoryDistributor.registerRequest(MemoryDistributor.java:158)
at
org.apache.tez.runtime.common.resources.MemoryDistributor.requestMemory(MemoryDistributor.java:97)
at
org.apache.tez.runtime.api.impl.TezTaskContextImpl.requestInitialMemory(TezTaskContextImpl.java:192)
at
org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput.initialize(OrderedPartitionedKVOutput.java:95)
Have any of you seen this issue before? That "requestInitialMemory"
function failure combined with the "IllegalArgumentException" message made
me think that maybe Tez was asking for a container that was too big...but I
didn't see anything odd in the properties. Then again, I don't have a lot
of insight into what this new version of Tez requires.
Any help is appreciated! Please let me know if you need additional
information.
Kristen Hardwick
Re: issue with Tez execution engine in HDP 2.2
Posted by Vikram Dixit <vi...@hortonworks.com>.
Hi Kristen,
I discussed this with tez folks and they tell me the version of tez
you have should work with that version of hive. It seems like the
request for container could have been very large (or -1 perhaps). Can
you share the hive logs as well as the application logs for this
issue. Probably worth a jira ticket for tracking purposes.
Thanks
Vikram.
On Mon, Dec 15, 2014 at 11:01 AM, Kristen Hardwick
<kh...@spryinc.com> wrote:
> Vikram,
>
> Thanks for the quick response. I am using the following versions:
>
> Hive 0.14.0.2.2.0.0
> Tez 0.5.2.2.2.0.0
>
> Do you know where I can find a Hortonworks RPM for Tez 0.5.3 so that I can
> upgrade manually? I used the Ambari installation from the Hortonworks site,
> so I think the version conflict is built into what is available for
> download.
>
> Thanks!
> Kristen
>
> On Mon, Dec 15, 2014 at 1:29 PM, Vikram Dixit <vi...@hortonworks.com>
> wrote:
>>
>> Hi Kristen,
>>
>> Can you share the version of tez you are using? Hive 0.14 (in HDP 2.2)
>> needs tez 0.5.3 or beyond. Not sure if there was an earlier
>> installation of tez that is being used here.
>>
>> Thanks
>> Vikram.
>>
>> On Mon, Dec 15, 2014 at 10:13 AM, Kristen Hardwick
>> <kh...@spryinc.com> wrote:
>> > Hi all,
>> >
>> > We recently created a new Amazon cluster with an installation of GA HDP
>> > 2.2
>> > from the Hortonworks website. One of the main reasons we wanted to try
>> > this
>> > version was to use Hive with Tez with the new cost based optimizer.
>> > However,
>> > running simple queries with Tez as the execution engine does not work.
>> >
>> > I created a single line file, created the Hive table for it, and ran
>> > this
>> > query to confirm proper data load:
>> >
>> > select * from test;
>> >
>> > No issues, so I ran this query with the "mr" execution engine, and had
>> > success:
>> >
>> > select count(*) from test; -- 1
>> >
>> > Then I ran the same query with the "tez" execution engine, and had no
>> > success. I got the following error:
>> >
>> > Status: Running (Executing on YARN cluster with App id
>> > application_1418140477139_0067)
>> >
>> >
>> > --------------------------------------------------------------------------------
>> > VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
>> >
>> > --------------------------------------------------------------------------------
>> > Map 1 FAILED 1 0 0 1 4 0
>> > Reducer 2 KILLED 1 0 0 1 0 1
>> >
>> > --------------------------------------------------------------------------------
>> > VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 9.61 s
>> >
>> > --------------------------------------------------------------------------------
>> > Status: Failed
>> > Vertex failed, vertexName=Map 1,
>> > vertexId=vertex_1418140477139_0067_1_00,
>> > diagnostics=[Task failed, taskId=task_1418140477139_0067_1_00_000000,
>> > diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running
>> > task:java.lang.IllegalArgumentException
>> > at
>> > com.google.common.base.Preconditions.checkArgument(Preconditions.java:72)
>> > at
>> >
>> > org.apache.tez.runtime.common.resources.MemoryDistributor.registerRequest(MemoryDistributor.java:158)
>> > at
>> >
>> > org.apache.tez.runtime.common.resources.MemoryDistributor.requestMemory(MemoryDistributor.java:97)
>> > at
>> >
>> > org.apache.tez.runtime.api.impl.TezTaskContextImpl.requestInitialMemory(TezTaskContextImpl.java:192)
>> > at
>> >
>> > org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput.initialize(OrderedPartitionedKVOutput.java:95)
>> >
>> > Have any of you seen this issue before? That "requestInitialMemory"
>> > function
>> > failure combined with the "IllegalArgumentException" message made me
>> > think
>> > that maybe Tez was asking for a container that was too big...but I
>> > didn't
>> > see anything odd in the properties. Then again, I don't have a lot of
>> > insight into what this new version of Tez requires.
>> >
>> > Any help is appreciated! Please let me know if you need additional
>> > information.
>> > Kristen Hardwick
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified
>> that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender
>> immediately
>> and delete it from your system. Thank You.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: issue with Tez execution engine in HDP 2.2
Posted by Kristen Hardwick <kh...@spryinc.com>.
Vikram,
Thanks for taking a look at this. We saw that you even had a chance to meet
with the person handling the support ticket I logged, so I appreciate that.
The issue stemmed from the "tez.runtime.io.sort.mb" having an invalid
default value. There is a hardcoded maximum of 2GB on this property, but
for our installation, the default value was set to 3481. To resolve the
issue, we just needed to change the value to 2040.
- Kristen
On Mon, Dec 15, 2014 at 7:37 PM, Vikram Dixit <vi...@hortonworks.com>
wrote:
>
> Hi Kristen,
>
> I discussed this with tez folks and they tell me the version of tez
> you have should work with that version of hive. It seems like the
> request for container could have been very large (or -1 perhaps). Can
> you share the hive logs as well as the application logs for this
> issue. Probably worth a jira ticket for tracking purposes.
>
> Thanks
> Vikram.
>
> On Mon, Dec 15, 2014 at 11:01 AM, Kristen Hardwick
> <kh...@spryinc.com> wrote:
> > Vikram,
> >
> > Thanks for the quick response. I am using the following versions:
> >
> > Hive 0.14.0.2.2.0.0
> > Tez 0.5.2.2.2.0.0
> >
> > Do you know where I can find a Hortonworks RPM for Tez 0.5.3 so that I
> can
> > upgrade manually? I used the Ambari installation from the Hortonworks
> site,
> > so I think the version conflict is built into what is available for
> > download.
> >
> > Thanks!
> > Kristen
> >
> > On Mon, Dec 15, 2014 at 1:29 PM, Vikram Dixit <vi...@hortonworks.com>
> > wrote:
> >>
> >> Hi Kristen,
> >>
> >> Can you share the version of tez you are using? Hive 0.14 (in HDP 2.2)
> >> needs tez 0.5.3 or beyond. Not sure if there was an earlier
> >> installation of tez that is being used here.
> >>
> >> Thanks
> >> Vikram.
> >>
> >> On Mon, Dec 15, 2014 at 10:13 AM, Kristen Hardwick
> >> <kh...@spryinc.com> wrote:
> >> > Hi all,
> >> >
> >> > We recently created a new Amazon cluster with an installation of GA
> HDP
> >> > 2.2
> >> > from the Hortonworks website. One of the main reasons we wanted to try
> >> > this
> >> > version was to use Hive with Tez with the new cost based optimizer.
> >> > However,
> >> > running simple queries with Tez as the execution engine does not work.
> >> >
> >> > I created a single line file, created the Hive table for it, and ran
> >> > this
> >> > query to confirm proper data load:
> >> >
> >> > select * from test;
> >> >
> >> > No issues, so I ran this query with the "mr" execution engine, and had
> >> > success:
> >> >
> >> > select count(*) from test; -- 1
> >> >
> >> > Then I ran the same query with the "tez" execution engine, and had no
> >> > success. I got the following error:
> >> >
> >> > Status: Running (Executing on YARN cluster with App id
> >> > application_1418140477139_0067)
> >> >
> >> >
> >> >
> --------------------------------------------------------------------------------
> >> > VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> >> >
> >> >
> --------------------------------------------------------------------------------
> >> > Map 1 FAILED 1 0 0 1 4 0
> >> > Reducer 2 KILLED 1 0 0 1 0 1
> >> >
> >> >
> --------------------------------------------------------------------------------
> >> > VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 9.61 s
> >> >
> >> >
> --------------------------------------------------------------------------------
> >> > Status: Failed
> >> > Vertex failed, vertexName=Map 1,
> >> > vertexId=vertex_1418140477139_0067_1_00,
> >> > diagnostics=[Task failed, taskId=task_1418140477139_0067_1_00_000000,
> >> > diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running
> >> > task:java.lang.IllegalArgumentException
> >> > at
> >> >
> com.google.common.base.Preconditions.checkArgument(Preconditions.java:72)
> >> > at
> >> >
> >> >
> org.apache.tez.runtime.common.resources.MemoryDistributor.registerRequest(MemoryDistributor.java:158)
> >> > at
> >> >
> >> >
> org.apache.tez.runtime.common.resources.MemoryDistributor.requestMemory(MemoryDistributor.java:97)
> >> > at
> >> >
> >> >
> org.apache.tez.runtime.api.impl.TezTaskContextImpl.requestInitialMemory(TezTaskContextImpl.java:192)
> >> > at
> >> >
> >> >
> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput.initialize(OrderedPartitionedKVOutput.java:95)
> >> >
> >> > Have any of you seen this issue before? That "requestInitialMemory"
> >> > function
> >> > failure combined with the "IllegalArgumentException" message made me
> >> > think
> >> > that maybe Tez was asking for a container that was too big...but I
> >> > didn't
> >> > see anything odd in the properties. Then again, I don't have a lot of
> >> > insight into what this new version of Tez requires.
> >> >
> >> > Any help is appreciated! Please let me know if you need additional
> >> > information.
> >> > Kristen Hardwick
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or entity
> >> to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> >> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> >> immediately
> >> and delete it from your system. Thank You.
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: issue with Tez execution engine in HDP 2.2
Posted by Vikram Dixit <vi...@hortonworks.com>.
Hi Kristen,
I discussed this with tez folks and they tell me the version of tez
you have should work with that version of hive. It seems like the
request for container could have been very large (or -1 perhaps). Can
you share the hive logs as well as the application logs for this
issue. Probably worth a jira ticket for tracking purposes.
Thanks
Vikram.
On Mon, Dec 15, 2014 at 11:01 AM, Kristen Hardwick
<kh...@spryinc.com> wrote:
> Vikram,
>
> Thanks for the quick response. I am using the following versions:
>
> Hive 0.14.0.2.2.0.0
> Tez 0.5.2.2.2.0.0
>
> Do you know where I can find a Hortonworks RPM for Tez 0.5.3 so that I can
> upgrade manually? I used the Ambari installation from the Hortonworks site,
> so I think the version conflict is built into what is available for
> download.
>
> Thanks!
> Kristen
>
> On Mon, Dec 15, 2014 at 1:29 PM, Vikram Dixit <vi...@hortonworks.com>
> wrote:
>>
>> Hi Kristen,
>>
>> Can you share the version of tez you are using? Hive 0.14 (in HDP 2.2)
>> needs tez 0.5.3 or beyond. Not sure if there was an earlier
>> installation of tez that is being used here.
>>
>> Thanks
>> Vikram.
>>
>> On Mon, Dec 15, 2014 at 10:13 AM, Kristen Hardwick
>> <kh...@spryinc.com> wrote:
>> > Hi all,
>> >
>> > We recently created a new Amazon cluster with an installation of GA HDP
>> > 2.2
>> > from the Hortonworks website. One of the main reasons we wanted to try
>> > this
>> > version was to use Hive with Tez with the new cost based optimizer.
>> > However,
>> > running simple queries with Tez as the execution engine does not work.
>> >
>> > I created a single line file, created the Hive table for it, and ran
>> > this
>> > query to confirm proper data load:
>> >
>> > select * from test;
>> >
>> > No issues, so I ran this query with the "mr" execution engine, and had
>> > success:
>> >
>> > select count(*) from test; -- 1
>> >
>> > Then I ran the same query with the "tez" execution engine, and had no
>> > success. I got the following error:
>> >
>> > Status: Running (Executing on YARN cluster with App id
>> > application_1418140477139_0067)
>> >
>> >
>> > --------------------------------------------------------------------------------
>> > VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
>> >
>> > --------------------------------------------------------------------------------
>> > Map 1 FAILED 1 0 0 1 4 0
>> > Reducer 2 KILLED 1 0 0 1 0 1
>> >
>> > --------------------------------------------------------------------------------
>> > VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 9.61 s
>> >
>> > --------------------------------------------------------------------------------
>> > Status: Failed
>> > Vertex failed, vertexName=Map 1,
>> > vertexId=vertex_1418140477139_0067_1_00,
>> > diagnostics=[Task failed, taskId=task_1418140477139_0067_1_00_000000,
>> > diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running
>> > task:java.lang.IllegalArgumentException
>> > at
>> > com.google.common.base.Preconditions.checkArgument(Preconditions.java:72)
>> > at
>> >
>> > org.apache.tez.runtime.common.resources.MemoryDistributor.registerRequest(MemoryDistributor.java:158)
>> > at
>> >
>> > org.apache.tez.runtime.common.resources.MemoryDistributor.requestMemory(MemoryDistributor.java:97)
>> > at
>> >
>> > org.apache.tez.runtime.api.impl.TezTaskContextImpl.requestInitialMemory(TezTaskContextImpl.java:192)
>> > at
>> >
>> > org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput.initialize(OrderedPartitionedKVOutput.java:95)
>> >
>> > Have any of you seen this issue before? That "requestInitialMemory"
>> > function
>> > failure combined with the "IllegalArgumentException" message made me
>> > think
>> > that maybe Tez was asking for a container that was too big...but I
>> > didn't
>> > see anything odd in the properties. Then again, I don't have a lot of
>> > insight into what this new version of Tez requires.
>> >
>> > Any help is appreciated! Please let me know if you need additional
>> > information.
>> > Kristen Hardwick
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified
>> that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender
>> immediately
>> and delete it from your system. Thank You.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: issue with Tez execution engine in HDP 2.2
Posted by Kristen Hardwick <kh...@spryinc.com>.
Vikram,
Thanks for the quick response. I am using the following versions:
Hive 0.14.0.2.2.0.0
Tez 0.5.2.2.2.0.0
Do you know where I can find a Hortonworks RPM for Tez 0.5.3 so that I can
upgrade manually? I used the Ambari installation from the Hortonworks site,
so I think the version conflict is built into what is available for
download.
Thanks!
Kristen
On Mon, Dec 15, 2014 at 1:29 PM, Vikram Dixit <vi...@hortonworks.com>
wrote:
>
> Hi Kristen,
>
> Can you share the version of tez you are using? Hive 0.14 (in HDP 2.2)
> needs tez 0.5.3 or beyond. Not sure if there was an earlier
> installation of tez that is being used here.
>
> Thanks
> Vikram.
>
> On Mon, Dec 15, 2014 at 10:13 AM, Kristen Hardwick
> <kh...@spryinc.com> wrote:
> > Hi all,
> >
> > We recently created a new Amazon cluster with an installation of GA HDP
> 2.2
> > from the Hortonworks website. One of the main reasons we wanted to try
> this
> > version was to use Hive with Tez with the new cost based optimizer.
> However,
> > running simple queries with Tez as the execution engine does not work.
> >
> > I created a single line file, created the Hive table for it, and ran this
> > query to confirm proper data load:
> >
> > select * from test;
> >
> > No issues, so I ran this query with the "mr" execution engine, and had
> > success:
> >
> > select count(*) from test; -- 1
> >
> > Then I ran the same query with the "tez" execution engine, and had no
> > success. I got the following error:
> >
> > Status: Running (Executing on YARN cluster with App id
> > application_1418140477139_0067)
> >
> >
> --------------------------------------------------------------------------------
> > VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> >
> --------------------------------------------------------------------------------
> > Map 1 FAILED 1 0 0 1 4 0
> > Reducer 2 KILLED 1 0 0 1 0 1
> >
> --------------------------------------------------------------------------------
> > VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 9.61 s
> >
> --------------------------------------------------------------------------------
> > Status: Failed
> > Vertex failed, vertexName=Map 1, vertexId=vertex_1418140477139_0067_1_00,
> > diagnostics=[Task failed, taskId=task_1418140477139_0067_1_00_000000,
> > diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running
> > task:java.lang.IllegalArgumentException
> > at
> com.google.common.base.Preconditions.checkArgument(Preconditions.java:72)
> > at
> >
> org.apache.tez.runtime.common.resources.MemoryDistributor.registerRequest(MemoryDistributor.java:158)
> > at
> >
> org.apache.tez.runtime.common.resources.MemoryDistributor.requestMemory(MemoryDistributor.java:97)
> > at
> >
> org.apache.tez.runtime.api.impl.TezTaskContextImpl.requestInitialMemory(TezTaskContextImpl.java:192)
> > at
> >
> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput.initialize(OrderedPartitionedKVOutput.java:95)
> >
> > Have any of you seen this issue before? That "requestInitialMemory"
> function
> > failure combined with the "IllegalArgumentException" message made me
> think
> > that maybe Tez was asking for a container that was too big...but I didn't
> > see anything odd in the properties. Then again, I don't have a lot of
> > insight into what this new version of Tez requires.
> >
> > Any help is appreciated! Please let me know if you need additional
> > information.
> > Kristen Hardwick
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: issue with Tez execution engine in HDP 2.2
Posted by Vikram Dixit <vi...@hortonworks.com>.
Hi Kristen,
Can you share the version of tez you are using? Hive 0.14 (in HDP 2.2)
needs tez 0.5.3 or beyond. Not sure if there was an earlier
installation of tez that is being used here.
Thanks
Vikram.
On Mon, Dec 15, 2014 at 10:13 AM, Kristen Hardwick
<kh...@spryinc.com> wrote:
> Hi all,
>
> We recently created a new Amazon cluster with an installation of GA HDP 2.2
> from the Hortonworks website. One of the main reasons we wanted to try this
> version was to use Hive with Tez with the new cost based optimizer. However,
> running simple queries with Tez as the execution engine does not work.
>
> I created a single line file, created the Hive table for it, and ran this
> query to confirm proper data load:
>
> select * from test;
>
> No issues, so I ran this query with the "mr" execution engine, and had
> success:
>
> select count(*) from test; -- 1
>
> Then I ran the same query with the "tez" execution engine, and had no
> success. I got the following error:
>
> Status: Running (Executing on YARN cluster with App id
> application_1418140477139_0067)
>
> --------------------------------------------------------------------------------
> VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> --------------------------------------------------------------------------------
> Map 1 FAILED 1 0 0 1 4 0
> Reducer 2 KILLED 1 0 0 1 0 1
> --------------------------------------------------------------------------------
> VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 9.61 s
> --------------------------------------------------------------------------------
> Status: Failed
> Vertex failed, vertexName=Map 1, vertexId=vertex_1418140477139_0067_1_00,
> diagnostics=[Task failed, taskId=task_1418140477139_0067_1_00_000000,
> diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running
> task:java.lang.IllegalArgumentException
> at com.google.common.base.Preconditions.checkArgument(Preconditions.java:72)
> at
> org.apache.tez.runtime.common.resources.MemoryDistributor.registerRequest(MemoryDistributor.java:158)
> at
> org.apache.tez.runtime.common.resources.MemoryDistributor.requestMemory(MemoryDistributor.java:97)
> at
> org.apache.tez.runtime.api.impl.TezTaskContextImpl.requestInitialMemory(TezTaskContextImpl.java:192)
> at
> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput.initialize(OrderedPartitionedKVOutput.java:95)
>
> Have any of you seen this issue before? That "requestInitialMemory" function
> failure combined with the "IllegalArgumentException" message made me think
> that maybe Tez was asking for a container that was too big...but I didn't
> see anything odd in the properties. Then again, I don't have a lot of
> insight into what this new version of Tez requires.
>
> Any help is appreciated! Please let me know if you need additional
> information.
> Kristen Hardwick
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.