You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2016/01/30 01:15:39 UTC

[jira] [Resolved] (PIG-4347) TEZ vertex intialization failed

     [ https://issues.apache.org/jira/browse/PIG-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy resolved PIG-4347.
-------------------------------------
    Resolution: Invalid

Closing old jiras. This is most likely wrong version of jars

> TEZ vertex intialization failed
> -------------------------------
>
>                 Key: PIG-4347
>                 URL: https://issues.apache.org/jira/browse/PIG-4347
>             Project: Pig
>          Issue Type: Bug
>          Components: tez
>    Affects Versions: 0.14.0
>         Environment: Centos 6.5
> Hadoop 2.4.1
> Tez 0.5.1
>            Reporter: LINTE
>
> Error while lauching a simple pig script with pig / tez .
> # pig -x tez
> grunt> STOCK_A = LOAD '/tmp/NYSE_daily_prices_A.csv';
> grunt> dump STOCK_A;
> Have you any idea on this issue ?
> AM Container logs : 
> 2014-11-27 19:00:19,165 INFO [IPC Server handler 0 on 37951] org.apache.tez.dag.app.DAGAppMaster: Running DAG: PigLatin:DefaultJobName-0_scope-0
> 2014-11-27 19:00:19,439 INFO [HistoryEventHandlingThread] org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService: Writing event DAG_SUBMITTED to history file
> 2014-11-27 19:00:19,439 INFO [IPC Server handler 0 on 37951] org.apache.tez.dag.history.HistoryEventHandler: [HISTORY][DAG:dag_1415874690742_0063_1][Event:DAG_SUBMITTED]: dagID=dag_1415874690742_0063_1, submitTime=1417111219103
> 2014-11-27 19:00:19,472 INFO [IPC Server handler 0 on 37951] org.apache.tez.dag.app.dag.impl.VertexImpl: setting additional outputs for vertex scope-2
> 2014-11-27 19:00:19,473 INFO [IPC Server handler 0 on 37951] org.apache.tez.dag.app.dag.impl.DAGImpl: Using Natural order dag scheduler
> 2014-11-27 19:00:19,475 INFO [IPC Server handler 0 on 37951] org.apache.tez.dag.history.HistoryEventHandler: [HISTORY][DAG:dag_1415874690742_0063_1][Event:DAG_INITIALIZED]: dagID=dag_1415874690742_0063_1, initTime=1417111219440
> 2014-11-27 19:00:19,475 INFO [IPC Server handler 0 on 37951] org.apache.tez.dag.app.dag.impl.DAGImpl: dag_1415874690742_0063_1 transitioned from NEW to INITED
> 2014-11-27 19:00:19,476 INFO [AsyncDispatcher event handler] org.apache.tez.dag.history.HistoryEventHandler: [HISTORY][DAG:dag_1415874690742_0063_1][Event:DAG_STARTED]: dagID=dag_1415874690742_0063_1, startTime=1417111219475
> 2014-11-27 19:00:19,477 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.DAGImpl: Added additional resources : [[]] to classpath
> 2014-11-27 19:00:19,478 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.DAGImpl: dag_1415874690742_0063_1 transitioned from INITED to RUNNING
> 2014-11-27 19:00:19,478 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Root Inputs exist for Vertex: scope-2 : {scope-0={InputName=scope-0}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputSplitDistributor, hasPayload=false}}
> 2014-11-27 19:00:19,478 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Starting root input initializer for input: scope-0, with class: [org.apache.tez.mapreduce.common.MRInputSplitDistributor]
> 2014-11-27 19:00:19,478 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Setting vertexManager to RootInputVertexManager for vertex_1415874690742_0063_1_00 [scope-2]
> 2014-11-27 19:00:19,483 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Creating 1 for vertex: vertex_1415874690742_0063_1_00 [scope-2]
> 2014-11-27 19:00:19,497 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Vertex will initialize via inputInitializers vertex_1415874690742_0063_1_00 [scope-2]. Starting root input initializers: 1
> 2014-11-27 19:00:19,508 INFO [InputInitializer [scope-2] #0] org.apache.tez.dag.app.dag.RootInputInitializerManager: Starting InputInitializer for Input: scope-0 on vertex vertex_1415874690742_0063_1_00 [scope-2]
> 2014-11-27 19:00:19,515 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: vertex_1415874690742_0063_1_00 [scope-2] transitioned from NEW to INITIALIZING due to event V_INIT
> 2014-11-27 19:00:19,522 INFO [InputInitializer [scope-2] #0] org.apache.tez.dag.app.dag.RootInputInitializerManager: Failed InputInitializer for Input: scope-0 on vertex vertex_1415874690742_0063_1_00 [scope-2]
> 2014-11-27 19:00:19,524 ERROR [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Vertex Input: scope-0 initializer failed
> com.google.protobuf.InvalidProtocolBufferException: incorrect header check
>         at org.apache.tez.dag.api.records.DAGProtos$ConfigurationProto.<init>(DAGProtos.java:13703)
>         at org.apache.tez.dag.api.records.DAGProtos$ConfigurationProto.<init>(DAGProtos.java:13642)
>         at org.apache.tez.dag.api.records.DAGProtos$ConfigurationProto$1.parsePartialFrom(DAGProtos.java:13731)
>         at org.apache.tez.dag.api.records.DAGProtos$ConfigurationProto$1.parsePartialFrom(DAGProtos.java:13726)
>         at com.google.protobuf.AbstractParser.parsePartialFrom(AbstractParser.java:200)
>         at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:217)
>         at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:223)
>         at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
>         at org.apache.tez.dag.api.records.DAGProtos$ConfigurationProto.parseFrom(DAGProtos.java:13883)
>         at org.apache.tez.common.TezUtils.createConfFromByteString(TezUtils.java:110)
>         at org.apache.tez.mapreduce.common.MRInputSplitDistributor.initialize(MRInputSplitDistributor.java:83)
>         at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:214)
>         at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:208)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
>         at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:208)
>         at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:195)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)