You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by tkg_cangkul <yu...@gmail.com> on 2015/10/29 09:25:11 UTC
error submit job oozie
hi i try to submit mapreduce job using oozie but i have error message below:
[TRANSIENT], ErrorCode [JA009], Message [JA009: Cannot initialize
Cluster. Please check your configuration for mapreduce.framework.name
and the correspond server addresses.]
org.apache.oozie.action.ActionExecutorException: JA009: Cannot
initialize Cluster. Please check your configuration for
mapreduce.framework.name and the correspond server addresses.
at
org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
i've been check all my hadoop & oozie conf and i think it was right.
when i try to run hadoop jar manually without oozie the proccess work
normally. pls help
this is my workflow.xml
<workflow-app xmlns="uri:oozie:workflow:0.2" name="20150818111113">
<start to="java-node"/>
<action name="java-node">
<java>
<job-tracker>localhost:8032</job-tracker>
<name-node>hdfs://localhost:8020</name-node>
<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>default</value>
</property>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>oozie.launcher.mapred.job.queue.name</name>
<value>default</value>
</property>
</configuration>
<main-class>coba.order</main-class>
<java-opts></java-opts>
<arg>/user/bsmash/yztest_oozie/data01.dat</arg>
<arg>/user/bsmash/yztest_oozie/out</arg>
<file>/user/bsmash/yztest_oozie/coba.jar</file>
<capture-output />
</java>
<ok to="end"/>
<error to="fail"/>
</action>
<kill name="fail">
<message>Java failed, error
message[${wf:errorMessage(wf:lastErrorNode()</message>
</kill>
<end name="end"/>
</workflow-app>
and this is my job.properties file:
nameNode=hdfs://localhost:8020
jobTracker=localhost:8032
queueName=default
oozie.use.system.libpath=true
oozie.processing.timezone=WIB
oozie.wf.application.path=${nameNode}/user/bsmash/yztest_oozie/workflow.xml
Re: error submit job oozie
Posted by Jagat Singh <ja...@gmail.com>.
8050
On 29 Oct 2015 9:35 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
> so what port that i must use to config jobtracker?
>
> 8021?
>
> On 29/10/15 17:31, Jagat Singh wrote:
>
>> 8032 is wrong it's not yarn port.
>>
>> Change to 8050
>> On 29 Oct 2015 9:24 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
>>
>> yups i'm running with yarn service
>>>
>>> On 29/10/15 17:22, Jagat Singh wrote:
>>>
>>> You are running yarn ?
>>>>
>>>> Check your jobtracker port if that is correct in oozie
>>>> On 29 Oct 2015 7:25 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
>>>>
>>>> hi i try to submit mapreduce job using oozie but i have error message
>>>>
>>>>> below:
>>>>>
>>>>> [TRANSIENT], ErrorCode [JA009], Message [JA009: Cannot initialize
>>>>> Cluster.
>>>>> Please check your configuration for mapreduce.framework.name and the
>>>>> correspond server addresses.]
>>>>> org.apache.oozie.action.ActionExecutorException: JA009: Cannot
>>>>> initialize
>>>>> Cluster. Please check your configuration for mapreduce.framework.name
>>>>> and
>>>>> the correspond server addresses.
>>>>> at
>>>>>
>>>>>
>>>>> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
>>>>>
>>>>> i've been check all my hadoop & oozie conf and i think it was right.
>>>>> when
>>>>> i try to run hadoop jar manually without oozie the proccess work
>>>>> normally.
>>>>> pls help
>>>>>
>>>>> this is my workflow.xml
>>>>>
>>>>> <workflow-app xmlns="uri:oozie:workflow:0.2" name="20150818111113">
>>>>> <start to="java-node"/>
>>>>> <action name="java-node">
>>>>> <java>
>>>>> <job-tracker>localhost:8032</job-tracker>
>>>>> <name-node>hdfs://localhost:8020</name-node>
>>>>> <configuration>
>>>>> <property>
>>>>> <name>mapred.job.queue.name</name>
>>>>> <value>default</value>
>>>>> </property>
>>>>> <property>
>>>>> <name>mapreduce.framework.name</name>
>>>>> <value>yarn</value>
>>>>> </property>
>>>>> <property>
>>>>> <name>oozie.launcher.mapred.job.queue.name</name>
>>>>> <value>default</value>
>>>>> </property>
>>>>> </configuration>
>>>>> <main-class>coba.order</main-class>
>>>>> <java-opts></java-opts>
>>>>> <arg>/user/bsmash/yztest_oozie/data01.dat</arg>
>>>>> <arg>/user/bsmash/yztest_oozie/out</arg>
>>>>> <file>/user/bsmash/yztest_oozie/coba.jar</file>
>>>>> <capture-output />
>>>>> </java>
>>>>> <ok to="end"/>
>>>>> <error to="fail"/>
>>>>> </action>
>>>>> <kill name="fail">
>>>>> <message>Java failed, error
>>>>> message[${wf:errorMessage(wf:lastErrorNode()</message>
>>>>> </kill>
>>>>> <end name="end"/>
>>>>> </workflow-app>
>>>>>
>>>>> and this is my job.properties file:
>>>>>
>>>>> nameNode=hdfs://localhost:8020
>>>>> jobTracker=localhost:8032
>>>>> queueName=default
>>>>> oozie.use.system.libpath=true
>>>>> oozie.processing.timezone=WIB
>>>>>
>>>>>
>>>>> oozie.wf.application.path=${nameNode}/user/bsmash/yztest_oozie/workflow.xml
>>>>>
>>>>>
>>>>>
>>>>>
>
Re: error submit job oozie
Posted by tkg_cangkul <yu...@gmail.com>.
so what port that i must use to config jobtracker?
8021?
On 29/10/15 17:31, Jagat Singh wrote:
> 8032 is wrong it's not yarn port.
>
> Change to 8050
> On 29 Oct 2015 9:24 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
>
>> yups i'm running with yarn service
>>
>> On 29/10/15 17:22, Jagat Singh wrote:
>>
>>> You are running yarn ?
>>>
>>> Check your jobtracker port if that is correct in oozie
>>> On 29 Oct 2015 7:25 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
>>>
>>> hi i try to submit mapreduce job using oozie but i have error message
>>>> below:
>>>>
>>>> [TRANSIENT], ErrorCode [JA009], Message [JA009: Cannot initialize
>>>> Cluster.
>>>> Please check your configuration for mapreduce.framework.name and the
>>>> correspond server addresses.]
>>>> org.apache.oozie.action.ActionExecutorException: JA009: Cannot initialize
>>>> Cluster. Please check your configuration for mapreduce.framework.name
>>>> and
>>>> the correspond server addresses.
>>>> at
>>>>
>>>> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
>>>>
>>>> i've been check all my hadoop & oozie conf and i think it was right. when
>>>> i try to run hadoop jar manually without oozie the proccess work
>>>> normally.
>>>> pls help
>>>>
>>>> this is my workflow.xml
>>>>
>>>> <workflow-app xmlns="uri:oozie:workflow:0.2" name="20150818111113">
>>>> <start to="java-node"/>
>>>> <action name="java-node">
>>>> <java>
>>>> <job-tracker>localhost:8032</job-tracker>
>>>> <name-node>hdfs://localhost:8020</name-node>
>>>> <configuration>
>>>> <property>
>>>> <name>mapred.job.queue.name</name>
>>>> <value>default</value>
>>>> </property>
>>>> <property>
>>>> <name>mapreduce.framework.name</name>
>>>> <value>yarn</value>
>>>> </property>
>>>> <property>
>>>> <name>oozie.launcher.mapred.job.queue.name</name>
>>>> <value>default</value>
>>>> </property>
>>>> </configuration>
>>>> <main-class>coba.order</main-class>
>>>> <java-opts></java-opts>
>>>> <arg>/user/bsmash/yztest_oozie/data01.dat</arg>
>>>> <arg>/user/bsmash/yztest_oozie/out</arg>
>>>> <file>/user/bsmash/yztest_oozie/coba.jar</file>
>>>> <capture-output />
>>>> </java>
>>>> <ok to="end"/>
>>>> <error to="fail"/>
>>>> </action>
>>>> <kill name="fail">
>>>> <message>Java failed, error
>>>> message[${wf:errorMessage(wf:lastErrorNode()</message>
>>>> </kill>
>>>> <end name="end"/>
>>>> </workflow-app>
>>>>
>>>> and this is my job.properties file:
>>>>
>>>> nameNode=hdfs://localhost:8020
>>>> jobTracker=localhost:8032
>>>> queueName=default
>>>> oozie.use.system.libpath=true
>>>> oozie.processing.timezone=WIB
>>>>
>>>> oozie.wf.application.path=${nameNode}/user/bsmash/yztest_oozie/workflow.xml
>>>>
>>>>
>>>>
Re: error submit job oozie
Posted by Jagat Singh <ja...@gmail.com>.
8032 is wrong it's not yarn port.
Change to 8050
On 29 Oct 2015 9:24 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
> yups i'm running with yarn service
>
> On 29/10/15 17:22, Jagat Singh wrote:
>
>> You are running yarn ?
>>
>> Check your jobtracker port if that is correct in oozie
>> On 29 Oct 2015 7:25 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
>>
>> hi i try to submit mapreduce job using oozie but i have error message
>>> below:
>>>
>>> [TRANSIENT], ErrorCode [JA009], Message [JA009: Cannot initialize
>>> Cluster.
>>> Please check your configuration for mapreduce.framework.name and the
>>> correspond server addresses.]
>>> org.apache.oozie.action.ActionExecutorException: JA009: Cannot initialize
>>> Cluster. Please check your configuration for mapreduce.framework.name
>>> and
>>> the correspond server addresses.
>>> at
>>>
>>> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
>>>
>>> i've been check all my hadoop & oozie conf and i think it was right. when
>>> i try to run hadoop jar manually without oozie the proccess work
>>> normally.
>>> pls help
>>>
>>> this is my workflow.xml
>>>
>>> <workflow-app xmlns="uri:oozie:workflow:0.2" name="20150818111113">
>>> <start to="java-node"/>
>>> <action name="java-node">
>>> <java>
>>> <job-tracker>localhost:8032</job-tracker>
>>> <name-node>hdfs://localhost:8020</name-node>
>>> <configuration>
>>> <property>
>>> <name>mapred.job.queue.name</name>
>>> <value>default</value>
>>> </property>
>>> <property>
>>> <name>mapreduce.framework.name</name>
>>> <value>yarn</value>
>>> </property>
>>> <property>
>>> <name>oozie.launcher.mapred.job.queue.name</name>
>>> <value>default</value>
>>> </property>
>>> </configuration>
>>> <main-class>coba.order</main-class>
>>> <java-opts></java-opts>
>>> <arg>/user/bsmash/yztest_oozie/data01.dat</arg>
>>> <arg>/user/bsmash/yztest_oozie/out</arg>
>>> <file>/user/bsmash/yztest_oozie/coba.jar</file>
>>> <capture-output />
>>> </java>
>>> <ok to="end"/>
>>> <error to="fail"/>
>>> </action>
>>> <kill name="fail">
>>> <message>Java failed, error
>>> message[${wf:errorMessage(wf:lastErrorNode()</message>
>>> </kill>
>>> <end name="end"/>
>>> </workflow-app>
>>>
>>> and this is my job.properties file:
>>>
>>> nameNode=hdfs://localhost:8020
>>> jobTracker=localhost:8032
>>> queueName=default
>>> oozie.use.system.libpath=true
>>> oozie.processing.timezone=WIB
>>>
>>> oozie.wf.application.path=${nameNode}/user/bsmash/yztest_oozie/workflow.xml
>>>
>>>
>>>
>
Re: error submit job oozie
Posted by tkg_cangkul <yu...@gmail.com>.
yups i'm running with yarn service
On 29/10/15 17:22, Jagat Singh wrote:
> You are running yarn ?
>
> Check your jobtracker port if that is correct in oozie
> On 29 Oct 2015 7:25 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
>
>> hi i try to submit mapreduce job using oozie but i have error message
>> below:
>>
>> [TRANSIENT], ErrorCode [JA009], Message [JA009: Cannot initialize Cluster.
>> Please check your configuration for mapreduce.framework.name and the
>> correspond server addresses.]
>> org.apache.oozie.action.ActionExecutorException: JA009: Cannot initialize
>> Cluster. Please check your configuration for mapreduce.framework.name and
>> the correspond server addresses.
>> at
>> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
>>
>> i've been check all my hadoop & oozie conf and i think it was right. when
>> i try to run hadoop jar manually without oozie the proccess work normally.
>> pls help
>>
>> this is my workflow.xml
>>
>> <workflow-app xmlns="uri:oozie:workflow:0.2" name="20150818111113">
>> <start to="java-node"/>
>> <action name="java-node">
>> <java>
>> <job-tracker>localhost:8032</job-tracker>
>> <name-node>hdfs://localhost:8020</name-node>
>> <configuration>
>> <property>
>> <name>mapred.job.queue.name</name>
>> <value>default</value>
>> </property>
>> <property>
>> <name>mapreduce.framework.name</name>
>> <value>yarn</value>
>> </property>
>> <property>
>> <name>oozie.launcher.mapred.job.queue.name</name>
>> <value>default</value>
>> </property>
>> </configuration>
>> <main-class>coba.order</main-class>
>> <java-opts></java-opts>
>> <arg>/user/bsmash/yztest_oozie/data01.dat</arg>
>> <arg>/user/bsmash/yztest_oozie/out</arg>
>> <file>/user/bsmash/yztest_oozie/coba.jar</file>
>> <capture-output />
>> </java>
>> <ok to="end"/>
>> <error to="fail"/>
>> </action>
>> <kill name="fail">
>> <message>Java failed, error
>> message[${wf:errorMessage(wf:lastErrorNode()</message>
>> </kill>
>> <end name="end"/>
>> </workflow-app>
>>
>> and this is my job.properties file:
>>
>> nameNode=hdfs://localhost:8020
>> jobTracker=localhost:8032
>> queueName=default
>> oozie.use.system.libpath=true
>> oozie.processing.timezone=WIB
>> oozie.wf.application.path=${nameNode}/user/bsmash/yztest_oozie/workflow.xml
>>
>>
Re: error submit job oozie
Posted by Jagat Singh <ja...@gmail.com>.
You are running yarn ?
Check your jobtracker port if that is correct in oozie
On 29 Oct 2015 7:25 PM, "tkg_cangkul" <yu...@gmail.com> wrote:
> hi i try to submit mapreduce job using oozie but i have error message
> below:
>
> [TRANSIENT], ErrorCode [JA009], Message [JA009: Cannot initialize Cluster.
> Please check your configuration for mapreduce.framework.name and the
> correspond server addresses.]
> org.apache.oozie.action.ActionExecutorException: JA009: Cannot initialize
> Cluster. Please check your configuration for mapreduce.framework.name and
> the correspond server addresses.
> at
> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
>
> i've been check all my hadoop & oozie conf and i think it was right. when
> i try to run hadoop jar manually without oozie the proccess work normally.
> pls help
>
> this is my workflow.xml
>
> <workflow-app xmlns="uri:oozie:workflow:0.2" name="20150818111113">
> <start to="java-node"/>
> <action name="java-node">
> <java>
> <job-tracker>localhost:8032</job-tracker>
> <name-node>hdfs://localhost:8020</name-node>
> <configuration>
> <property>
> <name>mapred.job.queue.name</name>
> <value>default</value>
> </property>
> <property>
> <name>mapreduce.framework.name</name>
> <value>yarn</value>
> </property>
> <property>
> <name>oozie.launcher.mapred.job.queue.name</name>
> <value>default</value>
> </property>
> </configuration>
> <main-class>coba.order</main-class>
> <java-opts></java-opts>
> <arg>/user/bsmash/yztest_oozie/data01.dat</arg>
> <arg>/user/bsmash/yztest_oozie/out</arg>
> <file>/user/bsmash/yztest_oozie/coba.jar</file>
> <capture-output />
> </java>
> <ok to="end"/>
> <error to="fail"/>
> </action>
> <kill name="fail">
> <message>Java failed, error
> message[${wf:errorMessage(wf:lastErrorNode()</message>
> </kill>
> <end name="end"/>
> </workflow-app>
>
> and this is my job.properties file:
>
> nameNode=hdfs://localhost:8020
> jobTracker=localhost:8032
> queueName=default
> oozie.use.system.libpath=true
> oozie.processing.timezone=WIB
> oozie.wf.application.path=${nameNode}/user/bsmash/yztest_oozie/workflow.xml
>
>
Re: error submit job oozie
Posted by tkg_cangkul <yu...@gmail.com>.
Hi Oussama,
thx for your reply.
i have check it and it was running. Here is the result
netstat -netulp | grep 19888
(No info could be read for "-p": geteuid()=1013 but you should be root.)
tcp 0 0 192.168.1.233:19888 0.0.0.0:*
LISTEN 502 21432506 -
i've been try to running hadoop manually without oozie and it
succeesfull. but if i try from oozie that error was appear.
any suggest?
On 29/10/15 17:10, Oussama Chougna wrote:
> Hi,
> Big chance that your hadoop Jobhistory server is not running.Please make sure the jobhistory server of Hadoop is running.
>
> Cheers,
>
> Oussama Chougna
>
>> Date: Thu, 29 Oct 2015 15:25:11 +0700
>> From: yuza.rasfar@gmail.com
>> To: user@oozie.apache.org
>> Subject: error submit job oozie
>>
>> hi i try to submit mapreduce job using oozie but i have error message below:
>>
>> [TRANSIENT], ErrorCode [JA009], Message [JA009: Cannot initialize
>> Cluster. Please check your configuration for mapreduce.framework.name
>> and the correspond server addresses.]
>> org.apache.oozie.action.ActionExecutorException: JA009: Cannot
>> initialize Cluster. Please check your configuration for
>> mapreduce.framework.name and the correspond server addresses.
>> at
>> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
>>
>> i've been check all my hadoop & oozie conf and i think it was right.
>> when i try to run hadoop jar manually without oozie the proccess work
>> normally. pls help
>>
>> this is my workflow.xml
>>
>> <workflow-app xmlns="uri:oozie:workflow:0.2" name="20150818111113">
>> <start to="java-node"/>
>> <action name="java-node">
>> <java>
>> <job-tracker>localhost:8032</job-tracker>
>> <name-node>hdfs://localhost:8020</name-node>
>> <configuration>
>> <property>
>> <name>mapred.job.queue.name</name>
>> <value>default</value>
>> </property>
>> <property>
>> <name>mapreduce.framework.name</name>
>> <value>yarn</value>
>> </property>
>> <property>
>> <name>oozie.launcher.mapred.job.queue.name</name>
>> <value>default</value>
>> </property>
>> </configuration>
>> <main-class>coba.order</main-class>
>> <java-opts></java-opts>
>> <arg>/user/bsmash/yztest_oozie/data01.dat</arg>
>> <arg>/user/bsmash/yztest_oozie/out</arg>
>> <file>/user/bsmash/yztest_oozie/coba.jar</file>
>> <capture-output />
>> </java>
>> <ok to="end"/>
>> <error to="fail"/>
>> </action>
>> <kill name="fail">
>> <message>Java failed, error
>> message[${wf:errorMessage(wf:lastErrorNode()</message>
>> </kill>
>> <end name="end"/>
>> </workflow-app>
>>
>> and this is my job.properties file:
>>
>> nameNode=hdfs://localhost:8020
>> jobTracker=localhost:8032
>> queueName=default
>> oozie.use.system.libpath=true
>> oozie.processing.timezone=WIB
>> oozie.wf.application.path=${nameNode}/user/bsmash/yztest_oozie/workflow.xml
>>
>
RE: error submit job oozie
Posted by Oussama Chougna <ou...@hotmail.com>.
Hi,
Big chance that your hadoop Jobhistory server is not running.Please make sure the jobhistory server of Hadoop is running.
Cheers,
Oussama Chougna
> Date: Thu, 29 Oct 2015 15:25:11 +0700
> From: yuza.rasfar@gmail.com
> To: user@oozie.apache.org
> Subject: error submit job oozie
>
> hi i try to submit mapreduce job using oozie but i have error message below:
>
> [TRANSIENT], ErrorCode [JA009], Message [JA009: Cannot initialize
> Cluster. Please check your configuration for mapreduce.framework.name
> and the correspond server addresses.]
> org.apache.oozie.action.ActionExecutorException: JA009: Cannot
> initialize Cluster. Please check your configuration for
> mapreduce.framework.name and the correspond server addresses.
> at
> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
>
> i've been check all my hadoop & oozie conf and i think it was right.
> when i try to run hadoop jar manually without oozie the proccess work
> normally. pls help
>
> this is my workflow.xml
>
> <workflow-app xmlns="uri:oozie:workflow:0.2" name="20150818111113">
> <start to="java-node"/>
> <action name="java-node">
> <java>
> <job-tracker>localhost:8032</job-tracker>
> <name-node>hdfs://localhost:8020</name-node>
> <configuration>
> <property>
> <name>mapred.job.queue.name</name>
> <value>default</value>
> </property>
> <property>
> <name>mapreduce.framework.name</name>
> <value>yarn</value>
> </property>
> <property>
> <name>oozie.launcher.mapred.job.queue.name</name>
> <value>default</value>
> </property>
> </configuration>
> <main-class>coba.order</main-class>
> <java-opts></java-opts>
> <arg>/user/bsmash/yztest_oozie/data01.dat</arg>
> <arg>/user/bsmash/yztest_oozie/out</arg>
> <file>/user/bsmash/yztest_oozie/coba.jar</file>
> <capture-output />
> </java>
> <ok to="end"/>
> <error to="fail"/>
> </action>
> <kill name="fail">
> <message>Java failed, error
> message[${wf:errorMessage(wf:lastErrorNode()</message>
> </kill>
> <end name="end"/>
> </workflow-app>
>
> and this is my job.properties file:
>
> nameNode=hdfs://localhost:8020
> jobTracker=localhost:8032
> queueName=default
> oozie.use.system.libpath=true
> oozie.processing.timezone=WIB
> oozie.wf.application.path=${nameNode}/user/bsmash/yztest_oozie/workflow.xml
>