You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by Jeetendra G <je...@housing.com> on 2015/10/29 12:23:14 UTC
Java action in Ooozie
Hi All,
I am running java workflow job using oozie.
I have Ambari server and I have installed oozie from Ambari.
When i ran the job it say succeeded but its not running my java class which
I mentioned inside workflow.xml. Also when I get oozie nothing can be find
pasting log beow, can anybody help here?
oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
0000040-151015123257993-oozie-oozi-W
2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start action
[0000040-151015123257993-oozie-oozi-W@:start:] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
[***0000040-151015123257993-oozie-oozi-W@:start:***]Action status=DONE
2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
[***0000040-151015123257993-oozie-oozi-W@:start:***]Action updated in DB!
2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification URL is
defined. Therefore nothing to notify for job
0000040-151015123257993-oozie-oozi-W@:start:
2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
defined. Therefore nothing to notify for job
0000040-151015123257993-oozie-oozi-W
2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start action
[0000040-151015123257993-oozie-oozi-W@java-node] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@java-node] checking action,
hadoop job ID [job_1444892488693_0073] status [RUNNING]
2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
[***0000040-151015123257993-oozie-oozi-W@java-node***]Action status=RUNNING
2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
[***0000040-151015123257993-oozie-oozi-W@java-node***]Action updated in DB!
2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No Notification URL
is defined. Therefore nothing to notify for job
0000040-151015123257993-oozie-oozi-W@java-node
2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@java-node] callback for action
[0000040-151015123257993-oozie-oozi-W@java-node]
2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action completed,
external ID [job_1444892488693_0073]
2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
[0000040-151015123257993-oozie-oozi-W@end] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@end]
[***0000040-151015123257993-oozie-oozi-W@end***]Action status=DONE
2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@end]
[***0000040-151015123257993-oozie-oozi-W@end***]Action updated in DB!
2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@end] No Notification URL is
defined. Therefore nothing to notify for job
0000040-151015123257993-oozie-oozi-W@end
2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
defined. Therefore nothing to notify for job
0000040-151015123257993-oozie-oozi-W
2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No Notification URL
is defined. Therefore nothing to notify for job
0000040-151015123257993-oozie-oozi-W@java-node
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
Hey this stdout log only here is the complete log
Log Type: stderr
Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
Log Length: 2254
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/hadoop/yarn/local/usercache/hdfs/filecache/22/dsl-data-ingestion-all.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Nov 04, 2015 2:59:15 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
register
INFO: Registering
org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a
provider class
Nov 04, 2015 2:59:15 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
register
INFO: Registering
org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider
class
Nov 04, 2015 2:59:15 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
register
INFO: Registering
org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root
resource class
Nov 04, 2015 2:59:15 PM
com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 04, 2015 2:59:15 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver
to GuiceManagedComponentProvider with the scope "Singleton"
Nov 04, 2015 2:59:15 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to
GuiceManagedComponentProvider with the scope "Singleton"
Nov 04, 2015 2:59:15 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices
to GuiceManagedComponentProvider with the scope "PerRequest"
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
for more info.
Log Type: stdout
Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
Log Length: 0
Log Type: syslog
Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
Log Length: 25565
Showing 4096 bytes of 25565 total. Click here
<http://hadoop03.housing.com:19888/jobhistory/logs/hadoop04.housing.com:45454/container_e02_1446620926630_0017_01_000001/container_e02_1446620926630_0017_01_000001/hdfs/syslog/?start=0>
for
the full log.
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copying hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
2015-11-04 14:59:22,880 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
to done location:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
2015-11-04 14:59:22,883 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
2015-11-04 14:59:22,956 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
to done location:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
2015-11-04 14:59:22,960 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
2015-11-04 14:59:22,962 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
2015-11-04 14:59:22,964 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
2015-11-04 14:59:22,965 INFO [Thread-67]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
JobHistoryEventHandler. super.stop()
2015-11-04 14:59:22,968 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
diagnostics to
2015-11-04 14:59:22,969 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
2015-11-04 14:59:22,976 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
application to be successfully unregistered.
2015-11-04 14:59:23,979 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
HostLocal:0 RackLocal:0
2015-11-04 14:59:23,980 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
directory hdfs://hadoop01.housing.com:8020
/user/hdfs/.staging/job_1446620926630_0017
2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server:
Stopping server on 50432
2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
2015-11-04 14:59:23,986 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
TaskHeartbeatHandler thread interrupted
On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <je...@housing.com> wrote:
> Hi Jaydeep here also I cant see any error below are the logs
>
> Log Type: syslog
>
> Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
>
> Log Length: 25565
>
> 2015-11-04 14:59:11,814 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1446620926630_0017_000001
> 2015-11-04 14:59:12,144 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 2015-11-04 14:59:12,184 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
> 2015-11-04 14:59:12,292 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId: -173762614)
> 2015-11-04 14:59:12,293 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs, renewer=oozie mr token, realUser=oozie, issueDate=1446629349951, maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> 2015-11-04 14:59:12,890 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
> 2015-11-04 14:59:13,064 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null
> 2015-11-04 14:59:13,065 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
> 2015-11-04 14:59:13,110 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> 2015-11-04 14:59:13,110 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> 2015-11-04 14:59:13,111 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> 2015-11-04 14:59:13,111 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> 2015-11-04 14:59:13,112 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> 2015-11-04 14:59:13,112 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> 2015-11-04 14:59:13,113 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> 2015-11-04 14:59:13,113 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> 2015-11-04 14:59:13,144 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring
> 2015-11-04 14:59:13,170 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring
> 2015-11-04 14:59:13,189 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring
> 2015-11-04 14:59:13,219 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
> 2015-11-04 14:59:13,255 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> 2015-11-04 14:59:13,453 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> 2015-11-04 14:59:13,546 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
> 2015-11-04 14:59:13,546 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
> 2015-11-04 14:59:13,557 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1446620926630_0017 to jobTokenSecretManager
> 2015-11-04 14:59:13,680 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1446620926630_0017 because: not enabled; too much RAM;
> 2015-11-04 14:59:13,701 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1446620926630_0017 = 0. Number of splits = 1
> 2015-11-04 14:59:13,701 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1446620926630_0017 = 0
> 2015-11-04 14:59:13,701 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1446620926630_0017Job Transitioned from NEW to INITED
> 2015-11-04 14:59:13,702 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1446620926630_0017.
> 2015-11-04 14:59:13,725 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
> 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640
> 2015-11-04 14:59:13,758 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
> 2015-11-04 14:59:13,759 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640] org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting
> 2015-11-04 14:59:13,762 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at hadoop04.housing.com/10.21.1.138:39640
> 2015-11-04 <http://hadoop04.housing.com/10.21.1.138:396402015-11-04> 14:59:13,853 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
> 2015-11-04 14:59:13,862 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
> 2015-11-04 14:59:13,867 WARN [main] org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be enabled using Log4j
> 2015-11-04 14:59:13,874 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> 2015-11-04 14:59:13,878 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce
> 2015-11-04 14:59:13,879 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static
> 2015-11-04 14:59:13,882 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
> 2015-11-04 14:59:13,882 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> 2015-11-04 14:59:14,217 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
> 2015-11-04 14:59:14,218 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
> 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> 2015-11-04 14:59:15,952 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at 49791
> 2015-11-04 14:59:15,957 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
> 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432
> 2015-11-04 14:59:15,963 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432] org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting
> 2015-11-04 14:59:15,988 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
> 2015-11-04 14:59:15,988 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
> 2015-11-04 14:59:15,988 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
> 2015-11-04 14:59:16,035 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at hadoop02.housing.com/10.21.1.136:8030
> 2015-11-04 <http://hadoop02.housing.com/10.21.1.136:80302015-11-04> 14:59:16,113 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: <memory:5120, vCores:3>
> 2015-11-04 14:59:16,113 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
> 2015-11-04 14:59:16,117 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500
> 2015-11-04 14:59:16,118 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10
> 2015-11-04 14:59:16,120 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
> 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1446620926630_0017Job Transitioned from INITED to SETUP
> 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP
> 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1
> 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1446620926630_0017_m_000000 Task Transitioned from NEW to SCHEDULED
> 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
> 2015-11-04 14:59:16,202 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:<memory:1536, vCores:1>
> 2015-11-04 14:59:16,252 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1446620926630_0017, File: hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> 2015-11-04 <http://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist2015-11-04> 14:59:17,117 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1446620926630_0017: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:19840, vCores:1> knownNMs=5
> 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
> 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop04.housing.com to /default-rack
> 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e02_1446620926630_0017_01_000002 to attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop04.housing.com to /default-rack
> 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar is not present. Not adding any jar to the list of resources.
> 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /user/hdfs/.staging/job_1446620926630_0017/job.xml
> 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1 tokens and #1 secret keys for NM use for launching container
> 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 2
> 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
> 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
> 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e02_1446620926630_0017_01_000002 taskAttempt attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop04.housing.com:45454
> 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1446620926630_0017_m_000000_0 : 13562
> 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using containerId: [container_e02_1446620926630_0017_01_000002 on NM: [hadoop04.housing.com:45454]
> 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
> 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to RUNNING
> 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1446620926630_0017: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:17920, vCores:1> knownNMs=5
> 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1446620926630_0017 (auth:SIMPLE)
> 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1446620926630_0017_m_2199023255554 asked for a task
> 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1446620926630_0017_m_2199023255554 given task: attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
> 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1446620926630_0017_m_000000_0 given a go for committing the task output.
> 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1446620926630_0017_m_000000_0:true
> 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e02_1446620926630_0017_01_000002 taskAttempt attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop04.housing.com:45454
> 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to SUCCEEDED
> 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
> 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
> 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT
> 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent
> 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED
> 2015-11-04 14:59:22,792 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry
> 2015-11-04 14:59:22,792 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
> 2015-11-04 14:59:22,793 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator notified that shouldUnregistered is: true
> 2015-11-04 14:59:22,793 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
> 2015-11-04 14:59:22,793 INFO [Thread-67] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
> 2015-11-04 14:59:22,793 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
> 2015-11-04 14:59:22,793 INFO [Thread-67] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
> 2015-11-04 14:59:22,845 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> 2015-11-04 <http://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp2015-11-04> 14:59:22,880 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> 2015-11-04 <http://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp2015-11-04> 14:59:22,883 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> 2015-11-04 <http://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp2015-11-04> 14:59:22,956 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> 2015-11-04 <http://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp2015-11-04> 14:59:22,960 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> 2015-11-04 <http://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary2015-11-04> 14:59:22,962 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> 2015-11-04 14:59:22,964 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> 2015-11-04 <http://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist2015-11-04> 14:59:22,965 INFO [Thread-67] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
> 2015-11-04 14:59:22,968 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to
> 2015-11-04 14:59:22,969 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> 2015-11-04 <http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_00172015-11-04> 14:59:22,976 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for application to be successfully unregistered.
> 2015-11-04 14:59:23,979 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> 2015-11-04 14:59:23,980 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://hadoop01.housing.com:8020 /user/hdfs/.staging/job_1446620926630_0017
> 2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server: Stopping server on 50432
> 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
> 2015-11-04 14:59:23,986 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted
>
>
> On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> jaydeep.vishwakarma@inmobi.com> wrote:
>
>> In first look I am not seeing any issue with job tracker or name node URL.
>> The job id is getting generated. Workflow Job is not going on PREP mode.
>>
>> Open this link.
>> http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
>>
>> You will be see the problem.
>>
>>
>>
>> On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <je...@housing.com>
>> wrote:
>>
>> > hey Serega I have cross verified jobTracker value is correct only I am
>> > using yarn so resource manager will become the job tracker?
>> >
>> > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
>> serega.sheypak@gmail.com>
>> > wrote:
>> >
>> > > Can you go to oozie server and grab logs from there? My assumption
>> that
>> > > <job-tracker>${jobTracker}</job-tracker>
>> > > <name-node>${nameNode}</name-node>
>> > >
>> > > have incorrect values. Probably ${jobTracker} is wrong and oozie can't
>> > even
>> > > start launcher mapper.
>> > >
>> > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
>> > > jaydeep.vishwakarma@inmobi.com>:
>> > >
>> > > > You are doing -log. Can you give the command as below and get the
>> job
>> > url
>> > > > (application launcher url).
>> > > >
>> > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
>> > > >
>> > > >
>> > > >
>> > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
>> jeetendra.g@housing.com>
>> > > > wrote:
>> > > >
>> > > > > and in job error log tab its saying error log is disables? by
>> default
>> > > why
>> > > > > error log is disables? i am using hortonworks
>> > > > >
>> > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
>> jeetendra.g@housing.com
>> > >
>> > > > > wrote:
>> > > > >
>> > > > > > same error.
>> > > > > >
>> > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start
>> action
>> > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
>> > > state :
>> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
>> > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
>> > > status=DONE
>> > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
>> > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
>> updated
>> > > in
>> > > > > DB!
>> > > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
>> > > > SERVER[
>> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
>> > Notification
>> > > > URL
>> > > > > > is defined. Therefore nothing to notify for job
>> > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
>> > > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
>> > > > SERVER[
>> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
>> Notification
>> > > URL
>> > > > is
>> > > > > > defined. Therefore nothing to notify for job
>> > > > > > 0000004-151104124010010-oozie-oozi-W
>> > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
>> > action
>> > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with
>> user-retry
>> > > > state :
>> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
>> > > > action,
>> > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
>> > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
>> > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
>> > > > > > status=RUNNING
>> > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
>> > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
>> > updated
>> > > > in
>> > > > > > DB!
>> > > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
>> > > > SERVER[
>> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
>> > > Notification
>> > > > > > URL is defined. Therefore nothing to notify for job
>> > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
>> > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback
>> > for
>> > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
>> > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
>> > > > completed,
>> > > > > > external ID [job_1446620926630_0016]
>> > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
>> > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry
>> state :
>> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
>> > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
>> status=DONE
>> > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
>> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > APP[java-main-wf]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
>> > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated
>> in
>> > > DB!
>> > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
>> > > > SERVER[
>> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
>> Notification
>> > URL
>> > > > is
>> > > > > > defined. Therefore nothing to notify for job
>> > > > > > 0000004-151104124010010-oozie-oozi-W@end
>> > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
>> > > > SERVER[
>> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
>> Notification
>> > > URL
>> > > > is
>> > > > > > defined. Therefore nothing to notify for job
>> > > > > > 0000004-151104124010010-oozie-oozi-W
>> > > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
>> > > > SERVER[
>> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
>> > > Notification
>> > > > > > URL is defined. Therefore nothing to notify for job
>> > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
>> > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
>> > > > > >
>> > > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
>> > > > > >> There you will find "Console URL" , Open that URL on browser.
>> You
>> > > will
>> > > > > get
>> > > > > >> the Launcher mapper logs.
>> > > > > >>
>> > > > > >>
>> > > > > >>
>> > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
>> > > jeetendra.g@housing.com>
>> > > > > >> wrote:
>> > > > > >>
>> > > > > >> > This is the log i am getting repeatedly
>> > > > > >> > 2015-10-29 16:39:11,095 INFO
>> WorkflowNotificationXCommand:520 -
>> > > > > SERVER[
>> > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
>> > > > Notification
>> > > > > >> URL
>> > > > > >> > is
>> > > > > >> > defined. Therefore nothing to notify for job
>> > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
>> > > > > >> > 2015-10-29 16:39:11,095 INFO
>> WorkflowNotificationXCommand:520 -
>> > > > > SERVER[
>> > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
>> > Notification
>> > > > URL
>> > > > > >> is
>> > > > > >> > defined. Therefore nothing to notify for job
>> > > > > >> > 0000040-151015123257993-oozie-oozi-W
>> > > > > >> >
>> > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
>> > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
>> > > > > >> >
>> > > > > >> > > Have you checked Launcher Mapper logs?. What it says?
>> > > > > >> > >
>> > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
>> > > > > jeetendra.g@housing.com>
>> > > > > >> > > wrote:
>> > > > > >> > >
>> > > > > >> > > > does anybody have any idea? i have been trying this from
>> 10
>> > > days
>> > > > > >> > nothing
>> > > > > >> > > > worked out.
>> > > > > >> > > >
>> > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
>> > > > > >> jeetendra.g@housing.com>
>> > > > > >> > > > wrote:
>> > > > > >> > > >
>> > > > > >> > > > > my workflow.xml
>> > > > > >> > > > >
>> > > > > >> > > > >
>> > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
>> > > > > name="java-main-wf">
>> > > > > >> > > > > <start to="java-node"/>
>> > > > > >> > > > > <action name="java-node">
>> > > > > >> > > > > <java>
>> > > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
>> > > > > >> > > > > <name-node>${nameNode}</name-node>
>> > > > > >> > > > >
>> > > > > <main-class>com.housing.common.JSONMerger</main-class>
>> > > > > >> > > > >
>> > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
>> > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
>> > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
>> > > > > >> > > > >
>> > > > > >> > > > > </java>
>> > > > > >> > > > > <ok to="end"/>
>> > > > > >> > > > > <error to="fail"/>
>> > > > > >> > > > > </action>
>> > > > > >> > > > > <kill name="fail">
>> > > > > >> > > > > <message>Java failed, error
>> > > > > >> > > > >
>> message[${wf:errorMessage(wf:lastErrorNode())}]</message>
>> > > > > >> > > > > </kill>
>> > > > > >> > > > > <end name="end"/>
>> > > > > >> > > > > </workflow-app>
>> > > > > >> > > > >
>> > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
>> > > > > >> > jeetendra.g@housing.com>
>> > > > > >> > > > > wrote:
>> > > > > >> > > > >
>> > > > > >> > > > >> Hi All,
>> > > > > >> > > > >>
>> > > > > >> > > > >> I am running java workflow job using oozie.
>> > > > > >> > > > >> I have Ambari server and I have installed oozie from
>> > > Ambari.
>> > > > > >> > > > >> When i ran the job it say succeeded but its not
>> running
>> > my
>> > > > java
>> > > > > >> > class
>> > > > > >> > > > >> which I mentioned inside workflow.xml. Also when I get
>> > > oozie
>> > > > > >> > nothing
>> > > > > >> > > > can
>> > > > > >> > > > >> be find pasting log beow, can anybody help here?
>> > > > > >> > > > >> oozie job -oozie
>> http://hadoop03.housing.com:11000/oozie
>> > > > -log
>> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> > Start
>> > > > > >> action
>> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
>> > > > user-retry
>> > > > > >> > state
>> > > > > >> > > :
>> > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
>> userRetryInterval
>> > > [10]
>> > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
>> > :start:***]Action
>> > > > > >> > > status=DONE
>> > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
>> > :start:***]Action
>> > > > > >> updated
>> > > > > >> > in
>> > > > > >> > > > DB!
>> > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
>> > > > WorkflowNotificationXCommand:520
>> > > > > -
>> > > > > >> > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> APP[-]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> No
>> > > > > >> > Notification
>> > > > > >> > > > URL
>> > > > > >> > > > >> is defined. Therefore nothing to notify for job
>> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
>> > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
>> > > > WorkflowNotificationXCommand:520
>> > > > > -
>> > > > > >> > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> APP[-]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
>> > > > > >> Notification
>> > > > > >> > URL
>> > > > > >> > > > is
>> > > > > >> > > > >> defined. Therefore nothing to notify for job
>> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > > Start
>> > > > > >> action
>> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
>> > > > > user-retry
>> > > > > >> > > state
>> > > > > >> > > > :
>> > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
>> userRetryInterval
>> > > [10]
>> > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > > > > checking
>> > > > > >> > > action,
>> > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status
>> [RUNNING]
>> > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
>> > > ***]Action
>> > > > > >> > > > >> status=RUNNING
>> > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
>> > > ***]Action
>> > > > > >> > updated
>> > > > > >> > > in
>> > > > > >> > > > >> DB!
>> > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
>> > > > WorkflowNotificationXCommand:520
>> > > > > -
>> > > > > >> > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> APP[-]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > No
>> > > > > >> > > Notification
>> > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
>> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
>> > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
>> > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> APP[-]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > > > > callback
>> > > > > >> for
>> > > > > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > > > action
>> > > > > >> > > > completed,
>> > > > > >> > > > >> external ID [job_1444892488693_0073]
>> > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
>> Start
>> > > > action
>> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
>> > user-retry
>> > > > > >> state :
>> > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
>> userRetryInterval
>> > > [10]
>> > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
>> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
>> ***]Action
>> > > > > >> status=DONE
>> > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520
>> -
>> > > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > >> APP[java-main-wf]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
>> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
>> ***]Action
>> > > > updated
>> > > > > >> in
>> > > > > >> > DB!
>> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
>> > > > WorkflowNotificationXCommand:520
>> > > > > -
>> > > > > >> > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> APP[-]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
>> > > > > Notification
>> > > > > >> > URL
>> > > > > >> > > is
>> > > > > >> > > > >> defined. Therefore nothing to notify for job
>> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
>> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
>> > > > WorkflowNotificationXCommand:520
>> > > > > -
>> > > > > >> > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> APP[-]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
>> > > > > >> Notification
>> > > > > >> > URL
>> > > > > >> > > > is
>> > > > > >> > > > >> defined. Therefore nothing to notify for job
>> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
>> > > > WorkflowNotificationXCommand:520
>> > > > > -
>> > > > > >> > > SERVER[
>> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> APP[-]
>> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > No
>> > > > > >> > > Notification
>> > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
>> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
>> > > > > >> > > > >>
>> > > > > >> > > > >
>> > > > > >> > > > >
>> > > > > >> > > >
>> > > > > >> > >
>> > > > > >> > > --
>> > > > > >> > >
>> _____________________________________________________________
>> > > > > >> > > The information contained in this communication is intended
>> > > solely
>> > > > > for
>> > > > > >> > the
>> > > > > >> > > use of the individual or entity to whom it is addressed and
>> > > others
>> > > > > >> > > authorized to receive it. It may contain confidential or
>> > legally
>> > > > > >> > privileged
>> > > > > >> > > information. If you are not the intended recipient you are
>> > > hereby
>> > > > > >> > notified
>> > > > > >> > > that any disclosure, copying, distribution or taking any
>> > action
>> > > in
>> > > > > >> > reliance
>> > > > > >> > > on the contents of this information is strictly prohibited
>> and
>> > > may
>> > > > > be
>> > > > > >> > > unlawful. If you have received this communication in error,
>> > > please
>> > > > > >> notify
>> > > > > >> > > us immediately by responding to this email and then delete
>> it
>> > > from
>> > > > > >> your
>> > > > > >> > > system. The firm is neither liable for the proper and
>> complete
>> > > > > >> > transmission
>> > > > > >> > > of the information contained in this communication nor for
>> any
>> > > > delay
>> > > > > >> in
>> > > > > >> > its
>> > > > > >> > > receipt.
>> > > > > >> > >
>> > > > > >> >
>> > > > > >>
>> > > > > >> --
>> > > > > >> _____________________________________________________________
>> > > > > >> The information contained in this communication is intended
>> solely
>> > > for
>> > > > > the
>> > > > > >> use of the individual or entity to whom it is addressed and
>> others
>> > > > > >> authorized to receive it. It may contain confidential or
>> legally
>> > > > > >> privileged
>> > > > > >> information. If you are not the intended recipient you are
>> hereby
>> > > > > notified
>> > > > > >> that any disclosure, copying, distribution or taking any
>> action in
>> > > > > >> reliance
>> > > > > >> on the contents of this information is strictly prohibited and
>> may
>> > > be
>> > > > > >> unlawful. If you have received this communication in error,
>> please
>> > > > > notify
>> > > > > >> us immediately by responding to this email and then delete it
>> from
>> > > > your
>> > > > > >> system. The firm is neither liable for the proper and complete
>> > > > > >> transmission
>> > > > > >> of the information contained in this communication nor for any
>> > delay
>> > > > in
>> > > > > >> its
>> > > > > >> receipt.
>> > > > > >>
>> > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > > > --
>> > > > _____________________________________________________________
>> > > > The information contained in this communication is intended solely
>> for
>> > > the
>> > > > use of the individual or entity to whom it is addressed and others
>> > > > authorized to receive it. It may contain confidential or legally
>> > > privileged
>> > > > information. If you are not the intended recipient you are hereby
>> > > notified
>> > > > that any disclosure, copying, distribution or taking any action in
>> > > reliance
>> > > > on the contents of this information is strictly prohibited and may
>> be
>> > > > unlawful. If you have received this communication in error, please
>> > notify
>> > > > us immediately by responding to this email and then delete it from
>> your
>> > > > system. The firm is neither liable for the proper and complete
>> > > transmission
>> > > > of the information contained in this communication nor for any
>> delay in
>> > > its
>> > > > receipt.
>> > > >
>> > >
>> >
>>
>> --
>> _____________________________________________________________
>> The information contained in this communication is intended solely for the
>> use of the individual or entity to whom it is addressed and others
>> authorized to receive it. It may contain confidential or legally
>> privileged
>> information. If you are not the intended recipient you are hereby notified
>> that any disclosure, copying, distribution or taking any action in
>> reliance
>> on the contents of this information is strictly prohibited and may be
>> unlawful. If you have received this communication in error, please notify
>> us immediately by responding to this email and then delete it from your
>> system. The firm is neither liable for the proper and complete
>> transmission
>> of the information contained in this communication nor for any delay in
>> its
>> receipt.
>>
>
>
Re: Java action in Ooozie
Posted by Laurent H <la...@gmail.com>.
Is it possible to share with us your "sample jobs in oozie examples" ? (the
action of theses oozie examples of course)
--
Laurent HATIER - Consultant Big Data & Business Intelligence chez CapGemini
fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
<http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
2015-11-04 15:40 GMT+01:00 Serega Sheypak <se...@gmail.com>:
> Which job succeeded? What is attached?
> Other problem could be: you have resource starvation, there are no
> resources on RM to run your job. Did you check it?
>
> 2015-11-04 15:15 GMT+01:00 Jeetendra G <je...@housing.com>:
>
> > Also I verified there is no issue with my java class because when I run
> it
> > without oozie its works perfectly.
> >
> >
> > On Wed, Nov 4, 2015 at 7:43 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > it says job succeeded attaching
> > >
> > > On Wed, Nov 4, 2015 at 7:37 PM, Serega Sheypak <
> serega.sheypak@gmail.com
> > >
> > > wrote:
> > >
> > >> Hm... ok, can you see what happens on YARN RM web ui?
> > >> There should be a job that runs yuor oozie mapper launcher.
> > >>
> > >> 2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma <
> > >> jaydeep.vishwakarma@inmobi.com>:
> > >>
> > >> > Good, So not issue with Yarn or name node urls. Can you share stdout
> > >> logs.
> > >> >
> > >> >
> > >> > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <
> jeetendra.g@housing.com>
> > >> > wrote:
> > >> >
> > >> > > Hi Jaydeep here also I cant see any error below are the logs
> > >> > >
> > >> > > Log Type: syslog
> > >> > >
> > >> > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
> > >> > >
> > >> > > Log Length: 25565
> > >> > >
> > >> > > 2015-11-04 14:59:11,814 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created
> MRAppMaster
> > >> > > for application appattempt_1446620926630_0017_000001
> > >> > > 2015-11-04 14:59:12,144 WARN [main]
> > >> > > org.apache.hadoop.util.NativeCodeLoader: Unable to load
> > native-hadoop
> > >> > > library for your platform... using builtin-java classes where
> > >> > > applicable
> > >> > > 2015-11-04 14:59:12,184 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with
> > tokens:
> > >> > > 2015-11-04 14:59:12,292 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > >> > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId {
> application_id {
> > >> > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
> > >> > > -173762614)
> > >> > > 2015-11-04 14:59:12,293 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > >> > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident:
> (owner=hdfs,
> > >> > > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
> > >> > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> > >> > > 2015-11-04 14:59:12,890 WARN [main]
> > >> > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
> > >> > > short-circuit local reads feature cannot be used because libhadoop
> > >> > > cannot be loaded.
> > >> > > 2015-11-04 14:59:13,064 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter
> set
> > in
> > >> > > config null
> > >> > > 2015-11-04 14:59:13,065 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
> > >> > > org.apache.hadoop.mapred.FileOutputCommitter
> > >> > > 2015-11-04 14:59:13,110 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.jobhistory.EventType for class
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> > >> > > 2015-11-04 14:59:13,110 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for
> class
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> > >> > > 2015-11-04 14:59:13,111 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for
> class
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> > >> > > 2015-11-04 14:59:13,111 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType
> > for
> > >> > > class
> > >> > >
> > >>
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> > >> > > 2015-11-04 14:59:13,112 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for
> > class
> > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> > >> > > 2015-11-04 14:59:13,112 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType
> > for
> > >> > > class
> > >> > >
> > >>
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> > >> > > 2015-11-04 14:59:13,113 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType
> > for
> > >> > > class
> > >> > >
> > >>
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> > >> > > 2015-11-04 14:59:13,113 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > >
> > >>
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> > >> > > for class
> > >> > >
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> > >> > > 2015-11-04 14:59:13,144 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > >> > > file system is set solely by core-default.xml therefore -
> ignoring
> > >> > > 2015-11-04 14:59:13,170 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > >> > > file system is set solely by core-default.xml therefore -
> ignoring
> > >> > > 2015-11-04 14:59:13,189 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > >> > > file system is set solely by core-default.xml therefore -
> ignoring
> > >> > > 2015-11-04 14:59:13,219 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > >> > > Emitting job history data to the timeline server is not enabled
> > >> > > 2015-11-04 14:59:13,255 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type
> for
> > >> > > class
> > >> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> > >> > > 2015-11-04 14:59:13,453 WARN [main]
> > >> > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> > >> > > configuration: tried
> > >> > > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> > >> > > 2015-11-04 14:59:13,546 INFO [main]
> > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
> > snapshot
> > >> > > period at 10 second(s).
> > >> > > 2015-11-04 14:59:13,546 INFO [main]
> > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster
> > metrics
> > >> > > system started
> > >> > > 2015-11-04 14:59:13,557 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job
> > token
> > >> > > for job_1446620926630_0017 to jobTokenSecretManager
> > >> > > 2015-11-04 14:59:13,680 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
> > >> > > job_1446620926630_0017 because: not enabled; too much RAM;
> > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size
> for
> > >> > > job job_1446620926630_0017 = 0. Number of splits = 1
> > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of
> > reduces
> > >> > > for job job_1446620926630_0017 = 0
> > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from NEW to INITED
> > >> > > 2015-11-04 14:59:13,702 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster
> > launching
> > >> > > normal, non-uberized, multi-container job job_1446620926630_0017.
> > >> > > 2015-11-04 14:59:13,725 INFO [main]
> > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > >> > > java.util.concurrent.LinkedBlockingQueue
> > >> > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
> > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port
> > 39640
> > >> > > 2015-11-04 14:59:13,758 INFO [main]
> > >> > > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> > >> > > Adding protocol
> > org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
> > >> > > to the server
> > >> > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
> > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > >> > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
> > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640:
> starting
> > >> > > 2015-11-04 14:59:13,762 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
> > >> > > Instantiated MRClientService at
> > >> hadoop04.housing.com/10.21.1.138:39640
> > >> > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
> > >> > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> > >> > > org.mortbay.log.Slf4jLog
> > >> > > 2015-11-04 14:59:13,862 INFO [main]
> > >> > >
> > org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> > >> > > Unable to initialize FileSignerSecretProvider, falling back to use
> > >> > > random secrets.
> > >> > > 2015-11-04 14:59:13,867 WARN [main]
> > >> > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can only
> be
> > >> > > enabled using Log4j
> > >> > > 2015-11-04 14:59:13,874 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
> > >> > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> > >> > > 2015-11-04 14:59:13,878 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > >> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> > to
> > >> > > context mapreduce
> > >> > > 2015-11-04 14:59:13,879 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > >> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> > to
> > >> > > context static
> > >> > > 2015-11-04 14:59:13,882 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
> > >> > > 2015-11-04 14:59:13,882 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> > >> > > 2015-11-04 14:59:14,217 INFO [main]
> > >> > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice
> > modules
> > >> > > 2015-11-04 14:59:14,218 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> > >> > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log:
> > jetty-6.1.26.hwx
> > >> > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
> > >> > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> > >> > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
> > >> > > HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> > >> > > 2015-11-04 14:59:15,952 INFO [main]
> > >> > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started
> at
> > >> > > 49791
> > >> > > 2015-11-04 14:59:15,957 INFO [main]
> > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > >> > > java.util.concurrent.LinkedBlockingQueue
> > >> > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
> > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port
> > 50432
> > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
> > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
> > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432:
> starting
> > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > nodeBlacklistingEnabled:true
> > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > maxTaskFailuresPerNode is 3
> > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > blacklistDisablePercent is 33
> > >> > > 2015-11-04 14:59:16,035 INFO [main]
> > >> > > org.apache.hadoop.yarn.client.RMProxy: Connecting to
> ResourceManager
> > >> > > at hadoop02.housing.com/10.21.1.136:8030
> > >> > > 2015-11-04 14:59:16,113 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> > >> > > maxContainerCapability: <memory:5120, vCores:3>
> > >> > > 2015-11-04 14:59:16,113 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue:
> default
> > >> > > 2015-11-04 14:59:16,117 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Upper limit on the thread pool size is 500
> > >> > > 2015-11-04 14:59:16,118 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > The
> > >> > > thread pool initial size is 10
> > >> > > 2015-11-04 14:59:16,120 INFO [main]
> > >> > >
> > >>
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > >> > > yarn.client.max-cached-nodemanagers-proxies : 0
> > >> > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from INITED to SETUP
> > >> > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
> > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > >> > > Processing the event EventType: JOB_SETUP
> > >> > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
> > >> > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
> > >> > > Output Committer Algorithm version is 1
> > >> > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> > >> > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > >> > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to
> > >> > > SCHEDULED
> > >> > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > NEW to UNASSIGNED
> > >> > > 2015-11-04 14:59:16,202 INFO [Thread-51]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > >> > > mapResourceRequest:<memory:1536, vCores:1>
> > >> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Event
> > >> > > Writer setup for JobId: job_1446620926630_0017, File:
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > >> > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> > >> > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
> > >> > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > >> > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> > >> > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > getResources() for application_1446620926630_0017: ask=1 release=
> 0
> > >> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
> > >> > > vCores:1> knownNMs=5
> > >> > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
> > >> > > allocated containers 1
> > >> > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > >> > > hadoop04.housing.com to /default-rack
> > >> > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> Assigned
> > >> > > container container_e02_1446620926630_0017_01_000002 to
> > >> > > attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> > >> > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> > >> > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > >> > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > >> > > hadoop04.housing.com to /default-rack
> > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job
> jar
> > >> > > is not present. Not adding any jar to the list of resources.
> > >> > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
> > >> > > job-conf file on the remote FS is
> > >> > > /user/hdfs/.staging/job_1446620926630_0017/job.xml
> > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> Adding
> > #1
> > >> > > tokens and #1 secret keys for NM use for launching container
> > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size
> of
> > >> > > containertokens_dob is 2
> > >> > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> Putting
> > >> > > shuffle token in serviceData
> > >> > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > UNASSIGNED to ASSIGNED
> > >> > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for
> > container
> > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > >> > > attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Launching attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
> > >> > >
> > >>
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > >> > > Opening proxy : hadoop04.housing.com:45454
> > >> > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Shuffle port returned by ContainerManager for
> > >> > > attempt_1446620926630_0017_m_000000_0 : 13562
> > >> > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
> > >> > > containerId: [container_e02_1446620926630_0017_01_000002 on NM:
> > >> > > [hadoop04.housing.com:45454]
> > >> > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > ASSIGNED to RUNNING
> > >> > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > >> > > task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED
> to
> > >> > > RUNNING
> > >> > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > getResources() for application_1446620926630_0017: ask=1 release=
> 0
> > >> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
> > >> > > vCores:1> knownNMs=5
> > >> > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
> > >> > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
> > >> > > job_1446620926630_0017 (auth:SIMPLE)
> > >> > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
> > >> > > jvm_1446620926630_0017_m_2199023255554 asked for a task
> > >> > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> > >> > > jvm_1446620926630_0017_m_2199023255554 given task:
> > >> > > attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> > >> > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending
> > state
> > >> > > update from attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > RUNNING to COMMIT_PENDING
> > >> > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 given a go for committing
> the
> > >> > > task output.
> > >> > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
> > >> > > request from attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
> > >> > > canCommit for attempt_1446620926630_0017_m_000000_0:true
> > >> > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> > >> > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done
> > acknowledgement
> > >> > > from attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> > >> > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for
> > container
> > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > >> > > attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > KILLING attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > >> > >
> > >>
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > >> > > Opening proxy : hadoop04.housing.com:45454
> > >> > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task
> succeeded
> > >> > > with attempt attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > >> > > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
> > >> > > SUCCEEDED
> > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
> > >> > > Tasks: 1
> > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
> > >> > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
> > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > >> > > Processing the event EventType: JOB_COMMIT
> > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling
> handler
> > >> > > for JobFinishedEvent
> > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from COMMITTING to
> SUCCEEDED
> > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
> > >> > > cleanly so this is the last retry
> > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify
> > RMCommunicator
> > >> > > isAMLastRetry: true
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> RMCommunicator
> > >> > > notified that shouldUnregistered is: true
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
> > >> > > isAMLastRetry: true
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > >> > > JobHistoryEventHandler notified that forceJobCompletion is true
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for
> all
> > >> > > the services
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > >> > > Stopping JobHistoryEventHandler. Size of the outstanding queue
> size
> > is
> > >> > > 0
> > >> > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Copying
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > >> > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Copied
> > >> > > to done location:
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > >> > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Copying
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > >> > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Copied
> > >> > > to done location:
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > >> > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Moved
> > >> > > tmp to done: hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> > >> > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Moved
> > >> > > tmp to done: hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> > >> > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Moved
> > >> > > tmp to done: hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> > >> > > 2015-11-04 14:59:22,965 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Stopped
> > >> > > JobHistoryEventHandler. super.stop()
> > >> > > 2015-11-04 14:59:22,968 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
> > >> > > diagnostics to
> > >> > > 2015-11-04 14:59:22,969 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url
> is
> > >> > >
> > >>
> http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> > >> > > 2015-11-04 14:59:22,976 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
> > >> > > application to be successfully unregistered.
> > >> > > 2015-11-04 14:59:23,979 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
> > >> > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> AssignedMaps:1
> > >> > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1
> ContRel:0
> > >> > > HostLocal:0 RackLocal:0
> > >> > > 2015-11-04 14:59:23,980 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
> > >> > > directory hdfs://hadoop01.housing.com:8020
> > >> > > /user/hdfs/.staging/job_1446620926630_0017
> > >> > > 2015-11-04 14:59:23,984 INFO [Thread-67]
> > org.apache.hadoop.ipc.Server:
> > >> > > Stopping server on 50432
> > >> > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
> > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on
> 50432
> > >> > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
> > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> > >> > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
> > >> > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
> > >> > > TaskHeartbeatHandler thread interrupted
> > >> > >
> > >> > >
> > >> > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> > >> > > jaydeep.vishwakarma@inmobi.com> wrote:
> > >> > >
> > >> > > > In first look I am not seeing any issue with job tracker or name
> > >> node
> > >> > > URL.
> > >> > > > The job id is getting generated. Workflow Job is not going on
> > PREP
> > >> > mode.
> > >> > > >
> > >> > > > Open this link.
> > >> > > >
> > >>
> http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
> > >> > > >
> > >> > > > You will be see the problem.
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <
> > >> jeetendra.g@housing.com>
> > >> > > > wrote:
> > >> > > >
> > >> > > > > hey Serega I have cross verified jobTracker value is correct
> > only
> > >> I
> > >> > am
> > >> > > > > using yarn so resource manager will become the job tracker?
> > >> > > > >
> > >> > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
> > >> > > serega.sheypak@gmail.com
> > >> > > > >
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > > > Can you go to oozie server and grab logs from there? My
> > >> assumption
> > >> > > that
> > >> > > > > > <job-tracker>${jobTracker}</job-tracker>
> > >> > > > > > <name-node>${nameNode}</name-node>
> > >> > > > > >
> > >> > > > > > have incorrect values. Probably ${jobTracker} is wrong and
> > oozie
> > >> > > can't
> > >> > > > > even
> > >> > > > > > start launcher mapper.
> > >> > > > > >
> > >> > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > >> > > > > > jaydeep.vishwakarma@inmobi.com>:
> > >> > > > > >
> > >> > > > > > > You are doing -log. Can you give the command as below and
> > get
> > >> the
> > >> > > job
> > >> > > > > url
> > >> > > > > > > (application launcher url).
> > >> > > > > > >
> > >> > > > > > > *oozie job -info
> > >> 0000040-151015123257993-oozie-oozi-W@java-node*
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
> > >> > > jeetendra.g@housing.com
> > >> > > > >
> > >> > > > > > > wrote:
> > >> > > > > > >
> > >> > > > > > > > and in job error log tab its saying error log is
> disables?
> > >> by
> > >> > > > default
> > >> > > > > > why
> > >> > > > > > > > error log is disables? i am using hortonworks
> > >> > > > > > > >
> > >> > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> > >> > > > jeetendra.g@housing.com
> > >> > > > > >
> > >> > > > > > > > wrote:
> > >> > > > > > > >
> > >> > > > > > > > > same error.
> > >> > > > > > > > >
> > >> > > > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > >> Start
> > >> > > > action
> > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with
> > >> > user-retry
> > >> > > > > > state :
> > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > >> [10]
> > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> > >> :start:***]Action
> > >> > > > > > status=DONE
> > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> > >> :start:***]Action
> > >> > > > updated
> > >> > > > > > in
> > >> > > > > > > > DB!
> > >> > > > > > > > > 2015-11-04 14:09:00,994 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> No
> > >> > > > > Notification
> > >> > > > > > > URL
> > >> > > > > > > > > is defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > >> > > > > > > > > 2015-11-04 14:09:01,004 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > >> > > > Notification
> > >> > > > > > URL
> > >> > > > > > > is
> > >> > > > > > > > > defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > >> > > > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> Start
> > >> > > > > action
> > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with
> > >> > > user-retry
> > >> > > > > > > state :
> > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > >> [10]
> > >> > > > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > checking
> > >> > > > > > > action,
> > >> > > > > > > > > hadoop job ID [job_1446620926630_0016] status
> [RUNNING]
> > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> > >> ***]Action
> > >> > > > > > > > > status=RUNNING
> > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> > >> ***]Action
> > >> > > > > updated
> > >> > > > > > > in
> > >> > > > > > > > > DB!
> > >> > > > > > > > > 2015-11-04 14:09:02,926 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > No
> > >> > > > > > Notification
> > >> > > > > > > > > URL is defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > >> > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 -
> > >> SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > callback
> > >> > > > > for
> > >> > > > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > action
> > >> > > > > > > completed,
> > >> > > > > > > > > external ID [job_1446620926630_0016]
> > >> > > > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> Start
> > >> > action
> > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with
> > >> user-retry
> > >> > > > state :
> > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > >> [10]
> > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end
> ***]Action
> > >> > > > status=DONE
> > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end
> ***]Action
> > >> > updated
> > >> > > > in
> > >> > > > > > DB!
> > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
> > >> > > Notification
> > >> > > > > URL
> > >> > > > > > > is
> > >> > > > > > > > > defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > >> > > > Notification
> > >> > > > > > URL
> > >> > > > > > > is
> > >> > > > > > > > > defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > >> > > > > > > > > 2015-11-04 14:09:18,105 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > No
> > >> > > > > > Notification
> > >> > > > > > > > > URL is defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > >> > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > >> > > > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > >> > > > > > > > >
> > >> > > > > > > > >> oozie job -info
> > >> > 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > > > >> There you will find "Console URL" , Open that URL on
> > >> > browser.
> > >> > > > You
> > >> > > > > > will
> > >> > > > > > > > get
> > >> > > > > > > > >> the Launcher mapper logs.
> > >> > > > > > > > >>
> > >> > > > > > > > >>
> > >> > > > > > > > >>
> > >> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > >> > > > > > jeetendra.g@housing.com>
> > >> > > > > > > > >> wrote:
> > >> > > > > > > > >>
> > >> > > > > > > > >> > This is the log i am getting repeatedly
> > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > >> > > > WorkflowNotificationXCommand:520 -
> > >> > > > > > > > SERVER[
> > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@
> :start:]
> > >> No
> > >> > > > > > > Notification
> > >> > > > > > > > >> URL
> > >> > > > > > > > >> > is
> > >> > > > > > > > >> > defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > >> > > > WorkflowNotificationXCommand:520 -
> > >> > > > > > > > SERVER[
> > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[]
> No
> > >> > > > > Notification
> > >> > > > > > > URL
> > >> > > > > > > > >> is
> > >> > > > > > > > >> > defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > >> > > > > > > > >> >
> > >> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep
> Vishwakarma <
> > >> > > > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > >> > > > > > > > >> >
> > >> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What it
> > says?
> > >> > > > > > > > >> > >
> > >> > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > >> > > > > > > > jeetendra.g@housing.com>
> > >> > > > > > > > >> > > wrote:
> > >> > > > > > > > >> > >
> > >> > > > > > > > >> > > > does anybody have any idea? i have been trying
> > this
> > >> > from
> > >> > > > 10
> > >> > > > > > days
> > >> > > > > > > > >> > nothing
> > >> > > > > > > > >> > > > worked out.
> > >> > > > > > > > >> > > >
> > >> > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > >> > > > > > > > >> jeetendra.g@housing.com>
> > >> > > > > > > > >> > > > wrote:
> > >> > > > > > > > >> > > >
> > >> > > > > > > > >> > > > > my workflow.xml
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > >> > > > > > > > name="java-main-wf">
> > >> > > > > > > > >> > > > > <start to="java-node"/>
> > >> > > > > > > > >> > > > > <action name="java-node">
> > >> > > > > > > > >> > > > > <java>
> > >> > > > > > > > >> > > > >
> > >> <job-tracker>${jobTracker}</job-tracker>
> > >> > > > > > > > >> > > > >
> <name-node>${nameNode}</name-node>
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > >> > > > > > > > >> > > > >
> > >> > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > >> > > > > > > > >> > > > >
> > >> 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > >> > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > > </java>
> > >> > > > > > > > >> > > > > <ok to="end"/>
> > >> > > > > > > > >> > > > > <error to="fail"/>
> > >> > > > > > > > >> > > > > </action>
> > >> > > > > > > > >> > > > > <kill name="fail">
> > >> > > > > > > > >> > > > > <message>Java failed, error
> > >> > > > > > > > >> > > > >
> > >> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > >> > > > > > > > >> > > > > </kill>
> > >> > > > > > > > >> > > > > <end name="end"/>
> > >> > > > > > > > >> > > > > </workflow-app>
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G
> <
> > >> > > > > > > > >> > jeetendra.g@housing.com>
> > >> > > > > > > > >> > > > > wrote:
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > >> Hi All,
> > >> > > > > > > > >> > > > >>
> > >> > > > > > > > >> > > > >> I am running java workflow job using oozie.
> > >> > > > > > > > >> > > > >> I have Ambari server and I have installed
> > oozie
> > >> > from
> > >> > > > > > Ambari.
> > >> > > > > > > > >> > > > >> When i ran the job it say succeeded but its
> > not
> > >> > > running
> > >> > > > > my
> > >> > > > > > > java
> > >> > > > > > > > >> > class
> > >> > > > > > > > >> > > > >> which I mentioned inside workflow.xml. Also
> > >> when I
> > >> > > get
> > >> > > > > > oozie
> > >> > > > > > > > >> > nothing
> > >> > > > > > > > >> > > > can
> > >> > > > > > > > >> > > > >> be find pasting log beow, can anybody help
> > here?
> > >> > > > > > > > >> > > > >> oozie job -oozie
> > >> > > > http://hadoop03.housing.com:11000/oozie
> > >> > > > > > > -log
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > >> > :start:]
> > >> > > > > Start
> > >> > > > > > > > >> action
> > >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@
> > :start:]
> > >> > with
> > >> > > > > > > user-retry
> > >> > > > > > > > >> > state
> > >> > > > > > > > >> > > :
> > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > >> > > userRetryInterval
> > >> > > > > > [10]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > >> > :start:]
> > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > >> > > > > :start:***]Action
> > >> > > > > > > > >> > > status=DONE
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > >> > :start:]
> > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > >> > > > > :start:***]Action
> > >> > > > > > > > >> updated
> > >> > > > > > > > >> > in
> > >> > > > > > > > >> > > > DB!
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > >> > :start:]
> > >> > > > No
> > >> > > > > > > > >> > Notification
> > >> > > > > > > > >> > > > URL
> > >> > > > > > > > >> > > > >> is defined. Therefore nothing to notify for
> > job
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@
> :start:
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[]
> > >> > No
> > >> > > > > > > > >> Notification
> > >> > > > > > > > >> > URL
> > >> > > > > > > > >> > > > is
> > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > Start
> > >> > > > > > > > >> action
> > >> > > > > > > > >> > > > >>
> > [0000040-151015123257993-oozie-oozi-W@java-node
> > >> ]
> > >> > > with
> > >> > > > > > > > user-retry
> > >> > > > > > > > >> > > state
> > >> > > > > > > > >> > > > :
> > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > >> > > userRetryInterval
> > >> > > > > > [10]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO
> > >> > JavaActionExecutor:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > > checking
> > >> > > > > > > > >> > > action,
> > >> > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073]
> status
> > >> > > [RUNNING]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > > >> > > > >>
> > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > ***]Action
> > >> > > > > > > > >> > > > >> status=RUNNING
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > > >> > > > >>
> > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > ***]Action
> > >> > > > > > > > >> > updated
> > >> > > > > > > > >> > > in
> > >> > > > > > > > >> > > > >> DB!
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > No
> > >> > > > > > > > >> > > Notification
> > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify
> > for
> > >> job
> > >> > > > > > > > >> > > > >>
> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO
> > >> CallbackServlet:520 -
> > >> > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > > callback
> > >> > > > > > > > >> for
> > >> > > > > > > > >> > > > >> action
> > >> > > [0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > ]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO
> > >> > JavaActionExecutor:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > action
> > >> > > > > > > > >> > > > completed,
> > >> > > > > > > > >> > > > >> external ID [job_1444892488693_0073]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > >> ]
> > >> > > Start
> > >> > > > > > > action
> > >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end]
> > with
> > >> > > > > user-retry
> > >> > > > > > > > >> state :
> > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > >> > > userRetryInterval
> > >> > > > > > [10]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > >> ]
> > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> > >> > > ***]Action
> > >> > > > > > > > >> status=DONE
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > >> ]
> > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> > >> > > ***]Action
> > >> > > > > > > updated
> > >> > > > > > > > >> in
> > >> > > > > > > > >> > DB!
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > >> ]
> > >> > No
> > >> > > > > > > > Notification
> > >> > > > > > > > >> > URL
> > >> > > > > > > > >> > > is
> > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[]
> > >> > No
> > >> > > > > > > > >> Notification
> > >> > > > > > > > >> > URL
> > >> > > > > > > > >> > > > is
> > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > No
> > >> > > > > > > > >> > > Notification
> > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify
> > for
> > >> job
> > >> > > > > > > > >> > > > >>
> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > > > >> > > > >>
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > >
> > >> > > > > > > > >> > >
> > >> > > > > > > > >> > > --
> > >> > > > > > > > >> > >
> > >> > > > _____________________________________________________________
> > >> > > > > > > > >> > > The information contained in this communication
> is
> > >> > > intended
> > >> > > > > > solely
> > >> > > > > > > > for
> > >> > > > > > > > >> > the
> > >> > > > > > > > >> > > use of the individual or entity to whom it is
> > >> addressed
> > >> > > and
> > >> > > > > > others
> > >> > > > > > > > >> > > authorized to receive it. It may contain
> > >> confidential or
> > >> > > > > legally
> > >> > > > > > > > >> > privileged
> > >> > > > > > > > >> > > information. If you are not the intended
> recipient
> > >> you
> > >> > are
> > >> > > > > > hereby
> > >> > > > > > > > >> > notified
> > >> > > > > > > > >> > > that any disclosure, copying, distribution or
> > taking
> > >> any
> > >> > > > > action
> > >> > > > > > in
> > >> > > > > > > > >> > reliance
> > >> > > > > > > > >> > > on the contents of this information is strictly
> > >> > prohibited
> > >> > > > and
> > >> > > > > > may
> > >> > > > > > > > be
> > >> > > > > > > > >> > > unlawful. If you have received this communication
> > in
> > >> > > error,
> > >> > > > > > please
> > >> > > > > > > > >> notify
> > >> > > > > > > > >> > > us immediately by responding to this email and
> then
> > >> > delete
> > >> > > > it
> > >> > > > > > from
> > >> > > > > > > > >> your
> > >> > > > > > > > >> > > system. The firm is neither liable for the proper
> > and
> > >> > > > complete
> > >> > > > > > > > >> > transmission
> > >> > > > > > > > >> > > of the information contained in this
> communication
> > >> nor
> > >> > for
> > >> > > > any
> > >> > > > > > > delay
> > >> > > > > > > > >> in
> > >> > > > > > > > >> > its
> > >> > > > > > > > >> > > receipt.
> > >> > > > > > > > >> > >
> > >> > > > > > > > >> >
> > >> > > > > > > > >>
> > >> > > > > > > > >> --
> > >> > > > > > > > >>
> > >> > _____________________________________________________________
> > >> > > > > > > > >> The information contained in this communication is
> > >> intended
> > >> > > > solely
> > >> > > > > > for
> > >> > > > > > > > the
> > >> > > > > > > > >> use of the individual or entity to whom it is
> addressed
> > >> and
> > >> > > > others
> > >> > > > > > > > >> authorized to receive it. It may contain confidential
> > or
> > >> > > legally
> > >> > > > > > > > >> privileged
> > >> > > > > > > > >> information. If you are not the intended recipient
> you
> > >> are
> > >> > > > hereby
> > >> > > > > > > > notified
> > >> > > > > > > > >> that any disclosure, copying, distribution or taking
> > any
> > >> > > action
> > >> > > > in
> > >> > > > > > > > >> reliance
> > >> > > > > > > > >> on the contents of this information is strictly
> > >> prohibited
> > >> > and
> > >> > > > may
> > >> > > > > > be
> > >> > > > > > > > >> unlawful. If you have received this communication in
> > >> error,
> > >> > > > please
> > >> > > > > > > > notify
> > >> > > > > > > > >> us immediately by responding to this email and then
> > >> delete
> > >> > it
> > >> > > > from
> > >> > > > > > > your
> > >> > > > > > > > >> system. The firm is neither liable for the proper and
> > >> > complete
> > >> > > > > > > > >> transmission
> > >> > > > > > > > >> of the information contained in this communication
> nor
> > >> for
> > >> > any
> > >> > > > > delay
> > >> > > > > > > in
> > >> > > > > > > > >> its
> > >> > > > > > > > >> receipt.
> > >> > > > > > > > >>
> > >> > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > > > --
> > >> > > > > > >
> > _____________________________________________________________
> > >> > > > > > > The information contained in this communication is
> intended
> > >> > solely
> > >> > > > for
> > >> > > > > > the
> > >> > > > > > > use of the individual or entity to whom it is addressed
> and
> > >> > others
> > >> > > > > > > authorized to receive it. It may contain confidential or
> > >> legally
> > >> > > > > > privileged
> > >> > > > > > > information. If you are not the intended recipient you are
> > >> hereby
> > >> > > > > > notified
> > >> > > > > > > that any disclosure, copying, distribution or taking any
> > >> action
> > >> > in
> > >> > > > > > reliance
> > >> > > > > > > on the contents of this information is strictly prohibited
> > and
> > >> > may
> > >> > > be
> > >> > > > > > > unlawful. If you have received this communication in
> error,
> > >> > please
> > >> > > > > notify
> > >> > > > > > > us immediately by responding to this email and then delete
> > it
> > >> > from
> > >> > > > your
> > >> > > > > > > system. The firm is neither liable for the proper and
> > complete
> > >> > > > > > transmission
> > >> > > > > > > of the information contained in this communication nor for
> > any
> > >> > > delay
> > >> > > > in
> > >> > > > > > its
> > >> > > > > > > receipt.
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > > > --
> > >> > > > _____________________________________________________________
> > >> > > > The information contained in this communication is intended
> solely
> > >> for
> > >> > > the
> > >> > > > use of the individual or entity to whom it is addressed and
> others
> > >> > > > authorized to receive it. It may contain confidential or legally
> > >> > > privileged
> > >> > > > information. If you are not the intended recipient you are
> hereby
> > >> > > notified
> > >> > > > that any disclosure, copying, distribution or taking any action
> in
> > >> > > reliance
> > >> > > > on the contents of this information is strictly prohibited and
> may
> > >> be
> > >> > > > unlawful. If you have received this communication in error,
> please
> > >> > notify
> > >> > > > us immediately by responding to this email and then delete it
> from
> > >> your
> > >> > > > system. The firm is neither liable for the proper and complete
> > >> > > transmission
> > >> > > > of the information contained in this communication nor for any
> > >> delay in
> > >> > > its
> > >> > > > receipt.
> > >> > > >
> > >> > >
> > >> >
> > >> > --
> > >> > _____________________________________________________________
> > >> > The information contained in this communication is intended solely
> for
> > >> the
> > >> > use of the individual or entity to whom it is addressed and others
> > >> > authorized to receive it. It may contain confidential or legally
> > >> privileged
> > >> > information. If you are not the intended recipient you are hereby
> > >> notified
> > >> > that any disclosure, copying, distribution or taking any action in
> > >> reliance
> > >> > on the contents of this information is strictly prohibited and may
> be
> > >> > unlawful. If you have received this communication in error, please
> > >> notify
> > >> > us immediately by responding to this email and then delete it from
> > your
> > >> > system. The firm is neither liable for the proper and complete
> > >> transmission
> > >> > of the information contained in this communication nor for any delay
> > in
> > >> its
> > >> > receipt.
> > >> >
> > >>
> > >
> > >
> >
>
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
Thanks Jaydeep fir help. One clue i have got oozie might have save output
somewhere else? see below logs.
but when I go to this location there is no data.my java code will read the
directory and merge the small files into one bigger file in the same place.
by default where oozie write the output?
2015-11-05 14:02:04,270 INFO [main]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of
task 'attempt_1446620926630_0034_m_000000_0' to hdfs://
hadoop01.housing.com:8020/user/hdfs/oozie-oozi/0000000-151105115318391-oozie-oozi-W/java-node--java/output/_temporary/1/task_1446620926630_0034_m_000000
2015-11-05 14:02:04,318 INFO [main] org.apache.hadoop.mapred.Task: Task
'attempt_1446620926630_0034_m_000000_0' done.
End of LogType:syslog
On Thu, Nov 5, 2015 at 2:05 PM, Jaydeep Vishwakarma <
jaydeep.vishwakarma@inmobi.com> wrote:
> Stdout logs will have some data in any case. As Oozie launcher writes N
> number of information using System.out.print. You might be having even std
> err as well which it is not coming.
>
> Try to see the logs form command prompt for application Id by following
> command.
> yarn logs -applicationId <application ID>
>
> If logs are still missing try to find in userlogs or do the debugging.
>
> On Thu, Nov 5, 2015 at 1:22 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > @ Serega:There are enough resources there is no resource starvation.
> >
> >
> > On Wed, Nov 4, 2015 at 8:10 PM, Serega Sheypak <serega.sheypak@gmail.com
> >
> > wrote:
> >
> > > Which job succeeded? What is attached?
> > > Other problem could be: you have resource starvation, there are no
> > > resources on RM to run your job. Did you check it?
> > >
> > > 2015-11-04 15:15 GMT+01:00 Jeetendra G <je...@housing.com>:
> > >
> > > > Also I verified there is no issue with my java class because when I
> run
> > > it
> > > > without oozie its works perfectly.
> > > >
> > > >
> > > > On Wed, Nov 4, 2015 at 7:43 PM, Jeetendra G <jeetendra.g@housing.com
> >
> > > > wrote:
> > > >
> > > > > it says job succeeded attaching
> > > > >
> > > > > On Wed, Nov 4, 2015 at 7:37 PM, Serega Sheypak <
> > > serega.sheypak@gmail.com
> > > > >
> > > > > wrote:
> > > > >
> > > > >> Hm... ok, can you see what happens on YARN RM web ui?
> > > > >> There should be a job that runs yuor oozie mapper launcher.
> > > > >>
> > > > >> 2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma <
> > > > >> jaydeep.vishwakarma@inmobi.com>:
> > > > >>
> > > > >> > Good, So not issue with Yarn or name node urls. Can you share
> > stdout
> > > > >> logs.
> > > > >> >
> > > > >> >
> > > > >> > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <
> > > jeetendra.g@housing.com>
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Hi Jaydeep here also I cant see any error below are the logs
> > > > >> > >
> > > > >> > > Log Type: syslog
> > > > >> > >
> > > > >> > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
> > > > >> > >
> > > > >> > > Log Length: 25565
> > > > >> > >
> > > > >> > > 2015-11-04 14:59:11,814 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created
> > > MRAppMaster
> > > > >> > > for application appattempt_1446620926630_0017_000001
> > > > >> > > 2015-11-04 14:59:12,144 WARN [main]
> > > > >> > > org.apache.hadoop.util.NativeCodeLoader: Unable to load
> > > > native-hadoop
> > > > >> > > library for your platform... using builtin-java classes where
> > > > >> > > applicable
> > > > >> > > 2015-11-04 14:59:12,184 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with
> > > > tokens:
> > > > >> > > 2015-11-04 14:59:12,292 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > > > >> > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId {
> > > application_id {
> > > > >> > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 }
> keyId:
> > > > >> > > -173762614)
> > > > >> > > 2015-11-04 14:59:12,293 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > > > >> > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident:
> > > (owner=hdfs,
> > > > >> > > renewer=oozie mr token, realUser=oozie,
> issueDate=1446629349951,
> > > > >> > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> > > > >> > > 2015-11-04 14:59:12,890 WARN [main]
> > > > >> > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
> > > > >> > > short-circuit local reads feature cannot be used because
> > libhadoop
> > > > >> > > cannot be loaded.
> > > > >> > > 2015-11-04 14:59:13,064 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster:
> OutputCommitter
> > > set
> > > > in
> > > > >> > > config null
> > > > >> > > 2015-11-04 14:59:13,065 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster:
> OutputCommitter
> > is
> > > > >> > > org.apache.hadoop.mapred.FileOutputCommitter
> > > > >> > > 2015-11-04 14:59:13,110 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.EventType for class
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> > > > >> > > 2015-11-04 14:59:13,110 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for
> > > class
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> > > > >> > > 2015-11-04 14:59:13,111 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for
> > > class
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> > > > >> > > 2015-11-04 14:59:13,111 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType
> > > > for
> > > > >> > > class
> > > > >> > >
> > > > >>
> > > >
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> > > > >> > > 2015-11-04 14:59:13,112 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType
> for
> > > > class
> > > > >> > >
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> > > > >> > > 2015-11-04 14:59:13,112 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType
> > > > for
> > > > >> > > class
> > > > >> > >
> > > > >>
> > >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> > > > >> > > 2015-11-04 14:59:13,113 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType
> > > > for
> > > > >> > > class
> > > > >> > >
> > > > >>
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> > > > >> > > 2015-11-04 14:59:13,113 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > >
> > > > >>
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> > > > >> > > for class
> > > > >> > >
> > > >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> > > > >> > > 2015-11-04 14:59:13,144 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils:
> > Default
> > > > >> > > file system is set solely by core-default.xml therefore -
> > > ignoring
> > > > >> > > 2015-11-04 14:59:13,170 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils:
> > Default
> > > > >> > > file system is set solely by core-default.xml therefore -
> > > ignoring
> > > > >> > > 2015-11-04 14:59:13,189 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils:
> > Default
> > > > >> > > file system is set solely by core-default.xml therefore -
> > > ignoring
> > > > >> > > 2015-11-04 14:59:13,219 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > > >> > > Emitting job history data to the timeline server is not
> enabled
> > > > >> > > 2015-11-04 14:59:13,255 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering
> class
> > > > >> > >
> org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type
> > > for
> > > > >> > > class
> > > > >> >
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> > > > >> > > 2015-11-04 14:59:13,453 WARN [main]
> > > > >> > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> > > > >> > > configuration: tried
> > > > >> > >
> > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> > > > >> > > 2015-11-04 14:59:13,546 INFO [main]
> > > > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
> > > > snapshot
> > > > >> > > period at 10 second(s).
> > > > >> > > 2015-11-04 14:59:13,546 INFO [main]
> > > > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster
> > > > metrics
> > > > >> > > system started
> > > > >> > > 2015-11-04 14:59:13,557 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding
> job
> > > > token
> > > > >> > > for job_1446620926630_0017 to jobTokenSecretManager
> > > > >> > > 2015-11-04 14:59:13,680 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not
> > uberizing
> > > > >> > > job_1446620926630_0017 because: not enabled; too much RAM;
> > > > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input
> size
> > > for
> > > > >> > > job job_1446620926630_0017 = 0. Number of splits = 1
> > > > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of
> > > > reduces
> > > > >> > > for job job_1446620926630_0017 = 0
> > > > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > > >> > > job_1446620926630_0017Job Transitioned from NEW to INITED
> > > > >> > > 2015-11-04 14:59:13,702 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster
> > > > launching
> > > > >> > > normal, non-uberized, multi-container job
> > job_1446620926630_0017.
> > > > >> > > 2015-11-04 14:59:13,725 INFO [main]
> > > > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > > > >> > > java.util.concurrent.LinkedBlockingQueue
> > > > >> > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
> > > > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for
> port
> > > > 39640
> > > > >> > > 2015-11-04 14:59:13,758 INFO [main]
> > > > >> > >
> org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> > > > >> > > Adding protocol
> > > > org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
> > > > >> > > to the server
> > > > >> > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
> > > > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > > > >> > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
> > > > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640:
> > > starting
> > > > >> > > 2015-11-04 14:59:13,762 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
> > > > >> > > Instantiated MRClientService at
> > > > >> hadoop04.housing.com/10.21.1.138:39640
> > > > >> > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging
> to
> > > > >> > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> > > > >> > > org.mortbay.log.Slf4jLog
> > > > >> > > 2015-11-04 14:59:13,862 INFO [main]
> > > > >> > >
> > > >
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> > > > >> > > Unable to initialize FileSignerSecretProvider, falling back to
> > use
> > > > >> > > random secrets.
> > > > >> > > 2015-11-04 14:59:13,867 WARN [main]
> > > > >> > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can
> > only
> > > be
> > > > >> > > enabled using Log4j
> > > > >> > > 2015-11-04 14:59:13,874 INFO [main]
> > > > >> > > org.apache.hadoop.http.HttpServer2: Added global filter
> 'safety'
> > > > >> > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> > > > >> > > 2015-11-04 14:59:13,878 INFO [main]
> > > > >> > > org.apache.hadoop.http.HttpServer2: Added filter
> AM_PROXY_FILTER
> > > > >> > >
> > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> > > > to
> > > > >> > > context mapreduce
> > > > >> > > 2015-11-04 14:59:13,879 INFO [main]
> > > > >> > > org.apache.hadoop.http.HttpServer2: Added filter
> AM_PROXY_FILTER
> > > > >> > >
> > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> > > > to
> > > > >> > > context static
> > > > >> > > 2015-11-04 14:59:13,882 INFO [main]
> > > > >> > > org.apache.hadoop.http.HttpServer2: adding path spec:
> > /mapreduce/*
> > > > >> > > 2015-11-04 14:59:13,882 INFO [main]
> > > > >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> > > > >> > > 2015-11-04 14:59:14,217 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice
> > > > modules
> > > > >> > > 2015-11-04 14:59:14,218 INFO [main]
> > > > >> > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> > > > >> > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log:
> > > > jetty-6.1.26.hwx
> > > > >> > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
> > > > >> > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> > > > >> > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
> > > > >> > > HttpServer2$
> SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> > > > >> > > 2015-11-04 14:59:15,952 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce
> > started
> > > at
> > > > >> > > 49791
> > > > >> > > 2015-11-04 14:59:15,957 INFO [main]
> > > > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > > > >> > > java.util.concurrent.LinkedBlockingQueue
> > > > >> > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
> > > > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for
> port
> > > > 50432
> > > > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
> > > > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > > > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
> > > > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432:
> > > starting
> > > > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > > >> > > nodeBlacklistingEnabled:true
> > > > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > > >> > > maxTaskFailuresPerNode is 3
> > > > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > > >> > > blacklistDisablePercent is 33
> > > > >> > > 2015-11-04 14:59:16,035 INFO [main]
> > > > >> > > org.apache.hadoop.yarn.client.RMProxy: Connecting to
> > > ResourceManager
> > > > >> > > at hadoop02.housing.com/10.21.1.136:8030
> > > > >> > > 2015-11-04 14:59:16,113 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> > > > >> > > maxContainerCapability: <memory:5120, vCores:3>
> > > > >> > > 2015-11-04 14:59:16,113 INFO [main]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue:
> > > default
> > > > >> > > 2015-11-04 14:59:16,117 INFO [main]
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > > >> > > Upper limit on the thread pool size is 500
> > > > >> > > 2015-11-04 14:59:16,118 INFO [main]
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > > The
> > > > >> > > thread pool initial size is 10
> > > > >> > > 2015-11-04 14:59:16,120 INFO [main]
> > > > >> > >
> > > > >>
> > >
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > > >> > > yarn.client.max-cached-nodemanagers-proxies : 0
> > > > >> > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > > >> > > job_1446620926630_0017Job Transitioned from INITED to SETUP
> > > > >> > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
> > > > >> > >
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > > > >> > > Processing the event EventType: JOB_SETUP
> > > > >> > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
> > > > >> > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:
> File
> > > > >> > > Output Committer Algorithm version is 1
> > > > >> > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > > >> > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> > > > >> > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to
> > > > >> > > SCHEDULED
> > > > >> > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > > from
> > > > >> > > NEW to UNASSIGNED
> > > > >> > > 2015-11-04 14:59:16,202 INFO [Thread-51]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > > > >> > > mapResourceRequest:<memory:1536, vCores:1>
> > > > >> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Event
> > > > >> > > Writer setup for JobId: job_1446620926630_0017, File:
> > > > >> > > hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > > > >> > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > Before
> > > > >> > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
> > > > >> > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > > > >> > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> > > > >> > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > > >> > > getResources() for application_1446620926630_0017: ask=1
> > release=
> > > 0
> > > > >> > > newContainers=0 finishedContainers=0
> > resourcelimit=<memory:19840,
> > > > >> > > vCores:1> knownNMs=5
> > > > >> > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> Got
> > > > >> > > allocated containers 1
> > > > >> > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
> > > > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > > > >> > > hadoop04.housing.com to /default-rack
> > > > >> > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > > Assigned
> > > > >> > > container container_e02_1446620926630_0017_01_000002 to
> > > > >> > > attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > After
> > > > >> > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> > > > >> > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > > > >> > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> > > > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > > > >> > > hadoop04.housing.com to /default-rack
> > > > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> Job
> > > jar
> > > > >> > > is not present. Not adding any jar to the list of resources.
> > > > >> > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> The
> > > > >> > > job-conf file on the remote FS is
> > > > >> > > /user/hdfs/.staging/job_1446620926630_0017/job.xml
> > > > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > Adding
> > > > #1
> > > > >> > > tokens and #1 secret keys for NM use for launching container
> > > > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > Size
> > > of
> > > > >> > > containertokens_dob is 2
> > > > >> > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > Putting
> > > > >> > > shuffle token in serviceData
> > > > >> > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > > from
> > > > >> > > UNASSIGNED to ASSIGNED
> > > > >> > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > > >> > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for
> > > > container
> > > > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > > > >> > > attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > > >> > > Launching attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
> > > > >> > >
> > > > >>
> > >
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > > >> > > Opening proxy : hadoop04.housing.com:45454
> > > > >> > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > > >> > > Shuffle port returned by ContainerManager for
> > > > >> > > attempt_1446620926630_0017_m_000000_0 : 13562
> > > > >> > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > > >> > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
> > > > >> > > containerId: [container_e02_1446620926630_0017_01_000002 on
> NM:
> > > > >> > > [hadoop04.housing.com:45454]
> > > > >> > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > > from
> > > > >> > > ASSIGNED to RUNNING
> > > > >> > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from
> > SCHEDULED
> > > to
> > > > >> > > RUNNING
> > > > >> > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > > >> > > getResources() for application_1446620926630_0017: ask=1
> > release=
> > > 0
> > > > >> > > newContainers=0 finishedContainers=0
> > resourcelimit=<memory:17920,
> > > > >> > > vCores:1> knownNMs=5
> > > > >> > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
> > > > >> > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful
> for
> > > > >> > > job_1446620926630_0017 (auth:SIMPLE)
> > > > >> > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
> > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID
> :
> > > > >> > > jvm_1446620926630_0017_m_2199023255554 asked for a task
> > > > >> > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
> > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> > > > >> > > jvm_1446620926630_0017_m_2199023255554 given task:
> > > > >> > > attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
> > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > > > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> > > > >> > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
> > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl:
> Commit-pending
> > > > state
> > > > >> > > update from attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > > from
> > > > >> > > RUNNING to COMMIT_PENDING
> > > > >> > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > > >> > > attempt_1446620926630_0017_m_000000_0 given a go for
> committing
> > > the
> > > > >> > > task output.
> > > > >> > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
> > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit
> > go/no-go
> > > > >> > > request from attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result
> of
> > > > >> > > canCommit for attempt_1446620926630_0017_m_000000_0:true
> > > > >> > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
> > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > > > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> > > > >> > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
> > > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done
> > > > acknowledgement
> > > > >> > > from attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > > from
> > > > >> > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> > > > >> > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > > >> > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for
> > > > container
> > > > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > > > >> > > attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > > > >> > >
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > > >> > > KILLING attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > > > >> > >
> > > > >>
> > >
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > > >> > > Opening proxy : hadoop04.housing.com:45454
> > > > >> > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > > from
> > > > >> > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> > > > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task
> > > succeeded
> > > > >> > > with attempt attempt_1446620926630_0017_m_000000_0
> > > > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from
> RUNNING
> > to
> > > > >> > > SUCCEEDED
> > > > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num
> > completed
> > > > >> > > Tasks: 1
> > > > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > > >> > > job_1446620926630_0017Job Transitioned from RUNNING to
> > COMMITTING
> > > > >> > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
> > > > >> > >
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > > > >> > > Processing the event EventType: JOB_COMMIT
> > > > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling
> > > handler
> > > > >> > > for JobFinishedEvent
> > > > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > > >> > > job_1446620926630_0017Job Transitioned from COMMITTING to
> > > SUCCEEDED
> > > > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are
> finishing
> > > > >> > > cleanly so this is the last retry
> > > > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify
> > > > RMCommunicator
> > > > >> > > isAMLastRetry: true
> > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> > > RMCommunicator
> > > > >> > > notified that shouldUnregistered is: true
> > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
> > > > >> > > isAMLastRetry: true
> > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > > >> > > JobHistoryEventHandler notified that forceJobCompletion is
> true
> > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop
> for
> > > all
> > > > >> > > the services
> > > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > > >> > > Stopping JobHistoryEventHandler. Size of the outstanding queue
> > > size
> > > > is
> > > > >> > > 0
> > > > >> > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > > Copying
> > > > >> > > hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > > > >> > > to hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > > >> > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > > Copied
> > > > >> > > to done location:
> > > > >> > > hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > > >> > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > > Copying
> > > > >> > > hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
> > > > >> > > to hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > > >> > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > > Copied
> > > > >> > > to done location:
> > > > >> > > hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > > >> > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Moved
> > > > >> > > tmp to done: hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
> > > > >> > > to hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> > > > >> > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Moved
> > > > >> > > tmp to done: hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > > >> > > to hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> > > > >> > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Moved
> > > > >> > > tmp to done: hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > > >> > > to hdfs://
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> > > > >> > > 2015-11-04 14:59:22,965 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > > Stopped
> > > > >> > > JobHistoryEventHandler. super.stop()
> > > > >> > > 2015-11-04 14:59:22,968 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting
> > job
> > > > >> > > diagnostics to
> > > > >> > > 2015-11-04 14:59:22,969 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History
> > url
> > > is
> > > > >> > >
> > > > >>
> > >
> http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> > > > >> > > 2015-11-04 14:59:22,976 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting
> > for
> > > > >> > > application to be successfully unregistered.
> > > > >> > > 2015-11-04 14:59:23,979 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > Final
> > > > >> > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> > > AssignedMaps:1
> > > > >> > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1
> > > ContRel:0
> > > > >> > > HostLocal:0 RackLocal:0
> > > > >> > > 2015-11-04 14:59:23,980 INFO [Thread-67]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting
> staging
> > > > >> > > directory hdfs://hadoop01.housing.com:8020
> > > > >> > > /user/hdfs/.staging/job_1446620926630_0017
> > > > >> > > 2015-11-04 14:59:23,984 INFO [Thread-67]
> > > > org.apache.hadoop.ipc.Server:
> > > > >> > > Stopping server on 50432
> > > > >> > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
> > > > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on
> > > 50432
> > > > >> > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
> > > > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> > > > >> > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler
> PingChecker]
> > > > >> > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
> > > > >> > > TaskHeartbeatHandler thread interrupted
> > > > >> > >
> > > > >> > >
> > > > >> > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> > > > >> > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >> > >
> > > > >> > > > In first look I am not seeing any issue with job tracker or
> > name
> > > > >> node
> > > > >> > > URL.
> > > > >> > > > The job id is getting generated. Workflow Job is not going
> on
> > > > PREP
> > > > >> > mode.
> > > > >> > > >
> > > > >> > > > Open this link.
> > > > >> > > >
> > > > >>
> > > http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
> > > > >> > > >
> > > > >> > > > You will be see the problem.
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <
> > > > >> jeetendra.g@housing.com>
> > > > >> > > > wrote:
> > > > >> > > >
> > > > >> > > > > hey Serega I have cross verified jobTracker value is
> correct
> > > > only
> > > > >> I
> > > > >> > am
> > > > >> > > > > using yarn so resource manager will become the job
> tracker?
> > > > >> > > > >
> > > > >> > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
> > > > >> > > serega.sheypak@gmail.com
> > > > >> > > > >
> > > > >> > > > > wrote:
> > > > >> > > > >
> > > > >> > > > > > Can you go to oozie server and grab logs from there? My
> > > > >> assumption
> > > > >> > > that
> > > > >> > > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > >> > > > > > <name-node>${nameNode}</name-node>
> > > > >> > > > > >
> > > > >> > > > > > have incorrect values. Probably ${jobTracker} is wrong
> and
> > > > oozie
> > > > >> > > can't
> > > > >> > > > > even
> > > > >> > > > > > start launcher mapper.
> > > > >> > > > > >
> > > > >> > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > > > >> > > > > > jaydeep.vishwakarma@inmobi.com>:
> > > > >> > > > > >
> > > > >> > > > > > > You are doing -log. Can you give the command as below
> > and
> > > > get
> > > > >> the
> > > > >> > > job
> > > > >> > > > > url
> > > > >> > > > > > > (application launcher url).
> > > > >> > > > > > >
> > > > >> > > > > > > *oozie job -info
> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node*
> > > > >> > > > > > >
> > > > >> > > > > > >
> > > > >> > > > > > >
> > > > >> > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
> > > > >> > > jeetendra.g@housing.com
> > > > >> > > > >
> > > > >> > > > > > > wrote:
> > > > >> > > > > > >
> > > > >> > > > > > > > and in job error log tab its saying error log is
> > > disables?
> > > > >> by
> > > > >> > > > default
> > > > >> > > > > > why
> > > > >> > > > > > > > error log is disables? i am using hortonworks
> > > > >> > > > > > > >
> > > > >> > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> > > > >> > > > jeetendra.g@housing.com
> > > > >> > > > > >
> > > > >> > > > > > > > wrote:
> > > > >> > > > > > > >
> > > > >> > > > > > > > > same error.
> > > > >> > > > > > > > >
> > > > >> > > > > > > > > 2015-11-04 14:09:00,935 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@
> > :start:]
> > > > >> Start
> > > > >> > > > action
> > > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:]
> with
> > > > >> > user-retry
> > > > >> > > > > > state :
> > > > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> > > userRetryInterval
> > > > >> [10]
> > > > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@
> > :start:]
> > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> > > > >> :start:***]Action
> > > > >> > > > > > status=DONE
> > > > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@
> > :start:]
> > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> > > > >> :start:***]Action
> > > > >> > > > updated
> > > > >> > > > > > in
> > > > >> > > > > > > > DB!
> > > > >> > > > > > > > > 2015-11-04 14:09:00,994 INFO
> > > > >> > WorkflowNotificationXCommand:520
> > > > >> > > -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@
> > :start:]
> > > No
> > > > >> > > > > Notification
> > > > >> > > > > > > URL
> > > > >> > > > > > > > > is defined. Therefore nothing to notify for job
> > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > >> > > > > > > > > 2015-11-04 14:09:01,004 INFO
> > > > >> > WorkflowNotificationXCommand:520
> > > > >> > > -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[]
> > No
> > > > >> > > > Notification
> > > > >> > > > > > URL
> > > > >> > > > > > > is
> > > > >> > > > > > > > > defined. Therefore nothing to notify for job
> > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > >> > > > > > > > > 2015-11-04 14:09:01,014 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > >
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > >> Start
> > > > >> > > > > action
> > > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node]
> > with
> > > > >> > > user-retry
> > > > >> > > > > > > state :
> > > > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> > > userRetryInterval
> > > > >> [10]
> > > > >> > > > > > > > > 2015-11-04 14:09:02,916 INFO
> > JavaActionExecutor:520 -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > >
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > >> > > checking
> > > > >> > > > > > > action,
> > > > >> > > > > > > > > hadoop job ID [job_1446620926630_0016] status
> > > [RUNNING]
> > > > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > >
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> > > > >> ***]Action
> > > > >> > > > > > > > > status=RUNNING
> > > > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > >
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> > > > >> ***]Action
> > > > >> > > > > updated
> > > > >> > > > > > > in
> > > > >> > > > > > > > > DB!
> > > > >> > > > > > > > > 2015-11-04 14:09:02,926 INFO
> > > > >> > WorkflowNotificationXCommand:520
> > > > >> > > -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > >
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > No
> > > > >> > > > > > Notification
> > > > >> > > > > > > > > URL is defined. Therefore nothing to notify for
> job
> > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > >> > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520
> -
> > > > >> SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > >
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > >> > > callback
> > > > >> > > > > for
> > > > >> > > > > > > > > action
> > [0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > >> > > > > > > > > 2015-11-04 14:09:17,907 INFO
> > JavaActionExecutor:520 -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > >
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > >> > action
> > > > >> > > > > > > completed,
> > > > >> > > > > > > > > external ID [job_1446620926630_0016]
> > > > >> > > > > > > > > 2015-11-04 14:09:18,029 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > Start
> > > > >> > action
> > > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with
> > > > >> user-retry
> > > > >> > > > state :
> > > > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> > > userRetryInterval
> > > > >> [10]
> > > > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end
> > > ***]Action
> > > > >> > > > status=DONE
> > > > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO
> > ActionStartXCommand:520
> > > -
> > > > >> > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> > > > > APP[java-main-wf]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end
> > > ***]Action
> > > > >> > updated
> > > > >> > > > in
> > > > >> > > > > > DB!
> > > > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > > > >> > WorkflowNotificationXCommand:520
> > > > >> > > -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> No
> > > > >> > > Notification
> > > > >> > > > > URL
> > > > >> > > > > > > is
> > > > >> > > > > > > > > defined. Therefore nothing to notify for job
> > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > > > >> > WorkflowNotificationXCommand:520
> > > > >> > > -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[]
> > No
> > > > >> > > > Notification
> > > > >> > > > > > URL
> > > > >> > > > > > > is
> > > > >> > > > > > > > > defined. Therefore nothing to notify for job
> > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > >> > > > > > > > > 2015-11-04 14:09:18,105 INFO
> > > > >> > WorkflowNotificationXCommand:520
> > > > >> > > -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > >> > > > > > > > >
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > > ]
> > > > No
> > > > >> > > > > > Notification
> > > > >> > > > > > > > > URL is defined. Therefore nothing to notify for
> job
> > > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > >> > > > > > > > >
> > > > >> > > > > > > > >
> > > > >> > > > > > > > >
> > > > >> > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep
> Vishwakarma
> > <
> > > > >> > > > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >> > > > > > > > >
> > > > >> > > > > > > > >> oozie job -info
> > > > >> > 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > > > > > >> There you will find "Console URL" , Open that URL
> > on
> > > > >> > browser.
> > > > >> > > > You
> > > > >> > > > > > will
> > > > >> > > > > > > > get
> > > > >> > > > > > > > >> the Launcher mapper logs.
> > > > >> > > > > > > > >>
> > > > >> > > > > > > > >>
> > > > >> > > > > > > > >>
> > > > >> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > > > >> > > > > > jeetendra.g@housing.com>
> > > > >> > > > > > > > >> wrote:
> > > > >> > > > > > > > >>
> > > > >> > > > > > > > >> > This is the log i am getting repeatedly
> > > > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > > > >> > > > WorkflowNotificationXCommand:520 -
> > > > >> > > > > > > > SERVER[
> > > > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> > > > APP[-]
> > > > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@
> > > :start:]
> > > > >> No
> > > > >> > > > > > > Notification
> > > > >> > > > > > > > >> URL
> > > > >> > > > > > > > >> > is
> > > > >> > > > > > > > >> > defined. Therefore nothing to notify for job
> > > > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > > > >> > > > WorkflowNotificationXCommand:520 -
> > > > >> > > > > > > > SERVER[
> > > > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> > > > APP[-]
> > > > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > ACTION[]
> > > No
> > > > >> > > > > Notification
> > > > >> > > > > > > URL
> > > > >> > > > > > > > >> is
> > > > >> > > > > > > > >> > defined. Therefore nothing to notify for job
> > > > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > > > > > >> >
> > > > >> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep
> > > Vishwakarma <
> > > > >> > > > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >> > > > > > > > >> >
> > > > >> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What
> it
> > > > says?
> > > > >> > > > > > > > >> > >
> > > > >> > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > >> > > > > > > > jeetendra.g@housing.com>
> > > > >> > > > > > > > >> > > wrote:
> > > > >> > > > > > > > >> > >
> > > > >> > > > > > > > >> > > > does anybody have any idea? i have been
> > trying
> > > > this
> > > > >> > from
> > > > >> > > > 10
> > > > >> > > > > > days
> > > > >> > > > > > > > >> > nothing
> > > > >> > > > > > > > >> > > > worked out.
> > > > >> > > > > > > > >> > > >
> > > > >> > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra
> G
> > <
> > > > >> > > > > > > > >> jeetendra.g@housing.com>
> > > > >> > > > > > > > >> > > > wrote:
> > > > >> > > > > > > > >> > > >
> > > > >> > > > > > > > >> > > > > my workflow.xml
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > > > >> > > > > <workflow-app
> > xmlns="uri:oozie:workflow:0.2"
> > > > >> > > > > > > > name="java-main-wf">
> > > > >> > > > > > > > >> > > > > <start to="java-node"/>
> > > > >> > > > > > > > >> > > > > <action name="java-node">
> > > > >> > > > > > > > >> > > > > <java>
> > > > >> > > > > > > > >> > > > >
> > > > >> <job-tracker>${jobTracker}</job-tracker>
> > > > >> > > > > > > > >> > > > >
> > > <name-node>${nameNode}</name-node>
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > > >
> > <main-class>com.housing.common.JSONMerger</main-class>
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > >> > > > > > > > >> > > > >
> > > > >> 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > >> > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > > > >> > > > > </java>
> > > > >> > > > > > > > >> > > > > <ok to="end"/>
> > > > >> > > > > > > > >> > > > > <error to="fail"/>
> > > > >> > > > > > > > >> > > > > </action>
> > > > >> > > > > > > > >> > > > > <kill name="fail">
> > > > >> > > > > > > > >> > > > > <message>Java failed, error
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > >> > > > > > > > >> > > > > </kill>
> > > > >> > > > > > > > >> > > > > <end name="end"/>
> > > > >> > > > > > > > >> > > > > </workflow-app>
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM,
> Jeetendra
> > G
> > > <
> > > > >> > > > > > > > >> > jeetendra.g@housing.com>
> > > > >> > > > > > > > >> > > > > wrote:
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > > > >> > > > >> Hi All,
> > > > >> > > > > > > > >> > > > >>
> > > > >> > > > > > > > >> > > > >> I am running java workflow job using
> > oozie.
> > > > >> > > > > > > > >> > > > >> I have Ambari server and I have
> installed
> > > > oozie
> > > > >> > from
> > > > >> > > > > > Ambari.
> > > > >> > > > > > > > >> > > > >> When i ran the job it say succeeded but
> > its
> > > > not
> > > > >> > > running
> > > > >> > > > > my
> > > > >> > > > > > > java
> > > > >> > > > > > > > >> > class
> > > > >> > > > > > > > >> > > > >> which I mentioned inside workflow.xml.
> > Also
> > > > >> when I
> > > > >> > > get
> > > > >> > > > > > oozie
> > > > >> > > > > > > > >> > nothing
> > > > >> > > > > > > > >> > > > can
> > > > >> > > > > > > > >> > > > >> be find pasting log beow, can anybody
> help
> > > > here?
> > > > >> > > > > > > > >> > > > >> oozie job -oozie
> > > > >> > > > http://hadoop03.housing.com:11000/oozie
> > > > >> > > > > > > -log
> > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@
> > > > >> > :start:]
> > > > >> > > > > Start
> > > > >> > > > > > > > >> action
> > > > >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@
> > > > :start:]
> > > > >> > with
> > > > >> > > > > > > user-retry
> > > > >> > > > > > > > >> > state
> > > > >> > > > > > > > >> > > :
> > > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > > >> > > userRetryInterval
> > > > >> > > > > > [10]
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@
> > > > >> > :start:]
> > > > >> > > > > > > > >> > > > >>
> [***0000040-151015123257993-oozie-oozi-W@
> > > > >> > > > > :start:***]Action
> > > > >> > > > > > > > >> > > status=DONE
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@
> > > > >> > :start:]
> > > > >> > > > > > > > >> > > > >>
> [***0000040-151015123257993-oozie-oozi-W@
> > > > >> > > > > :start:***]Action
> > > > >> > > > > > > > >> updated
> > > > >> > > > > > > > >> > in
> > > > >> > > > > > > > >> > > > DB!
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > >> > > > > > > WorkflowNotificationXCommand:520
> > > > >> > > > > > > > -
> > > > >> > > > > > > > >> > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > > TOKEN[-]
> > > > >> > > APP[-]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@
> > > > >> > :start:]
> > > > >> > > > No
> > > > >> > > > > > > > >> > Notification
> > > > >> > > > > > > > >> > > > URL
> > > > >> > > > > > > > >> > > > >> is defined. Therefore nothing to notify
> > for
> > > > job
> > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@
> > > :start:
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > >> > > > > > > WorkflowNotificationXCommand:520
> > > > >> > > > > > > > -
> > > > >> > > > > > > > >> > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > > TOKEN[-]
> > > > >> > > APP[-]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[]
> > > > >> > No
> > > > >> > > > > > > > >> Notification
> > > > >> > > > > > > > >> > URL
> > > > >> > > > > > > > >> > > > is
> > > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for
> > job
> > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > ]
> > > > >> > > > > > Start
> > > > >> > > > > > > > >> action
> > > > >> > > > > > > > >> > > > >>
> > > > [0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> ]
> > > > >> > > with
> > > > >> > > > > > > > user-retry
> > > > >> > > > > > > > >> > > state
> > > > >> > > > > > > > >> > > > :
> > > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > > >> > > userRetryInterval
> > > > >> > > > > > [10]
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO
> > > > >> > JavaActionExecutor:520
> > > > >> > > -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > ]
> > > > >> > > > > > > > checking
> > > > >> > > > > > > > >> > > action,
> > > > >> > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073]
> > > status
> > > > >> > > [RUNNING]
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > ]
> > > > >> > > > > > > > >> > > > >>
> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > > > ***]Action
> > > > >> > > > > > > > >> > > > >> status=RUNNING
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > ]
> > > > >> > > > > > > > >> > > > >>
> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > > > ***]Action
> > > > >> > > > > > > > >> > updated
> > > > >> > > > > > > > >> > > in
> > > > >> > > > > > > > >> > > > >> DB!
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > > >> > > > > > > WorkflowNotificationXCommand:520
> > > > >> > > > > > > > -
> > > > >> > > > > > > > >> > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > > TOKEN[-]
> > > > >> > > APP[-]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > ]
> > > > >> > > > > No
> > > > >> > > > > > > > >> > > Notification
> > > > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to
> > notify
> > > > for
> > > > >> job
> > > > >> > > > > > > > >> > > > >>
> > > 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO
> > > > >> CallbackServlet:520 -
> > > > >> > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > > TOKEN[-]
> > > > >> > > APP[-]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > ]
> > > > >> > > > > > > > callback
> > > > >> > > > > > > > >> for
> > > > >> > > > > > > > >> > > > >> action
> > > > >> > > [0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > ]
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO
> > > > >> > JavaActionExecutor:520
> > > > >> > > -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > ]
> > > > >> > > > > > > action
> > > > >> > > > > > > > >> > > > completed,
> > > > >> > > > > > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > > > >> ]
> > > > >> > > Start
> > > > >> > > > > > > action
> > > > >> > > > > > > > >> > > > >>
> [0000040-151015123257993-oozie-oozi-W@end
> > ]
> > > > with
> > > > >> > > > > user-retry
> > > > >> > > > > > > > >> state :
> > > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > > >> > > userRetryInterval
> > > > >> > > > > > [10]
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > > > >> ]
> > > > >> > > > > > > > >> > > > >>
> > [***0000040-151015123257993-oozie-oozi-W@end
> > > > >> > > ***]Action
> > > > >> > > > > > > > >> status=DONE
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
> > > > >> > > ActionStartXCommand:520 -
> > > > >> > > > > > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs]
> GROUP[-]
> > > > >> TOKEN[]
> > > > >> > > > > > > > >> APP[java-main-wf]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > > > >> ]
> > > > >> > > > > > > > >> > > > >>
> > [***0000040-151015123257993-oozie-oozi-W@end
> > > > >> > > ***]Action
> > > > >> > > > > > > updated
> > > > >> > > > > > > > >> in
> > > > >> > > > > > > > >> > DB!
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > >> > > > > > > WorkflowNotificationXCommand:520
> > > > >> > > > > > > > -
> > > > >> > > > > > > > >> > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > > TOKEN[-]
> > > > >> > > APP[-]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > > > >> ]
> > > > >> > No
> > > > >> > > > > > > > Notification
> > > > >> > > > > > > > >> > URL
> > > > >> > > > > > > > >> > > is
> > > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for
> > job
> > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > >> > > > > > > WorkflowNotificationXCommand:520
> > > > >> > > > > > > > -
> > > > >> > > > > > > > >> > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > > TOKEN[-]
> > > > >> > > APP[-]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[]
> > > > >> > No
> > > > >> > > > > > > > >> Notification
> > > > >> > > > > > > > >> > URL
> > > > >> > > > > > > > >> > > > is
> > > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for
> > job
> > > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > >> > > > > > > WorkflowNotificationXCommand:520
> > > > >> > > > > > > > -
> > > > >> > > > > > > > >> > > SERVER[
> > > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > > TOKEN[-]
> > > > >> > > APP[-]
> > > > >> > > > > > > > >> > > > >>
> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > > > > > >> > > > >>
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > ]
> > > > >> > > > > No
> > > > >> > > > > > > > >> > > Notification
> > > > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to
> > notify
> > > > for
> > > > >> job
> > > > >> > > > > > > > >> > > > >>
> > > 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > > > > > >> > > > >>
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > > > >> > > > >
> > > > >> > > > > > > > >> > > >
> > > > >> > > > > > > > >> > >
> > > > >> > > > > > > > >> > > --
> > > > >> > > > > > > > >> > >
> > > > >> > > >
> _____________________________________________________________
> > > > >> > > > > > > > >> > > The information contained in this
> communication
> > > is
> > > > >> > > intended
> > > > >> > > > > > solely
> > > > >> > > > > > > > for
> > > > >> > > > > > > > >> > the
> > > > >> > > > > > > > >> > > use of the individual or entity to whom it is
> > > > >> addressed
> > > > >> > > and
> > > > >> > > > > > others
> > > > >> > > > > > > > >> > > authorized to receive it. It may contain
> > > > >> confidential or
> > > > >> > > > > legally
> > > > >> > > > > > > > >> > privileged
> > > > >> > > > > > > > >> > > information. If you are not the intended
> > > recipient
> > > > >> you
> > > > >> > are
> > > > >> > > > > > hereby
> > > > >> > > > > > > > >> > notified
> > > > >> > > > > > > > >> > > that any disclosure, copying, distribution or
> > > > taking
> > > > >> any
> > > > >> > > > > action
> > > > >> > > > > > in
> > > > >> > > > > > > > >> > reliance
> > > > >> > > > > > > > >> > > on the contents of this information is
> strictly
> > > > >> > prohibited
> > > > >> > > > and
> > > > >> > > > > > may
> > > > >> > > > > > > > be
> > > > >> > > > > > > > >> > > unlawful. If you have received this
> > communication
> > > > in
> > > > >> > > error,
> > > > >> > > > > > please
> > > > >> > > > > > > > >> notify
> > > > >> > > > > > > > >> > > us immediately by responding to this email
> and
> > > then
> > > > >> > delete
> > > > >> > > > it
> > > > >> > > > > > from
> > > > >> > > > > > > > >> your
> > > > >> > > > > > > > >> > > system. The firm is neither liable for the
> > proper
> > > > and
> > > > >> > > > complete
> > > > >> > > > > > > > >> > transmission
> > > > >> > > > > > > > >> > > of the information contained in this
> > > communication
> > > > >> nor
> > > > >> > for
> > > > >> > > > any
> > > > >> > > > > > > delay
> > > > >> > > > > > > > >> in
> > > > >> > > > > > > > >> > its
> > > > >> > > > > > > > >> > > receipt.
> > > > >> > > > > > > > >> > >
> > > > >> > > > > > > > >> >
> > > > >> > > > > > > > >>
> > > > >> > > > > > > > >> --
> > > > >> > > > > > > > >>
> > > > >> > _____________________________________________________________
> > > > >> > > > > > > > >> The information contained in this communication
> is
> > > > >> intended
> > > > >> > > > solely
> > > > >> > > > > > for
> > > > >> > > > > > > > the
> > > > >> > > > > > > > >> use of the individual or entity to whom it is
> > > addressed
> > > > >> and
> > > > >> > > > others
> > > > >> > > > > > > > >> authorized to receive it. It may contain
> > confidential
> > > > or
> > > > >> > > legally
> > > > >> > > > > > > > >> privileged
> > > > >> > > > > > > > >> information. If you are not the intended
> recipient
> > > you
> > > > >> are
> > > > >> > > > hereby
> > > > >> > > > > > > > notified
> > > > >> > > > > > > > >> that any disclosure, copying, distribution or
> > taking
> > > > any
> > > > >> > > action
> > > > >> > > > in
> > > > >> > > > > > > > >> reliance
> > > > >> > > > > > > > >> on the contents of this information is strictly
> > > > >> prohibited
> > > > >> > and
> > > > >> > > > may
> > > > >> > > > > > be
> > > > >> > > > > > > > >> unlawful. If you have received this communication
> > in
> > > > >> error,
> > > > >> > > > please
> > > > >> > > > > > > > notify
> > > > >> > > > > > > > >> us immediately by responding to this email and
> then
> > > > >> delete
> > > > >> > it
> > > > >> > > > from
> > > > >> > > > > > > your
> > > > >> > > > > > > > >> system. The firm is neither liable for the proper
> > and
> > > > >> > complete
> > > > >> > > > > > > > >> transmission
> > > > >> > > > > > > > >> of the information contained in this
> communication
> > > nor
> > > > >> for
> > > > >> > any
> > > > >> > > > > delay
> > > > >> > > > > > > in
> > > > >> > > > > > > > >> its
> > > > >> > > > > > > > >> receipt.
> > > > >> > > > > > > > >>
> > > > >> > > > > > > > >
> > > > >> > > > > > > > >
> > > > >> > > > > > > >
> > > > >> > > > > > >
> > > > >> > > > > > > --
> > > > >> > > > > > >
> > > > _____________________________________________________________
> > > > >> > > > > > > The information contained in this communication is
> > > intended
> > > > >> > solely
> > > > >> > > > for
> > > > >> > > > > > the
> > > > >> > > > > > > use of the individual or entity to whom it is
> addressed
> > > and
> > > > >> > others
> > > > >> > > > > > > authorized to receive it. It may contain confidential
> or
> > > > >> legally
> > > > >> > > > > > privileged
> > > > >> > > > > > > information. If you are not the intended recipient you
> > are
> > > > >> hereby
> > > > >> > > > > > notified
> > > > >> > > > > > > that any disclosure, copying, distribution or taking
> any
> > > > >> action
> > > > >> > in
> > > > >> > > > > > reliance
> > > > >> > > > > > > on the contents of this information is strictly
> > prohibited
> > > > and
> > > > >> > may
> > > > >> > > be
> > > > >> > > > > > > unlawful. If you have received this communication in
> > > error,
> > > > >> > please
> > > > >> > > > > notify
> > > > >> > > > > > > us immediately by responding to this email and then
> > delete
> > > > it
> > > > >> > from
> > > > >> > > > your
> > > > >> > > > > > > system. The firm is neither liable for the proper and
> > > > complete
> > > > >> > > > > > transmission
> > > > >> > > > > > > of the information contained in this communication nor
> > for
> > > > any
> > > > >> > > delay
> > > > >> > > > in
> > > > >> > > > > > its
> > > > >> > > > > > > receipt.
> > > > >> > > > > > >
> > > > >> > > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > --
> > > > >> > > >
> _____________________________________________________________
> > > > >> > > > The information contained in this communication is intended
> > > solely
> > > > >> for
> > > > >> > > the
> > > > >> > > > use of the individual or entity to whom it is addressed and
> > > others
> > > > >> > > > authorized to receive it. It may contain confidential or
> > legally
> > > > >> > > privileged
> > > > >> > > > information. If you are not the intended recipient you are
> > > hereby
> > > > >> > > notified
> > > > >> > > > that any disclosure, copying, distribution or taking any
> > action
> > > in
> > > > >> > > reliance
> > > > >> > > > on the contents of this information is strictly prohibited
> and
> > > may
> > > > >> be
> > > > >> > > > unlawful. If you have received this communication in error,
> > > please
> > > > >> > notify
> > > > >> > > > us immediately by responding to this email and then delete
> it
> > > from
> > > > >> your
> > > > >> > > > system. The firm is neither liable for the proper and
> complete
> > > > >> > > transmission
> > > > >> > > > of the information contained in this communication nor for
> any
> > > > >> delay in
> > > > >> > > its
> > > > >> > > > receipt.
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >> > --
> > > > >> > _____________________________________________________________
> > > > >> > The information contained in this communication is intended
> solely
> > > for
> > > > >> the
> > > > >> > use of the individual or entity to whom it is addressed and
> others
> > > > >> > authorized to receive it. It may contain confidential or legally
> > > > >> privileged
> > > > >> > information. If you are not the intended recipient you are
> hereby
> > > > >> notified
> > > > >> > that any disclosure, copying, distribution or taking any action
> in
> > > > >> reliance
> > > > >> > on the contents of this information is strictly prohibited and
> may
> > > be
> > > > >> > unlawful. If you have received this communication in error,
> please
> > > > >> notify
> > > > >> > us immediately by responding to this email and then delete it
> from
> > > > your
> > > > >> > system. The firm is neither liable for the proper and complete
> > > > >> transmission
> > > > >> > of the information contained in this communication nor for any
> > delay
> > > > in
> > > > >> its
> > > > >> > receipt.
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
Re: Java action in Ooozie
Posted by Jaydeep Vishwakarma <ja...@inmobi.com>.
Stdout logs will have some data in any case. As Oozie launcher writes N
number of information using System.out.print. You might be having even std
err as well which it is not coming.
Try to see the logs form command prompt for application Id by following
command.
yarn logs -applicationId <application ID>
If logs are still missing try to find in userlogs or do the debugging.
On Thu, Nov 5, 2015 at 1:22 PM, Jeetendra G <je...@housing.com> wrote:
> @ Serega:There are enough resources there is no resource starvation.
>
>
> On Wed, Nov 4, 2015 at 8:10 PM, Serega Sheypak <se...@gmail.com>
> wrote:
>
> > Which job succeeded? What is attached?
> > Other problem could be: you have resource starvation, there are no
> > resources on RM to run your job. Did you check it?
> >
> > 2015-11-04 15:15 GMT+01:00 Jeetendra G <je...@housing.com>:
> >
> > > Also I verified there is no issue with my java class because when I run
> > it
> > > without oozie its works perfectly.
> > >
> > >
> > > On Wed, Nov 4, 2015 at 7:43 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > > > it says job succeeded attaching
> > > >
> > > > On Wed, Nov 4, 2015 at 7:37 PM, Serega Sheypak <
> > serega.sheypak@gmail.com
> > > >
> > > > wrote:
> > > >
> > > >> Hm... ok, can you see what happens on YARN RM web ui?
> > > >> There should be a job that runs yuor oozie mapper launcher.
> > > >>
> > > >> 2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma <
> > > >> jaydeep.vishwakarma@inmobi.com>:
> > > >>
> > > >> > Good, So not issue with Yarn or name node urls. Can you share
> stdout
> > > >> logs.
> > > >> >
> > > >> >
> > > >> > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <
> > jeetendra.g@housing.com>
> > > >> > wrote:
> > > >> >
> > > >> > > Hi Jaydeep here also I cant see any error below are the logs
> > > >> > >
> > > >> > > Log Type: syslog
> > > >> > >
> > > >> > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
> > > >> > >
> > > >> > > Log Length: 25565
> > > >> > >
> > > >> > > 2015-11-04 14:59:11,814 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created
> > MRAppMaster
> > > >> > > for application appattempt_1446620926630_0017_000001
> > > >> > > 2015-11-04 14:59:12,144 WARN [main]
> > > >> > > org.apache.hadoop.util.NativeCodeLoader: Unable to load
> > > native-hadoop
> > > >> > > library for your platform... using builtin-java classes where
> > > >> > > applicable
> > > >> > > 2015-11-04 14:59:12,184 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with
> > > tokens:
> > > >> > > 2015-11-04 14:59:12,292 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > > >> > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId {
> > application_id {
> > > >> > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
> > > >> > > -173762614)
> > > >> > > 2015-11-04 14:59:12,293 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > > >> > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident:
> > (owner=hdfs,
> > > >> > > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
> > > >> > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> > > >> > > 2015-11-04 14:59:12,890 WARN [main]
> > > >> > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
> > > >> > > short-circuit local reads feature cannot be used because
> libhadoop
> > > >> > > cannot be loaded.
> > > >> > > 2015-11-04 14:59:13,064 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter
> > set
> > > in
> > > >> > > config null
> > > >> > > 2015-11-04 14:59:13,065 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter
> is
> > > >> > > org.apache.hadoop.mapred.FileOutputCommitter
> > > >> > > 2015-11-04 14:59:13,110 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.EventType for class
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> > > >> > > 2015-11-04 14:59:13,110 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for
> > class
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> > > >> > > 2015-11-04 14:59:13,111 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for
> > class
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> > > >> > > 2015-11-04 14:59:13,111 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType
> > > for
> > > >> > > class
> > > >> > >
> > > >>
> > >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> > > >> > > 2015-11-04 14:59:13,112 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for
> > > class
> > > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> > > >> > > 2015-11-04 14:59:13,112 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType
> > > for
> > > >> > > class
> > > >> > >
> > > >>
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> > > >> > > 2015-11-04 14:59:13,113 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType
> > > for
> > > >> > > class
> > > >> > >
> > > >>
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> > > >> > > 2015-11-04 14:59:13,113 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > >
> > > >>
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> > > >> > > for class
> > > >> > >
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> > > >> > > 2015-11-04 14:59:13,144 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils:
> Default
> > > >> > > file system is set solely by core-default.xml therefore -
> > ignoring
> > > >> > > 2015-11-04 14:59:13,170 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils:
> Default
> > > >> > > file system is set solely by core-default.xml therefore -
> > ignoring
> > > >> > > 2015-11-04 14:59:13,189 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils:
> Default
> > > >> > > file system is set solely by core-default.xml therefore -
> > ignoring
> > > >> > > 2015-11-04 14:59:13,219 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > >> > > Emitting job history data to the timeline server is not enabled
> > > >> > > 2015-11-04 14:59:13,255 INFO [main]
> > > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type
> > for
> > > >> > > class
> > > >> >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> > > >> > > 2015-11-04 14:59:13,453 WARN [main]
> > > >> > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> > > >> > > configuration: tried
> > > >> > >
> hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> > > >> > > 2015-11-04 14:59:13,546 INFO [main]
> > > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
> > > snapshot
> > > >> > > period at 10 second(s).
> > > >> > > 2015-11-04 14:59:13,546 INFO [main]
> > > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster
> > > metrics
> > > >> > > system started
> > > >> > > 2015-11-04 14:59:13,557 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job
> > > token
> > > >> > > for job_1446620926630_0017 to jobTokenSecretManager
> > > >> > > 2015-11-04 14:59:13,680 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not
> uberizing
> > > >> > > job_1446620926630_0017 because: not enabled; too much RAM;
> > > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size
> > for
> > > >> > > job job_1446620926630_0017 = 0. Number of splits = 1
> > > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of
> > > reduces
> > > >> > > for job job_1446620926630_0017 = 0
> > > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > >> > > job_1446620926630_0017Job Transitioned from NEW to INITED
> > > >> > > 2015-11-04 14:59:13,702 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster
> > > launching
> > > >> > > normal, non-uberized, multi-container job
> job_1446620926630_0017.
> > > >> > > 2015-11-04 14:59:13,725 INFO [main]
> > > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > > >> > > java.util.concurrent.LinkedBlockingQueue
> > > >> > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
> > > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port
> > > 39640
> > > >> > > 2015-11-04 14:59:13,758 INFO [main]
> > > >> > > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> > > >> > > Adding protocol
> > > org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
> > > >> > > to the server
> > > >> > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
> > > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > > >> > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
> > > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640:
> > starting
> > > >> > > 2015-11-04 14:59:13,762 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
> > > >> > > Instantiated MRClientService at
> > > >> hadoop04.housing.com/10.21.1.138:39640
> > > >> > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
> > > >> > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> > > >> > > org.mortbay.log.Slf4jLog
> > > >> > > 2015-11-04 14:59:13,862 INFO [main]
> > > >> > >
> > > org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> > > >> > > Unable to initialize FileSignerSecretProvider, falling back to
> use
> > > >> > > random secrets.
> > > >> > > 2015-11-04 14:59:13,867 WARN [main]
> > > >> > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can
> only
> > be
> > > >> > > enabled using Log4j
> > > >> > > 2015-11-04 14:59:13,874 INFO [main]
> > > >> > > org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
> > > >> > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> > > >> > > 2015-11-04 14:59:13,878 INFO [main]
> > > >> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > > >> > >
> (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> > > to
> > > >> > > context mapreduce
> > > >> > > 2015-11-04 14:59:13,879 INFO [main]
> > > >> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > > >> > >
> (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> > > to
> > > >> > > context static
> > > >> > > 2015-11-04 14:59:13,882 INFO [main]
> > > >> > > org.apache.hadoop.http.HttpServer2: adding path spec:
> /mapreduce/*
> > > >> > > 2015-11-04 14:59:13,882 INFO [main]
> > > >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> > > >> > > 2015-11-04 14:59:14,217 INFO [main]
> > > >> > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice
> > > modules
> > > >> > > 2015-11-04 14:59:14,218 INFO [main]
> > > >> > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> > > >> > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log:
> > > jetty-6.1.26.hwx
> > > >> > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
> > > >> > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> > > >> > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
> > > >> > > HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> > > >> > > 2015-11-04 14:59:15,952 INFO [main]
> > > >> > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce
> started
> > at
> > > >> > > 49791
> > > >> > > 2015-11-04 14:59:15,957 INFO [main]
> > > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > > >> > > java.util.concurrent.LinkedBlockingQueue
> > > >> > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
> > > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port
> > > 50432
> > > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
> > > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
> > > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432:
> > starting
> > > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > >> > > nodeBlacklistingEnabled:true
> > > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > >> > > maxTaskFailuresPerNode is 3
> > > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > >> > > blacklistDisablePercent is 33
> > > >> > > 2015-11-04 14:59:16,035 INFO [main]
> > > >> > > org.apache.hadoop.yarn.client.RMProxy: Connecting to
> > ResourceManager
> > > >> > > at hadoop02.housing.com/10.21.1.136:8030
> > > >> > > 2015-11-04 14:59:16,113 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> > > >> > > maxContainerCapability: <memory:5120, vCores:3>
> > > >> > > 2015-11-04 14:59:16,113 INFO [main]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue:
> > default
> > > >> > > 2015-11-04 14:59:16,117 INFO [main]
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > >> > > Upper limit on the thread pool size is 500
> > > >> > > 2015-11-04 14:59:16,118 INFO [main]
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > The
> > > >> > > thread pool initial size is 10
> > > >> > > 2015-11-04 14:59:16,120 INFO [main]
> > > >> > >
> > > >>
> > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > >> > > yarn.client.max-cached-nodemanagers-proxies : 0
> > > >> > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > >> > > job_1446620926630_0017Job Transitioned from INITED to SETUP
> > > >> > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > > >> > > Processing the event EventType: JOB_SETUP
> > > >> > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
> > > >> > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
> > > >> > > Output Committer Algorithm version is 1
> > > >> > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > >> > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> > > >> > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to
> > > >> > > SCHEDULED
> > > >> > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > from
> > > >> > > NEW to UNASSIGNED
> > > >> > > 2015-11-04 14:59:16,202 INFO [Thread-51]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > > >> > > mapResourceRequest:<memory:1536, vCores:1>
> > > >> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Event
> > > >> > > Writer setup for JobId: job_1446620926630_0017, File:
> > > >> > > hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > > >> > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> Before
> > > >> > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
> > > >> > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > > >> > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> > > >> > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > >> > > getResources() for application_1446620926630_0017: ask=1
> release=
> > 0
> > > >> > > newContainers=0 finishedContainers=0
> resourcelimit=<memory:19840,
> > > >> > > vCores:1> knownNMs=5
> > > >> > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
> > > >> > > allocated containers 1
> > > >> > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
> > > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > > >> > > hadoop04.housing.com to /default-rack
> > > >> > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > Assigned
> > > >> > > container container_e02_1446620926630_0017_01_000002 to
> > > >> > > attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> After
> > > >> > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> > > >> > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > > >> > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> > > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > > >> > > hadoop04.housing.com to /default-rack
> > > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job
> > jar
> > > >> > > is not present. Not adding any jar to the list of resources.
> > > >> > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
> > > >> > > job-conf file on the remote FS is
> > > >> > > /user/hdfs/.staging/job_1446620926630_0017/job.xml
> > > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > Adding
> > > #1
> > > >> > > tokens and #1 secret keys for NM use for launching container
> > > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> Size
> > of
> > > >> > > containertokens_dob is 2
> > > >> > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > Putting
> > > >> > > shuffle token in serviceData
> > > >> > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > from
> > > >> > > UNASSIGNED to ASSIGNED
> > > >> > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > >> > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for
> > > container
> > > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > > >> > > attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > >> > > Launching attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
> > > >> > >
> > > >>
> > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > >> > > Opening proxy : hadoop04.housing.com:45454
> > > >> > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > >> > > Shuffle port returned by ContainerManager for
> > > >> > > attempt_1446620926630_0017_m_000000_0 : 13562
> > > >> > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > >> > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
> > > >> > > containerId: [container_e02_1446620926630_0017_01_000002 on NM:
> > > >> > > [hadoop04.housing.com:45454]
> > > >> > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > from
> > > >> > > ASSIGNED to RUNNING
> > > >> > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from
> SCHEDULED
> > to
> > > >> > > RUNNING
> > > >> > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > >> > > getResources() for application_1446620926630_0017: ask=1
> release=
> > 0
> > > >> > > newContainers=0 finishedContainers=0
> resourcelimit=<memory:17920,
> > > >> > > vCores:1> knownNMs=5
> > > >> > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
> > > >> > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
> > > >> > > job_1446620926630_0017 (auth:SIMPLE)
> > > >> > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
> > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
> > > >> > > jvm_1446620926630_0017_m_2199023255554 asked for a task
> > > >> > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
> > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> > > >> > > jvm_1446620926630_0017_m_2199023255554 given task:
> > > >> > > attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
> > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> > > >> > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
> > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending
> > > state
> > > >> > > update from attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > from
> > > >> > > RUNNING to COMMIT_PENDING
> > > >> > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > >> > > attempt_1446620926630_0017_m_000000_0 given a go for committing
> > the
> > > >> > > task output.
> > > >> > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
> > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit
> go/no-go
> > > >> > > request from attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
> > > >> > > canCommit for attempt_1446620926630_0017_m_000000_0:true
> > > >> > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
> > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> > > >> > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
> > > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done
> > > acknowledgement
> > > >> > > from attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > from
> > > >> > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> > > >> > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > >> > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for
> > > container
> > > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > > >> > > attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > > >> > >
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > >> > > KILLING attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > > >> > >
> > > >>
> > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > >> > > Opening proxy : hadoop04.housing.com:45454
> > > >> > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> > from
> > > >> > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> > > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task
> > succeeded
> > > >> > > with attempt attempt_1446620926630_0017_m_000000_0
> > > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > >> > > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING
> to
> > > >> > > SUCCEEDED
> > > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num
> completed
> > > >> > > Tasks: 1
> > > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > >> > > job_1446620926630_0017Job Transitioned from RUNNING to
> COMMITTING
> > > >> > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > > >> > > Processing the event EventType: JOB_COMMIT
> > > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling
> > handler
> > > >> > > for JobFinishedEvent
> > > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > >> > > job_1446620926630_0017Job Transitioned from COMMITTING to
> > SUCCEEDED
> > > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
> > > >> > > cleanly so this is the last retry
> > > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify
> > > RMCommunicator
> > > >> > > isAMLastRetry: true
> > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> > RMCommunicator
> > > >> > > notified that shouldUnregistered is: true
> > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
> > > >> > > isAMLastRetry: true
> > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > >> > > JobHistoryEventHandler notified that forceJobCompletion is true
> > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for
> > all
> > > >> > > the services
> > > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > >> > > Stopping JobHistoryEventHandler. Size of the outstanding queue
> > size
> > > is
> > > >> > > 0
> > > >> > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Copying
> > > >> > > hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > > >> > > to hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > >> > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Copied
> > > >> > > to done location:
> > > >> > > hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > >> > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Copying
> > > >> > > hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
> > > >> > > to hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > >> > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Copied
> > > >> > > to done location:
> > > >> > > hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > >> > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Moved
> > > >> > > tmp to done: hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
> > > >> > > to hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> > > >> > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Moved
> > > >> > > tmp to done: hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > >> > > to hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> > > >> > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Moved
> > > >> > > tmp to done: hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > >> > > to hdfs://
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> > > >> > > 2015-11-04 14:59:22,965 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Stopped
> > > >> > > JobHistoryEventHandler. super.stop()
> > > >> > > 2015-11-04 14:59:22,968 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting
> job
> > > >> > > diagnostics to
> > > >> > > 2015-11-04 14:59:22,969 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History
> url
> > is
> > > >> > >
> > > >>
> > http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> > > >> > > 2015-11-04 14:59:22,976 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting
> for
> > > >> > > application to be successfully unregistered.
> > > >> > > 2015-11-04 14:59:23,979 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> Final
> > > >> > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> > AssignedMaps:1
> > > >> > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1
> > ContRel:0
> > > >> > > HostLocal:0 RackLocal:0
> > > >> > > 2015-11-04 14:59:23,980 INFO [Thread-67]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
> > > >> > > directory hdfs://hadoop01.housing.com:8020
> > > >> > > /user/hdfs/.staging/job_1446620926630_0017
> > > >> > > 2015-11-04 14:59:23,984 INFO [Thread-67]
> > > org.apache.hadoop.ipc.Server:
> > > >> > > Stopping server on 50432
> > > >> > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
> > > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on
> > 50432
> > > >> > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
> > > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> > > >> > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
> > > >> > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
> > > >> > > TaskHeartbeatHandler thread interrupted
> > > >> > >
> > > >> > >
> > > >> > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> > > >> > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > >> > >
> > > >> > > > In first look I am not seeing any issue with job tracker or
> name
> > > >> node
> > > >> > > URL.
> > > >> > > > The job id is getting generated. Workflow Job is not going on
> > > PREP
> > > >> > mode.
> > > >> > > >
> > > >> > > > Open this link.
> > > >> > > >
> > > >>
> > http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
> > > >> > > >
> > > >> > > > You will be see the problem.
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <
> > > >> jeetendra.g@housing.com>
> > > >> > > > wrote:
> > > >> > > >
> > > >> > > > > hey Serega I have cross verified jobTracker value is correct
> > > only
> > > >> I
> > > >> > am
> > > >> > > > > using yarn so resource manager will become the job tracker?
> > > >> > > > >
> > > >> > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
> > > >> > > serega.sheypak@gmail.com
> > > >> > > > >
> > > >> > > > > wrote:
> > > >> > > > >
> > > >> > > > > > Can you go to oozie server and grab logs from there? My
> > > >> assumption
> > > >> > > that
> > > >> > > > > > <job-tracker>${jobTracker}</job-tracker>
> > > >> > > > > > <name-node>${nameNode}</name-node>
> > > >> > > > > >
> > > >> > > > > > have incorrect values. Probably ${jobTracker} is wrong and
> > > oozie
> > > >> > > can't
> > > >> > > > > even
> > > >> > > > > > start launcher mapper.
> > > >> > > > > >
> > > >> > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > > >> > > > > > jaydeep.vishwakarma@inmobi.com>:
> > > >> > > > > >
> > > >> > > > > > > You are doing -log. Can you give the command as below
> and
> > > get
> > > >> the
> > > >> > > job
> > > >> > > > > url
> > > >> > > > > > > (application launcher url).
> > > >> > > > > > >
> > > >> > > > > > > *oozie job -info
> > > >> 0000040-151015123257993-oozie-oozi-W@java-node*
> > > >> > > > > > >
> > > >> > > > > > >
> > > >> > > > > > >
> > > >> > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
> > > >> > > jeetendra.g@housing.com
> > > >> > > > >
> > > >> > > > > > > wrote:
> > > >> > > > > > >
> > > >> > > > > > > > and in job error log tab its saying error log is
> > disables?
> > > >> by
> > > >> > > > default
> > > >> > > > > > why
> > > >> > > > > > > > error log is disables? i am using hortonworks
> > > >> > > > > > > >
> > > >> > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> > > >> > > > jeetendra.g@housing.com
> > > >> > > > > >
> > > >> > > > > > > > wrote:
> > > >> > > > > > > >
> > > >> > > > > > > > > same error.
> > > >> > > > > > > > >
> > > >> > > > > > > > > 2015-11-04 14:09:00,935 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@
> :start:]
> > > >> Start
> > > >> > > > action
> > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with
> > > >> > user-retry
> > > >> > > > > > state :
> > > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> > userRetryInterval
> > > >> [10]
> > > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@
> :start:]
> > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> > > >> :start:***]Action
> > > >> > > > > > status=DONE
> > > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@
> :start:]
> > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> > > >> :start:***]Action
> > > >> > > > updated
> > > >> > > > > > in
> > > >> > > > > > > > DB!
> > > >> > > > > > > > > 2015-11-04 14:09:00,994 INFO
> > > >> > WorkflowNotificationXCommand:520
> > > >> > > -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@
> :start:]
> > No
> > > >> > > > > Notification
> > > >> > > > > > > URL
> > > >> > > > > > > > > is defined. Therefore nothing to notify for job
> > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > >> > > > > > > > > 2015-11-04 14:09:01,004 INFO
> > > >> > WorkflowNotificationXCommand:520
> > > >> > > -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[]
> No
> > > >> > > > Notification
> > > >> > > > > > URL
> > > >> > > > > > > is
> > > >> > > > > > > > > defined. Therefore nothing to notify for job
> > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > >> > > > > > > > > 2015-11-04 14:09:01,014 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > >
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > >> Start
> > > >> > > > > action
> > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node]
> with
> > > >> > > user-retry
> > > >> > > > > > > state :
> > > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> > userRetryInterval
> > > >> [10]
> > > >> > > > > > > > > 2015-11-04 14:09:02,916 INFO
> JavaActionExecutor:520 -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > >
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > >> > > checking
> > > >> > > > > > > action,
> > > >> > > > > > > > > hadoop job ID [job_1446620926630_0016] status
> > [RUNNING]
> > > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > >
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> > > >> ***]Action
> > > >> > > > > > > > > status=RUNNING
> > > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > >
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> > > >> ***]Action
> > > >> > > > > updated
> > > >> > > > > > > in
> > > >> > > > > > > > > DB!
> > > >> > > > > > > > > 2015-11-04 14:09:02,926 INFO
> > > >> > WorkflowNotificationXCommand:520
> > > >> > > -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > >
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > No
> > > >> > > > > > Notification
> > > >> > > > > > > > > URL is defined. Therefore nothing to notify for job
> > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > >> > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 -
> > > >> SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > >
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > >> > > callback
> > > >> > > > > for
> > > >> > > > > > > > > action
> [0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > >> > > > > > > > > 2015-11-04 14:09:17,907 INFO
> JavaActionExecutor:520 -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > >
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > >> > action
> > > >> > > > > > > completed,
> > > >> > > > > > > > > external ID [job_1446620926630_0016]
> > > >> > > > > > > > > 2015-11-04 14:09:18,029 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > Start
> > > >> > action
> > > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with
> > > >> user-retry
> > > >> > > > state :
> > > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> > userRetryInterval
> > > >> [10]
> > > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end
> > ***]Action
> > > >> > > > status=DONE
> > > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO
> ActionStartXCommand:520
> > -
> > > >> > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> > > > > APP[java-main-wf]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end
> > ***]Action
> > > >> > updated
> > > >> > > > in
> > > >> > > > > > DB!
> > > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > > >> > WorkflowNotificationXCommand:520
> > > >> > > -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
> > > >> > > Notification
> > > >> > > > > URL
> > > >> > > > > > > is
> > > >> > > > > > > > > defined. Therefore nothing to notify for job
> > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > > >> > WorkflowNotificationXCommand:520
> > > >> > > -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[]
> No
> > > >> > > > Notification
> > > >> > > > > > URL
> > > >> > > > > > > is
> > > >> > > > > > > > > defined. Therefore nothing to notify for job
> > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > >> > > > > > > > > 2015-11-04 14:09:18,105 INFO
> > > >> > WorkflowNotificationXCommand:520
> > > >> > > -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > >> > > > > > > > >
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> > ]
> > > No
> > > >> > > > > > Notification
> > > >> > > > > > > > > URL is defined. Therefore nothing to notify for job
> > > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > >> > > > > > > > >
> > > >> > > > > > > > >
> > > >> > > > > > > > >
> > > >> > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma
> <
> > > >> > > > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > >> > > > > > > > >
> > > >> > > > > > > > >> oozie job -info
> > > >> > 0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > > > > > > >> There you will find "Console URL" , Open that URL
> on
> > > >> > browser.
> > > >> > > > You
> > > >> > > > > > will
> > > >> > > > > > > > get
> > > >> > > > > > > > >> the Launcher mapper logs.
> > > >> > > > > > > > >>
> > > >> > > > > > > > >>
> > > >> > > > > > > > >>
> > > >> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > > >> > > > > > jeetendra.g@housing.com>
> > > >> > > > > > > > >> wrote:
> > > >> > > > > > > > >>
> > > >> > > > > > > > >> > This is the log i am getting repeatedly
> > > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > > >> > > > WorkflowNotificationXCommand:520 -
> > > >> > > > > > > > SERVER[
> > > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@
> > :start:]
> > > >> No
> > > >> > > > > > > Notification
> > > >> > > > > > > > >> URL
> > > >> > > > > > > > >> > is
> > > >> > > > > > > > >> > defined. Therefore nothing to notify for job
> > > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > > >> > > > WorkflowNotificationXCommand:520 -
> > > >> > > > > > > > SERVER[
> > > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[]
> > No
> > > >> > > > > Notification
> > > >> > > > > > > URL
> > > >> > > > > > > > >> is
> > > >> > > > > > > > >> > defined. Therefore nothing to notify for job
> > > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > >> > > > > > > > >> >
> > > >> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep
> > Vishwakarma <
> > > >> > > > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > >> > > > > > > > >> >
> > > >> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What it
> > > says?
> > > >> > > > > > > > >> > >
> > > >> > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > >> > > > > > > > jeetendra.g@housing.com>
> > > >> > > > > > > > >> > > wrote:
> > > >> > > > > > > > >> > >
> > > >> > > > > > > > >> > > > does anybody have any idea? i have been
> trying
> > > this
> > > >> > from
> > > >> > > > 10
> > > >> > > > > > days
> > > >> > > > > > > > >> > nothing
> > > >> > > > > > > > >> > > > worked out.
> > > >> > > > > > > > >> > > >
> > > >> > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G
> <
> > > >> > > > > > > > >> jeetendra.g@housing.com>
> > > >> > > > > > > > >> > > > wrote:
> > > >> > > > > > > > >> > > >
> > > >> > > > > > > > >> > > > > my workflow.xml
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > > > >> > > > > <workflow-app
> xmlns="uri:oozie:workflow:0.2"
> > > >> > > > > > > > name="java-main-wf">
> > > >> > > > > > > > >> > > > > <start to="java-node"/>
> > > >> > > > > > > > >> > > > > <action name="java-node">
> > > >> > > > > > > > >> > > > > <java>
> > > >> > > > > > > > >> > > > >
> > > >> <job-tracker>${jobTracker}</job-tracker>
> > > >> > > > > > > > >> > > > >
> > <name-node>${nameNode}</name-node>
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > > >
> <main-class>com.housing.common.JSONMerger</main-class>
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > >> > > > > > > > >> > > > >
> > > >> 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > >> > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > > > >> > > > > </java>
> > > >> > > > > > > > >> > > > > <ok to="end"/>
> > > >> > > > > > > > >> > > > > <error to="fail"/>
> > > >> > > > > > > > >> > > > > </action>
> > > >> > > > > > > > >> > > > > <kill name="fail">
> > > >> > > > > > > > >> > > > > <message>Java failed, error
> > > >> > > > > > > > >> > > > >
> > > >> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > >> > > > > > > > >> > > > > </kill>
> > > >> > > > > > > > >> > > > > <end name="end"/>
> > > >> > > > > > > > >> > > > > </workflow-app>
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra
> G
> > <
> > > >> > > > > > > > >> > jeetendra.g@housing.com>
> > > >> > > > > > > > >> > > > > wrote:
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > > > >> > > > >> Hi All,
> > > >> > > > > > > > >> > > > >>
> > > >> > > > > > > > >> > > > >> I am running java workflow job using
> oozie.
> > > >> > > > > > > > >> > > > >> I have Ambari server and I have installed
> > > oozie
> > > >> > from
> > > >> > > > > > Ambari.
> > > >> > > > > > > > >> > > > >> When i ran the job it say succeeded but
> its
> > > not
> > > >> > > running
> > > >> > > > > my
> > > >> > > > > > > java
> > > >> > > > > > > > >> > class
> > > >> > > > > > > > >> > > > >> which I mentioned inside workflow.xml.
> Also
> > > >> when I
> > > >> > > get
> > > >> > > > > > oozie
> > > >> > > > > > > > >> > nothing
> > > >> > > > > > > > >> > > > can
> > > >> > > > > > > > >> > > > >> be find pasting log beow, can anybody help
> > > here?
> > > >> > > > > > > > >> > > > >> oozie job -oozie
> > > >> > > > http://hadoop03.housing.com:11000/oozie
> > > >> > > > > > > -log
> > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@
> > > >> > :start:]
> > > >> > > > > Start
> > > >> > > > > > > > >> action
> > > >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@
> > > :start:]
> > > >> > with
> > > >> > > > > > > user-retry
> > > >> > > > > > > > >> > state
> > > >> > > > > > > > >> > > :
> > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > >> > > userRetryInterval
> > > >> > > > > > [10]
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@
> > > >> > :start:]
> > > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > > >> > > > > :start:***]Action
> > > >> > > > > > > > >> > > status=DONE
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@
> > > >> > :start:]
> > > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > > >> > > > > :start:***]Action
> > > >> > > > > > > > >> updated
> > > >> > > > > > > > >> > in
> > > >> > > > > > > > >> > > > DB!
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > >> > > > > > > WorkflowNotificationXCommand:520
> > > >> > > > > > > > -
> > > >> > > > > > > > >> > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > TOKEN[-]
> > > >> > > APP[-]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@
> > > >> > :start:]
> > > >> > > > No
> > > >> > > > > > > > >> > Notification
> > > >> > > > > > > > >> > > > URL
> > > >> > > > > > > > >> > > > >> is defined. Therefore nothing to notify
> for
> > > job
> > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@
> > :start:
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > >> > > > > > > WorkflowNotificationXCommand:520
> > > >> > > > > > > > -
> > > >> > > > > > > > >> > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > TOKEN[-]
> > > >> > > APP[-]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[]
> > > >> > No
> > > >> > > > > > > > >> Notification
> > > >> > > > > > > > >> > URL
> > > >> > > > > > > > >> > > > is
> > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for
> job
> > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > ]
> > > >> > > > > > Start
> > > >> > > > > > > > >> action
> > > >> > > > > > > > >> > > > >>
> > > [0000040-151015123257993-oozie-oozi-W@java-node
> > > >> ]
> > > >> > > with
> > > >> > > > > > > > user-retry
> > > >> > > > > > > > >> > > state
> > > >> > > > > > > > >> > > > :
> > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > >> > > userRetryInterval
> > > >> > > > > > [10]
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO
> > > >> > JavaActionExecutor:520
> > > >> > > -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > ]
> > > >> > > > > > > > checking
> > > >> > > > > > > > >> > > action,
> > > >> > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073]
> > status
> > > >> > > [RUNNING]
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > ]
> > > >> > > > > > > > >> > > > >>
> > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > > > > ***]Action
> > > >> > > > > > > > >> > > > >> status=RUNNING
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > ]
> > > >> > > > > > > > >> > > > >>
> > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > > > > ***]Action
> > > >> > > > > > > > >> > updated
> > > >> > > > > > > > >> > > in
> > > >> > > > > > > > >> > > > >> DB!
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > >> > > > > > > WorkflowNotificationXCommand:520
> > > >> > > > > > > > -
> > > >> > > > > > > > >> > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > TOKEN[-]
> > > >> > > APP[-]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > ]
> > > >> > > > > No
> > > >> > > > > > > > >> > > Notification
> > > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to
> notify
> > > for
> > > >> job
> > > >> > > > > > > > >> > > > >>
> > 0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO
> > > >> CallbackServlet:520 -
> > > >> > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > TOKEN[-]
> > > >> > > APP[-]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > ]
> > > >> > > > > > > > callback
> > > >> > > > > > > > >> for
> > > >> > > > > > > > >> > > > >> action
> > > >> > > [0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > > ]
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO
> > > >> > JavaActionExecutor:520
> > > >> > > -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > ]
> > > >> > > > > > > action
> > > >> > > > > > > > >> > > > completed,
> > > >> > > > > > > > >> > > > >> external ID [job_1444892488693_0073]
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > > >> ]
> > > >> > > Start
> > > >> > > > > > > action
> > > >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end
> ]
> > > with
> > > >> > > > > user-retry
> > > >> > > > > > > > >> state :
> > > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > >> > > userRetryInterval
> > > >> > > > > > [10]
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > > >> ]
> > > >> > > > > > > > >> > > > >>
> [***0000040-151015123257993-oozie-oozi-W@end
> > > >> > > ***]Action
> > > >> > > > > > > > >> status=DONE
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
> > > >> > > ActionStartXCommand:520 -
> > > >> > > > > > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > > >> TOKEN[]
> > > >> > > > > > > > >> APP[java-main-wf]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > > >> ]
> > > >> > > > > > > > >> > > > >>
> [***0000040-151015123257993-oozie-oozi-W@end
> > > >> > > ***]Action
> > > >> > > > > > > updated
> > > >> > > > > > > > >> in
> > > >> > > > > > > > >> > DB!
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > >> > > > > > > WorkflowNotificationXCommand:520
> > > >> > > > > > > > -
> > > >> > > > > > > > >> > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > TOKEN[-]
> > > >> > > APP[-]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > > >> ]
> > > >> > No
> > > >> > > > > > > > Notification
> > > >> > > > > > > > >> > URL
> > > >> > > > > > > > >> > > is
> > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for
> job
> > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > >> > > > > > > WorkflowNotificationXCommand:520
> > > >> > > > > > > > -
> > > >> > > > > > > > >> > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > TOKEN[-]
> > > >> > > APP[-]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[]
> > > >> > No
> > > >> > > > > > > > >> Notification
> > > >> > > > > > > > >> > URL
> > > >> > > > > > > > >> > > > is
> > > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for
> job
> > > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > >> > > > > > > WorkflowNotificationXCommand:520
> > > >> > > > > > > > -
> > > >> > > > > > > > >> > > SERVER[
> > > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > > TOKEN[-]
> > > >> > > APP[-]
> > > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > > > > > >> > > > >>
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > ]
> > > >> > > > > No
> > > >> > > > > > > > >> > > Notification
> > > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to
> notify
> > > for
> > > >> job
> > > >> > > > > > > > >> > > > >>
> > 0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > > > > > > >> > > > >>
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > > > >> > > > >
> > > >> > > > > > > > >> > > >
> > > >> > > > > > > > >> > >
> > > >> > > > > > > > >> > > --
> > > >> > > > > > > > >> > >
> > > >> > > > _____________________________________________________________
> > > >> > > > > > > > >> > > The information contained in this communication
> > is
> > > >> > > intended
> > > >> > > > > > solely
> > > >> > > > > > > > for
> > > >> > > > > > > > >> > the
> > > >> > > > > > > > >> > > use of the individual or entity to whom it is
> > > >> addressed
> > > >> > > and
> > > >> > > > > > others
> > > >> > > > > > > > >> > > authorized to receive it. It may contain
> > > >> confidential or
> > > >> > > > > legally
> > > >> > > > > > > > >> > privileged
> > > >> > > > > > > > >> > > information. If you are not the intended
> > recipient
> > > >> you
> > > >> > are
> > > >> > > > > > hereby
> > > >> > > > > > > > >> > notified
> > > >> > > > > > > > >> > > that any disclosure, copying, distribution or
> > > taking
> > > >> any
> > > >> > > > > action
> > > >> > > > > > in
> > > >> > > > > > > > >> > reliance
> > > >> > > > > > > > >> > > on the contents of this information is strictly
> > > >> > prohibited
> > > >> > > > and
> > > >> > > > > > may
> > > >> > > > > > > > be
> > > >> > > > > > > > >> > > unlawful. If you have received this
> communication
> > > in
> > > >> > > error,
> > > >> > > > > > please
> > > >> > > > > > > > >> notify
> > > >> > > > > > > > >> > > us immediately by responding to this email and
> > then
> > > >> > delete
> > > >> > > > it
> > > >> > > > > > from
> > > >> > > > > > > > >> your
> > > >> > > > > > > > >> > > system. The firm is neither liable for the
> proper
> > > and
> > > >> > > > complete
> > > >> > > > > > > > >> > transmission
> > > >> > > > > > > > >> > > of the information contained in this
> > communication
> > > >> nor
> > > >> > for
> > > >> > > > any
> > > >> > > > > > > delay
> > > >> > > > > > > > >> in
> > > >> > > > > > > > >> > its
> > > >> > > > > > > > >> > > receipt.
> > > >> > > > > > > > >> > >
> > > >> > > > > > > > >> >
> > > >> > > > > > > > >>
> > > >> > > > > > > > >> --
> > > >> > > > > > > > >>
> > > >> > _____________________________________________________________
> > > >> > > > > > > > >> The information contained in this communication is
> > > >> intended
> > > >> > > > solely
> > > >> > > > > > for
> > > >> > > > > > > > the
> > > >> > > > > > > > >> use of the individual or entity to whom it is
> > addressed
> > > >> and
> > > >> > > > others
> > > >> > > > > > > > >> authorized to receive it. It may contain
> confidential
> > > or
> > > >> > > legally
> > > >> > > > > > > > >> privileged
> > > >> > > > > > > > >> information. If you are not the intended recipient
> > you
> > > >> are
> > > >> > > > hereby
> > > >> > > > > > > > notified
> > > >> > > > > > > > >> that any disclosure, copying, distribution or
> taking
> > > any
> > > >> > > action
> > > >> > > > in
> > > >> > > > > > > > >> reliance
> > > >> > > > > > > > >> on the contents of this information is strictly
> > > >> prohibited
> > > >> > and
> > > >> > > > may
> > > >> > > > > > be
> > > >> > > > > > > > >> unlawful. If you have received this communication
> in
> > > >> error,
> > > >> > > > please
> > > >> > > > > > > > notify
> > > >> > > > > > > > >> us immediately by responding to this email and then
> > > >> delete
> > > >> > it
> > > >> > > > from
> > > >> > > > > > > your
> > > >> > > > > > > > >> system. The firm is neither liable for the proper
> and
> > > >> > complete
> > > >> > > > > > > > >> transmission
> > > >> > > > > > > > >> of the information contained in this communication
> > nor
> > > >> for
> > > >> > any
> > > >> > > > > delay
> > > >> > > > > > > in
> > > >> > > > > > > > >> its
> > > >> > > > > > > > >> receipt.
> > > >> > > > > > > > >>
> > > >> > > > > > > > >
> > > >> > > > > > > > >
> > > >> > > > > > > >
> > > >> > > > > > >
> > > >> > > > > > > --
> > > >> > > > > > >
> > > _____________________________________________________________
> > > >> > > > > > > The information contained in this communication is
> > intended
> > > >> > solely
> > > >> > > > for
> > > >> > > > > > the
> > > >> > > > > > > use of the individual or entity to whom it is addressed
> > and
> > > >> > others
> > > >> > > > > > > authorized to receive it. It may contain confidential or
> > > >> legally
> > > >> > > > > > privileged
> > > >> > > > > > > information. If you are not the intended recipient you
> are
> > > >> hereby
> > > >> > > > > > notified
> > > >> > > > > > > that any disclosure, copying, distribution or taking any
> > > >> action
> > > >> > in
> > > >> > > > > > reliance
> > > >> > > > > > > on the contents of this information is strictly
> prohibited
> > > and
> > > >> > may
> > > >> > > be
> > > >> > > > > > > unlawful. If you have received this communication in
> > error,
> > > >> > please
> > > >> > > > > notify
> > > >> > > > > > > us immediately by responding to this email and then
> delete
> > > it
> > > >> > from
> > > >> > > > your
> > > >> > > > > > > system. The firm is neither liable for the proper and
> > > complete
> > > >> > > > > > transmission
> > > >> > > > > > > of the information contained in this communication nor
> for
> > > any
> > > >> > > delay
> > > >> > > > in
> > > >> > > > > > its
> > > >> > > > > > > receipt.
> > > >> > > > > > >
> > > >> > > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > --
> > > >> > > > _____________________________________________________________
> > > >> > > > The information contained in this communication is intended
> > solely
> > > >> for
> > > >> > > the
> > > >> > > > use of the individual or entity to whom it is addressed and
> > others
> > > >> > > > authorized to receive it. It may contain confidential or
> legally
> > > >> > > privileged
> > > >> > > > information. If you are not the intended recipient you are
> > hereby
> > > >> > > notified
> > > >> > > > that any disclosure, copying, distribution or taking any
> action
> > in
> > > >> > > reliance
> > > >> > > > on the contents of this information is strictly prohibited and
> > may
> > > >> be
> > > >> > > > unlawful. If you have received this communication in error,
> > please
> > > >> > notify
> > > >> > > > us immediately by responding to this email and then delete it
> > from
> > > >> your
> > > >> > > > system. The firm is neither liable for the proper and complete
> > > >> > > transmission
> > > >> > > > of the information contained in this communication nor for any
> > > >> delay in
> > > >> > > its
> > > >> > > > receipt.
> > > >> > > >
> > > >> > >
> > > >> >
> > > >> > --
> > > >> > _____________________________________________________________
> > > >> > The information contained in this communication is intended solely
> > for
> > > >> the
> > > >> > use of the individual or entity to whom it is addressed and others
> > > >> > authorized to receive it. It may contain confidential or legally
> > > >> privileged
> > > >> > information. If you are not the intended recipient you are hereby
> > > >> notified
> > > >> > that any disclosure, copying, distribution or taking any action in
> > > >> reliance
> > > >> > on the contents of this information is strictly prohibited and may
> > be
> > > >> > unlawful. If you have received this communication in error, please
> > > >> notify
> > > >> > us immediately by responding to this email and then delete it from
> > > your
> > > >> > system. The firm is neither liable for the proper and complete
> > > >> transmission
> > > >> > of the information contained in this communication nor for any
> delay
> > > in
> > > >> its
> > > >> > receipt.
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
@ Serega:There are enough resources there is no resource starvation.
On Wed, Nov 4, 2015 at 8:10 PM, Serega Sheypak <se...@gmail.com>
wrote:
> Which job succeeded? What is attached?
> Other problem could be: you have resource starvation, there are no
> resources on RM to run your job. Did you check it?
>
> 2015-11-04 15:15 GMT+01:00 Jeetendra G <je...@housing.com>:
>
> > Also I verified there is no issue with my java class because when I run
> it
> > without oozie its works perfectly.
> >
> >
> > On Wed, Nov 4, 2015 at 7:43 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > it says job succeeded attaching
> > >
> > > On Wed, Nov 4, 2015 at 7:37 PM, Serega Sheypak <
> serega.sheypak@gmail.com
> > >
> > > wrote:
> > >
> > >> Hm... ok, can you see what happens on YARN RM web ui?
> > >> There should be a job that runs yuor oozie mapper launcher.
> > >>
> > >> 2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma <
> > >> jaydeep.vishwakarma@inmobi.com>:
> > >>
> > >> > Good, So not issue with Yarn or name node urls. Can you share stdout
> > >> logs.
> > >> >
> > >> >
> > >> > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <
> jeetendra.g@housing.com>
> > >> > wrote:
> > >> >
> > >> > > Hi Jaydeep here also I cant see any error below are the logs
> > >> > >
> > >> > > Log Type: syslog
> > >> > >
> > >> > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
> > >> > >
> > >> > > Log Length: 25565
> > >> > >
> > >> > > 2015-11-04 14:59:11,814 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created
> MRAppMaster
> > >> > > for application appattempt_1446620926630_0017_000001
> > >> > > 2015-11-04 14:59:12,144 WARN [main]
> > >> > > org.apache.hadoop.util.NativeCodeLoader: Unable to load
> > native-hadoop
> > >> > > library for your platform... using builtin-java classes where
> > >> > > applicable
> > >> > > 2015-11-04 14:59:12,184 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with
> > tokens:
> > >> > > 2015-11-04 14:59:12,292 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > >> > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId {
> application_id {
> > >> > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
> > >> > > -173762614)
> > >> > > 2015-11-04 14:59:12,293 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > >> > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident:
> (owner=hdfs,
> > >> > > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
> > >> > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> > >> > > 2015-11-04 14:59:12,890 WARN [main]
> > >> > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
> > >> > > short-circuit local reads feature cannot be used because libhadoop
> > >> > > cannot be loaded.
> > >> > > 2015-11-04 14:59:13,064 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter
> set
> > in
> > >> > > config null
> > >> > > 2015-11-04 14:59:13,065 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
> > >> > > org.apache.hadoop.mapred.FileOutputCommitter
> > >> > > 2015-11-04 14:59:13,110 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.jobhistory.EventType for class
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> > >> > > 2015-11-04 14:59:13,110 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for
> class
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> > >> > > 2015-11-04 14:59:13,111 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for
> class
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> > >> > > 2015-11-04 14:59:13,111 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType
> > for
> > >> > > class
> > >> > >
> > >>
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> > >> > > 2015-11-04 14:59:13,112 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for
> > class
> > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> > >> > > 2015-11-04 14:59:13,112 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType
> > for
> > >> > > class
> > >> > >
> > >>
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> > >> > > 2015-11-04 14:59:13,113 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType
> > for
> > >> > > class
> > >> > >
> > >>
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> > >> > > 2015-11-04 14:59:13,113 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > >
> > >>
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> > >> > > for class
> > >> > >
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> > >> > > 2015-11-04 14:59:13,144 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > >> > > file system is set solely by core-default.xml therefore -
> ignoring
> > >> > > 2015-11-04 14:59:13,170 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > >> > > file system is set solely by core-default.xml therefore -
> ignoring
> > >> > > 2015-11-04 14:59:13,189 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > >> > > file system is set solely by core-default.xml therefore -
> ignoring
> > >> > > 2015-11-04 14:59:13,219 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > >> > > Emitting job history data to the timeline server is not enabled
> > >> > > 2015-11-04 14:59:13,255 INFO [main]
> > >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type
> for
> > >> > > class
> > >> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> > >> > > 2015-11-04 14:59:13,453 WARN [main]
> > >> > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> > >> > > configuration: tried
> > >> > > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> > >> > > 2015-11-04 14:59:13,546 INFO [main]
> > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
> > snapshot
> > >> > > period at 10 second(s).
> > >> > > 2015-11-04 14:59:13,546 INFO [main]
> > >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster
> > metrics
> > >> > > system started
> > >> > > 2015-11-04 14:59:13,557 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job
> > token
> > >> > > for job_1446620926630_0017 to jobTokenSecretManager
> > >> > > 2015-11-04 14:59:13,680 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
> > >> > > job_1446620926630_0017 because: not enabled; too much RAM;
> > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size
> for
> > >> > > job job_1446620926630_0017 = 0. Number of splits = 1
> > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of
> > reduces
> > >> > > for job job_1446620926630_0017 = 0
> > >> > > 2015-11-04 14:59:13,701 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from NEW to INITED
> > >> > > 2015-11-04 14:59:13,702 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster
> > launching
> > >> > > normal, non-uberized, multi-container job job_1446620926630_0017.
> > >> > > 2015-11-04 14:59:13,725 INFO [main]
> > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > >> > > java.util.concurrent.LinkedBlockingQueue
> > >> > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
> > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port
> > 39640
> > >> > > 2015-11-04 14:59:13,758 INFO [main]
> > >> > > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> > >> > > Adding protocol
> > org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
> > >> > > to the server
> > >> > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
> > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > >> > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
> > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640:
> starting
> > >> > > 2015-11-04 14:59:13,762 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
> > >> > > Instantiated MRClientService at
> > >> hadoop04.housing.com/10.21.1.138:39640
> > >> > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
> > >> > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> > >> > > org.mortbay.log.Slf4jLog
> > >> > > 2015-11-04 14:59:13,862 INFO [main]
> > >> > >
> > org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> > >> > > Unable to initialize FileSignerSecretProvider, falling back to use
> > >> > > random secrets.
> > >> > > 2015-11-04 14:59:13,867 WARN [main]
> > >> > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can only
> be
> > >> > > enabled using Log4j
> > >> > > 2015-11-04 14:59:13,874 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
> > >> > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> > >> > > 2015-11-04 14:59:13,878 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > >> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> > to
> > >> > > context mapreduce
> > >> > > 2015-11-04 14:59:13,879 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > >> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> > to
> > >> > > context static
> > >> > > 2015-11-04 14:59:13,882 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
> > >> > > 2015-11-04 14:59:13,882 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> > >> > > 2015-11-04 14:59:14,217 INFO [main]
> > >> > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice
> > modules
> > >> > > 2015-11-04 14:59:14,218 INFO [main]
> > >> > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> > >> > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log:
> > jetty-6.1.26.hwx
> > >> > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
> > >> > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> > >> > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
> > >> > > HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> > >> > > 2015-11-04 14:59:15,952 INFO [main]
> > >> > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started
> at
> > >> > > 49791
> > >> > > 2015-11-04 14:59:15,957 INFO [main]
> > >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > >> > > java.util.concurrent.LinkedBlockingQueue
> > >> > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
> > >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port
> > 50432
> > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
> > >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > >> > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
> > >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432:
> starting
> > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > nodeBlacklistingEnabled:true
> > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > maxTaskFailuresPerNode is 3
> > >> > > 2015-11-04 14:59:15,988 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > blacklistDisablePercent is 33
> > >> > > 2015-11-04 14:59:16,035 INFO [main]
> > >> > > org.apache.hadoop.yarn.client.RMProxy: Connecting to
> ResourceManager
> > >> > > at hadoop02.housing.com/10.21.1.136:8030
> > >> > > 2015-11-04 14:59:16,113 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> > >> > > maxContainerCapability: <memory:5120, vCores:3>
> > >> > > 2015-11-04 14:59:16,113 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue:
> default
> > >> > > 2015-11-04 14:59:16,117 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Upper limit on the thread pool size is 500
> > >> > > 2015-11-04 14:59:16,118 INFO [main]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > The
> > >> > > thread pool initial size is 10
> > >> > > 2015-11-04 14:59:16,120 INFO [main]
> > >> > >
> > >>
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > >> > > yarn.client.max-cached-nodemanagers-proxies : 0
> > >> > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from INITED to SETUP
> > >> > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
> > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > >> > > Processing the event EventType: JOB_SETUP
> > >> > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
> > >> > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
> > >> > > Output Committer Algorithm version is 1
> > >> > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> > >> > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > >> > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to
> > >> > > SCHEDULED
> > >> > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > NEW to UNASSIGNED
> > >> > > 2015-11-04 14:59:16,202 INFO [Thread-51]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > >> > > mapResourceRequest:<memory:1536, vCores:1>
> > >> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Event
> > >> > > Writer setup for JobId: job_1446620926630_0017, File:
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > >> > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> > >> > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
> > >> > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > >> > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> > >> > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > getResources() for application_1446620926630_0017: ask=1 release=
> 0
> > >> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
> > >> > > vCores:1> knownNMs=5
> > >> > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
> > >> > > allocated containers 1
> > >> > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > >> > > hadoop04.housing.com to /default-rack
> > >> > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> Assigned
> > >> > > container container_e02_1446620926630_0017_01_000002 to
> > >> > > attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> > >> > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> > >> > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > >> > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > >> > > hadoop04.housing.com to /default-rack
> > >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job
> jar
> > >> > > is not present. Not adding any jar to the list of resources.
> > >> > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
> > >> > > job-conf file on the remote FS is
> > >> > > /user/hdfs/.staging/job_1446620926630_0017/job.xml
> > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> Adding
> > #1
> > >> > > tokens and #1 secret keys for NM use for launching container
> > >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size
> of
> > >> > > containertokens_dob is 2
> > >> > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> Putting
> > >> > > shuffle token in serviceData
> > >> > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > UNASSIGNED to ASSIGNED
> > >> > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for
> > container
> > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > >> > > attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Launching attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
> > >> > >
> > >>
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > >> > > Opening proxy : hadoop04.housing.com:45454
> > >> > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Shuffle port returned by ContainerManager for
> > >> > > attempt_1446620926630_0017_m_000000_0 : 13562
> > >> > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
> > >> > > containerId: [container_e02_1446620926630_0017_01_000002 on NM:
> > >> > > [hadoop04.housing.com:45454]
> > >> > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > ASSIGNED to RUNNING
> > >> > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > >> > > task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED
> to
> > >> > > RUNNING
> > >> > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > >> > > getResources() for application_1446620926630_0017: ask=1 release=
> 0
> > >> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
> > >> > > vCores:1> knownNMs=5
> > >> > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
> > >> > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
> > >> > > job_1446620926630_0017 (auth:SIMPLE)
> > >> > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
> > >> > > jvm_1446620926630_0017_m_2199023255554 asked for a task
> > >> > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> > >> > > jvm_1446620926630_0017_m_2199023255554 given task:
> > >> > > attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> > >> > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending
> > state
> > >> > > update from attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > RUNNING to COMMIT_PENDING
> > >> > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 given a go for committing
> the
> > >> > > task output.
> > >> > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
> > >> > > request from attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
> > >> > > canCommit for attempt_1446620926630_0017_m_000000_0:true
> > >> > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> > >> > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
> > >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done
> > acknowledgement
> > >> > > from attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> > >> > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for
> > container
> > >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > >> > > attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > >> > > KILLING attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > >> > >
> > >>
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > >> > > Opening proxy : hadoop04.housing.com:45454
> > >> > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned
> from
> > >> > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task
> succeeded
> > >> > > with attempt attempt_1446620926630_0017_m_000000_0
> > >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > >> > > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
> > >> > > SUCCEEDED
> > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
> > >> > > Tasks: 1
> > >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
> > >> > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
> > >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > >> > > Processing the event EventType: JOB_COMMIT
> > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling
> handler
> > >> > > for JobFinishedEvent
> > >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > >> > > job_1446620926630_0017Job Transitioned from COMMITTING to
> SUCCEEDED
> > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
> > >> > > cleanly so this is the last retry
> > >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify
> > RMCommunicator
> > >> > > isAMLastRetry: true
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> RMCommunicator
> > >> > > notified that shouldUnregistered is: true
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
> > >> > > isAMLastRetry: true
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > >> > > JobHistoryEventHandler notified that forceJobCompletion is true
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for
> all
> > >> > > the services
> > >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > >> > > Stopping JobHistoryEventHandler. Size of the outstanding queue
> size
> > is
> > >> > > 0
> > >> > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Copying
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > >> > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Copied
> > >> > > to done location:
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > >> > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Copying
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > >> > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Copied
> > >> > > to done location:
> > >> > > hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > >> > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Moved
> > >> > > tmp to done: hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> > >> > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Moved
> > >> > > tmp to done: hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> > >> > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Moved
> > >> > > tmp to done: hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > >> > > to hdfs://
> > >> > >
> > >> >
> > >>
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> > >> > > 2015-11-04 14:59:22,965 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Stopped
> > >> > > JobHistoryEventHandler. super.stop()
> > >> > > 2015-11-04 14:59:22,968 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
> > >> > > diagnostics to
> > >> > > 2015-11-04 14:59:22,969 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url
> is
> > >> > >
> > >>
> http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> > >> > > 2015-11-04 14:59:22,976 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
> > >> > > application to be successfully unregistered.
> > >> > > 2015-11-04 14:59:23,979 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
> > >> > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> AssignedMaps:1
> > >> > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1
> ContRel:0
> > >> > > HostLocal:0 RackLocal:0
> > >> > > 2015-11-04 14:59:23,980 INFO [Thread-67]
> > >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
> > >> > > directory hdfs://hadoop01.housing.com:8020
> > >> > > /user/hdfs/.staging/job_1446620926630_0017
> > >> > > 2015-11-04 14:59:23,984 INFO [Thread-67]
> > org.apache.hadoop.ipc.Server:
> > >> > > Stopping server on 50432
> > >> > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
> > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on
> 50432
> > >> > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
> > >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> > >> > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
> > >> > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
> > >> > > TaskHeartbeatHandler thread interrupted
> > >> > >
> > >> > >
> > >> > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> > >> > > jaydeep.vishwakarma@inmobi.com> wrote:
> > >> > >
> > >> > > > In first look I am not seeing any issue with job tracker or name
> > >> node
> > >> > > URL.
> > >> > > > The job id is getting generated. Workflow Job is not going on
> > PREP
> > >> > mode.
> > >> > > >
> > >> > > > Open this link.
> > >> > > >
> > >>
> http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
> > >> > > >
> > >> > > > You will be see the problem.
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <
> > >> jeetendra.g@housing.com>
> > >> > > > wrote:
> > >> > > >
> > >> > > > > hey Serega I have cross verified jobTracker value is correct
> > only
> > >> I
> > >> > am
> > >> > > > > using yarn so resource manager will become the job tracker?
> > >> > > > >
> > >> > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
> > >> > > serega.sheypak@gmail.com
> > >> > > > >
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > > > Can you go to oozie server and grab logs from there? My
> > >> assumption
> > >> > > that
> > >> > > > > > <job-tracker>${jobTracker}</job-tracker>
> > >> > > > > > <name-node>${nameNode}</name-node>
> > >> > > > > >
> > >> > > > > > have incorrect values. Probably ${jobTracker} is wrong and
> > oozie
> > >> > > can't
> > >> > > > > even
> > >> > > > > > start launcher mapper.
> > >> > > > > >
> > >> > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > >> > > > > > jaydeep.vishwakarma@inmobi.com>:
> > >> > > > > >
> > >> > > > > > > You are doing -log. Can you give the command as below and
> > get
> > >> the
> > >> > > job
> > >> > > > > url
> > >> > > > > > > (application launcher url).
> > >> > > > > > >
> > >> > > > > > > *oozie job -info
> > >> 0000040-151015123257993-oozie-oozi-W@java-node*
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
> > >> > > jeetendra.g@housing.com
> > >> > > > >
> > >> > > > > > > wrote:
> > >> > > > > > >
> > >> > > > > > > > and in job error log tab its saying error log is
> disables?
> > >> by
> > >> > > > default
> > >> > > > > > why
> > >> > > > > > > > error log is disables? i am using hortonworks
> > >> > > > > > > >
> > >> > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> > >> > > > jeetendra.g@housing.com
> > >> > > > > >
> > >> > > > > > > > wrote:
> > >> > > > > > > >
> > >> > > > > > > > > same error.
> > >> > > > > > > > >
> > >> > > > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > >> Start
> > >> > > > action
> > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with
> > >> > user-retry
> > >> > > > > > state :
> > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > >> [10]
> > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> > >> :start:***]Action
> > >> > > > > > status=DONE
> > >> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> > >> :start:***]Action
> > >> > > > updated
> > >> > > > > > in
> > >> > > > > > > > DB!
> > >> > > > > > > > > 2015-11-04 14:09:00,994 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> No
> > >> > > > > Notification
> > >> > > > > > > URL
> > >> > > > > > > > > is defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > >> > > > > > > > > 2015-11-04 14:09:01,004 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > >> > > > Notification
> > >> > > > > > URL
> > >> > > > > > > is
> > >> > > > > > > > > defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > >> > > > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> Start
> > >> > > > > action
> > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with
> > >> > > user-retry
> > >> > > > > > > state :
> > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > >> [10]
> > >> > > > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > checking
> > >> > > > > > > action,
> > >> > > > > > > > > hadoop job ID [job_1446620926630_0016] status
> [RUNNING]
> > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> > >> ***]Action
> > >> > > > > > > > > status=RUNNING
> > >> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> > >> ***]Action
> > >> > > > > updated
> > >> > > > > > > in
> > >> > > > > > > > > DB!
> > >> > > > > > > > > 2015-11-04 14:09:02,926 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > No
> > >> > > > > > Notification
> > >> > > > > > > > > URL is defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > >> > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 -
> > >> SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > callback
> > >> > > > > for
> > >> > > > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > > > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > >> > action
> > >> > > > > > > completed,
> > >> > > > > > > > > external ID [job_1446620926630_0016]
> > >> > > > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> Start
> > >> > action
> > >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with
> > >> user-retry
> > >> > > > state :
> > >> > > > > > > > > userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > >> [10]
> > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end
> ***]Action
> > >> > > > status=DONE
> > >> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520
> -
> > >> > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> > > > > APP[java-main-wf]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end
> ***]Action
> > >> > updated
> > >> > > > in
> > >> > > > > > DB!
> > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
> > >> > > Notification
> > >> > > > > URL
> > >> > > > > > > is
> > >> > > > > > > > > defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > >> > > > Notification
> > >> > > > > > URL
> > >> > > > > > > is
> > >> > > > > > > > > defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > >> > > > > > > > > 2015-11-04 14:09:18,105 INFO
> > >> > WorkflowNotificationXCommand:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node
> ]
> > No
> > >> > > > > > Notification
> > >> > > > > > > > > URL is defined. Therefore nothing to notify for job
> > >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > >> > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > >> > > > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > >> > > > > > > > >
> > >> > > > > > > > >> oozie job -info
> > >> > 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > > > >> There you will find "Console URL" , Open that URL on
> > >> > browser.
> > >> > > > You
> > >> > > > > > will
> > >> > > > > > > > get
> > >> > > > > > > > >> the Launcher mapper logs.
> > >> > > > > > > > >>
> > >> > > > > > > > >>
> > >> > > > > > > > >>
> > >> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > >> > > > > > jeetendra.g@housing.com>
> > >> > > > > > > > >> wrote:
> > >> > > > > > > > >>
> > >> > > > > > > > >> > This is the log i am getting repeatedly
> > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > >> > > > WorkflowNotificationXCommand:520 -
> > >> > > > > > > > SERVER[
> > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@
> :start:]
> > >> No
> > >> > > > > > > Notification
> > >> > > > > > > > >> URL
> > >> > > > > > > > >> > is
> > >> > > > > > > > >> > defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > >> > > > WorkflowNotificationXCommand:520 -
> > >> > > > > > > > SERVER[
> > >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[]
> No
> > >> > > > > Notification
> > >> > > > > > > URL
> > >> > > > > > > > >> is
> > >> > > > > > > > >> > defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > >> > > > > > > > >> >
> > >> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep
> Vishwakarma <
> > >> > > > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > >> > > > > > > > >> >
> > >> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What it
> > says?
> > >> > > > > > > > >> > >
> > >> > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > >> > > > > > > > jeetendra.g@housing.com>
> > >> > > > > > > > >> > > wrote:
> > >> > > > > > > > >> > >
> > >> > > > > > > > >> > > > does anybody have any idea? i have been trying
> > this
> > >> > from
> > >> > > > 10
> > >> > > > > > days
> > >> > > > > > > > >> > nothing
> > >> > > > > > > > >> > > > worked out.
> > >> > > > > > > > >> > > >
> > >> > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > >> > > > > > > > >> jeetendra.g@housing.com>
> > >> > > > > > > > >> > > > wrote:
> > >> > > > > > > > >> > > >
> > >> > > > > > > > >> > > > > my workflow.xml
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > >> > > > > > > > name="java-main-wf">
> > >> > > > > > > > >> > > > > <start to="java-node"/>
> > >> > > > > > > > >> > > > > <action name="java-node">
> > >> > > > > > > > >> > > > > <java>
> > >> > > > > > > > >> > > > >
> > >> <job-tracker>${jobTracker}</job-tracker>
> > >> > > > > > > > >> > > > >
> <name-node>${nameNode}</name-node>
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > >> > > > > > > > >> > > > >
> > >> > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > >> > > > > > > > >> > > > >
> > >> 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > >> > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > > </java>
> > >> > > > > > > > >> > > > > <ok to="end"/>
> > >> > > > > > > > >> > > > > <error to="fail"/>
> > >> > > > > > > > >> > > > > </action>
> > >> > > > > > > > >> > > > > <kill name="fail">
> > >> > > > > > > > >> > > > > <message>Java failed, error
> > >> > > > > > > > >> > > > >
> > >> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > >> > > > > > > > >> > > > > </kill>
> > >> > > > > > > > >> > > > > <end name="end"/>
> > >> > > > > > > > >> > > > > </workflow-app>
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G
> <
> > >> > > > > > > > >> > jeetendra.g@housing.com>
> > >> > > > > > > > >> > > > > wrote:
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > >> Hi All,
> > >> > > > > > > > >> > > > >>
> > >> > > > > > > > >> > > > >> I am running java workflow job using oozie.
> > >> > > > > > > > >> > > > >> I have Ambari server and I have installed
> > oozie
> > >> > from
> > >> > > > > > Ambari.
> > >> > > > > > > > >> > > > >> When i ran the job it say succeeded but its
> > not
> > >> > > running
> > >> > > > > my
> > >> > > > > > > java
> > >> > > > > > > > >> > class
> > >> > > > > > > > >> > > > >> which I mentioned inside workflow.xml. Also
> > >> when I
> > >> > > get
> > >> > > > > > oozie
> > >> > > > > > > > >> > nothing
> > >> > > > > > > > >> > > > can
> > >> > > > > > > > >> > > > >> be find pasting log beow, can anybody help
> > here?
> > >> > > > > > > > >> > > > >> oozie job -oozie
> > >> > > > http://hadoop03.housing.com:11000/oozie
> > >> > > > > > > -log
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > >> > :start:]
> > >> > > > > Start
> > >> > > > > > > > >> action
> > >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@
> > :start:]
> > >> > with
> > >> > > > > > > user-retry
> > >> > > > > > > > >> > state
> > >> > > > > > > > >> > > :
> > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > >> > > userRetryInterval
> > >> > > > > > [10]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > >> > :start:]
> > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > >> > > > > :start:***]Action
> > >> > > > > > > > >> > > status=DONE
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > >> > :start:]
> > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > >> > > > > :start:***]Action
> > >> > > > > > > > >> updated
> > >> > > > > > > > >> > in
> > >> > > > > > > > >> > > > DB!
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > >> > :start:]
> > >> > > > No
> > >> > > > > > > > >> > Notification
> > >> > > > > > > > >> > > > URL
> > >> > > > > > > > >> > > > >> is defined. Therefore nothing to notify for
> > job
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@
> :start:
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[]
> > >> > No
> > >> > > > > > > > >> Notification
> > >> > > > > > > > >> > URL
> > >> > > > > > > > >> > > > is
> > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > Start
> > >> > > > > > > > >> action
> > >> > > > > > > > >> > > > >>
> > [0000040-151015123257993-oozie-oozi-W@java-node
> > >> ]
> > >> > > with
> > >> > > > > > > > user-retry
> > >> > > > > > > > >> > > state
> > >> > > > > > > > >> > > > :
> > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > >> > > userRetryInterval
> > >> > > > > > [10]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO
> > >> > JavaActionExecutor:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > > checking
> > >> > > > > > > > >> > > action,
> > >> > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073]
> status
> > >> > > [RUNNING]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > > >> > > > >>
> > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > ***]Action
> > >> > > > > > > > >> > > > >> status=RUNNING
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > > >> > > > >>
> > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > ***]Action
> > >> > > > > > > > >> > updated
> > >> > > > > > > > >> > > in
> > >> > > > > > > > >> > > > >> DB!
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > No
> > >> > > > > > > > >> > > Notification
> > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify
> > for
> > >> job
> > >> > > > > > > > >> > > > >>
> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO
> > >> CallbackServlet:520 -
> > >> > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > > callback
> > >> > > > > > > > >> for
> > >> > > > > > > > >> > > > >> action
> > >> > > [0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > ]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO
> > >> > JavaActionExecutor:520
> > >> > > -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > > > action
> > >> > > > > > > > >> > > > completed,
> > >> > > > > > > > >> > > > >> external ID [job_1444892488693_0073]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > >> ]
> > >> > > Start
> > >> > > > > > > action
> > >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end]
> > with
> > >> > > > > user-retry
> > >> > > > > > > > >> state :
> > >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > >> > > userRetryInterval
> > >> > > > > > [10]
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > >> ]
> > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> > >> > > ***]Action
> > >> > > > > > > > >> status=DONE
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
> > >> > > ActionStartXCommand:520 -
> > >> > > > > > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> > >> TOKEN[]
> > >> > > > > > > > >> APP[java-main-wf]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > >> ]
> > >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> > >> > > ***]Action
> > >> > > > > > > updated
> > >> > > > > > > > >> in
> > >> > > > > > > > >> > DB!
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@end
> > >> ]
> > >> > No
> > >> > > > > > > > Notification
> > >> > > > > > > > >> > URL
> > >> > > > > > > > >> > > is
> > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[]
> > >> > No
> > >> > > > > > > > >> Notification
> > >> > > > > > > > >> > URL
> > >> > > > > > > > >> > > > is
> > >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > >> > > > > > > WorkflowNotificationXCommand:520
> > >> > > > > > > > -
> > >> > > > > > > > >> > > SERVER[
> > >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> > TOKEN[-]
> > >> > > APP[-]
> > >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > > > > > >> > > > >>
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > ]
> > >> > > > > No
> > >> > > > > > > > >> > > Notification
> > >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify
> > for
> > >> job
> > >> > > > > > > > >> > > > >>
> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > > > > > >> > > > >>
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > > >
> > >> > > > > > > > >> > > >
> > >> > > > > > > > >> > >
> > >> > > > > > > > >> > > --
> > >> > > > > > > > >> > >
> > >> > > > _____________________________________________________________
> > >> > > > > > > > >> > > The information contained in this communication
> is
> > >> > > intended
> > >> > > > > > solely
> > >> > > > > > > > for
> > >> > > > > > > > >> > the
> > >> > > > > > > > >> > > use of the individual or entity to whom it is
> > >> addressed
> > >> > > and
> > >> > > > > > others
> > >> > > > > > > > >> > > authorized to receive it. It may contain
> > >> confidential or
> > >> > > > > legally
> > >> > > > > > > > >> > privileged
> > >> > > > > > > > >> > > information. If you are not the intended
> recipient
> > >> you
> > >> > are
> > >> > > > > > hereby
> > >> > > > > > > > >> > notified
> > >> > > > > > > > >> > > that any disclosure, copying, distribution or
> > taking
> > >> any
> > >> > > > > action
> > >> > > > > > in
> > >> > > > > > > > >> > reliance
> > >> > > > > > > > >> > > on the contents of this information is strictly
> > >> > prohibited
> > >> > > > and
> > >> > > > > > may
> > >> > > > > > > > be
> > >> > > > > > > > >> > > unlawful. If you have received this communication
> > in
> > >> > > error,
> > >> > > > > > please
> > >> > > > > > > > >> notify
> > >> > > > > > > > >> > > us immediately by responding to this email and
> then
> > >> > delete
> > >> > > > it
> > >> > > > > > from
> > >> > > > > > > > >> your
> > >> > > > > > > > >> > > system. The firm is neither liable for the proper
> > and
> > >> > > > complete
> > >> > > > > > > > >> > transmission
> > >> > > > > > > > >> > > of the information contained in this
> communication
> > >> nor
> > >> > for
> > >> > > > any
> > >> > > > > > > delay
> > >> > > > > > > > >> in
> > >> > > > > > > > >> > its
> > >> > > > > > > > >> > > receipt.
> > >> > > > > > > > >> > >
> > >> > > > > > > > >> >
> > >> > > > > > > > >>
> > >> > > > > > > > >> --
> > >> > > > > > > > >>
> > >> > _____________________________________________________________
> > >> > > > > > > > >> The information contained in this communication is
> > >> intended
> > >> > > > solely
> > >> > > > > > for
> > >> > > > > > > > the
> > >> > > > > > > > >> use of the individual or entity to whom it is
> addressed
> > >> and
> > >> > > > others
> > >> > > > > > > > >> authorized to receive it. It may contain confidential
> > or
> > >> > > legally
> > >> > > > > > > > >> privileged
> > >> > > > > > > > >> information. If you are not the intended recipient
> you
> > >> are
> > >> > > > hereby
> > >> > > > > > > > notified
> > >> > > > > > > > >> that any disclosure, copying, distribution or taking
> > any
> > >> > > action
> > >> > > > in
> > >> > > > > > > > >> reliance
> > >> > > > > > > > >> on the contents of this information is strictly
> > >> prohibited
> > >> > and
> > >> > > > may
> > >> > > > > > be
> > >> > > > > > > > >> unlawful. If you have received this communication in
> > >> error,
> > >> > > > please
> > >> > > > > > > > notify
> > >> > > > > > > > >> us immediately by responding to this email and then
> > >> delete
> > >> > it
> > >> > > > from
> > >> > > > > > > your
> > >> > > > > > > > >> system. The firm is neither liable for the proper and
> > >> > complete
> > >> > > > > > > > >> transmission
> > >> > > > > > > > >> of the information contained in this communication
> nor
> > >> for
> > >> > any
> > >> > > > > delay
> > >> > > > > > > in
> > >> > > > > > > > >> its
> > >> > > > > > > > >> receipt.
> > >> > > > > > > > >>
> > >> > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > > > --
> > >> > > > > > >
> > _____________________________________________________________
> > >> > > > > > > The information contained in this communication is
> intended
> > >> > solely
> > >> > > > for
> > >> > > > > > the
> > >> > > > > > > use of the individual or entity to whom it is addressed
> and
> > >> > others
> > >> > > > > > > authorized to receive it. It may contain confidential or
> > >> legally
> > >> > > > > > privileged
> > >> > > > > > > information. If you are not the intended recipient you are
> > >> hereby
> > >> > > > > > notified
> > >> > > > > > > that any disclosure, copying, distribution or taking any
> > >> action
> > >> > in
> > >> > > > > > reliance
> > >> > > > > > > on the contents of this information is strictly prohibited
> > and
> > >> > may
> > >> > > be
> > >> > > > > > > unlawful. If you have received this communication in
> error,
> > >> > please
> > >> > > > > notify
> > >> > > > > > > us immediately by responding to this email and then delete
> > it
> > >> > from
> > >> > > > your
> > >> > > > > > > system. The firm is neither liable for the proper and
> > complete
> > >> > > > > > transmission
> > >> > > > > > > of the information contained in this communication nor for
> > any
> > >> > > delay
> > >> > > > in
> > >> > > > > > its
> > >> > > > > > > receipt.
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > > > --
> > >> > > > _____________________________________________________________
> > >> > > > The information contained in this communication is intended
> solely
> > >> for
> > >> > > the
> > >> > > > use of the individual or entity to whom it is addressed and
> others
> > >> > > > authorized to receive it. It may contain confidential or legally
> > >> > > privileged
> > >> > > > information. If you are not the intended recipient you are
> hereby
> > >> > > notified
> > >> > > > that any disclosure, copying, distribution or taking any action
> in
> > >> > > reliance
> > >> > > > on the contents of this information is strictly prohibited and
> may
> > >> be
> > >> > > > unlawful. If you have received this communication in error,
> please
> > >> > notify
> > >> > > > us immediately by responding to this email and then delete it
> from
> > >> your
> > >> > > > system. The firm is neither liable for the proper and complete
> > >> > > transmission
> > >> > > > of the information contained in this communication nor for any
> > >> delay in
> > >> > > its
> > >> > > > receipt.
> > >> > > >
> > >> > >
> > >> >
> > >> > --
> > >> > _____________________________________________________________
> > >> > The information contained in this communication is intended solely
> for
> > >> the
> > >> > use of the individual or entity to whom it is addressed and others
> > >> > authorized to receive it. It may contain confidential or legally
> > >> privileged
> > >> > information. If you are not the intended recipient you are hereby
> > >> notified
> > >> > that any disclosure, copying, distribution or taking any action in
> > >> reliance
> > >> > on the contents of this information is strictly prohibited and may
> be
> > >> > unlawful. If you have received this communication in error, please
> > >> notify
> > >> > us immediately by responding to this email and then delete it from
> > your
> > >> > system. The firm is neither liable for the proper and complete
> > >> transmission
> > >> > of the information contained in this communication nor for any delay
> > in
> > >> its
> > >> > receipt.
> > >> >
> > >>
> > >
> > >
> >
>
Re: Java action in Ooozie
Posted by Serega Sheypak <se...@gmail.com>.
Which job succeeded? What is attached?
Other problem could be: you have resource starvation, there are no
resources on RM to run your job. Did you check it?
2015-11-04 15:15 GMT+01:00 Jeetendra G <je...@housing.com>:
> Also I verified there is no issue with my java class because when I run it
> without oozie its works perfectly.
>
>
> On Wed, Nov 4, 2015 at 7:43 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > it says job succeeded attaching
> >
> > On Wed, Nov 4, 2015 at 7:37 PM, Serega Sheypak <serega.sheypak@gmail.com
> >
> > wrote:
> >
> >> Hm... ok, can you see what happens on YARN RM web ui?
> >> There should be a job that runs yuor oozie mapper launcher.
> >>
> >> 2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma <
> >> jaydeep.vishwakarma@inmobi.com>:
> >>
> >> > Good, So not issue with Yarn or name node urls. Can you share stdout
> >> logs.
> >> >
> >> >
> >> > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <je...@housing.com>
> >> > wrote:
> >> >
> >> > > Hi Jaydeep here also I cant see any error below are the logs
> >> > >
> >> > > Log Type: syslog
> >> > >
> >> > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
> >> > >
> >> > > Log Length: 25565
> >> > >
> >> > > 2015-11-04 14:59:11,814 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster
> >> > > for application appattempt_1446620926630_0017_000001
> >> > > 2015-11-04 14:59:12,144 WARN [main]
> >> > > org.apache.hadoop.util.NativeCodeLoader: Unable to load
> native-hadoop
> >> > > library for your platform... using builtin-java classes where
> >> > > applicable
> >> > > 2015-11-04 14:59:12,184 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with
> tokens:
> >> > > 2015-11-04 14:59:12,292 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> >> > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id {
> >> > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
> >> > > -173762614)
> >> > > 2015-11-04 14:59:12,293 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> >> > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs,
> >> > > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
> >> > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> >> > > 2015-11-04 14:59:12,890 WARN [main]
> >> > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
> >> > > short-circuit local reads feature cannot be used because libhadoop
> >> > > cannot be loaded.
> >> > > 2015-11-04 14:59:13,064 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set
> in
> >> > > config null
> >> > > 2015-11-04 14:59:13,065 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
> >> > > org.apache.hadoop.mapred.FileOutputCommitter
> >> > > 2015-11-04 14:59:13,110 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > > org.apache.hadoop.mapreduce.jobhistory.EventType for class
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> >> > > 2015-11-04 14:59:13,110 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> >> > > 2015-11-04 14:59:13,111 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> >> > > 2015-11-04 14:59:13,111 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType
> for
> >> > > class
> >> > >
> >>
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> >> > > 2015-11-04 14:59:13,112 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for
> class
> >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> >> > > 2015-11-04 14:59:13,112 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType
> for
> >> > > class
> >> > >
> >> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> >> > > 2015-11-04 14:59:13,113 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType
> for
> >> > > class
> >> > >
> >> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> >> > > 2015-11-04 14:59:13,113 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > >
> >> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> >> > > for class
> >> > >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> >> > > 2015-11-04 14:59:13,144 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> >> > > file system is set solely by core-default.xml therefore - ignoring
> >> > > 2015-11-04 14:59:13,170 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> >> > > file system is set solely by core-default.xml therefore - ignoring
> >> > > 2015-11-04 14:59:13,189 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> >> > > file system is set solely by core-default.xml therefore - ignoring
> >> > > 2015-11-04 14:59:13,219 INFO [main]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> >> > > Emitting job history data to the timeline server is not enabled
> >> > > 2015-11-04 14:59:13,255 INFO [main]
> >> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> >> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for
> >> > > class
> >> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> >> > > 2015-11-04 14:59:13,453 WARN [main]
> >> > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> >> > > configuration: tried
> >> > > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> >> > > 2015-11-04 14:59:13,546 INFO [main]
> >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
> snapshot
> >> > > period at 10 second(s).
> >> > > 2015-11-04 14:59:13,546 INFO [main]
> >> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster
> metrics
> >> > > system started
> >> > > 2015-11-04 14:59:13,557 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job
> token
> >> > > for job_1446620926630_0017 to jobTokenSecretManager
> >> > > 2015-11-04 14:59:13,680 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
> >> > > job_1446620926630_0017 because: not enabled; too much RAM;
> >> > > 2015-11-04 14:59:13,701 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for
> >> > > job job_1446620926630_0017 = 0. Number of splits = 1
> >> > > 2015-11-04 14:59:13,701 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of
> reduces
> >> > > for job job_1446620926630_0017 = 0
> >> > > 2015-11-04 14:59:13,701 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> >> > > job_1446620926630_0017Job Transitioned from NEW to INITED
> >> > > 2015-11-04 14:59:13,702 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster
> launching
> >> > > normal, non-uberized, multi-container job job_1446620926630_0017.
> >> > > 2015-11-04 14:59:13,725 INFO [main]
> >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> >> > > java.util.concurrent.LinkedBlockingQueue
> >> > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
> >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port
> 39640
> >> > > 2015-11-04 14:59:13,758 INFO [main]
> >> > > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> >> > > Adding protocol
> org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
> >> > > to the server
> >> > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
> >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> >> > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
> >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting
> >> > > 2015-11-04 14:59:13,762 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
> >> > > Instantiated MRClientService at
> >> hadoop04.housing.com/10.21.1.138:39640
> >> > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
> >> > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> >> > > org.mortbay.log.Slf4jLog
> >> > > 2015-11-04 14:59:13,862 INFO [main]
> >> > >
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> >> > > Unable to initialize FileSignerSecretProvider, falling back to use
> >> > > random secrets.
> >> > > 2015-11-04 14:59:13,867 WARN [main]
> >> > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be
> >> > > enabled using Log4j
> >> > > 2015-11-04 14:59:13,874 INFO [main]
> >> > > org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
> >> > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> >> > > 2015-11-04 14:59:13,878 INFO [main]
> >> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> >> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> to
> >> > > context mapreduce
> >> > > 2015-11-04 14:59:13,879 INFO [main]
> >> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> >> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter)
> to
> >> > > context static
> >> > > 2015-11-04 14:59:13,882 INFO [main]
> >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
> >> > > 2015-11-04 14:59:13,882 INFO [main]
> >> > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> >> > > 2015-11-04 14:59:14,217 INFO [main]
> >> > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice
> modules
> >> > > 2015-11-04 14:59:14,218 INFO [main]
> >> > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> >> > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log:
> jetty-6.1.26.hwx
> >> > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
> >> > >
> >> > >
> >> >
> >>
> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
> >> > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> >> > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
> >> > > HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> >> > > 2015-11-04 14:59:15,952 INFO [main]
> >> > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at
> >> > > 49791
> >> > > 2015-11-04 14:59:15,957 INFO [main]
> >> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> >> > > java.util.concurrent.LinkedBlockingQueue
> >> > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
> >> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port
> 50432
> >> > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
> >> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> >> > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
> >> > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting
> >> > > 2015-11-04 14:59:15,988 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> >> > > nodeBlacklistingEnabled:true
> >> > > 2015-11-04 14:59:15,988 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> >> > > maxTaskFailuresPerNode is 3
> >> > > 2015-11-04 14:59:15,988 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> >> > > blacklistDisablePercent is 33
> >> > > 2015-11-04 14:59:16,035 INFO [main]
> >> > > org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager
> >> > > at hadoop02.housing.com/10.21.1.136:8030
> >> > > 2015-11-04 14:59:16,113 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> >> > > maxContainerCapability: <memory:5120, vCores:3>
> >> > > 2015-11-04 14:59:16,113 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
> >> > > 2015-11-04 14:59:16,117 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> >> > > Upper limit on the thread pool size is 500
> >> > > 2015-11-04 14:59:16,118 INFO [main]
> >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> The
> >> > > thread pool initial size is 10
> >> > > 2015-11-04 14:59:16,120 INFO [main]
> >> > >
> >> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> >> > > yarn.client.max-cached-nodemanagers-proxies : 0
> >> > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> >> > > job_1446620926630_0017Job Transitioned from INITED to SETUP
> >> > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
> >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> >> > > Processing the event EventType: JOB_SETUP
> >> > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
> >> > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
> >> > > Output Committer Algorithm version is 1
> >> > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> >> > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> >> > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> >> > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to
> >> > > SCHEDULED
> >> > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> >> > > NEW to UNASSIGNED
> >> > > 2015-11-04 14:59:16,202 INFO [Thread-51]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> >> > > mapResourceRequest:<memory:1536, vCores:1>
> >> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
> >> > > Writer setup for JobId: job_1446620926630_0017, File:
> >> > > hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> >> > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> >> > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
> >> > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> >> > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> >> > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> >> > > getResources() for application_1446620926630_0017: ask=1 release= 0
> >> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
> >> > > vCores:1> knownNMs=5
> >> > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
> >> > > allocated containers 1
> >> > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
> >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> >> > > hadoop04.housing.com to /default-rack
> >> > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
> >> > > container container_e02_1446620926630_0017_01_000002 to
> >> > > attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> >> > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> >> > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> >> > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> >> > > hadoop04.housing.com to /default-rack
> >> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar
> >> > > is not present. Not adding any jar to the list of resources.
> >> > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
> >> > > job-conf file on the remote FS is
> >> > > /user/hdfs/.staging/job_1446620926630_0017/job.xml
> >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding
> #1
> >> > > tokens and #1 secret keys for NM use for launching container
> >> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
> >> > > containertokens_dob is 2
> >> > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
> >> > > shuffle token in serviceData
> >> > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> >> > > UNASSIGNED to ASSIGNED
> >> > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
> >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> >> > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for
> container
> >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> >> > > attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
> >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> >> > > Launching attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
> >> > >
> >> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> >> > > Opening proxy : hadoop04.housing.com:45454
> >> > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
> >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> >> > > Shuffle port returned by ContainerManager for
> >> > > attempt_1446620926630_0017_m_000000_0 : 13562
> >> > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> >> > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
> >> > > containerId: [container_e02_1446620926630_0017_01_000002 on NM:
> >> > > [hadoop04.housing.com:45454]
> >> > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> >> > > ASSIGNED to RUNNING
> >> > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> >> > > task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to
> >> > > RUNNING
> >> > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> >> > > getResources() for application_1446620926630_0017: ask=1 release= 0
> >> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
> >> > > vCores:1> knownNMs=5
> >> > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
> >> > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
> >> > > job_1446620926630_0017 (auth:SIMPLE)
> >> > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
> >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
> >> > > jvm_1446620926630_0017_m_2199023255554 asked for a task
> >> > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
> >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> >> > > jvm_1446620926630_0017_m_2199023255554 given task:
> >> > > attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
> >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> >> > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
> >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending
> state
> >> > > update from attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> >> > > RUNNING to COMMIT_PENDING
> >> > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> >> > > attempt_1446620926630_0017_m_000000_0 given a go for committing the
> >> > > task output.
> >> > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
> >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
> >> > > request from attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
> >> > > canCommit for attempt_1446620926630_0017_m_000000_0:true
> >> > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
> >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> >> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> >> > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
> >> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done
> acknowledgement
> >> > > from attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> >> > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> >> > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
> >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> >> > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for
> container
> >> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> >> > > attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> >> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> >> > > KILLING attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> >> > >
> >> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> >> > > Opening proxy : hadoop04.housing.com:45454
> >> > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> >> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> >> > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded
> >> > > with attempt attempt_1446620926630_0017_m_000000_0
> >> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> >> > > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
> >> > > SUCCEEDED
> >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
> >> > > Tasks: 1
> >> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> >> > > job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
> >> > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
> >> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> >> > > Processing the event EventType: JOB_COMMIT
> >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler
> >> > > for JobFinishedEvent
> >> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> >> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> >> > > job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED
> >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
> >> > > cleanly so this is the last retry
> >> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify
> RMCommunicator
> >> > > isAMLastRetry: true
> >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator
> >> > > notified that shouldUnregistered is: true
> >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
> >> > > isAMLastRetry: true
> >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> >> > > JobHistoryEventHandler notified that forceJobCompletion is true
> >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all
> >> > > the services
> >> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> >> > > Stopping JobHistoryEventHandler. Size of the outstanding queue size
> is
> >> > > 0
> >> > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Copying
> >> > > hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> >> > > to hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> >> > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Copied
> >> > > to done location:
> >> > > hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> >> > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Copying
> >> > > hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
> >> > > to hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> >> > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Copied
> >> > > to done location:
> >> > > hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> >> > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> >> > > tmp to done: hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
> >> > > to hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> >> > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> >> > > tmp to done: hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> >> > > to hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> >> > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> >> > > tmp to done: hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> >> > > to hdfs://
> >> > >
> >> >
> >>
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> >> > > 2015-11-04 14:59:22,965 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Stopped
> >> > > JobHistoryEventHandler. super.stop()
> >> > > 2015-11-04 14:59:22,968 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
> >> > > diagnostics to
> >> > > 2015-11-04 14:59:22,969 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
> >> > >
> >> http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> >> > > 2015-11-04 14:59:22,976 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
> >> > > application to be successfully unregistered.
> >> > > 2015-11-04 14:59:23,979 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
> >> > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
> >> > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
> >> > > HostLocal:0 RackLocal:0
> >> > > 2015-11-04 14:59:23,980 INFO [Thread-67]
> >> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
> >> > > directory hdfs://hadoop01.housing.com:8020
> >> > > /user/hdfs/.staging/job_1446620926630_0017
> >> > > 2015-11-04 14:59:23,984 INFO [Thread-67]
> org.apache.hadoop.ipc.Server:
> >> > > Stopping server on 50432
> >> > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
> >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
> >> > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
> >> > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> >> > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
> >> > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
> >> > > TaskHeartbeatHandler thread interrupted
> >> > >
> >> > >
> >> > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> >> > > jaydeep.vishwakarma@inmobi.com> wrote:
> >> > >
> >> > > > In first look I am not seeing any issue with job tracker or name
> >> node
> >> > > URL.
> >> > > > The job id is getting generated. Workflow Job is not going on
> PREP
> >> > mode.
> >> > > >
> >> > > > Open this link.
> >> > > >
> >> http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
> >> > > >
> >> > > > You will be see the problem.
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <
> >> jeetendra.g@housing.com>
> >> > > > wrote:
> >> > > >
> >> > > > > hey Serega I have cross verified jobTracker value is correct
> only
> >> I
> >> > am
> >> > > > > using yarn so resource manager will become the job tracker?
> >> > > > >
> >> > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
> >> > > serega.sheypak@gmail.com
> >> > > > >
> >> > > > > wrote:
> >> > > > >
> >> > > > > > Can you go to oozie server and grab logs from there? My
> >> assumption
> >> > > that
> >> > > > > > <job-tracker>${jobTracker}</job-tracker>
> >> > > > > > <name-node>${nameNode}</name-node>
> >> > > > > >
> >> > > > > > have incorrect values. Probably ${jobTracker} is wrong and
> oozie
> >> > > can't
> >> > > > > even
> >> > > > > > start launcher mapper.
> >> > > > > >
> >> > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> >> > > > > > jaydeep.vishwakarma@inmobi.com>:
> >> > > > > >
> >> > > > > > > You are doing -log. Can you give the command as below and
> get
> >> the
> >> > > job
> >> > > > > url
> >> > > > > > > (application launcher url).
> >> > > > > > >
> >> > > > > > > *oozie job -info
> >> 0000040-151015123257993-oozie-oozi-W@java-node*
> >> > > > > > >
> >> > > > > > >
> >> > > > > > >
> >> > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
> >> > > jeetendra.g@housing.com
> >> > > > >
> >> > > > > > > wrote:
> >> > > > > > >
> >> > > > > > > > and in job error log tab its saying error log is disables?
> >> by
> >> > > > default
> >> > > > > > why
> >> > > > > > > > error log is disables? i am using hortonworks
> >> > > > > > > >
> >> > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> >> > > > jeetendra.g@housing.com
> >> > > > > >
> >> > > > > > > > wrote:
> >> > > > > > > >
> >> > > > > > > > > same error.
> >> > > > > > > > >
> >> > > > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> >> Start
> >> > > > action
> >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with
> >> > user-retry
> >> > > > > > state :
> >> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
> >> [10]
> >> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> >> :start:***]Action
> >> > > > > > status=DONE
> >> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
> >> :start:***]Action
> >> > > > updated
> >> > > > > > in
> >> > > > > > > > DB!
> >> > > > > > > > > 2015-11-04 14:09:00,994 INFO
> >> > WorkflowNotificationXCommand:520
> >> > > -
> >> > > > > > > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> >> > > > > Notification
> >> > > > > > > URL
> >> > > > > > > > > is defined. Therefore nothing to notify for job
> >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> >> > > > > > > > > 2015-11-04 14:09:01,004 INFO
> >> > WorkflowNotificationXCommand:520
> >> > > -
> >> > > > > > > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> >> > > > Notification
> >> > > > > > URL
> >> > > > > > > is
> >> > > > > > > > > defined. Therefore nothing to notify for job
> >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> >> > > > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> >> Start
> >> > > > > action
> >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with
> >> > > user-retry
> >> > > > > > > state :
> >> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
> >> [10]
> >> > > > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> >> > > checking
> >> > > > > > > action,
> >> > > > > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> >> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> >> ***]Action
> >> > > > > > > > > status=RUNNING
> >> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> >> ***]Action
> >> > > > > updated
> >> > > > > > > in
> >> > > > > > > > > DB!
> >> > > > > > > > > 2015-11-04 14:09:02,926 INFO
> >> > WorkflowNotificationXCommand:520
> >> > > -
> >> > > > > > > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> No
> >> > > > > > Notification
> >> > > > > > > > > URL is defined. Therefore nothing to notify for job
> >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> >> > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 -
> >> SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> >> > > callback
> >> > > > > for
> >> > > > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> >> > > > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> >> > action
> >> > > > > > > completed,
> >> > > > > > > > > external ID [job_1446620926630_0016]
> >> > > > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start
> >> > action
> >> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with
> >> user-retry
> >> > > > state :
> >> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
> >> [10]
> >> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> >> > > > status=DONE
> >> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 -
> >> > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> > > > > APP[java-main-wf]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> >> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> >> > updated
> >> > > > in
> >> > > > > > DB!
> >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> >> > WorkflowNotificationXCommand:520
> >> > > -
> >> > > > > > > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
> >> > > Notification
> >> > > > > URL
> >> > > > > > > is
> >> > > > > > > > > defined. Therefore nothing to notify for job
> >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end
> >> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> >> > WorkflowNotificationXCommand:520
> >> > > -
> >> > > > > > > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> >> > > > Notification
> >> > > > > > URL
> >> > > > > > > is
> >> > > > > > > > > defined. Therefore nothing to notify for job
> >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> >> > > > > > > > > 2015-11-04 14:09:18,105 INFO
> >> > WorkflowNotificationXCommand:520
> >> > > -
> >> > > > > > > SERVER[
> >> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> >> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> No
> >> > > > > > Notification
> >> > > > > > > > > URL is defined. Therefore nothing to notify for job
> >> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> >> > > > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> >> > > > > > > > >
> >> > > > > > > > >> oozie job -info
> >> > 0000040-151015123257993-oozie-oozi-W@java-node
> >> > > > > > > > >> There you will find "Console URL" , Open that URL on
> >> > browser.
> >> > > > You
> >> > > > > > will
> >> > > > > > > > get
> >> > > > > > > > >> the Launcher mapper logs.
> >> > > > > > > > >>
> >> > > > > > > > >>
> >> > > > > > > > >>
> >> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> >> > > > > > jeetendra.g@housing.com>
> >> > > > > > > > >> wrote:
> >> > > > > > > > >>
> >> > > > > > > > >> > This is the log i am getting repeatedly
> >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> >> > > > WorkflowNotificationXCommand:520 -
> >> > > > > > > > SERVER[
> >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> >> No
> >> > > > > > > Notification
> >> > > > > > > > >> URL
> >> > > > > > > > >> > is
> >> > > > > > > > >> > defined. Therefore nothing to notify for job
> >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> >> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> >> > > > WorkflowNotificationXCommand:520 -
> >> > > > > > > > SERVER[
> >> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> >> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> >> > > > > Notification
> >> > > > > > > URL
> >> > > > > > > > >> is
> >> > > > > > > > >> > defined. Therefore nothing to notify for job
> >> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W
> >> > > > > > > > >> >
> >> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> >> > > > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> >> > > > > > > > >> >
> >> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What it
> says?
> >> > > > > > > > >> > >
> >> > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> >> > > > > > > > jeetendra.g@housing.com>
> >> > > > > > > > >> > > wrote:
> >> > > > > > > > >> > >
> >> > > > > > > > >> > > > does anybody have any idea? i have been trying
> this
> >> > from
> >> > > > 10
> >> > > > > > days
> >> > > > > > > > >> > nothing
> >> > > > > > > > >> > > > worked out.
> >> > > > > > > > >> > > >
> >> > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> >> > > > > > > > >> jeetendra.g@housing.com>
> >> > > > > > > > >> > > > wrote:
> >> > > > > > > > >> > > >
> >> > > > > > > > >> > > > > my workflow.xml
> >> > > > > > > > >> > > > >
> >> > > > > > > > >> > > > >
> >> > > > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> >> > > > > > > > name="java-main-wf">
> >> > > > > > > > >> > > > > <start to="java-node"/>
> >> > > > > > > > >> > > > > <action name="java-node">
> >> > > > > > > > >> > > > > <java>
> >> > > > > > > > >> > > > >
> >> <job-tracker>${jobTracker}</job-tracker>
> >> > > > > > > > >> > > > > <name-node>${nameNode}</name-node>
> >> > > > > > > > >> > > > >
> >> > > > > > > > <main-class>com.housing.common.JSONMerger</main-class>
> >> > > > > > > > >> > > > >
> >> > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> >> > > > > > > > >> > > > >
> >> 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> >> > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> >> > > > > > > > >> > > > >
> >> > > > > > > > >> > > > > </java>
> >> > > > > > > > >> > > > > <ok to="end"/>
> >> > > > > > > > >> > > > > <error to="fail"/>
> >> > > > > > > > >> > > > > </action>
> >> > > > > > > > >> > > > > <kill name="fail">
> >> > > > > > > > >> > > > > <message>Java failed, error
> >> > > > > > > > >> > > > >
> >> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> >> > > > > > > > >> > > > > </kill>
> >> > > > > > > > >> > > > > <end name="end"/>
> >> > > > > > > > >> > > > > </workflow-app>
> >> > > > > > > > >> > > > >
> >> > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> >> > > > > > > > >> > jeetendra.g@housing.com>
> >> > > > > > > > >> > > > > wrote:
> >> > > > > > > > >> > > > >
> >> > > > > > > > >> > > > >> Hi All,
> >> > > > > > > > >> > > > >>
> >> > > > > > > > >> > > > >> I am running java workflow job using oozie.
> >> > > > > > > > >> > > > >> I have Ambari server and I have installed
> oozie
> >> > from
> >> > > > > > Ambari.
> >> > > > > > > > >> > > > >> When i ran the job it say succeeded but its
> not
> >> > > running
> >> > > > > my
> >> > > > > > > java
> >> > > > > > > > >> > class
> >> > > > > > > > >> > > > >> which I mentioned inside workflow.xml. Also
> >> when I
> >> > > get
> >> > > > > > oozie
> >> > > > > > > > >> > nothing
> >> > > > > > > > >> > > > can
> >> > > > > > > > >> > > > >> be find pasting log beow, can anybody help
> here?
> >> > > > > > > > >> > > > >> oozie job -oozie
> >> > > > http://hadoop03.housing.com:11000/oozie
> >> > > > > > > -log
> >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> >> > :start:]
> >> > > > > Start
> >> > > > > > > > >> action
> >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@
> :start:]
> >> > with
> >> > > > > > > user-retry
> >> > > > > > > > >> > state
> >> > > > > > > > >> > > :
> >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> >> > > userRetryInterval
> >> > > > > > [10]
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> >> > :start:]
> >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> >> > > > > :start:***]Action
> >> > > > > > > > >> > > status=DONE
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> >> > :start:]
> >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> >> > > > > :start:***]Action
> >> > > > > > > > >> updated
> >> > > > > > > > >> > in
> >> > > > > > > > >> > > > DB!
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> >> > > > > > > WorkflowNotificationXCommand:520
> >> > > > > > > > -
> >> > > > > > > > >> > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> >> > > APP[-]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> >> > :start:]
> >> > > > No
> >> > > > > > > > >> > Notification
> >> > > > > > > > >> > > > URL
> >> > > > > > > > >> > > > >> is defined. Therefore nothing to notify for
> job
> >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> >> > > > > > > WorkflowNotificationXCommand:520
> >> > > > > > > > -
> >> > > > > > > > >> > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> >> > > APP[-]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[]
> >> > No
> >> > > > > > > > >> Notification
> >> > > > > > > > >> > URL
> >> > > > > > > > >> > > > is
> >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> >> > > ]
> >> > > > > > Start
> >> > > > > > > > >> action
> >> > > > > > > > >> > > > >>
> [0000040-151015123257993-oozie-oozi-W@java-node
> >> ]
> >> > > with
> >> > > > > > > > user-retry
> >> > > > > > > > >> > > state
> >> > > > > > > > >> > > > :
> >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> >> > > userRetryInterval
> >> > > > > > [10]
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO
> >> > JavaActionExecutor:520
> >> > > -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> >> > > ]
> >> > > > > > > > checking
> >> > > > > > > > >> > > action,
> >> > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status
> >> > > [RUNNING]
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> >> > > ]
> >> > > > > > > > >> > > > >>
> >> [***0000040-151015123257993-oozie-oozi-W@java-node
> >> > > > > > ***]Action
> >> > > > > > > > >> > > > >> status=RUNNING
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> >> > > ]
> >> > > > > > > > >> > > > >>
> >> [***0000040-151015123257993-oozie-oozi-W@java-node
> >> > > > > > ***]Action
> >> > > > > > > > >> > updated
> >> > > > > > > > >> > > in
> >> > > > > > > > >> > > > >> DB!
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> >> > > > > > > WorkflowNotificationXCommand:520
> >> > > > > > > > -
> >> > > > > > > > >> > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> >> > > APP[-]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> >> > > ]
> >> > > > > No
> >> > > > > > > > >> > > Notification
> >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify
> for
> >> job
> >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO
> >> CallbackServlet:520 -
> >> > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> >> > > APP[-]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> >> > > ]
> >> > > > > > > > callback
> >> > > > > > > > >> for
> >> > > > > > > > >> > > > >> action
> >> > > [0000040-151015123257993-oozie-oozi-W@java-node
> >> > > > ]
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO
> >> > JavaActionExecutor:520
> >> > > -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> >> > > ]
> >> > > > > > > action
> >> > > > > > > > >> > > > completed,
> >> > > > > > > > >> > > > >> external ID [job_1444892488693_0073]
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@end
> >> ]
> >> > > Start
> >> > > > > > > action
> >> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end]
> with
> >> > > > > user-retry
> >> > > > > > > > >> state :
> >> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> >> > > userRetryInterval
> >> > > > > > [10]
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@end
> >> ]
> >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> >> > > ***]Action
> >> > > > > > > > >> status=DONE
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
> >> > > ActionStartXCommand:520 -
> >> > > > > > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> >> TOKEN[]
> >> > > > > > > > >> APP[java-main-wf]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@end
> >> ]
> >> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> >> > > ***]Action
> >> > > > > > > updated
> >> > > > > > > > >> in
> >> > > > > > > > >> > DB!
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> >> > > > > > > WorkflowNotificationXCommand:520
> >> > > > > > > > -
> >> > > > > > > > >> > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> >> > > APP[-]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@end
> >> ]
> >> > No
> >> > > > > > > > Notification
> >> > > > > > > > >> > URL
> >> > > > > > > > >> > > is
> >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> >> > > > > > > WorkflowNotificationXCommand:520
> >> > > > > > > > -
> >> > > > > > > > >> > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> >> > > APP[-]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[]
> >> > No
> >> > > > > > > > >> Notification
> >> > > > > > > > >> > URL
> >> > > > > > > > >> > > > is
> >> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> >> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> >> > > > > > > WorkflowNotificationXCommand:520
> >> > > > > > > > -
> >> > > > > > > > >> > > SERVER[
> >> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-]
> TOKEN[-]
> >> > > APP[-]
> >> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > > > > > >> > > > >>
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> >> > > ]
> >> > > > > No
> >> > > > > > > > >> > > Notification
> >> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify
> for
> >> job
> >> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> >> > > > > > > > >> > > > >>
> >> > > > > > > > >> > > > >
> >> > > > > > > > >> > > > >
> >> > > > > > > > >> > > >
> >> > > > > > > > >> > >
> >> > > > > > > > >> > > --
> >> > > > > > > > >> > >
> >> > > > _____________________________________________________________
> >> > > > > > > > >> > > The information contained in this communication is
> >> > > intended
> >> > > > > > solely
> >> > > > > > > > for
> >> > > > > > > > >> > the
> >> > > > > > > > >> > > use of the individual or entity to whom it is
> >> addressed
> >> > > and
> >> > > > > > others
> >> > > > > > > > >> > > authorized to receive it. It may contain
> >> confidential or
> >> > > > > legally
> >> > > > > > > > >> > privileged
> >> > > > > > > > >> > > information. If you are not the intended recipient
> >> you
> >> > are
> >> > > > > > hereby
> >> > > > > > > > >> > notified
> >> > > > > > > > >> > > that any disclosure, copying, distribution or
> taking
> >> any
> >> > > > > action
> >> > > > > > in
> >> > > > > > > > >> > reliance
> >> > > > > > > > >> > > on the contents of this information is strictly
> >> > prohibited
> >> > > > and
> >> > > > > > may
> >> > > > > > > > be
> >> > > > > > > > >> > > unlawful. If you have received this communication
> in
> >> > > error,
> >> > > > > > please
> >> > > > > > > > >> notify
> >> > > > > > > > >> > > us immediately by responding to this email and then
> >> > delete
> >> > > > it
> >> > > > > > from
> >> > > > > > > > >> your
> >> > > > > > > > >> > > system. The firm is neither liable for the proper
> and
> >> > > > complete
> >> > > > > > > > >> > transmission
> >> > > > > > > > >> > > of the information contained in this communication
> >> nor
> >> > for
> >> > > > any
> >> > > > > > > delay
> >> > > > > > > > >> in
> >> > > > > > > > >> > its
> >> > > > > > > > >> > > receipt.
> >> > > > > > > > >> > >
> >> > > > > > > > >> >
> >> > > > > > > > >>
> >> > > > > > > > >> --
> >> > > > > > > > >>
> >> > _____________________________________________________________
> >> > > > > > > > >> The information contained in this communication is
> >> intended
> >> > > > solely
> >> > > > > > for
> >> > > > > > > > the
> >> > > > > > > > >> use of the individual or entity to whom it is addressed
> >> and
> >> > > > others
> >> > > > > > > > >> authorized to receive it. It may contain confidential
> or
> >> > > legally
> >> > > > > > > > >> privileged
> >> > > > > > > > >> information. If you are not the intended recipient you
> >> are
> >> > > > hereby
> >> > > > > > > > notified
> >> > > > > > > > >> that any disclosure, copying, distribution or taking
> any
> >> > > action
> >> > > > in
> >> > > > > > > > >> reliance
> >> > > > > > > > >> on the contents of this information is strictly
> >> prohibited
> >> > and
> >> > > > may
> >> > > > > > be
> >> > > > > > > > >> unlawful. If you have received this communication in
> >> error,
> >> > > > please
> >> > > > > > > > notify
> >> > > > > > > > >> us immediately by responding to this email and then
> >> delete
> >> > it
> >> > > > from
> >> > > > > > > your
> >> > > > > > > > >> system. The firm is neither liable for the proper and
> >> > complete
> >> > > > > > > > >> transmission
> >> > > > > > > > >> of the information contained in this communication nor
> >> for
> >> > any
> >> > > > > delay
> >> > > > > > > in
> >> > > > > > > > >> its
> >> > > > > > > > >> receipt.
> >> > > > > > > > >>
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > >
> >> > > > > > >
> >> > > > > > > --
> >> > > > > > >
> _____________________________________________________________
> >> > > > > > > The information contained in this communication is intended
> >> > solely
> >> > > > for
> >> > > > > > the
> >> > > > > > > use of the individual or entity to whom it is addressed and
> >> > others
> >> > > > > > > authorized to receive it. It may contain confidential or
> >> legally
> >> > > > > > privileged
> >> > > > > > > information. If you are not the intended recipient you are
> >> hereby
> >> > > > > > notified
> >> > > > > > > that any disclosure, copying, distribution or taking any
> >> action
> >> > in
> >> > > > > > reliance
> >> > > > > > > on the contents of this information is strictly prohibited
> and
> >> > may
> >> > > be
> >> > > > > > > unlawful. If you have received this communication in error,
> >> > please
> >> > > > > notify
> >> > > > > > > us immediately by responding to this email and then delete
> it
> >> > from
> >> > > > your
> >> > > > > > > system. The firm is neither liable for the proper and
> complete
> >> > > > > > transmission
> >> > > > > > > of the information contained in this communication nor for
> any
> >> > > delay
> >> > > > in
> >> > > > > > its
> >> > > > > > > receipt.
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > > > --
> >> > > > _____________________________________________________________
> >> > > > The information contained in this communication is intended solely
> >> for
> >> > > the
> >> > > > use of the individual or entity to whom it is addressed and others
> >> > > > authorized to receive it. It may contain confidential or legally
> >> > > privileged
> >> > > > information. If you are not the intended recipient you are hereby
> >> > > notified
> >> > > > that any disclosure, copying, distribution or taking any action in
> >> > > reliance
> >> > > > on the contents of this information is strictly prohibited and may
> >> be
> >> > > > unlawful. If you have received this communication in error, please
> >> > notify
> >> > > > us immediately by responding to this email and then delete it from
> >> your
> >> > > > system. The firm is neither liable for the proper and complete
> >> > > transmission
> >> > > > of the information contained in this communication nor for any
> >> delay in
> >> > > its
> >> > > > receipt.
> >> > > >
> >> > >
> >> >
> >> > --
> >> > _____________________________________________________________
> >> > The information contained in this communication is intended solely for
> >> the
> >> > use of the individual or entity to whom it is addressed and others
> >> > authorized to receive it. It may contain confidential or legally
> >> privileged
> >> > information. If you are not the intended recipient you are hereby
> >> notified
> >> > that any disclosure, copying, distribution or taking any action in
> >> reliance
> >> > on the contents of this information is strictly prohibited and may be
> >> > unlawful. If you have received this communication in error, please
> >> notify
> >> > us immediately by responding to this email and then delete it from
> your
> >> > system. The firm is neither liable for the proper and complete
> >> transmission
> >> > of the information contained in this communication nor for any delay
> in
> >> its
> >> > receipt.
> >> >
> >>
> >
> >
>
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
Also I verified there is no issue with my java class because when I run it
without oozie its works perfectly.
On Wed, Nov 4, 2015 at 7:43 PM, Jeetendra G <je...@housing.com> wrote:
> it says job succeeded attaching
>
> On Wed, Nov 4, 2015 at 7:37 PM, Serega Sheypak <se...@gmail.com>
> wrote:
>
>> Hm... ok, can you see what happens on YARN RM web ui?
>> There should be a job that runs yuor oozie mapper launcher.
>>
>> 2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma <
>> jaydeep.vishwakarma@inmobi.com>:
>>
>> > Good, So not issue with Yarn or name node urls. Can you share stdout
>> logs.
>> >
>> >
>> > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <je...@housing.com>
>> > wrote:
>> >
>> > > Hi Jaydeep here also I cant see any error below are the logs
>> > >
>> > > Log Type: syslog
>> > >
>> > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
>> > >
>> > > Log Length: 25565
>> > >
>> > > 2015-11-04 14:59:11,814 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster
>> > > for application appattempt_1446620926630_0017_000001
>> > > 2015-11-04 14:59:12,144 WARN [main]
>> > > org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
>> > > library for your platform... using builtin-java classes where
>> > > applicable
>> > > 2015-11-04 14:59:12,184 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
>> > > 2015-11-04 14:59:12,292 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
>> > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id {
>> > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
>> > > -173762614)
>> > > 2015-11-04 14:59:12,293 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
>> > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs,
>> > > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
>> > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
>> > > 2015-11-04 14:59:12,890 WARN [main]
>> > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
>> > > short-circuit local reads feature cannot be used because libhadoop
>> > > cannot be loaded.
>> > > 2015-11-04 14:59:13,064 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
>> > > config null
>> > > 2015-11-04 14:59:13,065 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
>> > > org.apache.hadoop.mapred.FileOutputCommitter
>> > > 2015-11-04 14:59:13,110 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > > org.apache.hadoop.mapreduce.jobhistory.EventType for class
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
>> > > 2015-11-04 14:59:13,110 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
>> > > 2015-11-04 14:59:13,111 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
>> > > 2015-11-04 14:59:13,111 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
>> > > class
>> > >
>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
>> > > 2015-11-04 14:59:13,112 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
>> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
>> > > 2015-11-04 14:59:13,112 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
>> > > class
>> > >
>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
>> > > 2015-11-04 14:59:13,113 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
>> > > class
>> > >
>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
>> > > 2015-11-04 14:59:13,113 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > >
>> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
>> > > for class
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
>> > > 2015-11-04 14:59:13,144 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
>> > > file system is set solely by core-default.xml therefore - ignoring
>> > > 2015-11-04 14:59:13,170 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
>> > > file system is set solely by core-default.xml therefore - ignoring
>> > > 2015-11-04 14:59:13,189 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
>> > > file system is set solely by core-default.xml therefore - ignoring
>> > > 2015-11-04 14:59:13,219 INFO [main]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
>> > > Emitting job history data to the timeline server is not enabled
>> > > 2015-11-04 14:59:13,255 INFO [main]
>> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
>> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for
>> > > class
>> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
>> > > 2015-11-04 14:59:13,453 WARN [main]
>> > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
>> > > configuration: tried
>> > > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
>> > > 2015-11-04 14:59:13,546 INFO [main]
>> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>> > > period at 10 second(s).
>> > > 2015-11-04 14:59:13,546 INFO [main]
>> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
>> > > system started
>> > > 2015-11-04 14:59:13,557 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token
>> > > for job_1446620926630_0017 to jobTokenSecretManager
>> > > 2015-11-04 14:59:13,680 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
>> > > job_1446620926630_0017 because: not enabled; too much RAM;
>> > > 2015-11-04 14:59:13,701 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for
>> > > job job_1446620926630_0017 = 0. Number of splits = 1
>> > > 2015-11-04 14:59:13,701 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces
>> > > for job job_1446620926630_0017 = 0
>> > > 2015-11-04 14:59:13,701 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
>> > > job_1446620926630_0017Job Transitioned from NEW to INITED
>> > > 2015-11-04 14:59:13,702 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
>> > > normal, non-uberized, multi-container job job_1446620926630_0017.
>> > > 2015-11-04 14:59:13,725 INFO [main]
>> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
>> > > java.util.concurrent.LinkedBlockingQueue
>> > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
>> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640
>> > > 2015-11-04 14:59:13,758 INFO [main]
>> > > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
>> > > Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
>> > > to the server
>> > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
>> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
>> > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
>> > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting
>> > > 2015-11-04 14:59:13,762 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
>> > > Instantiated MRClientService at
>> hadoop04.housing.com/10.21.1.138:39640
>> > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
>> > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> > > org.mortbay.log.Slf4jLog
>> > > 2015-11-04 14:59:13,862 INFO [main]
>> > > org.apache.hadoop.security.authentication.server.AuthenticationFilter:
>> > > Unable to initialize FileSignerSecretProvider, falling back to use
>> > > random secrets.
>> > > 2015-11-04 14:59:13,867 WARN [main]
>> > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be
>> > > enabled using Log4j
>> > > 2015-11-04 14:59:13,874 INFO [main]
>> > > org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
>> > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
>> > > 2015-11-04 14:59:13,878 INFO [main]
>> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
>> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
>> > > context mapreduce
>> > > 2015-11-04 14:59:13,879 INFO [main]
>> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
>> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
>> > > context static
>> > > 2015-11-04 14:59:13,882 INFO [main]
>> > > org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
>> > > 2015-11-04 14:59:13,882 INFO [main]
>> > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
>> > > 2015-11-04 14:59:14,217 INFO [main]
>> > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
>> > > 2015-11-04 14:59:14,218 INFO [main]
>> > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
>> > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
>> > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
>> > >
>> > >
>> >
>> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
>> > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
>> > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
>> > > HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
>> > > 2015-11-04 14:59:15,952 INFO [main]
>> > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at
>> > > 49791
>> > > 2015-11-04 14:59:15,957 INFO [main]
>> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
>> > > java.util.concurrent.LinkedBlockingQueue
>> > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
>> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432
>> > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
>> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
>> > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
>> > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting
>> > > 2015-11-04 14:59:15,988 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
>> > > nodeBlacklistingEnabled:true
>> > > 2015-11-04 14:59:15,988 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
>> > > maxTaskFailuresPerNode is 3
>> > > 2015-11-04 14:59:15,988 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
>> > > blacklistDisablePercent is 33
>> > > 2015-11-04 14:59:16,035 INFO [main]
>> > > org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager
>> > > at hadoop02.housing.com/10.21.1.136:8030
>> > > 2015-11-04 14:59:16,113 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
>> > > maxContainerCapability: <memory:5120, vCores:3>
>> > > 2015-11-04 14:59:16,113 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
>> > > 2015-11-04 14:59:16,117 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
>> > > Upper limit on the thread pool size is 500
>> > > 2015-11-04 14:59:16,118 INFO [main]
>> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
>> > > thread pool initial size is 10
>> > > 2015-11-04 14:59:16,120 INFO [main]
>> > >
>> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
>> > > yarn.client.max-cached-nodemanagers-proxies : 0
>> > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
>> > > job_1446620926630_0017Job Transitioned from INITED to SETUP
>> > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
>> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
>> > > Processing the event EventType: JOB_SETUP
>> > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
>> > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
>> > > Output Committer Algorithm version is 1
>> > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
>> > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING
>> > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
>> > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to
>> > > SCHEDULED
>> > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
>> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
>> > > NEW to UNASSIGNED
>> > > 2015-11-04 14:59:16,202 INFO [Thread-51]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
>> > > mapResourceRequest:<memory:1536, vCores:1>
>> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
>> > > Writer setup for JobId: job_1446620926630_0017, File:
>> > > hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
>> > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
>> > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
>> > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
>> > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
>> > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
>> > > getResources() for application_1446620926630_0017: ask=1 release= 0
>> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
>> > > vCores:1> knownNMs=5
>> > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
>> > > allocated containers 1
>> > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
>> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
>> > > hadoop04.housing.com to /default-rack
>> > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
>> > > container container_e02_1446620926630_0017_01_000002 to
>> > > attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
>> > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
>> > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
>> > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
>> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
>> > > hadoop04.housing.com to /default-rack
>> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar
>> > > is not present. Not adding any jar to the list of resources.
>> > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
>> > > job-conf file on the remote FS is
>> > > /user/hdfs/.staging/job_1446620926630_0017/job.xml
>> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1
>> > > tokens and #1 secret keys for NM use for launching container
>> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
>> > > containertokens_dob is 2
>> > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
>> > > shuffle token in serviceData
>> > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
>> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
>> > > UNASSIGNED to ASSIGNED
>> > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
>> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
>> > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
>> > > container_e02_1446620926630_0017_01_000002 taskAttempt
>> > > attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
>> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
>> > > Launching attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
>> > >
>> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
>> > > Opening proxy : hadoop04.housing.com:45454
>> > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
>> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
>> > > Shuffle port returned by ContainerManager for
>> > > attempt_1446620926630_0017_m_000000_0 : 13562
>> > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
>> > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
>> > > containerId: [container_e02_1446620926630_0017_01_000002 on NM:
>> > > [hadoop04.housing.com:45454]
>> > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
>> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
>> > > ASSIGNED to RUNNING
>> > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
>> > > task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to
>> > > RUNNING
>> > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
>> > > getResources() for application_1446620926630_0017: ask=1 release= 0
>> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
>> > > vCores:1> knownNMs=5
>> > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
>> > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
>> > > job_1446620926630_0017 (auth:SIMPLE)
>> > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
>> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
>> > > jvm_1446620926630_0017_m_2199023255554 asked for a task
>> > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
>> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
>> > > jvm_1446620926630_0017_m_2199023255554 given task:
>> > > attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
>> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
>> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
>> > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
>> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state
>> > > update from attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
>> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
>> > > RUNNING to COMMIT_PENDING
>> > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
>> > > attempt_1446620926630_0017_m_000000_0 given a go for committing the
>> > > task output.
>> > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
>> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
>> > > request from attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
>> > > canCommit for attempt_1446620926630_0017_m_000000_0:true
>> > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
>> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
>> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
>> > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
>> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement
>> > > from attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
>> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
>> > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
>> > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
>> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
>> > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
>> > > container_e02_1446620926630_0017_01_000002 taskAttempt
>> > > attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
>> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
>> > > KILLING attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
>> > >
>> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
>> > > Opening proxy : hadoop04.housing.com:45454
>> > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
>> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
>> > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
>> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded
>> > > with attempt attempt_1446620926630_0017_m_000000_0
>> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
>> > > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
>> > > SUCCEEDED
>> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
>> > > Tasks: 1
>> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
>> > > job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
>> > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
>> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
>> > > Processing the event EventType: JOB_COMMIT
>> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler
>> > > for JobFinishedEvent
>> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
>> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
>> > > job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED
>> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
>> > > cleanly so this is the last retry
>> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
>> > > isAMLastRetry: true
>> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator
>> > > notified that shouldUnregistered is: true
>> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
>> > > isAMLastRetry: true
>> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
>> > > JobHistoryEventHandler notified that forceJobCompletion is true
>> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all
>> > > the services
>> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
>> > > Stopping JobHistoryEventHandler. Size of the outstanding queue size is
>> > > 0
>> > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
>> > > hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
>> > > to hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
>> > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
>> > > to done location:
>> > > hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
>> > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
>> > > hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
>> > > to hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
>> > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
>> > > to done location:
>> > > hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
>> > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
>> > > tmp to done: hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
>> > > to hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
>> > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
>> > > tmp to done: hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
>> > > to hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
>> > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
>> > > tmp to done: hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
>> > > to hdfs://
>> > >
>> >
>> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
>> > > 2015-11-04 14:59:22,965 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
>> > > JobHistoryEventHandler. super.stop()
>> > > 2015-11-04 14:59:22,968 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
>> > > diagnostics to
>> > > 2015-11-04 14:59:22,969 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
>> > >
>> http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
>> > > 2015-11-04 14:59:22,976 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
>> > > application to be successfully unregistered.
>> > > 2015-11-04 14:59:23,979 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
>> > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
>> > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
>> > > HostLocal:0 RackLocal:0
>> > > 2015-11-04 14:59:23,980 INFO [Thread-67]
>> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
>> > > directory hdfs://hadoop01.housing.com:8020
>> > > /user/hdfs/.staging/job_1446620926630_0017
>> > > 2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server:
>> > > Stopping server on 50432
>> > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
>> > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
>> > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
>> > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
>> > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
>> > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
>> > > TaskHeartbeatHandler thread interrupted
>> > >
>> > >
>> > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
>> > > jaydeep.vishwakarma@inmobi.com> wrote:
>> > >
>> > > > In first look I am not seeing any issue with job tracker or name
>> node
>> > > URL.
>> > > > The job id is getting generated. Workflow Job is not going on PREP
>> > mode.
>> > > >
>> > > > Open this link.
>> > > >
>> http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
>> > > >
>> > > > You will be see the problem.
>> > > >
>> > > >
>> > > >
>> > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <
>> jeetendra.g@housing.com>
>> > > > wrote:
>> > > >
>> > > > > hey Serega I have cross verified jobTracker value is correct only
>> I
>> > am
>> > > > > using yarn so resource manager will become the job tracker?
>> > > > >
>> > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
>> > > serega.sheypak@gmail.com
>> > > > >
>> > > > > wrote:
>> > > > >
>> > > > > > Can you go to oozie server and grab logs from there? My
>> assumption
>> > > that
>> > > > > > <job-tracker>${jobTracker}</job-tracker>
>> > > > > > <name-node>${nameNode}</name-node>
>> > > > > >
>> > > > > > have incorrect values. Probably ${jobTracker} is wrong and oozie
>> > > can't
>> > > > > even
>> > > > > > start launcher mapper.
>> > > > > >
>> > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
>> > > > > > jaydeep.vishwakarma@inmobi.com>:
>> > > > > >
>> > > > > > > You are doing -log. Can you give the command as below and get
>> the
>> > > job
>> > > > > url
>> > > > > > > (application launcher url).
>> > > > > > >
>> > > > > > > *oozie job -info
>> 0000040-151015123257993-oozie-oozi-W@java-node*
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
>> > > jeetendra.g@housing.com
>> > > > >
>> > > > > > > wrote:
>> > > > > > >
>> > > > > > > > and in job error log tab its saying error log is disables?
>> by
>> > > > default
>> > > > > > why
>> > > > > > > > error log is disables? i am using hortonworks
>> > > > > > > >
>> > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
>> > > > jeetendra.g@housing.com
>> > > > > >
>> > > > > > > > wrote:
>> > > > > > > >
>> > > > > > > > > same error.
>> > > > > > > > >
>> > > > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
>> Start
>> > > > action
>> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with
>> > user-retry
>> > > > > > state :
>> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
>> [10]
>> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
>> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
>> :start:***]Action
>> > > > > > status=DONE
>> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
>> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@
>> :start:***]Action
>> > > > updated
>> > > > > > in
>> > > > > > > > DB!
>> > > > > > > > > 2015-11-04 14:09:00,994 INFO
>> > WorkflowNotificationXCommand:520
>> > > -
>> > > > > > > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
>> > > > > Notification
>> > > > > > > URL
>> > > > > > > > > is defined. Therefore nothing to notify for job
>> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
>> > > > > > > > > 2015-11-04 14:09:01,004 INFO
>> > WorkflowNotificationXCommand:520
>> > > -
>> > > > > > > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
>> > > > Notification
>> > > > > > URL
>> > > > > > > is
>> > > > > > > > > defined. Therefore nothing to notify for job
>> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
>> > > > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
>> Start
>> > > > > action
>> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with
>> > > user-retry
>> > > > > > > state :
>> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
>> [10]
>> > > > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
>> > > checking
>> > > > > > > action,
>> > > > > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
>> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
>> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
>> ***]Action
>> > > > > > > > > status=RUNNING
>> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
>> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
>> ***]Action
>> > > > > updated
>> > > > > > > in
>> > > > > > > > > DB!
>> > > > > > > > > 2015-11-04 14:09:02,926 INFO
>> > WorkflowNotificationXCommand:520
>> > > -
>> > > > > > > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
>> > > > > > Notification
>> > > > > > > > > URL is defined. Therefore nothing to notify for job
>> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
>> > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 -
>> SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
>> > > callback
>> > > > > for
>> > > > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
>> > > > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
>> > action
>> > > > > > > completed,
>> > > > > > > > > external ID [job_1446620926630_0016]
>> > > > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start
>> > action
>> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with
>> user-retry
>> > > > state :
>> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
>> [10]
>> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
>> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
>> > > > status=DONE
>> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 -
>> > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> > > > > APP[java-main-wf]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
>> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
>> > updated
>> > > > in
>> > > > > > DB!
>> > > > > > > > > 2015-11-04 14:09:18,104 INFO
>> > WorkflowNotificationXCommand:520
>> > > -
>> > > > > > > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
>> > > Notification
>> > > > > URL
>> > > > > > > is
>> > > > > > > > > defined. Therefore nothing to notify for job
>> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end
>> > > > > > > > > 2015-11-04 14:09:18,104 INFO
>> > WorkflowNotificationXCommand:520
>> > > -
>> > > > > > > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
>> > > > Notification
>> > > > > > URL
>> > > > > > > is
>> > > > > > > > > defined. Therefore nothing to notify for job
>> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
>> > > > > > > > > 2015-11-04 14:09:18,105 INFO
>> > WorkflowNotificationXCommand:520
>> > > -
>> > > > > > > SERVER[
>> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
>> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
>> > > > > > Notification
>> > > > > > > > > URL is defined. Therefore nothing to notify for job
>> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
>> > > > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
>> > > > > > > > >
>> > > > > > > > >> oozie job -info
>> > 0000040-151015123257993-oozie-oozi-W@java-node
>> > > > > > > > >> There you will find "Console URL" , Open that URL on
>> > browser.
>> > > > You
>> > > > > > will
>> > > > > > > > get
>> > > > > > > > >> the Launcher mapper logs.
>> > > > > > > > >>
>> > > > > > > > >>
>> > > > > > > > >>
>> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
>> > > > > > jeetendra.g@housing.com>
>> > > > > > > > >> wrote:
>> > > > > > > > >>
>> > > > > > > > >> > This is the log i am getting repeatedly
>> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
>> > > > WorkflowNotificationXCommand:520 -
>> > > > > > > > SERVER[
>> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> No
>> > > > > > > Notification
>> > > > > > > > >> URL
>> > > > > > > > >> > is
>> > > > > > > > >> > defined. Therefore nothing to notify for job
>> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
>> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
>> > > > WorkflowNotificationXCommand:520 -
>> > > > > > > > SERVER[
>> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
>> > > > > Notification
>> > > > > > > URL
>> > > > > > > > >> is
>> > > > > > > > >> > defined. Therefore nothing to notify for job
>> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W
>> > > > > > > > >> >
>> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
>> > > > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
>> > > > > > > > >> >
>> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What it says?
>> > > > > > > > >> > >
>> > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
>> > > > > > > > jeetendra.g@housing.com>
>> > > > > > > > >> > > wrote:
>> > > > > > > > >> > >
>> > > > > > > > >> > > > does anybody have any idea? i have been trying this
>> > from
>> > > > 10
>> > > > > > days
>> > > > > > > > >> > nothing
>> > > > > > > > >> > > > worked out.
>> > > > > > > > >> > > >
>> > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
>> > > > > > > > >> jeetendra.g@housing.com>
>> > > > > > > > >> > > > wrote:
>> > > > > > > > >> > > >
>> > > > > > > > >> > > > > my workflow.xml
>> > > > > > > > >> > > > >
>> > > > > > > > >> > > > >
>> > > > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
>> > > > > > > > name="java-main-wf">
>> > > > > > > > >> > > > > <start to="java-node"/>
>> > > > > > > > >> > > > > <action name="java-node">
>> > > > > > > > >> > > > > <java>
>> > > > > > > > >> > > > >
>> <job-tracker>${jobTracker}</job-tracker>
>> > > > > > > > >> > > > > <name-node>${nameNode}</name-node>
>> > > > > > > > >> > > > >
>> > > > > > > > <main-class>com.housing.common.JSONMerger</main-class>
>> > > > > > > > >> > > > >
>> > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
>> > > > > > > > >> > > > >
>> 10.1.6.186:8020/configuration/jsonmerger-dev.conf
>> > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
>> > > > > > > > >> > > > >
>> > > > > > > > >> > > > > </java>
>> > > > > > > > >> > > > > <ok to="end"/>
>> > > > > > > > >> > > > > <error to="fail"/>
>> > > > > > > > >> > > > > </action>
>> > > > > > > > >> > > > > <kill name="fail">
>> > > > > > > > >> > > > > <message>Java failed, error
>> > > > > > > > >> > > > >
>> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
>> > > > > > > > >> > > > > </kill>
>> > > > > > > > >> > > > > <end name="end"/>
>> > > > > > > > >> > > > > </workflow-app>
>> > > > > > > > >> > > > >
>> > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
>> > > > > > > > >> > jeetendra.g@housing.com>
>> > > > > > > > >> > > > > wrote:
>> > > > > > > > >> > > > >
>> > > > > > > > >> > > > >> Hi All,
>> > > > > > > > >> > > > >>
>> > > > > > > > >> > > > >> I am running java workflow job using oozie.
>> > > > > > > > >> > > > >> I have Ambari server and I have installed oozie
>> > from
>> > > > > > Ambari.
>> > > > > > > > >> > > > >> When i ran the job it say succeeded but its not
>> > > running
>> > > > > my
>> > > > > > > java
>> > > > > > > > >> > class
>> > > > > > > > >> > > > >> which I mentioned inside workflow.xml. Also
>> when I
>> > > get
>> > > > > > oozie
>> > > > > > > > >> > nothing
>> > > > > > > > >> > > > can
>> > > > > > > > >> > > > >> be find pasting log beow, can anybody help here?
>> > > > > > > > >> > > > >> oozie job -oozie
>> > > > http://hadoop03.housing.com:11000/oozie
>> > > > > > > -log
>> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
>> > :start:]
>> > > > > Start
>> > > > > > > > >> action
>> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:]
>> > with
>> > > > > > > user-retry
>> > > > > > > > >> > state
>> > > > > > > > >> > > :
>> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
>> > > userRetryInterval
>> > > > > > [10]
>> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
>> > :start:]
>> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
>> > > > > :start:***]Action
>> > > > > > > > >> > > status=DONE
>> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
>> > :start:]
>> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
>> > > > > :start:***]Action
>> > > > > > > > >> updated
>> > > > > > > > >> > in
>> > > > > > > > >> > > > DB!
>> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
>> > > > > > > WorkflowNotificationXCommand:520
>> > > > > > > > -
>> > > > > > > > >> > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> > > APP[-]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
>> > :start:]
>> > > > No
>> > > > > > > > >> > Notification
>> > > > > > > > >> > > > URL
>> > > > > > > > >> > > > >> is defined. Therefore nothing to notify for job
>> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
>> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
>> > > > > > > WorkflowNotificationXCommand:520
>> > > > > > > > -
>> > > > > > > > >> > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> > > APP[-]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[]
>> > No
>> > > > > > > > >> Notification
>> > > > > > > > >> > URL
>> > > > > > > > >> > > > is
>> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
>> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >>
>> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> > > ]
>> > > > > > Start
>> > > > > > > > >> action
>> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node
>> ]
>> > > with
>> > > > > > > > user-retry
>> > > > > > > > >> > > state
>> > > > > > > > >> > > > :
>> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
>> > > userRetryInterval
>> > > > > > [10]
>> > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO
>> > JavaActionExecutor:520
>> > > -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >>
>> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> > > ]
>> > > > > > > > checking
>> > > > > > > > >> > > action,
>> > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status
>> > > [RUNNING]
>> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >>
>> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> > > ]
>> > > > > > > > >> > > > >>
>> [***0000040-151015123257993-oozie-oozi-W@java-node
>> > > > > > ***]Action
>> > > > > > > > >> > > > >> status=RUNNING
>> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >>
>> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> > > ]
>> > > > > > > > >> > > > >>
>> [***0000040-151015123257993-oozie-oozi-W@java-node
>> > > > > > ***]Action
>> > > > > > > > >> > updated
>> > > > > > > > >> > > in
>> > > > > > > > >> > > > >> DB!
>> > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
>> > > > > > > WorkflowNotificationXCommand:520
>> > > > > > > > -
>> > > > > > > > >> > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> > > APP[-]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >>
>> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> > > ]
>> > > > > No
>> > > > > > > > >> > > Notification
>> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for
>> job
>> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
>> > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO
>> CallbackServlet:520 -
>> > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> > > APP[-]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >>
>> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> > > ]
>> > > > > > > > callback
>> > > > > > > > >> for
>> > > > > > > > >> > > > >> action
>> > > [0000040-151015123257993-oozie-oozi-W@java-node
>> > > > ]
>> > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO
>> > JavaActionExecutor:520
>> > > -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >>
>> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> > > ]
>> > > > > > > action
>> > > > > > > > >> > > > completed,
>> > > > > > > > >> > > > >> external ID [job_1444892488693_0073]
>> > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end
>> ]
>> > > Start
>> > > > > > > action
>> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
>> > > > > user-retry
>> > > > > > > > >> state :
>> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
>> > > userRetryInterval
>> > > > > > [10]
>> > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end
>> ]
>> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
>> > > ***]Action
>> > > > > > > > >> status=DONE
>> > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
>> > > ActionStartXCommand:520 -
>> > > > > > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
>> TOKEN[]
>> > > > > > > > >> APP[java-main-wf]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end
>> ]
>> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
>> > > ***]Action
>> > > > > > > updated
>> > > > > > > > >> in
>> > > > > > > > >> > DB!
>> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
>> > > > > > > WorkflowNotificationXCommand:520
>> > > > > > > > -
>> > > > > > > > >> > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> > > APP[-]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end
>> ]
>> > No
>> > > > > > > > Notification
>> > > > > > > > >> > URL
>> > > > > > > > >> > > is
>> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
>> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
>> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
>> > > > > > > WorkflowNotificationXCommand:520
>> > > > > > > > -
>> > > > > > > > >> > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> > > APP[-]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[]
>> > No
>> > > > > > > > >> Notification
>> > > > > > > > >> > URL
>> > > > > > > > >> > > > is
>> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
>> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
>> > > > > > > WorkflowNotificationXCommand:520
>> > > > > > > > -
>> > > > > > > > >> > > SERVER[
>> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
>> > > APP[-]
>> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > > > > > >> > > > >>
>> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
>> > > ]
>> > > > > No
>> > > > > > > > >> > > Notification
>> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for
>> job
>> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
>> > > > > > > > >> > > > >>
>> > > > > > > > >> > > > >
>> > > > > > > > >> > > > >
>> > > > > > > > >> > > >
>> > > > > > > > >> > >
>> > > > > > > > >> > > --
>> > > > > > > > >> > >
>> > > > _____________________________________________________________
>> > > > > > > > >> > > The information contained in this communication is
>> > > intended
>> > > > > > solely
>> > > > > > > > for
>> > > > > > > > >> > the
>> > > > > > > > >> > > use of the individual or entity to whom it is
>> addressed
>> > > and
>> > > > > > others
>> > > > > > > > >> > > authorized to receive it. It may contain
>> confidential or
>> > > > > legally
>> > > > > > > > >> > privileged
>> > > > > > > > >> > > information. If you are not the intended recipient
>> you
>> > are
>> > > > > > hereby
>> > > > > > > > >> > notified
>> > > > > > > > >> > > that any disclosure, copying, distribution or taking
>> any
>> > > > > action
>> > > > > > in
>> > > > > > > > >> > reliance
>> > > > > > > > >> > > on the contents of this information is strictly
>> > prohibited
>> > > > and
>> > > > > > may
>> > > > > > > > be
>> > > > > > > > >> > > unlawful. If you have received this communication in
>> > > error,
>> > > > > > please
>> > > > > > > > >> notify
>> > > > > > > > >> > > us immediately by responding to this email and then
>> > delete
>> > > > it
>> > > > > > from
>> > > > > > > > >> your
>> > > > > > > > >> > > system. The firm is neither liable for the proper and
>> > > > complete
>> > > > > > > > >> > transmission
>> > > > > > > > >> > > of the information contained in this communication
>> nor
>> > for
>> > > > any
>> > > > > > > delay
>> > > > > > > > >> in
>> > > > > > > > >> > its
>> > > > > > > > >> > > receipt.
>> > > > > > > > >> > >
>> > > > > > > > >> >
>> > > > > > > > >>
>> > > > > > > > >> --
>> > > > > > > > >>
>> > _____________________________________________________________
>> > > > > > > > >> The information contained in this communication is
>> intended
>> > > > solely
>> > > > > > for
>> > > > > > > > the
>> > > > > > > > >> use of the individual or entity to whom it is addressed
>> and
>> > > > others
>> > > > > > > > >> authorized to receive it. It may contain confidential or
>> > > legally
>> > > > > > > > >> privileged
>> > > > > > > > >> information. If you are not the intended recipient you
>> are
>> > > > hereby
>> > > > > > > > notified
>> > > > > > > > >> that any disclosure, copying, distribution or taking any
>> > > action
>> > > > in
>> > > > > > > > >> reliance
>> > > > > > > > >> on the contents of this information is strictly
>> prohibited
>> > and
>> > > > may
>> > > > > > be
>> > > > > > > > >> unlawful. If you have received this communication in
>> error,
>> > > > please
>> > > > > > > > notify
>> > > > > > > > >> us immediately by responding to this email and then
>> delete
>> > it
>> > > > from
>> > > > > > > your
>> > > > > > > > >> system. The firm is neither liable for the proper and
>> > complete
>> > > > > > > > >> transmission
>> > > > > > > > >> of the information contained in this communication nor
>> for
>> > any
>> > > > > delay
>> > > > > > > in
>> > > > > > > > >> its
>> > > > > > > > >> receipt.
>> > > > > > > > >>
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > > > --
>> > > > > > > _____________________________________________________________
>> > > > > > > The information contained in this communication is intended
>> > solely
>> > > > for
>> > > > > > the
>> > > > > > > use of the individual or entity to whom it is addressed and
>> > others
>> > > > > > > authorized to receive it. It may contain confidential or
>> legally
>> > > > > > privileged
>> > > > > > > information. If you are not the intended recipient you are
>> hereby
>> > > > > > notified
>> > > > > > > that any disclosure, copying, distribution or taking any
>> action
>> > in
>> > > > > > reliance
>> > > > > > > on the contents of this information is strictly prohibited and
>> > may
>> > > be
>> > > > > > > unlawful. If you have received this communication in error,
>> > please
>> > > > > notify
>> > > > > > > us immediately by responding to this email and then delete it
>> > from
>> > > > your
>> > > > > > > system. The firm is neither liable for the proper and complete
>> > > > > > transmission
>> > > > > > > of the information contained in this communication nor for any
>> > > delay
>> > > > in
>> > > > > > its
>> > > > > > > receipt.
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > > > --
>> > > > _____________________________________________________________
>> > > > The information contained in this communication is intended solely
>> for
>> > > the
>> > > > use of the individual or entity to whom it is addressed and others
>> > > > authorized to receive it. It may contain confidential or legally
>> > > privileged
>> > > > information. If you are not the intended recipient you are hereby
>> > > notified
>> > > > that any disclosure, copying, distribution or taking any action in
>> > > reliance
>> > > > on the contents of this information is strictly prohibited and may
>> be
>> > > > unlawful. If you have received this communication in error, please
>> > notify
>> > > > us immediately by responding to this email and then delete it from
>> your
>> > > > system. The firm is neither liable for the proper and complete
>> > > transmission
>> > > > of the information contained in this communication nor for any
>> delay in
>> > > its
>> > > > receipt.
>> > > >
>> > >
>> >
>> > --
>> > _____________________________________________________________
>> > The information contained in this communication is intended solely for
>> the
>> > use of the individual or entity to whom it is addressed and others
>> > authorized to receive it. It may contain confidential or legally
>> privileged
>> > information. If you are not the intended recipient you are hereby
>> notified
>> > that any disclosure, copying, distribution or taking any action in
>> reliance
>> > on the contents of this information is strictly prohibited and may be
>> > unlawful. If you have received this communication in error, please
>> notify
>> > us immediately by responding to this email and then delete it from your
>> > system. The firm is neither liable for the proper and complete
>> transmission
>> > of the information contained in this communication nor for any delay in
>> its
>> > receipt.
>> >
>>
>
>
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
it says job succeeded attaching
On Wed, Nov 4, 2015 at 7:37 PM, Serega Sheypak <se...@gmail.com>
wrote:
> Hm... ok, can you see what happens on YARN RM web ui?
> There should be a job that runs yuor oozie mapper launcher.
>
> 2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma <
> jaydeep.vishwakarma@inmobi.com>:
>
> > Good, So not issue with Yarn or name node urls. Can you share stdout
> logs.
> >
> >
> > On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > Hi Jaydeep here also I cant see any error below are the logs
> > >
> > > Log Type: syslog
> > >
> > > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
> > >
> > > Log Length: 25565
> > >
> > > 2015-11-04 14:59:11,814 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster
> > > for application appattempt_1446620926630_0017_000001
> > > 2015-11-04 14:59:12,144 WARN [main]
> > > org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
> > > library for your platform... using builtin-java classes where
> > > applicable
> > > 2015-11-04 14:59:12,184 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
> > > 2015-11-04 14:59:12,292 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id {
> > > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
> > > -173762614)
> > > 2015-11-04 14:59:12,293 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs,
> > > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
> > > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> > > 2015-11-04 14:59:12,890 WARN [main]
> > > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
> > > short-circuit local reads feature cannot be used because libhadoop
> > > cannot be loaded.
> > > 2015-11-04 14:59:13,064 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
> > > config null
> > > 2015-11-04 14:59:13,065 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
> > > org.apache.hadoop.mapred.FileOutputCommitter
> > > 2015-11-04 14:59:13,110 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.jobhistory.EventType for class
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> > > 2015-11-04 14:59:13,110 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> > > 2015-11-04 14:59:13,111 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> > > 2015-11-04 14:59:13,111 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
> > > class
> > >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> > > 2015-11-04 14:59:13,112 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> > > 2015-11-04 14:59:13,112 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
> > > class
> > >
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> > > 2015-11-04 14:59:13,113 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
> > > class
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> > > 2015-11-04 14:59:13,113 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> > > for class
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> > > 2015-11-04 14:59:13,144 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > > file system is set solely by core-default.xml therefore - ignoring
> > > 2015-11-04 14:59:13,170 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > > file system is set solely by core-default.xml therefore - ignoring
> > > 2015-11-04 14:59:13,189 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > > file system is set solely by core-default.xml therefore - ignoring
> > > 2015-11-04 14:59:13,219 INFO [main]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Emitting job history data to the timeline server is not enabled
> > > 2015-11-04 14:59:13,255 INFO [main]
> > > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for
> > > class
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> > > 2015-11-04 14:59:13,453 WARN [main]
> > > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> > > configuration: tried
> > > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> > > 2015-11-04 14:59:13,546 INFO [main]
> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> > > period at 10 second(s).
> > > 2015-11-04 14:59:13,546 INFO [main]
> > > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
> > > system started
> > > 2015-11-04 14:59:13,557 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token
> > > for job_1446620926630_0017 to jobTokenSecretManager
> > > 2015-11-04 14:59:13,680 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
> > > job_1446620926630_0017 because: not enabled; too much RAM;
> > > 2015-11-04 14:59:13,701 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for
> > > job job_1446620926630_0017 = 0. Number of splits = 1
> > > 2015-11-04 14:59:13,701 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces
> > > for job job_1446620926630_0017 = 0
> > > 2015-11-04 14:59:13,701 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > job_1446620926630_0017Job Transitioned from NEW to INITED
> > > 2015-11-04 14:59:13,702 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
> > > normal, non-uberized, multi-container job job_1446620926630_0017.
> > > 2015-11-04 14:59:13,725 INFO [main]
> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > > java.util.concurrent.LinkedBlockingQueue
> > > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640
> > > 2015-11-04 14:59:13,758 INFO [main]
> > > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> > > Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
> > > to the server
> > > 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
> > > org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting
> > > 2015-11-04 14:59:13,762 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
> > > Instantiated MRClientService at hadoop04.housing.com/10.21.1.138:39640
> > > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
> > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> > > org.mortbay.log.Slf4jLog
> > > 2015-11-04 14:59:13,862 INFO [main]
> > > org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> > > Unable to initialize FileSignerSecretProvider, falling back to use
> > > random secrets.
> > > 2015-11-04 14:59:13,867 WARN [main]
> > > org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be
> > > enabled using Log4j
> > > 2015-11-04 14:59:13,874 INFO [main]
> > > org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
> > > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> > > 2015-11-04 14:59:13,878 INFO [main]
> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> > > context mapreduce
> > > 2015-11-04 14:59:13,879 INFO [main]
> > > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> > > context static
> > > 2015-11-04 14:59:13,882 INFO [main]
> > > org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
> > > 2015-11-04 14:59:13,882 INFO [main]
> > > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> > > 2015-11-04 14:59:14,217 INFO [main]
> > > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
> > > 2015-11-04 14:59:14,218 INFO [main]
> > > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> > > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
> > > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
> > >
> > >
> >
> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
> > > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> > > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
> > > HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> > > 2015-11-04 14:59:15,952 INFO [main]
> > > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at
> > > 49791
> > > 2015-11-04 14:59:15,957 INFO [main]
> > > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > > java.util.concurrent.LinkedBlockingQueue
> > > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
> > > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432
> > > 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
> > > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
> > > org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting
> > > 2015-11-04 14:59:15,988 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > nodeBlacklistingEnabled:true
> > > 2015-11-04 14:59:15,988 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > maxTaskFailuresPerNode is 3
> > > 2015-11-04 14:59:15,988 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > blacklistDisablePercent is 33
> > > 2015-11-04 14:59:16,035 INFO [main]
> > > org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager
> > > at hadoop02.housing.com/10.21.1.136:8030
> > > 2015-11-04 14:59:16,113 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> > > maxContainerCapability: <memory:5120, vCores:3>
> > > 2015-11-04 14:59:16,113 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
> > > 2015-11-04 14:59:16,117 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > Upper limit on the thread pool size is 500
> > > 2015-11-04 14:59:16,118 INFO [main]
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
> > > thread pool initial size is 10
> > > 2015-11-04 14:59:16,120 INFO [main]
> > >
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > yarn.client.max-cached-nodemanagers-proxies : 0
> > > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > job_1446620926630_0017Job Transitioned from INITED to SETUP
> > > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > > Processing the event EventType: JOB_SETUP
> > > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
> > > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
> > > Output Committer Algorithm version is 1
> > > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> > > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > task_1446620926630_0017_m_000000 Task Transitioned from NEW to
> > > SCHEDULED
> > > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > > NEW to UNASSIGNED
> > > 2015-11-04 14:59:16,202 INFO [Thread-51]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > > mapResourceRequest:<memory:1536, vCores:1>
> > > 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
> > > Writer setup for JobId: job_1446620926630_0017, File:
> > > hdfs://
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> > > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
> > > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> > > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > getResources() for application_1446620926630_0017: ask=1 release= 0
> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
> > > vCores:1> knownNMs=5
> > > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
> > > allocated containers 1
> > > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > > hadoop04.housing.com to /default-rack
> > > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
> > > container container_e02_1446620926630_0017_01_000002 to
> > > attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> > > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> > > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > > hadoop04.housing.com to /default-rack
> > > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar
> > > is not present. Not adding any jar to the list of resources.
> > > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
> > > job-conf file on the remote FS is
> > > /user/hdfs/.staging/job_1446620926630_0017/job.xml
> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1
> > > tokens and #1 secret keys for NM use for launching container
> > > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
> > > containertokens_dob is 2
> > > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
> > > shuffle token in serviceData
> > > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > > UNASSIGNED to ASSIGNED
> > > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > > attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > Launching attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
> > >
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > Opening proxy : hadoop04.housing.com:45454
> > > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > Shuffle port returned by ContainerManager for
> > > attempt_1446620926630_0017_m_000000_0 : 13562
> > > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
> > > containerId: [container_e02_1446620926630_0017_01_000002 on NM:
> > > [hadoop04.housing.com:45454]
> > > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > > ASSIGNED to RUNNING
> > > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to
> > > RUNNING
> > > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > > getResources() for application_1446620926630_0017: ask=1 release= 0
> > > newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
> > > vCores:1> knownNMs=5
> > > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
> > > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
> > > job_1446620926630_0017 (auth:SIMPLE)
> > > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
> > > jvm_1446620926630_0017_m_2199023255554 asked for a task
> > > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> > > jvm_1446620926630_0017_m_2199023255554 given task:
> > > attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> > > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state
> > > update from attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > > RUNNING to COMMIT_PENDING
> > > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > attempt_1446620926630_0017_m_000000_0 given a go for committing the
> > > task output.
> > > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
> > > request from attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
> > > canCommit for attempt_1446620926630_0017_m_000000_0:true
> > > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> > > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
> > > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement
> > > from attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> > > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
> > > container_e02_1446620926630_0017_01_000002 taskAttempt
> > > attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > > KILLING attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > >
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > > Opening proxy : hadoop04.housing.com:45454
> > > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded
> > > with attempt attempt_1446620926630_0017_m_000000_0
> > > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
> > > SUCCEEDED
> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
> > > Tasks: 1
> > > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
> > > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
> > > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > > Processing the event EventType: JOB_COMMIT
> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler
> > > for JobFinishedEvent
> > > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > > job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED
> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
> > > cleanly so this is the last retry
> > > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
> > > isAMLastRetry: true
> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator
> > > notified that shouldUnregistered is: true
> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
> > > isAMLastRetry: true
> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > JobHistoryEventHandler notified that forceJobCompletion is true
> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all
> > > the services
> > > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > > Stopping JobHistoryEventHandler. Size of the outstanding queue size is
> > > 0
> > > 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> > > hdfs://
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > > to hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
> > > to done location:
> > > hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> > > hdfs://
> > >
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
> > > to hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
> > > to done location:
> > > hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> > > tmp to done: hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
> > > to hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> > > 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> > > tmp to done: hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > > to hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> > > 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> > > tmp to done: hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > > to hdfs://
> > >
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> > > 2015-11-04 14:59:22,965 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
> > > JobHistoryEventHandler. super.stop()
> > > 2015-11-04 14:59:22,968 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
> > > diagnostics to
> > > 2015-11-04 14:59:22,969 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
> > >
> http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> > > 2015-11-04 14:59:22,976 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
> > > application to be successfully unregistered.
> > > 2015-11-04 14:59:23,979 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
> > > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
> > > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
> > > HostLocal:0 RackLocal:0
> > > 2015-11-04 14:59:23,980 INFO [Thread-67]
> > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
> > > directory hdfs://hadoop01.housing.com:8020
> > > /user/hdfs/.staging/job_1446620926630_0017
> > > 2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server:
> > > Stopping server on 50432
> > > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
> > > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
> > > 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
> > > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> > > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
> > > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
> > > TaskHeartbeatHandler thread interrupted
> > >
> > >
> > > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> > > jaydeep.vishwakarma@inmobi.com> wrote:
> > >
> > > > In first look I am not seeing any issue with job tracker or name node
> > > URL.
> > > > The job id is getting generated. Workflow Job is not going on PREP
> > mode.
> > > >
> > > > Open this link.
> > > >
> http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
> > > >
> > > > You will be see the problem.
> > > >
> > > >
> > > >
> > > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <jeetendra.g@housing.com
> >
> > > > wrote:
> > > >
> > > > > hey Serega I have cross verified jobTracker value is correct only I
> > am
> > > > > using yarn so resource manager will become the job tracker?
> > > > >
> > > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
> > > serega.sheypak@gmail.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > Can you go to oozie server and grab logs from there? My
> assumption
> > > that
> > > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > > > <name-node>${nameNode}</name-node>
> > > > > >
> > > > > > have incorrect values. Probably ${jobTracker} is wrong and oozie
> > > can't
> > > > > even
> > > > > > start launcher mapper.
> > > > > >
> > > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > > > > > jaydeep.vishwakarma@inmobi.com>:
> > > > > >
> > > > > > > You are doing -log. Can you give the command as below and get
> the
> > > job
> > > > > url
> > > > > > > (application launcher url).
> > > > > > >
> > > > > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> *
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
> > > jeetendra.g@housing.com
> > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > and in job error log tab its saying error log is disables? by
> > > > default
> > > > > > why
> > > > > > > > error log is disables? i am using hortonworks
> > > > > > > >
> > > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> > > > jeetendra.g@housing.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > same error.
> > > > > > > > >
> > > > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start
> > > > action
> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with
> > user-retry
> > > > > > state :
> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
> [10]
> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > > > > > status=DONE
> > > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > > > updated
> > > > > > in
> > > > > > > > DB!
> > > > > > > > > 2015-11-04 14:09:00,994 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > > > > > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> > > > > Notification
> > > > > > > URL
> > > > > > > > > is defined. Therefore nothing to notify for job
> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > > > > > 2015-11-04 14:09:01,004 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > > > > > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > > > Notification
> > > > > > URL
> > > > > > > is
> > > > > > > > > defined. Therefore nothing to notify for job
> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> Start
> > > > > action
> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with
> > > user-retry
> > > > > > > state :
> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
> [10]
> > > > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > checking
> > > > > > > action,
> > > > > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> ***]Action
> > > > > > > > > status=RUNNING
> > > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node
> ***]Action
> > > > > updated
> > > > > > > in
> > > > > > > > > DB!
> > > > > > > > > 2015-11-04 14:09:02,926 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > > > > > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > > > > Notification
> > > > > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > callback
> > > > > for
> > > > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > action
> > > > > > > completed,
> > > > > > > > > external ID [job_1446620926630_0016]
> > > > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start
> > action
> > > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry
> > > > state :
> > > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval
> [10]
> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> > > > status=DONE
> > > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 -
> > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > APP[java-main-wf]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> > updated
> > > > in
> > > > > > DB!
> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > > > > > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
> > > Notification
> > > > > URL
> > > > > > > is
> > > > > > > > > defined. Therefore nothing to notify for job
> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > > > > > 2015-11-04 14:09:18,104 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > > > > > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > > > Notification
> > > > > > URL
> > > > > > > is
> > > > > > > > > defined. Therefore nothing to notify for job
> > > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > > > > 2015-11-04 14:09:18,105 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > > > > > SERVER[
> > > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > > > > Notification
> > > > > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > > > > >
> > > > > > > > >> oozie job -info
> > 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > > > >> There you will find "Console URL" , Open that URL on
> > browser.
> > > > You
> > > > > > will
> > > > > > > > get
> > > > > > > > >> the Launcher mapper logs.
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > > > > > jeetendra.g@housing.com>
> > > > > > > > >> wrote:
> > > > > > > > >>
> > > > > > > > >> > This is the log i am getting repeatedly
> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > > > WorkflowNotificationXCommand:520 -
> > > > > > > > SERVER[
> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > > > > Notification
> > > > > > > > >> URL
> > > > > > > > >> > is
> > > > > > > > >> > defined. Therefore nothing to notify for job
> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > > > WorkflowNotificationXCommand:520 -
> > > > > > > > SERVER[
> > > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > Notification
> > > > > > > URL
> > > > > > > > >> is
> > > > > > > > >> > defined. Therefore nothing to notify for job
> > > > > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > > > > > >> >
> > > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > > > > >> >
> > > > > > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > > > > > >> > >
> > > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > > > > > jeetendra.g@housing.com>
> > > > > > > > >> > > wrote:
> > > > > > > > >> > >
> > > > > > > > >> > > > does anybody have any idea? i have been trying this
> > from
> > > > 10
> > > > > > days
> > > > > > > > >> > nothing
> > > > > > > > >> > > > worked out.
> > > > > > > > >> > > >
> > > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > > > > > >> jeetendra.g@housing.com>
> > > > > > > > >> > > > wrote:
> > > > > > > > >> > > >
> > > > > > > > >> > > > > my workflow.xml
> > > > > > > > >> > > > >
> > > > > > > > >> > > > >
> > > > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > > > > > name="java-main-wf">
> > > > > > > > >> > > > > <start to="java-node"/>
> > > > > > > > >> > > > > <action name="java-node">
> > > > > > > > >> > > > > <java>
> > > > > > > > >> > > > >
> <job-tracker>${jobTracker}</job-tracker>
> > > > > > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > > > > > >> > > > >
> > > > > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > > > > > >> > > > >
> > > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > > > > > >> > > > >
> > > > > > > > >> > > > > </java>
> > > > > > > > >> > > > > <ok to="end"/>
> > > > > > > > >> > > > > <error to="fail"/>
> > > > > > > > >> > > > > </action>
> > > > > > > > >> > > > > <kill name="fail">
> > > > > > > > >> > > > > <message>Java failed, error
> > > > > > > > >> > > > >
> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > > > > > >> > > > > </kill>
> > > > > > > > >> > > > > <end name="end"/>
> > > > > > > > >> > > > > </workflow-app>
> > > > > > > > >> > > > >
> > > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > > > > > >> > jeetendra.g@housing.com>
> > > > > > > > >> > > > > wrote:
> > > > > > > > >> > > > >
> > > > > > > > >> > > > >> Hi All,
> > > > > > > > >> > > > >>
> > > > > > > > >> > > > >> I am running java workflow job using oozie.
> > > > > > > > >> > > > >> I have Ambari server and I have installed oozie
> > from
> > > > > > Ambari.
> > > > > > > > >> > > > >> When i ran the job it say succeeded but its not
> > > running
> > > > > my
> > > > > > > java
> > > > > > > > >> > class
> > > > > > > > >> > > > >> which I mentioned inside workflow.xml. Also when
> I
> > > get
> > > > > > oozie
> > > > > > > > >> > nothing
> > > > > > > > >> > > > can
> > > > > > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > > > > > >> > > > >> oozie job -oozie
> > > > http://hadoop03.housing.com:11000/oozie
> > > > > > > -log
> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > :start:]
> > > > > Start
> > > > > > > > >> action
> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:]
> > with
> > > > > > > user-retry
> > > > > > > > >> > state
> > > > > > > > >> > > :
> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > userRetryInterval
> > > > > > [10]
> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > :start:]
> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > > > > :start:***]Action
> > > > > > > > >> > > status=DONE
> > > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > :start:]
> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > > > > :start:***]Action
> > > > > > > > >> updated
> > > > > > > > >> > in
> > > > > > > > >> > > > DB!
> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > > > > WorkflowNotificationXCommand:520
> > > > > > > > -
> > > > > > > > >> > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> > :start:]
> > > > No
> > > > > > > > >> > Notification
> > > > > > > > >> > > > URL
> > > > > > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > > > > WorkflowNotificationXCommand:520
> > > > > > > > -
> > > > > > > > >> > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[]
> > No
> > > > > > > > >> Notification
> > > > > > > > >> > URL
> > > > > > > > >> > > > is
> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > > Start
> > > > > > > > >> action
> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node]
> > > with
> > > > > > > > user-retry
> > > > > > > > >> > > state
> > > > > > > > >> > > > :
> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > userRetryInterval
> > > > > > [10]
> > > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO
> > JavaActionExecutor:520
> > > -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > > > > checking
> > > > > > > > >> > > action,
> > > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status
> > > [RUNNING]
> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > > > > >> > > > >>
> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > ***]Action
> > > > > > > > >> > > > >> status=RUNNING
> > > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > > > > >> > > > >>
> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > ***]Action
> > > > > > > > >> > updated
> > > > > > > > >> > > in
> > > > > > > > >> > > > >> DB!
> > > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > > > > > WorkflowNotificationXCommand:520
> > > > > > > > -
> > > > > > > > >> > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > No
> > > > > > > > >> > > Notification
> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for
> job
> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO
> CallbackServlet:520 -
> > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > > > > callback
> > > > > > > > >> for
> > > > > > > > >> > > > >> action
> > > [0000040-151015123257993-oozie-oozi-W@java-node
> > > > ]
> > > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO
> > JavaActionExecutor:520
> > > -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > > > action
> > > > > > > > >> > > > completed,
> > > > > > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > Start
> > > > > > > action
> > > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> > > > > user-retry
> > > > > > > > >> state :
> > > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > > userRetryInterval
> > > > > > [10]
> > > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> > > ***]Action
> > > > > > > > >> status=DONE
> > > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
> > > ActionStartXCommand:520 -
> > > > > > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-]
> TOKEN[]
> > > > > > > > >> APP[java-main-wf]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> > > ***]Action
> > > > > > > updated
> > > > > > > > >> in
> > > > > > > > >> > DB!
> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > > > WorkflowNotificationXCommand:520
> > > > > > > > -
> > > > > > > > >> > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > No
> > > > > > > > Notification
> > > > > > > > >> > URL
> > > > > > > > >> > > is
> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > > > WorkflowNotificationXCommand:520
> > > > > > > > -
> > > > > > > > >> > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[]
> > No
> > > > > > > > >> Notification
> > > > > > > > >> > URL
> > > > > > > > >> > > > is
> > > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > > > WorkflowNotificationXCommand:520
> > > > > > > > -
> > > > > > > > >> > > SERVER[
> > > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > > APP[-]
> > > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > > >> > > > >>
> > ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > No
> > > > > > > > >> > > Notification
> > > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for
> job
> > > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > > > >> > > > >>
> > > > > > > > >> > > > >
> > > > > > > > >> > > > >
> > > > > > > > >> > > >
> > > > > > > > >> > >
> > > > > > > > >> > > --
> > > > > > > > >> > >
> > > > _____________________________________________________________
> > > > > > > > >> > > The information contained in this communication is
> > > intended
> > > > > > solely
> > > > > > > > for
> > > > > > > > >> > the
> > > > > > > > >> > > use of the individual or entity to whom it is
> addressed
> > > and
> > > > > > others
> > > > > > > > >> > > authorized to receive it. It may contain confidential
> or
> > > > > legally
> > > > > > > > >> > privileged
> > > > > > > > >> > > information. If you are not the intended recipient you
> > are
> > > > > > hereby
> > > > > > > > >> > notified
> > > > > > > > >> > > that any disclosure, copying, distribution or taking
> any
> > > > > action
> > > > > > in
> > > > > > > > >> > reliance
> > > > > > > > >> > > on the contents of this information is strictly
> > prohibited
> > > > and
> > > > > > may
> > > > > > > > be
> > > > > > > > >> > > unlawful. If you have received this communication in
> > > error,
> > > > > > please
> > > > > > > > >> notify
> > > > > > > > >> > > us immediately by responding to this email and then
> > delete
> > > > it
> > > > > > from
> > > > > > > > >> your
> > > > > > > > >> > > system. The firm is neither liable for the proper and
> > > > complete
> > > > > > > > >> > transmission
> > > > > > > > >> > > of the information contained in this communication nor
> > for
> > > > any
> > > > > > > delay
> > > > > > > > >> in
> > > > > > > > >> > its
> > > > > > > > >> > > receipt.
> > > > > > > > >> > >
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > > >> --
> > > > > > > > >>
> > _____________________________________________________________
> > > > > > > > >> The information contained in this communication is
> intended
> > > > solely
> > > > > > for
> > > > > > > > the
> > > > > > > > >> use of the individual or entity to whom it is addressed
> and
> > > > others
> > > > > > > > >> authorized to receive it. It may contain confidential or
> > > legally
> > > > > > > > >> privileged
> > > > > > > > >> information. If you are not the intended recipient you are
> > > > hereby
> > > > > > > > notified
> > > > > > > > >> that any disclosure, copying, distribution or taking any
> > > action
> > > > in
> > > > > > > > >> reliance
> > > > > > > > >> on the contents of this information is strictly prohibited
> > and
> > > > may
> > > > > > be
> > > > > > > > >> unlawful. If you have received this communication in
> error,
> > > > please
> > > > > > > > notify
> > > > > > > > >> us immediately by responding to this email and then delete
> > it
> > > > from
> > > > > > > your
> > > > > > > > >> system. The firm is neither liable for the proper and
> > complete
> > > > > > > > >> transmission
> > > > > > > > >> of the information contained in this communication nor for
> > any
> > > > > delay
> > > > > > > in
> > > > > > > > >> its
> > > > > > > > >> receipt.
> > > > > > > > >>
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > _____________________________________________________________
> > > > > > > The information contained in this communication is intended
> > solely
> > > > for
> > > > > > the
> > > > > > > use of the individual or entity to whom it is addressed and
> > others
> > > > > > > authorized to receive it. It may contain confidential or
> legally
> > > > > > privileged
> > > > > > > information. If you are not the intended recipient you are
> hereby
> > > > > > notified
> > > > > > > that any disclosure, copying, distribution or taking any action
> > in
> > > > > > reliance
> > > > > > > on the contents of this information is strictly prohibited and
> > may
> > > be
> > > > > > > unlawful. If you have received this communication in error,
> > please
> > > > > notify
> > > > > > > us immediately by responding to this email and then delete it
> > from
> > > > your
> > > > > > > system. The firm is neither liable for the proper and complete
> > > > > > transmission
> > > > > > > of the information contained in this communication nor for any
> > > delay
> > > > in
> > > > > > its
> > > > > > > receipt.
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > > --
> > > > _____________________________________________________________
> > > > The information contained in this communication is intended solely
> for
> > > the
> > > > use of the individual or entity to whom it is addressed and others
> > > > authorized to receive it. It may contain confidential or legally
> > > privileged
> > > > information. If you are not the intended recipient you are hereby
> > > notified
> > > > that any disclosure, copying, distribution or taking any action in
> > > reliance
> > > > on the contents of this information is strictly prohibited and may be
> > > > unlawful. If you have received this communication in error, please
> > notify
> > > > us immediately by responding to this email and then delete it from
> your
> > > > system. The firm is neither liable for the proper and complete
> > > transmission
> > > > of the information contained in this communication nor for any delay
> in
> > > its
> > > > receipt.
> > > >
> > >
> >
> > --
> > _____________________________________________________________
> > The information contained in this communication is intended solely for
> the
> > use of the individual or entity to whom it is addressed and others
> > authorized to receive it. It may contain confidential or legally
> privileged
> > information. If you are not the intended recipient you are hereby
> notified
> > that any disclosure, copying, distribution or taking any action in
> reliance
> > on the contents of this information is strictly prohibited and may be
> > unlawful. If you have received this communication in error, please notify
> > us immediately by responding to this email and then delete it from your
> > system. The firm is neither liable for the proper and complete
> transmission
> > of the information contained in this communication nor for any delay in
> its
> > receipt.
> >
>
Re: Java action in Ooozie
Posted by Serega Sheypak <se...@gmail.com>.
Hm... ok, can you see what happens on YARN RM web ui?
There should be a job that runs yuor oozie mapper launcher.
2015-11-04 15:02 GMT+01:00 Jaydeep Vishwakarma <
jaydeep.vishwakarma@inmobi.com>:
> Good, So not issue with Yarn or name node urls. Can you share stdout logs.
>
>
> On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > Hi Jaydeep here also I cant see any error below are the logs
> >
> > Log Type: syslog
> >
> > Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
> >
> > Log Length: 25565
> >
> > 2015-11-04 14:59:11,814 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster
> > for application appattempt_1446620926630_0017_000001
> > 2015-11-04 14:59:12,144 WARN [main]
> > org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
> > library for your platform... using builtin-java classes where
> > applicable
> > 2015-11-04 14:59:12,184 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
> > 2015-11-04 14:59:12,292 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id {
> > id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
> > -173762614)
> > 2015-11-04 14:59:12,293 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> > RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs,
> > renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
> > maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> > 2015-11-04 14:59:12,890 WARN [main]
> > org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
> > short-circuit local reads feature cannot be used because libhadoop
> > cannot be loaded.
> > 2015-11-04 14:59:13,064 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
> > config null
> > 2015-11-04 14:59:13,065 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
> > org.apache.hadoop.mapred.FileOutputCommitter
> > 2015-11-04 14:59:13,110 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.jobhistory.EventType for class
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> > 2015-11-04 14:59:13,110 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> > 2015-11-04 14:59:13,111 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> > 2015-11-04 14:59:13,111 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
> > class
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> > 2015-11-04 14:59:13,112 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
> > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> > 2015-11-04 14:59:13,112 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
> > class
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> > 2015-11-04 14:59:13,113 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
> > class
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> > 2015-11-04 14:59:13,113 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> > for class
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> > 2015-11-04 14:59:13,144 INFO [main]
> > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > file system is set solely by core-default.xml therefore - ignoring
> > 2015-11-04 14:59:13,170 INFO [main]
> > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > file system is set solely by core-default.xml therefore - ignoring
> > 2015-11-04 14:59:13,189 INFO [main]
> > org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> > file system is set solely by core-default.xml therefore - ignoring
> > 2015-11-04 14:59:13,219 INFO [main]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Emitting job history data to the timeline server is not enabled
> > 2015-11-04 14:59:13,255 INFO [main]
> > org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> > org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for
> > class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> > 2015-11-04 14:59:13,453 WARN [main]
> > org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> > configuration: tried
> > hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> > 2015-11-04 14:59:13,546 INFO [main]
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> > period at 10 second(s).
> > 2015-11-04 14:59:13,546 INFO [main]
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
> > system started
> > 2015-11-04 14:59:13,557 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token
> > for job_1446620926630_0017 to jobTokenSecretManager
> > 2015-11-04 14:59:13,680 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
> > job_1446620926630_0017 because: not enabled; too much RAM;
> > 2015-11-04 14:59:13,701 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for
> > job job_1446620926630_0017 = 0. Number of splits = 1
> > 2015-11-04 14:59:13,701 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces
> > for job job_1446620926630_0017 = 0
> > 2015-11-04 14:59:13,701 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > job_1446620926630_0017Job Transitioned from NEW to INITED
> > 2015-11-04 14:59:13,702 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
> > normal, non-uberized, multi-container job job_1446620926630_0017.
> > 2015-11-04 14:59:13,725 INFO [main]
> > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > java.util.concurrent.LinkedBlockingQueue
> > 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
> > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640
> > 2015-11-04 14:59:13,758 INFO [main]
> > org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> > Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
> > to the server
> > 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
> > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
> > org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting
> > 2015-11-04 14:59:13,762 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
> > Instantiated MRClientService at hadoop04.housing.com/10.21.1.138:39640
> > 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
> > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> > org.mortbay.log.Slf4jLog
> > 2015-11-04 14:59:13,862 INFO [main]
> > org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> > Unable to initialize FileSignerSecretProvider, falling back to use
> > random secrets.
> > 2015-11-04 14:59:13,867 WARN [main]
> > org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be
> > enabled using Log4j
> > 2015-11-04 14:59:13,874 INFO [main]
> > org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
> > (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> > 2015-11-04 14:59:13,878 INFO [main]
> > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> > context mapreduce
> > 2015-11-04 14:59:13,879 INFO [main]
> > org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> > (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> > context static
> > 2015-11-04 14:59:13,882 INFO [main]
> > org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
> > 2015-11-04 14:59:13,882 INFO [main]
> > org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> > 2015-11-04 14:59:14,217 INFO [main]
> > org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
> > 2015-11-04 14:59:14,218 INFO [main]
> > org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> > 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
> > 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
> >
> >
> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
> > to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> > 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
> > HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> > 2015-11-04 14:59:15,952 INFO [main]
> > org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at
> > 49791
> > 2015-11-04 14:59:15,957 INFO [main]
> > org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> > java.util.concurrent.LinkedBlockingQueue
> > 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
> > org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432
> > 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
> > org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> > 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
> > org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting
> > 2015-11-04 14:59:15,988 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > nodeBlacklistingEnabled:true
> > 2015-11-04 14:59:15,988 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > maxTaskFailuresPerNode is 3
> > 2015-11-04 14:59:15,988 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > blacklistDisablePercent is 33
> > 2015-11-04 14:59:16,035 INFO [main]
> > org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager
> > at hadoop02.housing.com/10.21.1.136:8030
> > 2015-11-04 14:59:16,113 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> > maxContainerCapability: <memory:5120, vCores:3>
> > 2015-11-04 14:59:16,113 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
> > 2015-11-04 14:59:16,117 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > Upper limit on the thread pool size is 500
> > 2015-11-04 14:59:16,118 INFO [main]
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
> > thread pool initial size is 10
> > 2015-11-04 14:59:16,120 INFO [main]
> > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > yarn.client.max-cached-nodemanagers-proxies : 0
> > 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > job_1446620926630_0017Job Transitioned from INITED to SETUP
> > 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
> > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > Processing the event EventType: JOB_SETUP
> > 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
> > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
> > Output Committer Algorithm version is 1
> > 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> > 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > task_1446620926630_0017_m_000000 Task Transitioned from NEW to
> > SCHEDULED
> > 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > NEW to UNASSIGNED
> > 2015-11-04 14:59:16,202 INFO [Thread-51]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> > mapResourceRequest:<memory:1536, vCores:1>
> > 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
> > Writer setup for JobId: job_1446620926630_0017, File:
> > hdfs://
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> > Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
> > AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> > 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > getResources() for application_1446620926630_0017: ask=1 release= 0
> > newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
> > vCores:1> knownNMs=5
> > 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
> > allocated containers 1
> > 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
> > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > hadoop04.housing.com to /default-rack
> > 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
> > container container_e02_1446620926630_0017_01_000002 to
> > attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> > Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> > AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> > ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.yarn.util.RackResolver: Resolved
> > hadoop04.housing.com to /default-rack
> > 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar
> > is not present. Not adding any jar to the list of resources.
> > 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
> > job-conf file on the remote FS is
> > /user/hdfs/.staging/job_1446620926630_0017/job.xml
> > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1
> > tokens and #1 secret keys for NM use for launching container
> > 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
> > containertokens_dob is 2
> > 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
> > shuffle token in serviceData
> > 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > UNASSIGNED to ASSIGNED
> > 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
> > container_e02_1446620926630_0017_01_000002 taskAttempt
> > attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > Launching attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
> > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > Opening proxy : hadoop04.housing.com:45454
> > 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > Shuffle port returned by ContainerManager for
> > attempt_1446620926630_0017_m_000000_0 : 13562
> > 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
> > containerId: [container_e02_1446620926630_0017_01_000002 on NM:
> > [hadoop04.housing.com:45454]
> > 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > ASSIGNED to RUNNING
> > 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to
> > RUNNING
> > 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> > getResources() for application_1446620926630_0017: ask=1 release= 0
> > newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
> > vCores:1> knownNMs=5
> > 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
> > SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
> > job_1446620926630_0017 (auth:SIMPLE)
> > 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
> > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
> > jvm_1446620926630_0017_m_2199023255554 asked for a task
> > 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
> > org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> > jvm_1446620926630_0017_m_2199023255554 given task:
> > attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
> > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> > 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
> > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state
> > update from attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > RUNNING to COMMIT_PENDING
> > 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > attempt_1446620926630_0017_m_000000_0 given a go for committing the
> > task output.
> > 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
> > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
> > request from attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
> > canCommit for attempt_1446620926630_0017_m_000000_0:true
> > 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
> > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> > TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> > 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
> > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement
> > from attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> > 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
> > container_e02_1446620926630_0017_01_000002 taskAttempt
> > attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> > KILLING attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> > Opening proxy : hadoop04.housing.com:45454
> > 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> > attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> > SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded
> > with attempt attempt_1446620926630_0017_m_000000_0
> > 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> > task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
> > SUCCEEDED
> > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
> > Tasks: 1
> > 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
> > 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
> > org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> > Processing the event EventType: JOB_COMMIT
> > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler
> > for JobFinishedEvent
> > 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> > org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> > job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED
> > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
> > cleanly so this is the last retry
> > 2015-11-04 14:59:22,792 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
> > isAMLastRetry: true
> > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator
> > notified that shouldUnregistered is: true
> > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
> > isAMLastRetry: true
> > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > JobHistoryEventHandler notified that forceJobCompletion is true
> > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all
> > the services
> > 2015-11-04 14:59:22,793 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> > Stopping JobHistoryEventHandler. Size of the outstanding queue size is
> > 0
> > 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> > hdfs://
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> > to hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
> > to done location:
> > hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> > hdfs://
> >
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
> > to hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
> > to done location:
> > hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> > tmp to done: hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
> > to hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> > 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> > tmp to done: hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> > to hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> > 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> > tmp to done: hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> > to hdfs://
> >
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> > 2015-11-04 14:59:22,965 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
> > JobHistoryEventHandler. super.stop()
> > 2015-11-04 14:59:22,968 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
> > diagnostics to
> > 2015-11-04 14:59:22,969 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
> > http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> > 2015-11-04 14:59:22,976 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
> > application to be successfully unregistered.
> > 2015-11-04 14:59:23,979 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
> > Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
> > AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
> > HostLocal:0 RackLocal:0
> > 2015-11-04 14:59:23,980 INFO [Thread-67]
> > org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
> > directory hdfs://hadoop01.housing.com:8020
> > /user/hdfs/.staging/job_1446620926630_0017
> > 2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server:
> > Stopping server on 50432
> > 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
> > org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
> > 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
> > org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> > 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
> > org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
> > TaskHeartbeatHandler thread interrupted
> >
> >
> > On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> > jaydeep.vishwakarma@inmobi.com> wrote:
> >
> > > In first look I am not seeing any issue with job tracker or name node
> > URL.
> > > The job id is getting generated. Workflow Job is not going on PREP
> mode.
> > >
> > > Open this link.
> > > http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
> > >
> > > You will be see the problem.
> > >
> > >
> > >
> > > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > > > hey Serega I have cross verified jobTracker value is correct only I
> am
> > > > using yarn so resource manager will become the job tracker?
> > > >
> > > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
> > serega.sheypak@gmail.com
> > > >
> > > > wrote:
> > > >
> > > > > Can you go to oozie server and grab logs from there? My assumption
> > that
> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > > <name-node>${nameNode}</name-node>
> > > > >
> > > > > have incorrect values. Probably ${jobTracker} is wrong and oozie
> > can't
> > > > even
> > > > > start launcher mapper.
> > > > >
> > > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > > > > jaydeep.vishwakarma@inmobi.com>:
> > > > >
> > > > > > You are doing -log. Can you give the command as below and get the
> > job
> > > > url
> > > > > > (application launcher url).
> > > > > >
> > > > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
> > jeetendra.g@housing.com
> > > >
> > > > > > wrote:
> > > > > >
> > > > > > > and in job error log tab its saying error log is disables? by
> > > default
> > > > > why
> > > > > > > error log is disables? i am using hortonworks
> > > > > > >
> > > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> > > jeetendra.g@housing.com
> > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > same error.
> > > > > > > >
> > > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start
> > > action
> > > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with
> user-retry
> > > > > state :
> > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > > > > status=DONE
> > > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > > updated
> > > > > in
> > > > > > > DB!
> > > > > > > > 2015-11-04 14:09:00,994 INFO
> WorkflowNotificationXCommand:520
> > -
> > > > > > SERVER[
> > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> > > > Notification
> > > > > > URL
> > > > > > > > is defined. Therefore nothing to notify for job
> > > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > > > > 2015-11-04 14:09:01,004 INFO
> WorkflowNotificationXCommand:520
> > -
> > > > > > SERVER[
> > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > > Notification
> > > > > URL
> > > > > > is
> > > > > > > > defined. Therefore nothing to notify for job
> > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
> > > > action
> > > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with
> > user-retry
> > > > > > state :
> > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > checking
> > > > > > action,
> > > > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > > > > > status=RUNNING
> > > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > updated
> > > > > > in
> > > > > > > > DB!
> > > > > > > > 2015-11-04 14:09:02,926 INFO
> WorkflowNotificationXCommand:520
> > -
> > > > > > SERVER[
> > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > > > Notification
> > > > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > callback
> > > > for
> > > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> action
> > > > > > completed,
> > > > > > > > external ID [job_1446620926630_0016]
> > > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start
> action
> > > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry
> > > state :
> > > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> > > status=DONE
> > > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 -
> SERVER[
> > > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > APP[java-main-wf]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> updated
> > > in
> > > > > DB!
> > > > > > > > 2015-11-04 14:09:18,104 INFO
> WorkflowNotificationXCommand:520
> > -
> > > > > > SERVER[
> > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
> > Notification
> > > > URL
> > > > > > is
> > > > > > > > defined. Therefore nothing to notify for job
> > > > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > > > > 2015-11-04 14:09:18,104 INFO
> WorkflowNotificationXCommand:520
> > -
> > > > > > SERVER[
> > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > > Notification
> > > > > URL
> > > > > > is
> > > > > > > > defined. Therefore nothing to notify for job
> > > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > > > 2015-11-04 14:09:18,105 INFO
> WorkflowNotificationXCommand:520
> > -
> > > > > > SERVER[
> > > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > > > Notification
> > > > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > > > >
> > > > > > > >> oozie job -info
> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > > >> There you will find "Console URL" , Open that URL on
> browser.
> > > You
> > > > > will
> > > > > > > get
> > > > > > > >> the Launcher mapper logs.
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > > > > jeetendra.g@housing.com>
> > > > > > > >> wrote:
> > > > > > > >>
> > > > > > > >> > This is the log i am getting repeatedly
> > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > > WorkflowNotificationXCommand:520 -
> > > > > > > SERVER[
> > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > > > Notification
> > > > > > > >> URL
> > > > > > > >> > is
> > > > > > > >> > defined. Therefore nothing to notify for job
> > > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > > WorkflowNotificationXCommand:520 -
> > > > > > > SERVER[
> > > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > Notification
> > > > > > URL
> > > > > > > >> is
> > > > > > > >> > defined. Therefore nothing to notify for job
> > > > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > > > > >> >
> > > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > > > >> >
> > > > > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > > > > >> > >
> > > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > > > > jeetendra.g@housing.com>
> > > > > > > >> > > wrote:
> > > > > > > >> > >
> > > > > > > >> > > > does anybody have any idea? i have been trying this
> from
> > > 10
> > > > > days
> > > > > > > >> > nothing
> > > > > > > >> > > > worked out.
> > > > > > > >> > > >
> > > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > > > > >> jeetendra.g@housing.com>
> > > > > > > >> > > > wrote:
> > > > > > > >> > > >
> > > > > > > >> > > > > my workflow.xml
> > > > > > > >> > > > >
> > > > > > > >> > > > >
> > > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > > > > name="java-main-wf">
> > > > > > > >> > > > > <start to="java-node"/>
> > > > > > > >> > > > > <action name="java-node">
> > > > > > > >> > > > > <java>
> > > > > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > > > > >> > > > >
> > > > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > > > > >> > > > >
> > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > > > > >> > > > >
> > > > > > > >> > > > > </java>
> > > > > > > >> > > > > <ok to="end"/>
> > > > > > > >> > > > > <error to="fail"/>
> > > > > > > >> > > > > </action>
> > > > > > > >> > > > > <kill name="fail">
> > > > > > > >> > > > > <message>Java failed, error
> > > > > > > >> > > > >
> > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > > > > >> > > > > </kill>
> > > > > > > >> > > > > <end name="end"/>
> > > > > > > >> > > > > </workflow-app>
> > > > > > > >> > > > >
> > > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > > > > >> > jeetendra.g@housing.com>
> > > > > > > >> > > > > wrote:
> > > > > > > >> > > > >
> > > > > > > >> > > > >> Hi All,
> > > > > > > >> > > > >>
> > > > > > > >> > > > >> I am running java workflow job using oozie.
> > > > > > > >> > > > >> I have Ambari server and I have installed oozie
> from
> > > > > Ambari.
> > > > > > > >> > > > >> When i ran the job it say succeeded but its not
> > running
> > > > my
> > > > > > java
> > > > > > > >> > class
> > > > > > > >> > > > >> which I mentioned inside workflow.xml. Also when I
> > get
> > > > > oozie
> > > > > > > >> > nothing
> > > > > > > >> > > > can
> > > > > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > > > > >> > > > >> oozie job -oozie
> > > http://hadoop03.housing.com:11000/oozie
> > > > > > -log
> > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> :start:]
> > > > Start
> > > > > > > >> action
> > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:]
> with
> > > > > > user-retry
> > > > > > > >> > state
> > > > > > > >> > > :
> > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > userRetryInterval
> > > > > [10]
> > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> :start:]
> > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > > > :start:***]Action
> > > > > > > >> > > status=DONE
> > > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> :start:]
> > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > > > :start:***]Action
> > > > > > > >> updated
> > > > > > > >> > in
> > > > > > > >> > > > DB!
> > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > > > WorkflowNotificationXCommand:520
> > > > > > > -
> > > > > > > >> > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@
> :start:]
> > > No
> > > > > > > >> > Notification
> > > > > > > >> > > > URL
> > > > > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > > > WorkflowNotificationXCommand:520
> > > > > > > -
> > > > > > > >> > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[]
> No
> > > > > > > >> Notification
> > > > > > > >> > URL
> > > > > > > >> > > > is
> > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > > Start
> > > > > > > >> action
> > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node]
> > with
> > > > > > > user-retry
> > > > > > > >> > > state
> > > > > > > >> > > > :
> > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > userRetryInterval
> > > > > [10]
> > > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO
> JavaActionExecutor:520
> > -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > > > > checking
> > > > > > > >> > > action,
> > > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status
> > [RUNNING]
> > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > > > ***]Action
> > > > > > > >> > > > >> status=RUNNING
> > > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > > > ***]Action
> > > > > > > >> > updated
> > > > > > > >> > > in
> > > > > > > >> > > > >> DB!
> > > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > > > > WorkflowNotificationXCommand:520
> > > > > > > -
> > > > > > > >> > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > No
> > > > > > > >> > > Notification
> > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
> > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > > > > callback
> > > > > > > >> for
> > > > > > > >> > > > >> action
> > [0000040-151015123257993-oozie-oozi-W@java-node
> > > ]
> > > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO
> JavaActionExecutor:520
> > -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > > > action
> > > > > > > >> > > > completed,
> > > > > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > Start
> > > > > > action
> > > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> > > > user-retry
> > > > > > > >> state :
> > > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> > userRetryInterval
> > > > > [10]
> > > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> > ***]Action
> > > > > > > >> status=DONE
> > > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
> > ActionStartXCommand:520 -
> > > > > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > > >> APP[java-main-wf]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> > ***]Action
> > > > > > updated
> > > > > > > >> in
> > > > > > > >> > DB!
> > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > > WorkflowNotificationXCommand:520
> > > > > > > -
> > > > > > > >> > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> No
> > > > > > > Notification
> > > > > > > >> > URL
> > > > > > > >> > > is
> > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > > WorkflowNotificationXCommand:520
> > > > > > > -
> > > > > > > >> > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[]
> No
> > > > > > > >> Notification
> > > > > > > >> > URL
> > > > > > > >> > > > is
> > > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > > WorkflowNotificationXCommand:520
> > > > > > > -
> > > > > > > >> > > SERVER[
> > > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> > APP[-]
> > > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > > >> > > > >>
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > No
> > > > > > > >> > > Notification
> > > > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > > >> > > > >>
> > > > > > > >> > > > >
> > > > > > > >> > > > >
> > > > > > > >> > > >
> > > > > > > >> > >
> > > > > > > >> > > --
> > > > > > > >> > >
> > > _____________________________________________________________
> > > > > > > >> > > The information contained in this communication is
> > intended
> > > > > solely
> > > > > > > for
> > > > > > > >> > the
> > > > > > > >> > > use of the individual or entity to whom it is addressed
> > and
> > > > > others
> > > > > > > >> > > authorized to receive it. It may contain confidential or
> > > > legally
> > > > > > > >> > privileged
> > > > > > > >> > > information. If you are not the intended recipient you
> are
> > > > > hereby
> > > > > > > >> > notified
> > > > > > > >> > > that any disclosure, copying, distribution or taking any
> > > > action
> > > > > in
> > > > > > > >> > reliance
> > > > > > > >> > > on the contents of this information is strictly
> prohibited
> > > and
> > > > > may
> > > > > > > be
> > > > > > > >> > > unlawful. If you have received this communication in
> > error,
> > > > > please
> > > > > > > >> notify
> > > > > > > >> > > us immediately by responding to this email and then
> delete
> > > it
> > > > > from
> > > > > > > >> your
> > > > > > > >> > > system. The firm is neither liable for the proper and
> > > complete
> > > > > > > >> > transmission
> > > > > > > >> > > of the information contained in this communication nor
> for
> > > any
> > > > > > delay
> > > > > > > >> in
> > > > > > > >> > its
> > > > > > > >> > > receipt.
> > > > > > > >> > >
> > > > > > > >> >
> > > > > > > >>
> > > > > > > >> --
> > > > > > > >>
> _____________________________________________________________
> > > > > > > >> The information contained in this communication is intended
> > > solely
> > > > > for
> > > > > > > the
> > > > > > > >> use of the individual or entity to whom it is addressed and
> > > others
> > > > > > > >> authorized to receive it. It may contain confidential or
> > legally
> > > > > > > >> privileged
> > > > > > > >> information. If you are not the intended recipient you are
> > > hereby
> > > > > > > notified
> > > > > > > >> that any disclosure, copying, distribution or taking any
> > action
> > > in
> > > > > > > >> reliance
> > > > > > > >> on the contents of this information is strictly prohibited
> and
> > > may
> > > > > be
> > > > > > > >> unlawful. If you have received this communication in error,
> > > please
> > > > > > > notify
> > > > > > > >> us immediately by responding to this email and then delete
> it
> > > from
> > > > > > your
> > > > > > > >> system. The firm is neither liable for the proper and
> complete
> > > > > > > >> transmission
> > > > > > > >> of the information contained in this communication nor for
> any
> > > > delay
> > > > > > in
> > > > > > > >> its
> > > > > > > >> receipt.
> > > > > > > >>
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > _____________________________________________________________
> > > > > > The information contained in this communication is intended
> solely
> > > for
> > > > > the
> > > > > > use of the individual or entity to whom it is addressed and
> others
> > > > > > authorized to receive it. It may contain confidential or legally
> > > > > privileged
> > > > > > information. If you are not the intended recipient you are hereby
> > > > > notified
> > > > > > that any disclosure, copying, distribution or taking any action
> in
> > > > > reliance
> > > > > > on the contents of this information is strictly prohibited and
> may
> > be
> > > > > > unlawful. If you have received this communication in error,
> please
> > > > notify
> > > > > > us immediately by responding to this email and then delete it
> from
> > > your
> > > > > > system. The firm is neither liable for the proper and complete
> > > > > transmission
> > > > > > of the information contained in this communication nor for any
> > delay
> > > in
> > > > > its
> > > > > > receipt.
> > > > > >
> > > > >
> > > >
> > >
> > > --
> > > _____________________________________________________________
> > > The information contained in this communication is intended solely for
> > the
> > > use of the individual or entity to whom it is addressed and others
> > > authorized to receive it. It may contain confidential or legally
> > privileged
> > > information. If you are not the intended recipient you are hereby
> > notified
> > > that any disclosure, copying, distribution or taking any action in
> > reliance
> > > on the contents of this information is strictly prohibited and may be
> > > unlawful. If you have received this communication in error, please
> notify
> > > us immediately by responding to this email and then delete it from your
> > > system. The firm is neither liable for the proper and complete
> > transmission
> > > of the information contained in this communication nor for any delay in
> > its
> > > receipt.
> > >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
Re: Java action in Ooozie
Posted by Jaydeep Vishwakarma <ja...@inmobi.com>.
Good, So not issue with Yarn or name node urls. Can you share stdout logs.
On Wed, Nov 4, 2015 at 7:15 PM, Jeetendra G <je...@housing.com> wrote:
> Hi Jaydeep here also I cant see any error below are the logs
>
> Log Type: syslog
>
> Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
>
> Log Length: 25565
>
> 2015-11-04 14:59:11,814 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster
> for application appattempt_1446620926630_0017_000001
> 2015-11-04 14:59:12,144 WARN [main]
> org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where
> applicable
> 2015-11-04 14:59:12,184 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
> 2015-11-04 14:59:12,292 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id {
> id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
> -173762614)
> 2015-11-04 14:59:12,293 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
> RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs,
> renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
> maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
> 2015-11-04 14:59:12,890 WARN [main]
> org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
> short-circuit local reads feature cannot be used because libhadoop
> cannot be loaded.
> 2015-11-04 14:59:13,064 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
> config null
> 2015-11-04 14:59:13,065 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
> org.apache.hadoop.mapred.FileOutputCommitter
> 2015-11-04 14:59:13,110 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.jobhistory.EventType for class
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> 2015-11-04 14:59:13,110 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> 2015-11-04 14:59:13,111 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> 2015-11-04 14:59:13,111 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> 2015-11-04 14:59:13,112 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> 2015-11-04 14:59:13,112 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> 2015-11-04 14:59:13,113 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> 2015-11-04 14:59:13,113 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
> 2015-11-04 14:59:13,144 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> file system is set solely by core-default.xml therefore - ignoring
> 2015-11-04 14:59:13,170 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> file system is set solely by core-default.xml therefore - ignoring
> 2015-11-04 14:59:13,189 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
> file system is set solely by core-default.xml therefore - ignoring
> 2015-11-04 14:59:13,219 INFO [main]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Emitting job history data to the timeline server is not enabled
> 2015-11-04 14:59:13,255 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for
> class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> 2015-11-04 14:59:13,453 WARN [main]
> org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> configuration: tried
> hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> 2015-11-04 14:59:13,546 INFO [main]
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2015-11-04 14:59:13,546 INFO [main]
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
> system started
> 2015-11-04 14:59:13,557 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token
> for job_1446620926630_0017 to jobTokenSecretManager
> 2015-11-04 14:59:13,680 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
> job_1446620926630_0017 because: not enabled; too much RAM;
> 2015-11-04 14:59:13,701 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for
> job job_1446620926630_0017 = 0. Number of splits = 1
> 2015-11-04 14:59:13,701 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces
> for job job_1446620926630_0017 = 0
> 2015-11-04 14:59:13,701 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1446620926630_0017Job Transitioned from NEW to INITED
> 2015-11-04 14:59:13,702 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
> normal, non-uberized, multi-container job job_1446620926630_0017.
> 2015-11-04 14:59:13,725 INFO [main]
> org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> java.util.concurrent.LinkedBlockingQueue
> 2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
> org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640
> 2015-11-04 14:59:13,758 INFO [main]
> org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
> to the server
> 2015-11-04 14:59:13,759 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> 2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
> org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting
> 2015-11-04 14:59:13,762 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
> Instantiated MRClientService at hadoop04.housing.com/10.21.1.138:39640
> 2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> org.mortbay.log.Slf4jLog
> 2015-11-04 14:59:13,862 INFO [main]
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> Unable to initialize FileSignerSecretProvider, falling back to use
> random secrets.
> 2015-11-04 14:59:13,867 WARN [main]
> org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be
> enabled using Log4j
> 2015-11-04 14:59:13,874 INFO [main]
> org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
> (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> 2015-11-04 14:59:13,878 INFO [main]
> org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> context mapreduce
> 2015-11-04 14:59:13,879 INFO [main]
> org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
> (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> context static
> 2015-11-04 14:59:13,882 INFO [main]
> org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
> 2015-11-04 14:59:13,882 INFO [main]
> org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
> 2015-11-04 14:59:14,217 INFO [main]
> org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
> 2015-11-04 14:59:14,218 INFO [main]
> org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
> 2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
> 2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
>
> jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
> to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
> 2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
> HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
> 2015-11-04 14:59:15,952 INFO [main]
> org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at
> 49791
> 2015-11-04 14:59:15,957 INFO [main]
> org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
> java.util.concurrent.LinkedBlockingQueue
> 2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
> org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432
> 2015-11-04 14:59:15,963 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> 2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
> org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting
> 2015-11-04 14:59:15,988 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> nodeBlacklistingEnabled:true
> 2015-11-04 14:59:15,988 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> maxTaskFailuresPerNode is 3
> 2015-11-04 14:59:15,988 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> blacklistDisablePercent is 33
> 2015-11-04 14:59:16,035 INFO [main]
> org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager
> at hadoop02.housing.com/10.21.1.136:8030
> 2015-11-04 14:59:16,113 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> maxContainerCapability: <memory:5120, vCores:3>
> 2015-11-04 14:59:16,113 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
> 2015-11-04 14:59:16,117 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Upper limit on the thread pool size is 500
> 2015-11-04 14:59:16,118 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
> thread pool initial size is 10
> 2015-11-04 14:59:16,120 INFO [main]
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> yarn.client.max-cached-nodemanagers-proxies : 0
> 2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1446620926630_0017Job Transitioned from INITED to SETUP
> 2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> Processing the event EventType: JOB_SETUP
> 2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
> Output Committer Algorithm version is 1
> 2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1446620926630_0017Job Transitioned from SETUP to RUNNING
> 2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1446620926630_0017_m_000000 Task Transitioned from NEW to
> SCHEDULED
> 2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> NEW to UNASSIGNED
> 2015-11-04 14:59:16,202 INFO [Thread-51]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> mapResourceRequest:<memory:1536, vCores:1>
> 2015-11-04 14:59:16,252 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
> Writer setup for JobId: job_1446620926630_0017, File:
> hdfs://
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> 2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
> AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> 2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> getResources() for application_1446620926630_0017: ask=1 release= 0
> newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
> vCores:1> knownNMs=5
> 2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
> allocated containers 1
> 2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
> org.apache.hadoop.yarn.util.RackResolver: Resolved
> hadoop04.housing.com to /default-rack
> 2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
> container container_e02_1446620926630_0017_01_000002 to
> attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
> AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
> ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
> 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.yarn.util.RackResolver: Resolved
> hadoop04.housing.com to /default-rack
> 2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar
> is not present. Not adding any jar to the list of resources.
> 2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
> job-conf file on the remote FS is
> /user/hdfs/.staging/job_1446620926630_0017/job.xml
> 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1
> tokens and #1 secret keys for NM use for launching container
> 2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
> containertokens_dob is 2
> 2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
> shuffle token in serviceData
> 2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> UNASSIGNED to ASSIGNED
> 2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
> container_e02_1446620926630_0017_01_000002 taskAttempt
> attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Launching attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> Opening proxy : hadoop04.housing.com:45454
> 2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Shuffle port returned by ContainerManager for
> attempt_1446620926630_0017_m_000000_0 : 13562
> 2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
> containerId: [container_e02_1446620926630_0017_01_000002 on NM:
> [hadoop04.housing.com:45454]
> 2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> ASSIGNED to RUNNING
> 2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to
> RUNNING
> 2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> getResources() for application_1446620926630_0017: ask=1 release= 0
> newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
> vCores:1> knownNMs=5
> 2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
> SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
> job_1446620926630_0017 (auth:SIMPLE)
> 2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
> jvm_1446620926630_0017_m_2199023255554 asked for a task
> 2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> jvm_1446620926630_0017_m_2199023255554 given task:
> attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
> 2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state
> update from attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> RUNNING to COMMIT_PENDING
> 2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> attempt_1446620926630_0017_m_000000_0 given a go for committing the
> task output.
> 2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
> request from attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
> canCommit for attempt_1446620926630_0017_m_000000_0:true
> 2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
> TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
> 2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement
> from attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> 2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
> container_e02_1446620926630_0017_01_000002 taskAttempt
> attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> KILLING attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> Opening proxy : hadoop04.housing.com:45454
> 2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
> SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded
> with attempt attempt_1446620926630_0017_m_000000_0
> 2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
> SUCCEEDED
> 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
> Tasks: 1
> 2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
> 2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> Processing the event EventType: JOB_COMMIT
> 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler
> for JobFinishedEvent
> 2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED
> 2015-11-04 14:59:22,792 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
> cleanly so this is the last retry
> 2015-11-04 14:59:22,792 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
> isAMLastRetry: true
> 2015-11-04 14:59:22,793 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator
> notified that shouldUnregistered is: true
> 2015-11-04 14:59:22,793 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
> isAMLastRetry: true
> 2015-11-04 14:59:22,793 INFO [Thread-67]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> JobHistoryEventHandler notified that forceJobCompletion is true
> 2015-11-04 14:59:22,793 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all
> the services
> 2015-11-04 14:59:22,793 INFO [Thread-67]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> Stopping JobHistoryEventHandler. Size of the outstanding queue size is
> 0
> 2015-11-04 14:59:22,845 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> hdfs://
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
> to hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> 2015-11-04 14:59:22,880 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
> to done location:
> hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> 2015-11-04 14:59:22,883 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> hdfs://
> hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
> to hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> 2015-11-04 14:59:22,956 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
> to done location:
> hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> 2015-11-04 14:59:22,960 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> tmp to done: hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
> to hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
> 2015-11-04 14:59:22,962 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> tmp to done: hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
> to hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
> 2015-11-04 14:59:22,964 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
> tmp to done: hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
> to hdfs://
> hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
> 2015-11-04 14:59:22,965 INFO [Thread-67]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
> JobHistoryEventHandler. super.stop()
> 2015-11-04 14:59:22,968 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
> diagnostics to
> 2015-11-04 14:59:22,969 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
> http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
> 2015-11-04 14:59:22,976 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
> application to be successfully unregistered.
> 2015-11-04 14:59:23,979 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
> Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
> AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
> HostLocal:0 RackLocal:0
> 2015-11-04 14:59:23,980 INFO [Thread-67]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
> directory hdfs://hadoop01.housing.com:8020
> /user/hdfs/.staging/job_1446620926630_0017
> 2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server:
> Stopping server on 50432
> 2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
> org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
> 2015-11-04 14:59:23,986 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> 2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
> org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
> TaskHeartbeatHandler thread interrupted
>
>
> On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
> jaydeep.vishwakarma@inmobi.com> wrote:
>
> > In first look I am not seeing any issue with job tracker or name node
> URL.
> > The job id is getting generated. Workflow Job is not going on PREP mode.
> >
> > Open this link.
> > http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
> >
> > You will be see the problem.
> >
> >
> >
> > On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > hey Serega I have cross verified jobTracker value is correct only I am
> > > using yarn so resource manager will become the job tracker?
> > >
> > > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <
> serega.sheypak@gmail.com
> > >
> > > wrote:
> > >
> > > > Can you go to oozie server and grab logs from there? My assumption
> that
> > > > <job-tracker>${jobTracker}</job-tracker>
> > > > <name-node>${nameNode}</name-node>
> > > >
> > > > have incorrect values. Probably ${jobTracker} is wrong and oozie
> can't
> > > even
> > > > start launcher mapper.
> > > >
> > > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > > > jaydeep.vishwakarma@inmobi.com>:
> > > >
> > > > > You are doing -log. Can you give the command as below and get the
> job
> > > url
> > > > > (application launcher url).
> > > > >
> > > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <
> jeetendra.g@housing.com
> > >
> > > > > wrote:
> > > > >
> > > > > > and in job error log tab its saying error log is disables? by
> > default
> > > > why
> > > > > > error log is disables? i am using hortonworks
> > > > > >
> > > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> > jeetendra.g@housing.com
> > > >
> > > > > > wrote:
> > > > > >
> > > > > > > same error.
> > > > > > >
> > > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start
> > action
> > > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
> > > > state :
> > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > > > status=DONE
> > > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > updated
> > > > in
> > > > > > DB!
> > > > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520
> -
> > > > > SERVER[
> > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> > > Notification
> > > > > URL
> > > > > > > is defined. Therefore nothing to notify for job
> > > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520
> -
> > > > > SERVER[
> > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > Notification
> > > > URL
> > > > > is
> > > > > > > defined. Therefore nothing to notify for job
> > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
> > > action
> > > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with
> user-retry
> > > > > state :
> > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> checking
> > > > > action,
> > > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > > > > status=RUNNING
> > > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > updated
> > > > > in
> > > > > > > DB!
> > > > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520
> -
> > > > > SERVER[
> > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > > Notification
> > > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> callback
> > > for
> > > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> > > > > completed,
> > > > > > > external ID [job_1446620926630_0016]
> > > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry
> > state :
> > > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> > status=DONE
> > > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > APP[java-main-wf]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated
> > in
> > > > DB!
> > > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520
> -
> > > > > SERVER[
> > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No
> Notification
> > > URL
> > > > > is
> > > > > > > defined. Therefore nothing to notify for job
> > > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520
> -
> > > > > SERVER[
> > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> > Notification
> > > > URL
> > > > > is
> > > > > > > defined. Therefore nothing to notify for job
> > > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520
> -
> > > > > SERVER[
> > > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > > Notification
> > > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > > >
> > > > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > >> There you will find "Console URL" , Open that URL on browser.
> > You
> > > > will
> > > > > > get
> > > > > > >> the Launcher mapper logs.
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > > > jeetendra.g@housing.com>
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > This is the log i am getting repeatedly
> > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > WorkflowNotificationXCommand:520 -
> > > > > > SERVER[
> > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > > Notification
> > > > > > >> URL
> > > > > > >> > is
> > > > > > >> > defined. Therefore nothing to notify for job
> > > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > > >> > 2015-10-29 16:39:11,095 INFO
> > WorkflowNotificationXCommand:520 -
> > > > > > SERVER[
> > > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > Notification
> > > > > URL
> > > > > > >> is
> > > > > > >> > defined. Therefore nothing to notify for job
> > > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > > > >> >
> > > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > > >> >
> > > > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > > > >> > >
> > > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > > > jeetendra.g@housing.com>
> > > > > > >> > > wrote:
> > > > > > >> > >
> > > > > > >> > > > does anybody have any idea? i have been trying this from
> > 10
> > > > days
> > > > > > >> > nothing
> > > > > > >> > > > worked out.
> > > > > > >> > > >
> > > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > > > >> jeetendra.g@housing.com>
> > > > > > >> > > > wrote:
> > > > > > >> > > >
> > > > > > >> > > > > my workflow.xml
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > > > name="java-main-wf">
> > > > > > >> > > > > <start to="java-node"/>
> > > > > > >> > > > > <action name="java-node">
> > > > > > >> > > > > <java>
> > > > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > > > >> > > > >
> > > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > > > >> > > > >
> > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > > > >> > > > >
> > > > > > >> > > > > </java>
> > > > > > >> > > > > <ok to="end"/>
> > > > > > >> > > > > <error to="fail"/>
> > > > > > >> > > > > </action>
> > > > > > >> > > > > <kill name="fail">
> > > > > > >> > > > > <message>Java failed, error
> > > > > > >> > > > >
> > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > > > >> > > > > </kill>
> > > > > > >> > > > > <end name="end"/>
> > > > > > >> > > > > </workflow-app>
> > > > > > >> > > > >
> > > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > > > >> > jeetendra.g@housing.com>
> > > > > > >> > > > > wrote:
> > > > > > >> > > > >
> > > > > > >> > > > >> Hi All,
> > > > > > >> > > > >>
> > > > > > >> > > > >> I am running java workflow job using oozie.
> > > > > > >> > > > >> I have Ambari server and I have installed oozie from
> > > > Ambari.
> > > > > > >> > > > >> When i ran the job it say succeeded but its not
> running
> > > my
> > > > > java
> > > > > > >> > class
> > > > > > >> > > > >> which I mentioned inside workflow.xml. Also when I
> get
> > > > oozie
> > > > > > >> > nothing
> > > > > > >> > > > can
> > > > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > > > >> > > > >> oozie job -oozie
> > http://hadoop03.housing.com:11000/oozie
> > > > > -log
> > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > Start
> > > > > > >> action
> > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> > > > > user-retry
> > > > > > >> > state
> > > > > > >> > > :
> > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > > > [10]
> > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > > :start:***]Action
> > > > > > >> > > status=DONE
> > > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > > :start:***]Action
> > > > > > >> updated
> > > > > > >> > in
> > > > > > >> > > > DB!
> > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > > WorkflowNotificationXCommand:520
> > > > > > -
> > > > > > >> > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > No
> > > > > > >> > Notification
> > > > > > >> > > > URL
> > > > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > > WorkflowNotificationXCommand:520
> > > > > > -
> > > > > > >> > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > > >> Notification
> > > > > > >> > URL
> > > > > > >> > > > is
> > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > Start
> > > > > > >> action
> > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node]
> with
> > > > > > user-retry
> > > > > > >> > > state
> > > > > > >> > > > :
> > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > > > [10]
> > > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520
> -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > > > checking
> > > > > > >> > > action,
> > > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status
> [RUNNING]
> > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > > ***]Action
> > > > > > >> > > > >> status=RUNNING
> > > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > > ***]Action
> > > > > > >> > updated
> > > > > > >> > > in
> > > > > > >> > > > >> DB!
> > > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > > > WorkflowNotificationXCommand:520
> > > > > > -
> > > > > > >> > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > No
> > > > > > >> > > Notification
> > > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
> > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > > > callback
> > > > > > >> for
> > > > > > >> > > > >> action
> [0000040-151015123257993-oozie-oozi-W@java-node
> > ]
> > > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520
> -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > > action
> > > > > > >> > > > completed,
> > > > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> Start
> > > > > action
> > > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> > > user-retry
> > > > > > >> state :
> > > > > > >> > > > >> userRetryCount [0], userRetryMax [0],
> userRetryInterval
> > > > [10]
> > > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> ***]Action
> > > > > > >> status=DONE
> > > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO
> ActionStartXCommand:520 -
> > > > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > > >> APP[java-main-wf]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end
> ***]Action
> > > > > updated
> > > > > > >> in
> > > > > > >> > DB!
> > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > WorkflowNotificationXCommand:520
> > > > > > -
> > > > > > >> > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > > > > > Notification
> > > > > > >> > URL
> > > > > > >> > > is
> > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > WorkflowNotificationXCommand:520
> > > > > > -
> > > > > > >> > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > > >> Notification
> > > > > > >> > URL
> > > > > > >> > > > is
> > > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > > WorkflowNotificationXCommand:520
> > > > > > -
> > > > > > >> > > SERVER[
> > > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-]
> APP[-]
> > > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > No
> > > > > > >> > > Notification
> > > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > > >> > > > >>
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > > >
> > > > > > >> > >
> > > > > > >> > > --
> > > > > > >> > >
> > _____________________________________________________________
> > > > > > >> > > The information contained in this communication is
> intended
> > > > solely
> > > > > > for
> > > > > > >> > the
> > > > > > >> > > use of the individual or entity to whom it is addressed
> and
> > > > others
> > > > > > >> > > authorized to receive it. It may contain confidential or
> > > legally
> > > > > > >> > privileged
> > > > > > >> > > information. If you are not the intended recipient you are
> > > > hereby
> > > > > > >> > notified
> > > > > > >> > > that any disclosure, copying, distribution or taking any
> > > action
> > > > in
> > > > > > >> > reliance
> > > > > > >> > > on the contents of this information is strictly prohibited
> > and
> > > > may
> > > > > > be
> > > > > > >> > > unlawful. If you have received this communication in
> error,
> > > > please
> > > > > > >> notify
> > > > > > >> > > us immediately by responding to this email and then delete
> > it
> > > > from
> > > > > > >> your
> > > > > > >> > > system. The firm is neither liable for the proper and
> > complete
> > > > > > >> > transmission
> > > > > > >> > > of the information contained in this communication nor for
> > any
> > > > > delay
> > > > > > >> in
> > > > > > >> > its
> > > > > > >> > > receipt.
> > > > > > >> > >
> > > > > > >> >
> > > > > > >>
> > > > > > >> --
> > > > > > >> _____________________________________________________________
> > > > > > >> The information contained in this communication is intended
> > solely
> > > > for
> > > > > > the
> > > > > > >> use of the individual or entity to whom it is addressed and
> > others
> > > > > > >> authorized to receive it. It may contain confidential or
> legally
> > > > > > >> privileged
> > > > > > >> information. If you are not the intended recipient you are
> > hereby
> > > > > > notified
> > > > > > >> that any disclosure, copying, distribution or taking any
> action
> > in
> > > > > > >> reliance
> > > > > > >> on the contents of this information is strictly prohibited and
> > may
> > > > be
> > > > > > >> unlawful. If you have received this communication in error,
> > please
> > > > > > notify
> > > > > > >> us immediately by responding to this email and then delete it
> > from
> > > > > your
> > > > > > >> system. The firm is neither liable for the proper and complete
> > > > > > >> transmission
> > > > > > >> of the information contained in this communication nor for any
> > > delay
> > > > > in
> > > > > > >> its
> > > > > > >> receipt.
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > _____________________________________________________________
> > > > > The information contained in this communication is intended solely
> > for
> > > > the
> > > > > use of the individual or entity to whom it is addressed and others
> > > > > authorized to receive it. It may contain confidential or legally
> > > > privileged
> > > > > information. If you are not the intended recipient you are hereby
> > > > notified
> > > > > that any disclosure, copying, distribution or taking any action in
> > > > reliance
> > > > > on the contents of this information is strictly prohibited and may
> be
> > > > > unlawful. If you have received this communication in error, please
> > > notify
> > > > > us immediately by responding to this email and then delete it from
> > your
> > > > > system. The firm is neither liable for the proper and complete
> > > > transmission
> > > > > of the information contained in this communication nor for any
> delay
> > in
> > > > its
> > > > > receipt.
> > > > >
> > > >
> > >
> >
> > --
> > _____________________________________________________________
> > The information contained in this communication is intended solely for
> the
> > use of the individual or entity to whom it is addressed and others
> > authorized to receive it. It may contain confidential or legally
> privileged
> > information. If you are not the intended recipient you are hereby
> notified
> > that any disclosure, copying, distribution or taking any action in
> reliance
> > on the contents of this information is strictly prohibited and may be
> > unlawful. If you have received this communication in error, please notify
> > us immediately by responding to this email and then delete it from your
> > system. The firm is neither liable for the proper and complete
> transmission
> > of the information contained in this communication nor for any delay in
> its
> > receipt.
> >
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
Hi Jaydeep here also I cant see any error below are the logs
Log Type: syslog
Log Upload Time: Wed Nov 04 14:59:29 +0530 2015
Log Length: 25565
2015-11-04 14:59:11,814 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster
for application appattempt_1446620926630_0017_000001
2015-11-04 14:59:12,144 WARN [main]
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where
applicable
2015-11-04 14:59:12,184 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2015-11-04 14:59:12,292 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id {
id: 17 cluster_timestamp: 1446620926630 } attemptId: 1 } keyId:
-173762614)
2015-11-04 14:59:12,293 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
RM_DELEGATION_TOKEN, Service: 10.21.1.136:8050, Ident: (owner=hdfs,
renewer=oozie mr token, realUser=oozie, issueDate=1446629349951,
maxDate=1447234149951, sequenceNumber=26, masterKeyId=6)
2015-11-04 14:59:12,890 WARN [main]
org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
short-circuit local reads feature cannot be used because libhadoop
cannot be loaded.
2015-11-04 14:59:13,064 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
config null
2015-11-04 14:59:13,065 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
org.apache.hadoop.mapred.FileOutputCommitter
2015-11-04 14:59:13,110 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.jobhistory.EventType for class
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2015-11-04 14:59:13,110 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2015-11-04 14:59:13,111 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2015-11-04 14:59:13,111 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2015-11-04 14:59:13,112 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2015-11-04 14:59:13,112 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2015-11-04 14:59:13,113 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2015-11-04 14:59:13,113 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2015-11-04 14:59:13,144 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore - ignoring
2015-11-04 14:59:13,170 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore - ignoring
2015-11-04 14:59:13,189 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore - ignoring
2015-11-04 14:59:13,219 INFO [main]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Emitting job history data to the timeline server is not enabled
2015-11-04 14:59:13,255 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2015-11-04 14:59:13,453 WARN [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
configuration: tried
hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
2015-11-04 14:59:13,546 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2015-11-04 14:59:13,546 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
system started
2015-11-04 14:59:13,557 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token
for job_1446620926630_0017 to jobTokenSecretManager
2015-11-04 14:59:13,680 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
job_1446620926630_0017 because: not enabled; too much RAM;
2015-11-04 14:59:13,701 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for
job job_1446620926630_0017 = 0. Number of splits = 1
2015-11-04 14:59:13,701 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces
for job job_1446620926630_0017 = 0
2015-11-04 14:59:13,701 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from NEW to INITED
2015-11-04 14:59:13,702 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
normal, non-uberized, multi-container job job_1446620926630_0017.
2015-11-04 14:59:13,725 INFO [main]
org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
java.util.concurrent.LinkedBlockingQueue
2015-11-04 14:59:13,736 INFO [Socket Reader #1 for port 39640]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39640
2015-11-04 14:59:13,758 INFO [main]
org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
to the server
2015-11-04 14:59:13,759 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-04 14:59:13,761 INFO [IPC Server listener on 39640]
org.apache.hadoop.ipc.Server: IPC Server listener on 39640: starting
2015-11-04 14:59:13,762 INFO [main]
org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
Instantiated MRClientService at hadoop04.housing.com/10.21.1.138:39640
2015-11-04 14:59:13,853 INFO [main] org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2015-11-04 14:59:13,862 INFO [main]
org.apache.hadoop.security.authentication.server.AuthenticationFilter:
Unable to initialize FileSignerSecretProvider, falling back to use
random secrets.
2015-11-04 14:59:13,867 WARN [main]
org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be
enabled using Log4j
2015-11-04 14:59:13,874 INFO [main]
org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
(class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-11-04 14:59:13,878 INFO [main]
org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context mapreduce
2015-11-04 14:59:13,879 INFO [main]
org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context static
2015-11-04 14:59:13,882 INFO [main]
org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
2015-11-04 14:59:13,882 INFO [main]
org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2015-11-04 14:59:14,217 INFO [main]
org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2015-11-04 14:59:14,218 INFO [main]
org.apache.hadoop.http.HttpServer2: Jetty bound to port 49791
2015-11-04 14:59:14,219 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
2015-11-04 14:59:14,260 INFO [main] org.mortbay.log: Extract
jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar!/webapps/mapreduce
to ./tmp/Jetty_0_0_0_0_49791_mapreduce____.kdgzqp/webapp
2015-11-04 14:59:15,952 INFO [main] org.mortbay.log: Started
HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:49791
2015-11-04 14:59:15,952 INFO [main]
org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at
49791
2015-11-04 14:59:15,957 INFO [main]
org.apache.hadoop.ipc.CallQueueManager: Using callQueue class
java.util.concurrent.LinkedBlockingQueue
2015-11-04 14:59:15,957 INFO [Socket Reader #1 for port 50432]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50432
2015-11-04 14:59:15,963 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-04 14:59:15,963 INFO [IPC Server listener on 50432]
org.apache.hadoop.ipc.Server: IPC Server listener on 50432: starting
2015-11-04 14:59:15,988 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
nodeBlacklistingEnabled:true
2015-11-04 14:59:15,988 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
maxTaskFailuresPerNode is 3
2015-11-04 14:59:15,988 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
blacklistDisablePercent is 33
2015-11-04 14:59:16,035 INFO [main]
org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager
at hadoop02.housing.com/10.21.1.136:8030
2015-11-04 14:59:16,113 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
maxContainerCapability: <memory:5120, vCores:3>
2015-11-04 14:59:16,113 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
2015-11-04 14:59:16,117 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Upper limit on the thread pool size is 500
2015-11-04 14:59:16,118 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
thread pool initial size is 10
2015-11-04 14:59:16,120 INFO [main]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
yarn.client.max-cached-nodemanagers-proxies : 0
2015-11-04 14:59:16,127 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from INITED to SETUP
2015-11-04 14:59:16,157 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: JOB_SETUP
2015-11-04 14:59:16,160 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
Output Committer Algorithm version is 1
2015-11-04 14:59:16,173 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from SETUP to RUNNING
2015-11-04 14:59:16,194 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1446620926630_0017_m_000000 Task Transitioned from NEW to
SCHEDULED
2015-11-04 14:59:16,195 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
NEW to UNASSIGNED
2015-11-04 14:59:16,202 INFO [Thread-51]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
mapResourceRequest:<memory:1536, vCores:1>
2015-11-04 14:59:16,252 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
Writer setup for JobId: job_1446620926630_0017, File:
hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
2015-11-04 14:59:17,117 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0
AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
2015-11-04 14:59:17,154 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1446620926630_0017: ask=1 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:19840,
vCores:1> knownNMs=5
2015-11-04 14:59:18,171 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
allocated containers 1
2015-11-04 14:59:18,198 INFO [RMCommunicator Allocator]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoop04.housing.com to /default-rack
2015-11-04 14:59:18,201 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_e02_1446620926630_0017_01_000002 to
attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:18,202 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoop04.housing.com to /default-rack
2015-11-04 14:59:18,245 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar
is not present. Not adding any jar to the list of resources.
2015-11-04 14:59:18,263 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
job-conf file on the remote FS is
/user/hdfs/.staging/job_1446620926630_0017/job.xml
2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1
tokens and #1 secret keys for NM use for launching container
2015-11-04 14:59:18,290 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
containertokens_dob is 2
2015-11-04 14:59:18,291 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
shuffle token in serviceData
2015-11-04 14:59:18,359 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED
2015-11-04 14:59:18,363 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_e02_1446620926630_0017_01_000002 taskAttempt
attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:18,364 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Launching attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:18,365 INFO [ContainerLauncher #0]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoop04.housing.com:45454
2015-11-04 14:59:18,435 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Shuffle port returned by ContainerManager for
attempt_1446620926630_0017_m_000000_0 : 13562
2015-11-04 14:59:18,437 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
TaskAttempt: [attempt_1446620926630_0017_m_000000_0] using
containerId: [container_e02_1446620926630_0017_01_000002 on NM:
[hadoop04.housing.com:45454]
2015-11-04 14:59:18,439 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
ASSIGNED to RUNNING
2015-11-04 14:59:18,440 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1446620926630_0017_m_000000 Task Transitioned from SCHEDULED to
RUNNING
2015-11-04 14:59:19,213 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1446620926630_0017: ask=1 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:17920,
vCores:1> knownNMs=5
2015-11-04 14:59:20,114 INFO [Socket Reader #1 for port 50432]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1446620926630_0017 (auth:SIMPLE)
2015-11-04 14:59:20,138 INFO [IPC Server handler 3 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1446620926630_0017_m_2199023255554 asked for a task
2015-11-04 14:59:20,139 INFO [IPC Server handler 3 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1446620926630_0017_m_2199023255554 given task:
attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,549 INFO [IPC Server handler 2 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 0.0
2015-11-04 14:59:22,589 INFO [IPC Server handler 1 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state
update from attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,590 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
RUNNING to COMMIT_PENDING
2015-11-04 14:59:22,591 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
attempt_1446620926630_0017_m_000000_0 given a go for committing the
task output.
2015-11-04 14:59:22,597 INFO [IPC Server handler 0 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go
request from attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,598 INFO [IPC Server handler 0 on 50432]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of
canCommit for attempt_1446620926630_0017_m_000000_0:true
2015-11-04 14:59:22,635 INFO [IPC Server handler 4 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1446620926630_0017_m_000000_0 is : 1.0
2015-11-04 14:59:22,643 INFO [IPC Server handler 16 on 50432]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement
from attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,645 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
2015-11-04 14:59:22,647 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
container_e02_1446620926630_0017_01_000002 taskAttempt
attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
KILLING attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,648 INFO [ContainerLauncher #1]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoop04.housing.com:45454
2015-11-04 14:59:22,675 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1446620926630_0017_m_000000_0 TaskAttempt Transitioned from
SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded
with attempt attempt_1446620926630_0017_m_000000_0
2015-11-04 14:59:22,683 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1446620926630_0017_m_000000 Task Transitioned from RUNNING to
SUCCEEDED
2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
Tasks: 1
2015-11-04 14:59:22,685 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from RUNNING to COMMITTING
2015-11-04 14:59:22,697 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: JOB_COMMIT
2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler
for JobFinishedEvent
2015-11-04 14:59:22,787 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1446620926630_0017Job Transitioned from COMMITTING to SUCCEEDED
2015-11-04 14:59:22,792 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
cleanly so this is the last retry
2015-11-04 14:59:22,792 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
isAMLastRetry: true
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator
notified that shouldUnregistered is: true
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
isAMLastRetry: true
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
JobHistoryEventHandler notified that forceJobCompletion is true
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all
the services
2015-11-04 14:59:22,793 INFO [Thread-67]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Stopping JobHistoryEventHandler. Size of the outstanding queue size is
0
2015-11-04 14:59:22,845 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1.jhist
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
2015-11-04 14:59:22,880 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
to done location:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
2015-11-04 14:59:22,883 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://hadoop01.housing.com:8020/user/hdfs/.staging/job_1446620926630_0017/job_1446620926630_0017_1_conf.xml
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
2015-11-04 14:59:22,956 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
to done location:
hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
2015-11-04 14:59:22,960 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary_tmp
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017.summary
2015-11-04 14:59:22,962 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml_tmp
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017_conf.xml
2015-11-04 14:59:22,964 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist_tmp
to hdfs://hadoop01.housing.com:8020/mr-history/tmp/hdfs/job_1446620926630_0017-1446629350323-hdfs-oozie%3Alauncher%3AT%3Djava%3AW%3Djava%2Dmain%2Dwf%3AA%3Djava%2Dnode%3AI-1446629362786-1-0-SUCCEEDED-default-1446629356124.jhist
2015-11-04 14:59:22,965 INFO [Thread-67]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
JobHistoryEventHandler. super.stop()
2015-11-04 14:59:22,968 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
diagnostics to
2015-11-04 14:59:22,969 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
http://hadoop03.housing.com:19888/jobhistory/job/job_1446620926630_0017
2015-11-04 14:59:22,976 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
application to be successfully unregistered.
2015-11-04 14:59:23,979 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
HostLocal:0 RackLocal:0
2015-11-04 14:59:23,980 INFO [Thread-67]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
directory hdfs://hadoop01.housing.com:8020
/user/hdfs/.staging/job_1446620926630_0017
2015-11-04 14:59:23,984 INFO [Thread-67] org.apache.hadoop.ipc.Server:
Stopping server on 50432
2015-11-04 14:59:23,985 INFO [IPC Server listener on 50432]
org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50432
2015-11-04 14:59:23,986 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2015-11-04 14:59:23,986 INFO [TaskHeartbeatHandler PingChecker]
org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
TaskHeartbeatHandler thread interrupted
On Wed, Nov 4, 2015 at 6:38 PM, Jaydeep Vishwakarma <
jaydeep.vishwakarma@inmobi.com> wrote:
> In first look I am not seeing any issue with job tracker or name node URL.
> The job id is getting generated. Workflow Job is not going on PREP mode.
>
> Open this link.
> http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
>
> You will be see the problem.
>
>
>
> On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > hey Serega I have cross verified jobTracker value is correct only I am
> > using yarn so resource manager will become the job tracker?
> >
> > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <serega.sheypak@gmail.com
> >
> > wrote:
> >
> > > Can you go to oozie server and grab logs from there? My assumption that
> > > <job-tracker>${jobTracker}</job-tracker>
> > > <name-node>${nameNode}</name-node>
> > >
> > > have incorrect values. Probably ${jobTracker} is wrong and oozie can't
> > even
> > > start launcher mapper.
> > >
> > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > > jaydeep.vishwakarma@inmobi.com>:
> > >
> > > > You are doing -log. Can you give the command as below and get the job
> > url
> > > > (application launcher url).
> > > >
> > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> > > >
> > > >
> > > >
> > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <jeetendra.g@housing.com
> >
> > > > wrote:
> > > >
> > > > > and in job error log tab its saying error log is disables? by
> default
> > > why
> > > > > error log is disables? i am using hortonworks
> > > > >
> > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> jeetendra.g@housing.com
> > >
> > > > > wrote:
> > > > >
> > > > > > same error.
> > > > > >
> > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start
> action
> > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
> > > state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > > status=DONE
> > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> updated
> > > in
> > > > > DB!
> > > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> > Notification
> > > > URL
> > > > > > is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
> > action
> > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> > > > state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> > > > action,
> > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > > > status=RUNNING
> > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > updated
> > > > in
> > > > > > DB!
> > > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > Notification
> > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback
> > for
> > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> > > > completed,
> > > > > > external ID [job_1446620926630_0016]
> > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry
> state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> status=DONE
> > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated
> in
> > > DB!
> > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification
> > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > Notification
> > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > >
> > > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> There you will find "Console URL" , Open that URL on browser.
> You
> > > will
> > > > > get
> > > > > >> the Launcher mapper logs.
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > > jeetendra.g@housing.com>
> > > > > >> wrote:
> > > > > >>
> > > > > >> > This is the log i am getting repeatedly
> > > > > >> > 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520 -
> > > > > SERVER[
> > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > Notification
> > > > > >> URL
> > > > > >> > is
> > > > > >> > defined. Therefore nothing to notify for job
> > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > >> > 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520 -
> > > > > SERVER[
> > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > Notification
> > > > URL
> > > > > >> is
> > > > > >> > defined. Therefore nothing to notify for job
> > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > > >> >
> > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > >> >
> > > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > > >> > >
> > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > > jeetendra.g@housing.com>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > > does anybody have any idea? i have been trying this from
> 10
> > > days
> > > > > >> > nothing
> > > > > >> > > > worked out.
> > > > > >> > > >
> > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > > >> jeetendra.g@housing.com>
> > > > > >> > > > wrote:
> > > > > >> > > >
> > > > > >> > > > > my workflow.xml
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > > name="java-main-wf">
> > > > > >> > > > > <start to="java-node"/>
> > > > > >> > > > > <action name="java-node">
> > > > > >> > > > > <java>
> > > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > > >> > > > >
> > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > > >> > > > >
> > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > > >> > > > >
> > > > > >> > > > > </java>
> > > > > >> > > > > <ok to="end"/>
> > > > > >> > > > > <error to="fail"/>
> > > > > >> > > > > </action>
> > > > > >> > > > > <kill name="fail">
> > > > > >> > > > > <message>Java failed, error
> > > > > >> > > > >
> message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > > >> > > > > </kill>
> > > > > >> > > > > <end name="end"/>
> > > > > >> > > > > </workflow-app>
> > > > > >> > > > >
> > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > > >> > jeetendra.g@housing.com>
> > > > > >> > > > > wrote:
> > > > > >> > > > >
> > > > > >> > > > >> Hi All,
> > > > > >> > > > >>
> > > > > >> > > > >> I am running java workflow job using oozie.
> > > > > >> > > > >> I have Ambari server and I have installed oozie from
> > > Ambari.
> > > > > >> > > > >> When i ran the job it say succeeded but its not running
> > my
> > > > java
> > > > > >> > class
> > > > > >> > > > >> which I mentioned inside workflow.xml. Also when I get
> > > oozie
> > > > > >> > nothing
> > > > > >> > > > can
> > > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > > >> > > > >> oozie job -oozie
> http://hadoop03.housing.com:11000/oozie
> > > > -log
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > Start
> > > > > >> action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> > > > user-retry
> > > > > >> > state
> > > > > >> > > :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > :start:***]Action
> > > > > >> > > status=DONE
> > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > :start:***]Action
> > > > > >> updated
> > > > > >> > in
> > > > > >> > > > DB!
> > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> No
> > > > > >> > Notification
> > > > > >> > > > URL
> > > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > >> Notification
> > > > > >> > URL
> > > > > >> > > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > Start
> > > > > >> action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > > > > user-retry
> > > > > >> > > state
> > > > > >> > > > :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > checking
> > > > > >> > > action,
> > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > ***]Action
> > > > > >> > > > >> status=RUNNING
> > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > ***]Action
> > > > > >> > updated
> > > > > >> > > in
> > > > > >> > > > >> DB!
> > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > No
> > > > > >> > > Notification
> > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
> > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > callback
> > > > > >> for
> > > > > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > action
> > > > > >> > > > completed,
> > > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> > > > action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> > user-retry
> > > > > >> state :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > > >> status=DONE
> > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > updated
> > > > > >> in
> > > > > >> > DB!
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > > > > Notification
> > > > > >> > URL
> > > > > >> > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > >> Notification
> > > > > >> > URL
> > > > > >> > > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > No
> > > > > >> > > Notification
> > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> > > > >>
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> > > --
> > > > > >> > >
> _____________________________________________________________
> > > > > >> > > The information contained in this communication is intended
> > > solely
> > > > > for
> > > > > >> > the
> > > > > >> > > use of the individual or entity to whom it is addressed and
> > > others
> > > > > >> > > authorized to receive it. It may contain confidential or
> > legally
> > > > > >> > privileged
> > > > > >> > > information. If you are not the intended recipient you are
> > > hereby
> > > > > >> > notified
> > > > > >> > > that any disclosure, copying, distribution or taking any
> > action
> > > in
> > > > > >> > reliance
> > > > > >> > > on the contents of this information is strictly prohibited
> and
> > > may
> > > > > be
> > > > > >> > > unlawful. If you have received this communication in error,
> > > please
> > > > > >> notify
> > > > > >> > > us immediately by responding to this email and then delete
> it
> > > from
> > > > > >> your
> > > > > >> > > system. The firm is neither liable for the proper and
> complete
> > > > > >> > transmission
> > > > > >> > > of the information contained in this communication nor for
> any
> > > > delay
> > > > > >> in
> > > > > >> > its
> > > > > >> > > receipt.
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > > >> --
> > > > > >> _____________________________________________________________
> > > > > >> The information contained in this communication is intended
> solely
> > > for
> > > > > the
> > > > > >> use of the individual or entity to whom it is addressed and
> others
> > > > > >> authorized to receive it. It may contain confidential or legally
> > > > > >> privileged
> > > > > >> information. If you are not the intended recipient you are
> hereby
> > > > > notified
> > > > > >> that any disclosure, copying, distribution or taking any action
> in
> > > > > >> reliance
> > > > > >> on the contents of this information is strictly prohibited and
> may
> > > be
> > > > > >> unlawful. If you have received this communication in error,
> please
> > > > > notify
> > > > > >> us immediately by responding to this email and then delete it
> from
> > > > your
> > > > > >> system. The firm is neither liable for the proper and complete
> > > > > >> transmission
> > > > > >> of the information contained in this communication nor for any
> > delay
> > > > in
> > > > > >> its
> > > > > >> receipt.
> > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > >
> > > > --
> > > > _____________________________________________________________
> > > > The information contained in this communication is intended solely
> for
> > > the
> > > > use of the individual or entity to whom it is addressed and others
> > > > authorized to receive it. It may contain confidential or legally
> > > privileged
> > > > information. If you are not the intended recipient you are hereby
> > > notified
> > > > that any disclosure, copying, distribution or taking any action in
> > > reliance
> > > > on the contents of this information is strictly prohibited and may be
> > > > unlawful. If you have received this communication in error, please
> > notify
> > > > us immediately by responding to this email and then delete it from
> your
> > > > system. The firm is neither liable for the proper and complete
> > > transmission
> > > > of the information contained in this communication nor for any delay
> in
> > > its
> > > > receipt.
> > > >
> > >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
Re: Java action in Ooozie
Posted by Jaydeep Vishwakarma <ja...@inmobi.com>.
In first look I am not seeing any issue with job tracker or name node URL.
The job id is getting generated. Workflow Job is not going on PREP mode.
Open this link.
http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
You will be see the problem.
On Wed, Nov 4, 2015 at 6:24 PM, Jeetendra G <je...@housing.com> wrote:
> hey Serega I have cross verified jobTracker value is correct only I am
> using yarn so resource manager will become the job tracker?
>
> On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <se...@gmail.com>
> wrote:
>
> > Can you go to oozie server and grab logs from there? My assumption that
> > <job-tracker>${jobTracker}</job-tracker>
> > <name-node>${nameNode}</name-node>
> >
> > have incorrect values. Probably ${jobTracker} is wrong and oozie can't
> even
> > start launcher mapper.
> >
> > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > jaydeep.vishwakarma@inmobi.com>:
> >
> > > You are doing -log. Can you give the command as below and get the job
> url
> > > (application launcher url).
> > >
> > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> > >
> > >
> > >
> > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > > > and in job error log tab its saying error log is disables? by default
> > why
> > > > error log is disables? i am using hortonworks
> > > >
> > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <jeetendra.g@housing.com
> >
> > > > wrote:
> > > >
> > > > > same error.
> > > > >
> > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
> > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
> > state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > status=DONE
> > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated
> > in
> > > > DB!
> > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> Notification
> > > URL
> > > > > is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
> action
> > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> > > state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> > > action,
> > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > > status=RUNNING
> > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> updated
> > > in
> > > > > DB!
> > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > Notification
> > > > > URL is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback
> for
> > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> > > completed,
> > > > > external ID [job_1446620926630_0016]
> > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
> > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated in
> > DB!
> > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification
> URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > Notification
> > > > > URL is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >
> > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> There you will find "Console URL" , Open that URL on browser. You
> > will
> > > > get
> > > > >> the Launcher mapper logs.
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > jeetendra.g@housing.com>
> > > > >> wrote:
> > > > >>
> > > > >> > This is the log i am getting repeatedly
> > > > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > Notification
> > > > >> URL
> > > > >> > is
> > > > >> > defined. Therefore nothing to notify for job
> > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > >> is
> > > > >> > defined. Therefore nothing to notify for job
> > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > >> >
> > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >> >
> > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > >> > >
> > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > jeetendra.g@housing.com>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > > does anybody have any idea? i have been trying this from 10
> > days
> > > > >> > nothing
> > > > >> > > > worked out.
> > > > >> > > >
> > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > >> jeetendra.g@housing.com>
> > > > >> > > > wrote:
> > > > >> > > >
> > > > >> > > > > my workflow.xml
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > name="java-main-wf">
> > > > >> > > > > <start to="java-node"/>
> > > > >> > > > > <action name="java-node">
> > > > >> > > > > <java>
> > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > >> > > > >
> > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > >> > > > >
> > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > >> > > > >
> > > > >> > > > > </java>
> > > > >> > > > > <ok to="end"/>
> > > > >> > > > > <error to="fail"/>
> > > > >> > > > > </action>
> > > > >> > > > > <kill name="fail">
> > > > >> > > > > <message>Java failed, error
> > > > >> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > >> > > > > </kill>
> > > > >> > > > > <end name="end"/>
> > > > >> > > > > </workflow-app>
> > > > >> > > > >
> > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > >> > jeetendra.g@housing.com>
> > > > >> > > > > wrote:
> > > > >> > > > >
> > > > >> > > > >> Hi All,
> > > > >> > > > >>
> > > > >> > > > >> I am running java workflow job using oozie.
> > > > >> > > > >> I have Ambari server and I have installed oozie from
> > Ambari.
> > > > >> > > > >> When i ran the job it say succeeded but its not running
> my
> > > java
> > > > >> > class
> > > > >> > > > >> which I mentioned inside workflow.xml. Also when I get
> > oozie
> > > > >> > nothing
> > > > >> > > > can
> > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > >> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie
> > > -log
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> Start
> > > > >> action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> > > user-retry
> > > > >> > state
> > > > >> > > :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> :start:***]Action
> > > > >> > > status=DONE
> > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> :start:***]Action
> > > > >> updated
> > > > >> > in
> > > > >> > > > DB!
> > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > >> > Notification
> > > > >> > > > URL
> > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > >> Notification
> > > > >> > URL
> > > > >> > > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > Start
> > > > >> action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > > > user-retry
> > > > >> > > state
> > > > >> > > > :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > checking
> > > > >> > > action,
> > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > ***]Action
> > > > >> > > > >> status=RUNNING
> > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > ***]Action
> > > > >> > updated
> > > > >> > > in
> > > > >> > > > >> DB!
> > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> No
> > > > >> > > Notification
> > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
> SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > callback
> > > > >> for
> > > > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > action
> > > > >> > > > completed,
> > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> > > action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> user-retry
> > > > >> state :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > >> status=DONE
> > > > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > updated
> > > > >> in
> > > > >> > DB!
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > > > Notification
> > > > >> > URL
> > > > >> > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > >> Notification
> > > > >> > URL
> > > > >> > > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> No
> > > > >> > > Notification
> > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > >>
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> > > --
> > > > >> > > _____________________________________________________________
> > > > >> > > The information contained in this communication is intended
> > solely
> > > > for
> > > > >> > the
> > > > >> > > use of the individual or entity to whom it is addressed and
> > others
> > > > >> > > authorized to receive it. It may contain confidential or
> legally
> > > > >> > privileged
> > > > >> > > information. If you are not the intended recipient you are
> > hereby
> > > > >> > notified
> > > > >> > > that any disclosure, copying, distribution or taking any
> action
> > in
> > > > >> > reliance
> > > > >> > > on the contents of this information is strictly prohibited and
> > may
> > > > be
> > > > >> > > unlawful. If you have received this communication in error,
> > please
> > > > >> notify
> > > > >> > > us immediately by responding to this email and then delete it
> > from
> > > > >> your
> > > > >> > > system. The firm is neither liable for the proper and complete
> > > > >> > transmission
> > > > >> > > of the information contained in this communication nor for any
> > > delay
> > > > >> in
> > > > >> > its
> > > > >> > > receipt.
> > > > >> > >
> > > > >> >
> > > > >>
> > > > >> --
> > > > >> _____________________________________________________________
> > > > >> The information contained in this communication is intended solely
> > for
> > > > the
> > > > >> use of the individual or entity to whom it is addressed and others
> > > > >> authorized to receive it. It may contain confidential or legally
> > > > >> privileged
> > > > >> information. If you are not the intended recipient you are hereby
> > > > notified
> > > > >> that any disclosure, copying, distribution or taking any action in
> > > > >> reliance
> > > > >> on the contents of this information is strictly prohibited and may
> > be
> > > > >> unlawful. If you have received this communication in error, please
> > > > notify
> > > > >> us immediately by responding to this email and then delete it from
> > > your
> > > > >> system. The firm is neither liable for the proper and complete
> > > > >> transmission
> > > > >> of the information contained in this communication nor for any
> delay
> > > in
> > > > >> its
> > > > >> receipt.
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> > > --
> > > _____________________________________________________________
> > > The information contained in this communication is intended solely for
> > the
> > > use of the individual or entity to whom it is addressed and others
> > > authorized to receive it. It may contain confidential or legally
> > privileged
> > > information. If you are not the intended recipient you are hereby
> > notified
> > > that any disclosure, copying, distribution or taking any action in
> > reliance
> > > on the contents of this information is strictly prohibited and may be
> > > unlawful. If you have received this communication in error, please
> notify
> > > us immediately by responding to this email and then delete it from your
> > > system. The firm is neither liable for the proper and complete
> > transmission
> > > of the information contained in this communication nor for any delay in
> > its
> > > receipt.
> > >
> >
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: Java action in Ooozie
Posted by Serega Sheypak <se...@gmail.com>.
>using yarn so resource manager will become the job tracker?
Yes
>Your yarn RM could be in stanby or smth like that.
1. Check oozie host connectivity, your oozie can access yarn RM using
${jobTracker}
value. Do telnet to host:port, you should be able to connect
2. Check yarn RM using exact VALUE you setting to ${jobTracker}, open
browser and see if it's in ACTIVE state
I believe 1 or 2 should fail.
Get Oozie server log. Not oozie flow log. You show oozie flow log, oozie
server log should report you about failing to connect to yarn RM (my
guess)...
2015-11-04 13:54 GMT+01:00 Jeetendra G <je...@housing.com>:
> hey Serega I have cross verified jobTracker value is correct only I am
> using yarn so resource manager will become the job tracker?
>
> On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <se...@gmail.com>
> wrote:
>
> > Can you go to oozie server and grab logs from there? My assumption that
> > <job-tracker>${jobTracker}</job-tracker>
> > <name-node>${nameNode}</name-node>
> >
> > have incorrect values. Probably ${jobTracker} is wrong and oozie can't
> even
> > start launcher mapper.
> >
> > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > jaydeep.vishwakarma@inmobi.com>:
> >
> > > You are doing -log. Can you give the command as below and get the job
> url
> > > (application launcher url).
> > >
> > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> > >
> > >
> > >
> > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > > > and in job error log tab its saying error log is disables? by default
> > why
> > > > error log is disables? i am using hortonworks
> > > >
> > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <jeetendra.g@housing.com
> >
> > > > wrote:
> > > >
> > > > > same error.
> > > > >
> > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
> > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
> > state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > status=DONE
> > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated
> > in
> > > > DB!
> > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> Notification
> > > URL
> > > > > is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
> action
> > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> > > state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> > > action,
> > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > > status=RUNNING
> > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> updated
> > > in
> > > > > DB!
> > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > Notification
> > > > > URL is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback
> for
> > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> > > completed,
> > > > > external ID [job_1446620926630_0016]
> > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
> > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated in
> > DB!
> > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification
> URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > Notification
> > > > > URL is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >
> > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> There you will find "Console URL" , Open that URL on browser. You
> > will
> > > > get
> > > > >> the Launcher mapper logs.
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > jeetendra.g@housing.com>
> > > > >> wrote:
> > > > >>
> > > > >> > This is the log i am getting repeatedly
> > > > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > Notification
> > > > >> URL
> > > > >> > is
> > > > >> > defined. Therefore nothing to notify for job
> > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > >> is
> > > > >> > defined. Therefore nothing to notify for job
> > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > >> >
> > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >> >
> > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > >> > >
> > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > jeetendra.g@housing.com>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > > does anybody have any idea? i have been trying this from 10
> > days
> > > > >> > nothing
> > > > >> > > > worked out.
> > > > >> > > >
> > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > >> jeetendra.g@housing.com>
> > > > >> > > > wrote:
> > > > >> > > >
> > > > >> > > > > my workflow.xml
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > name="java-main-wf">
> > > > >> > > > > <start to="java-node"/>
> > > > >> > > > > <action name="java-node">
> > > > >> > > > > <java>
> > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > >> > > > >
> > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > >> > > > >
> > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > >> > > > >
> > > > >> > > > > </java>
> > > > >> > > > > <ok to="end"/>
> > > > >> > > > > <error to="fail"/>
> > > > >> > > > > </action>
> > > > >> > > > > <kill name="fail">
> > > > >> > > > > <message>Java failed, error
> > > > >> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > >> > > > > </kill>
> > > > >> > > > > <end name="end"/>
> > > > >> > > > > </workflow-app>
> > > > >> > > > >
> > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > >> > jeetendra.g@housing.com>
> > > > >> > > > > wrote:
> > > > >> > > > >
> > > > >> > > > >> Hi All,
> > > > >> > > > >>
> > > > >> > > > >> I am running java workflow job using oozie.
> > > > >> > > > >> I have Ambari server and I have installed oozie from
> > Ambari.
> > > > >> > > > >> When i ran the job it say succeeded but its not running
> my
> > > java
> > > > >> > class
> > > > >> > > > >> which I mentioned inside workflow.xml. Also when I get
> > oozie
> > > > >> > nothing
> > > > >> > > > can
> > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > >> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie
> > > -log
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> Start
> > > > >> action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> > > user-retry
> > > > >> > state
> > > > >> > > :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> :start:***]Action
> > > > >> > > status=DONE
> > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> :start:***]Action
> > > > >> updated
> > > > >> > in
> > > > >> > > > DB!
> > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > >> > Notification
> > > > >> > > > URL
> > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > >> Notification
> > > > >> > URL
> > > > >> > > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > Start
> > > > >> action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > > > user-retry
> > > > >> > > state
> > > > >> > > > :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > checking
> > > > >> > > action,
> > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > ***]Action
> > > > >> > > > >> status=RUNNING
> > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > ***]Action
> > > > >> > updated
> > > > >> > > in
> > > > >> > > > >> DB!
> > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> No
> > > > >> > > Notification
> > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
> SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > callback
> > > > >> for
> > > > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > action
> > > > >> > > > completed,
> > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> > > action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> user-retry
> > > > >> state :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > >> status=DONE
> > > > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > updated
> > > > >> in
> > > > >> > DB!
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > > > Notification
> > > > >> > URL
> > > > >> > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > >> Notification
> > > > >> > URL
> > > > >> > > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> No
> > > > >> > > Notification
> > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > >>
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> > > --
> > > > >> > > _____________________________________________________________
> > > > >> > > The information contained in this communication is intended
> > solely
> > > > for
> > > > >> > the
> > > > >> > > use of the individual or entity to whom it is addressed and
> > others
> > > > >> > > authorized to receive it. It may contain confidential or
> legally
> > > > >> > privileged
> > > > >> > > information. If you are not the intended recipient you are
> > hereby
> > > > >> > notified
> > > > >> > > that any disclosure, copying, distribution or taking any
> action
> > in
> > > > >> > reliance
> > > > >> > > on the contents of this information is strictly prohibited and
> > may
> > > > be
> > > > >> > > unlawful. If you have received this communication in error,
> > please
> > > > >> notify
> > > > >> > > us immediately by responding to this email and then delete it
> > from
> > > > >> your
> > > > >> > > system. The firm is neither liable for the proper and complete
> > > > >> > transmission
> > > > >> > > of the information contained in this communication nor for any
> > > delay
> > > > >> in
> > > > >> > its
> > > > >> > > receipt.
> > > > >> > >
> > > > >> >
> > > > >>
> > > > >> --
> > > > >> _____________________________________________________________
> > > > >> The information contained in this communication is intended solely
> > for
> > > > the
> > > > >> use of the individual or entity to whom it is addressed and others
> > > > >> authorized to receive it. It may contain confidential or legally
> > > > >> privileged
> > > > >> information. If you are not the intended recipient you are hereby
> > > > notified
> > > > >> that any disclosure, copying, distribution or taking any action in
> > > > >> reliance
> > > > >> on the contents of this information is strictly prohibited and may
> > be
> > > > >> unlawful. If you have received this communication in error, please
> > > > notify
> > > > >> us immediately by responding to this email and then delete it from
> > > your
> > > > >> system. The firm is neither liable for the proper and complete
> > > > >> transmission
> > > > >> of the information contained in this communication nor for any
> delay
> > > in
> > > > >> its
> > > > >> receipt.
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> > > --
> > > _____________________________________________________________
> > > The information contained in this communication is intended solely for
> > the
> > > use of the individual or entity to whom it is addressed and others
> > > authorized to receive it. It may contain confidential or legally
> > privileged
> > > information. If you are not the intended recipient you are hereby
> > notified
> > > that any disclosure, copying, distribution or taking any action in
> > reliance
> > > on the contents of this information is strictly prohibited and may be
> > > unlawful. If you have received this communication in error, please
> notify
> > > us immediately by responding to this email and then delete it from your
> > > system. The firm is neither liable for the proper and complete
> > transmission
> > > of the information contained in this communication nor for any delay in
> > its
> > > receipt.
> > >
> >
>
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
I have a lib folder inside that I have put the related jar so that is not
an issue. there are some sample jobs in oozie examples I am able to run
those.
On Wed, Nov 4, 2015 at 6:46 PM, Laurent H <la...@gmail.com> wrote:
> In your xml, is there <archive>[FILE-PATH]</archive> option ? If not, it's
> normal that nothing is done : you have to put your jar into the yarn
> container for execute your java program.
>
> I don't know if bring a file from "hdfs://" works in a lambda node (hope
> so), but you can pass it from your wf.xml with <file> option (don't know if
> this option is identical to -files option in hadoop jar command...)
>
> Regards,
>
> --
> Laurent HATIER - Consultant Big Data & Business Intelligence chez CapGemini
> fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
> <http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
>
> 2015-11-04 13:54 GMT+01:00 Jeetendra G <je...@housing.com>:
>
> > hey Serega I have cross verified jobTracker value is correct only I am
> > using yarn so resource manager will become the job tracker?
> >
> > On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <serega.sheypak@gmail.com
> >
> > wrote:
> >
> > > Can you go to oozie server and grab logs from there? My assumption that
> > > <job-tracker>${jobTracker}</job-tracker>
> > > <name-node>${nameNode}</name-node>
> > >
> > > have incorrect values. Probably ${jobTracker} is wrong and oozie can't
> > even
> > > start launcher mapper.
> > >
> > > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > > jaydeep.vishwakarma@inmobi.com>:
> > >
> > > > You are doing -log. Can you give the command as below and get the job
> > url
> > > > (application launcher url).
> > > >
> > > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> > > >
> > > >
> > > >
> > > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <jeetendra.g@housing.com
> >
> > > > wrote:
> > > >
> > > > > and in job error log tab its saying error log is disables? by
> default
> > > why
> > > > > error log is disables? i am using hortonworks
> > > > >
> > > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <
> jeetendra.g@housing.com
> > >
> > > > > wrote:
> > > > >
> > > > > > same error.
> > > > > >
> > > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start
> action
> > > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
> > > state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > > status=DONE
> > > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> updated
> > > in
> > > > > DB!
> > > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> > Notification
> > > > URL
> > > > > > is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
> > action
> > > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> > > > state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> > > > action,
> > > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > > > status=RUNNING
> > > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > updated
> > > > in
> > > > > > DB!
> > > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > Notification
> > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback
> > for
> > > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> > > > completed,
> > > > > > external ID [job_1446620926630_0016]
> > > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry
> state :
> > > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action
> status=DONE
> > > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > APP[java-main-wf]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated
> in
> > > DB!
> > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification
> > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > is
> > > > > > defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > > Notification
> > > > > > URL is defined. Therefore nothing to notify for job
> > > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > >
> > > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> There you will find "Console URL" , Open that URL on browser.
> You
> > > will
> > > > > get
> > > > > >> the Launcher mapper logs.
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > > jeetendra.g@housing.com>
> > > > > >> wrote:
> > > > > >>
> > > > > >> > This is the log i am getting repeatedly
> > > > > >> > 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520 -
> > > > > SERVER[
> > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > Notification
> > > > > >> URL
> > > > > >> > is
> > > > > >> > defined. Therefore nothing to notify for job
> > > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > >> > 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520 -
> > > > > SERVER[
> > > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > Notification
> > > > URL
> > > > > >> is
> > > > > >> > defined. Therefore nothing to notify for job
> > > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > > >> >
> > > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > > >> >
> > > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > > >> > >
> > > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > > jeetendra.g@housing.com>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > > does anybody have any idea? i have been trying this from
> 10
> > > days
> > > > > >> > nothing
> > > > > >> > > > worked out.
> > > > > >> > > >
> > > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > > >> jeetendra.g@housing.com>
> > > > > >> > > > wrote:
> > > > > >> > > >
> > > > > >> > > > > my workflow.xml
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > > name="java-main-wf">
> > > > > >> > > > > <start to="java-node"/>
> > > > > >> > > > > <action name="java-node">
> > > > > >> > > > > <java>
> > > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > > >> > > > >
> > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > > >> > > > >
> > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > > >> > > > >
> > > > > >> > > > > </java>
> > > > > >> > > > > <ok to="end"/>
> > > > > >> > > > > <error to="fail"/>
> > > > > >> > > > > </action>
> > > > > >> > > > > <kill name="fail">
> > > > > >> > > > > <message>Java failed, error
> > > > > >> > > > >
> message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > > >> > > > > </kill>
> > > > > >> > > > > <end name="end"/>
> > > > > >> > > > > </workflow-app>
> > > > > >> > > > >
> > > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > > >> > jeetendra.g@housing.com>
> > > > > >> > > > > wrote:
> > > > > >> > > > >
> > > > > >> > > > >> Hi All,
> > > > > >> > > > >>
> > > > > >> > > > >> I am running java workflow job using oozie.
> > > > > >> > > > >> I have Ambari server and I have installed oozie from
> > > Ambari.
> > > > > >> > > > >> When i ran the job it say succeeded but its not running
> > my
> > > > java
> > > > > >> > class
> > > > > >> > > > >> which I mentioned inside workflow.xml. Also when I get
> > > oozie
> > > > > >> > nothing
> > > > > >> > > > can
> > > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > > >> > > > >> oozie job -oozie
> http://hadoop03.housing.com:11000/oozie
> > > > -log
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > Start
> > > > > >> action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> > > > user-retry
> > > > > >> > state
> > > > > >> > > :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > :start:***]Action
> > > > > >> > > status=DONE
> > > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> > :start:***]Action
> > > > > >> updated
> > > > > >> > in
> > > > > >> > > > DB!
> > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> No
> > > > > >> > Notification
> > > > > >> > > > URL
> > > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > >> Notification
> > > > > >> > URL
> > > > > >> > > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > Start
> > > > > >> action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > > > > user-retry
> > > > > >> > > state
> > > > > >> > > > :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > checking
> > > > > >> > > action,
> > > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > ***]Action
> > > > > >> > > > >> status=RUNNING
> > > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > > ***]Action
> > > > > >> > updated
> > > > > >> > > in
> > > > > >> > > > >> DB!
> > > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > No
> > > > > >> > > Notification
> > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
> > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > > callback
> > > > > >> for
> > > > > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node
> ]
> > > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > action
> > > > > >> > > > completed,
> > > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> > > > action
> > > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> > user-retry
> > > > > >> state :
> > > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > > [10]
> > > > > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > > >> status=DONE
> > > > > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> > > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > > >> APP[java-main-wf]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > updated
> > > > > >> in
> > > > > >> > DB!
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > > > > Notification
> > > > > >> > URL
> > > > > >> > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > > >> Notification
> > > > > >> > URL
> > > > > >> > > > is
> > > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > > WorkflowNotificationXCommand:520
> > > > > -
> > > > > >> > > SERVER[
> > > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > No
> > > > > >> > > Notification
> > > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > > >> > > > >>
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> > > --
> > > > > >> > >
> _____________________________________________________________
> > > > > >> > > The information contained in this communication is intended
> > > solely
> > > > > for
> > > > > >> > the
> > > > > >> > > use of the individual or entity to whom it is addressed and
> > > others
> > > > > >> > > authorized to receive it. It may contain confidential or
> > legally
> > > > > >> > privileged
> > > > > >> > > information. If you are not the intended recipient you are
> > > hereby
> > > > > >> > notified
> > > > > >> > > that any disclosure, copying, distribution or taking any
> > action
> > > in
> > > > > >> > reliance
> > > > > >> > > on the contents of this information is strictly prohibited
> and
> > > may
> > > > > be
> > > > > >> > > unlawful. If you have received this communication in error,
> > > please
> > > > > >> notify
> > > > > >> > > us immediately by responding to this email and then delete
> it
> > > from
> > > > > >> your
> > > > > >> > > system. The firm is neither liable for the proper and
> complete
> > > > > >> > transmission
> > > > > >> > > of the information contained in this communication nor for
> any
> > > > delay
> > > > > >> in
> > > > > >> > its
> > > > > >> > > receipt.
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > > >> --
> > > > > >> _____________________________________________________________
> > > > > >> The information contained in this communication is intended
> solely
> > > for
> > > > > the
> > > > > >> use of the individual or entity to whom it is addressed and
> others
> > > > > >> authorized to receive it. It may contain confidential or legally
> > > > > >> privileged
> > > > > >> information. If you are not the intended recipient you are
> hereby
> > > > > notified
> > > > > >> that any disclosure, copying, distribution or taking any action
> in
> > > > > >> reliance
> > > > > >> on the contents of this information is strictly prohibited and
> may
> > > be
> > > > > >> unlawful. If you have received this communication in error,
> please
> > > > > notify
> > > > > >> us immediately by responding to this email and then delete it
> from
> > > > your
> > > > > >> system. The firm is neither liable for the proper and complete
> > > > > >> transmission
> > > > > >> of the information contained in this communication nor for any
> > delay
> > > > in
> > > > > >> its
> > > > > >> receipt.
> > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > >
> > > > --
> > > > _____________________________________________________________
> > > > The information contained in this communication is intended solely
> for
> > > the
> > > > use of the individual or entity to whom it is addressed and others
> > > > authorized to receive it. It may contain confidential or legally
> > > privileged
> > > > information. If you are not the intended recipient you are hereby
> > > notified
> > > > that any disclosure, copying, distribution or taking any action in
> > > reliance
> > > > on the contents of this information is strictly prohibited and may be
> > > > unlawful. If you have received this communication in error, please
> > notify
> > > > us immediately by responding to this email and then delete it from
> your
> > > > system. The firm is neither liable for the proper and complete
> > > transmission
> > > > of the information contained in this communication nor for any delay
> in
> > > its
> > > > receipt.
> > > >
> > >
> >
>
Re: Java action in Ooozie
Posted by Laurent H <la...@gmail.com>.
In your xml, is there <archive>[FILE-PATH]</archive> option ? If not, it's
normal that nothing is done : you have to put your jar into the yarn
container for execute your java program.
I don't know if bring a file from "hdfs://" works in a lambda node (hope
so), but you can pass it from your wf.xml with <file> option (don't know if
this option is identical to -files option in hadoop jar command...)
Regards,
--
Laurent HATIER - Consultant Big Data & Business Intelligence chez CapGemini
fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
<http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
2015-11-04 13:54 GMT+01:00 Jeetendra G <je...@housing.com>:
> hey Serega I have cross verified jobTracker value is correct only I am
> using yarn so resource manager will become the job tracker?
>
> On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <se...@gmail.com>
> wrote:
>
> > Can you go to oozie server and grab logs from there? My assumption that
> > <job-tracker>${jobTracker}</job-tracker>
> > <name-node>${nameNode}</name-node>
> >
> > have incorrect values. Probably ${jobTracker} is wrong and oozie can't
> even
> > start launcher mapper.
> >
> > 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> > jaydeep.vishwakarma@inmobi.com>:
> >
> > > You are doing -log. Can you give the command as below and get the job
> url
> > > (application launcher url).
> > >
> > > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> > >
> > >
> > >
> > > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > > > and in job error log tab its saying error log is disables? by default
> > why
> > > > error log is disables? i am using hortonworks
> > > >
> > > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <jeetendra.g@housing.com
> >
> > > > wrote:
> > > >
> > > > > same error.
> > > > >
> > > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
> > > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
> > state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> > status=DONE
> > > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated
> > in
> > > > DB!
> > > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No
> Notification
> > > URL
> > > > > is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start
> action
> > > > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> > > state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> > > action,
> > > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > > status=RUNNING
> > > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> updated
> > > in
> > > > > DB!
> > > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > Notification
> > > > > URL is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback
> for
> > > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> > > completed,
> > > > > external ID [job_1446620926630_0016]
> > > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
> > > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
> > > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated in
> > DB!
> > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification
> URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > is
> > > > > defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W
> > > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> > Notification
> > > > > URL is defined. Therefore nothing to notify for job
> > > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >
> > > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> There you will find "Console URL" , Open that URL on browser. You
> > will
> > > > get
> > > > >> the Launcher mapper logs.
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> > jeetendra.g@housing.com>
> > > > >> wrote:
> > > > >>
> > > > >> > This is the log i am getting repeatedly
> > > > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > Notification
> > > > >> URL
> > > > >> > is
> > > > >> > defined. Therefore nothing to notify for job
> > > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > > SERVER[
> > > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> Notification
> > > URL
> > > > >> is
> > > > >> > defined. Therefore nothing to notify for job
> > > > >> > 0000040-151015123257993-oozie-oozi-W
> > > > >> >
> > > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > > >> >
> > > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > > >> > >
> > > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > > jeetendra.g@housing.com>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > > does anybody have any idea? i have been trying this from 10
> > days
> > > > >> > nothing
> > > > >> > > > worked out.
> > > > >> > > >
> > > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > > >> jeetendra.g@housing.com>
> > > > >> > > > wrote:
> > > > >> > > >
> > > > >> > > > > my workflow.xml
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > > name="java-main-wf">
> > > > >> > > > > <start to="java-node"/>
> > > > >> > > > > <action name="java-node">
> > > > >> > > > > <java>
> > > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > >> > > > > <name-node>${nameNode}</name-node>
> > > > >> > > > >
> > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > >> > > > >
> > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > >> > > > >
> > > > >> > > > > </java>
> > > > >> > > > > <ok to="end"/>
> > > > >> > > > > <error to="fail"/>
> > > > >> > > > > </action>
> > > > >> > > > > <kill name="fail">
> > > > >> > > > > <message>Java failed, error
> > > > >> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > >> > > > > </kill>
> > > > >> > > > > <end name="end"/>
> > > > >> > > > > </workflow-app>
> > > > >> > > > >
> > > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > > >> > jeetendra.g@housing.com>
> > > > >> > > > > wrote:
> > > > >> > > > >
> > > > >> > > > >> Hi All,
> > > > >> > > > >>
> > > > >> > > > >> I am running java workflow job using oozie.
> > > > >> > > > >> I have Ambari server and I have installed oozie from
> > Ambari.
> > > > >> > > > >> When i ran the job it say succeeded but its not running
> my
> > > java
> > > > >> > class
> > > > >> > > > >> which I mentioned inside workflow.xml. Also when I get
> > oozie
> > > > >> > nothing
> > > > >> > > > can
> > > > >> > > > >> be find pasting log beow, can anybody help here?
> > > > >> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie
> > > -log
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> Start
> > > > >> action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> > > user-retry
> > > > >> > state
> > > > >> > > :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> :start:***]Action
> > > > >> > > status=DONE
> > > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@
> :start:***]Action
> > > > >> updated
> > > > >> > in
> > > > >> > > > DB!
> > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > > >> > Notification
> > > > >> > > > URL
> > > > >> > > > >> is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > >> Notification
> > > > >> > URL
> > > > >> > > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > Start
> > > > >> action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > > > user-retry
> > > > >> > > state
> > > > >> > > > :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > checking
> > > > >> > > action,
> > > > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > ***]Action
> > > > >> > > > >> status=RUNNING
> > > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> > ***]Action
> > > > >> > updated
> > > > >> > > in
> > > > >> > > > >> DB!
> > > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> No
> > > > >> > > Notification
> > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 -
> SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > callback
> > > > >> for
> > > > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > action
> > > > >> > > > completed,
> > > > >> > > > >> external ID [job_1444892488693_0073]
> > > > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> > > action
> > > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with
> user-retry
> > > > >> state :
> > > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> > [10]
> > > > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > > >> status=DONE
> > > > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > > >> APP[java-main-wf]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > updated
> > > > >> in
> > > > >> > DB!
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > > > Notification
> > > > >> > URL
> > > > >> > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > > >> Notification
> > > > >> > URL
> > > > >> > > > is
> > > > >> > > > >> defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > > WorkflowNotificationXCommand:520
> > > > -
> > > > >> > > SERVER[
> > > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> No
> > > > >> > > Notification
> > > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> > > > >>
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> > > --
> > > > >> > > _____________________________________________________________
> > > > >> > > The information contained in this communication is intended
> > solely
> > > > for
> > > > >> > the
> > > > >> > > use of the individual or entity to whom it is addressed and
> > others
> > > > >> > > authorized to receive it. It may contain confidential or
> legally
> > > > >> > privileged
> > > > >> > > information. If you are not the intended recipient you are
> > hereby
> > > > >> > notified
> > > > >> > > that any disclosure, copying, distribution or taking any
> action
> > in
> > > > >> > reliance
> > > > >> > > on the contents of this information is strictly prohibited and
> > may
> > > > be
> > > > >> > > unlawful. If you have received this communication in error,
> > please
> > > > >> notify
> > > > >> > > us immediately by responding to this email and then delete it
> > from
> > > > >> your
> > > > >> > > system. The firm is neither liable for the proper and complete
> > > > >> > transmission
> > > > >> > > of the information contained in this communication nor for any
> > > delay
> > > > >> in
> > > > >> > its
> > > > >> > > receipt.
> > > > >> > >
> > > > >> >
> > > > >>
> > > > >> --
> > > > >> _____________________________________________________________
> > > > >> The information contained in this communication is intended solely
> > for
> > > > the
> > > > >> use of the individual or entity to whom it is addressed and others
> > > > >> authorized to receive it. It may contain confidential or legally
> > > > >> privileged
> > > > >> information. If you are not the intended recipient you are hereby
> > > > notified
> > > > >> that any disclosure, copying, distribution or taking any action in
> > > > >> reliance
> > > > >> on the contents of this information is strictly prohibited and may
> > be
> > > > >> unlawful. If you have received this communication in error, please
> > > > notify
> > > > >> us immediately by responding to this email and then delete it from
> > > your
> > > > >> system. The firm is neither liable for the proper and complete
> > > > >> transmission
> > > > >> of the information contained in this communication nor for any
> delay
> > > in
> > > > >> its
> > > > >> receipt.
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> > > --
> > > _____________________________________________________________
> > > The information contained in this communication is intended solely for
> > the
> > > use of the individual or entity to whom it is addressed and others
> > > authorized to receive it. It may contain confidential or legally
> > privileged
> > > information. If you are not the intended recipient you are hereby
> > notified
> > > that any disclosure, copying, distribution or taking any action in
> > reliance
> > > on the contents of this information is strictly prohibited and may be
> > > unlawful. If you have received this communication in error, please
> notify
> > > us immediately by responding to this email and then delete it from your
> > > system. The firm is neither liable for the proper and complete
> > transmission
> > > of the information contained in this communication nor for any delay in
> > its
> > > receipt.
> > >
> >
>
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
hey Serega I have cross verified jobTracker value is correct only I am
using yarn so resource manager will become the job tracker?
On Wed, Nov 4, 2015 at 6:17 PM, Serega Sheypak <se...@gmail.com>
wrote:
> Can you go to oozie server and grab logs from there? My assumption that
> <job-tracker>${jobTracker}</job-tracker>
> <name-node>${nameNode}</name-node>
>
> have incorrect values. Probably ${jobTracker} is wrong and oozie can't even
> start launcher mapper.
>
> 2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
> jaydeep.vishwakarma@inmobi.com>:
>
> > You are doing -log. Can you give the command as below and get the job url
> > (application launcher url).
> >
> > *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
> >
> >
> >
> > On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > and in job error log tab its saying error log is disables? by default
> why
> > > error log is disables? i am using hortonworks
> > >
> > > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > > > same error.
> > > >
> > > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
> > > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry
> state :
> > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action
> status=DONE
> > > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated
> in
> > > DB!
> > > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No Notification
> > URL
> > > > is defined. Therefore nothing to notify for job
> > > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification
> URL
> > is
> > > > defined. Therefore nothing to notify for job
> > > > 0000004-151104124010010-oozie-oozi-W
> > > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start action
> > > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> > state :
> > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> > action,
> > > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > > status=RUNNING
> > > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action updated
> > in
> > > > DB!
> > > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> Notification
> > > > URL is defined. Therefore nothing to notify for job
> > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback for
> > > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> > completed,
> > > > external ID [job_1446620926630_0016]
> > > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
> > > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
> > > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated in
> DB!
> > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification URL
> > is
> > > > defined. Therefore nothing to notify for job
> > > > 0000004-151104124010010-oozie-oozi-W@end
> > > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification
> URL
> > is
> > > > defined. Therefore nothing to notify for job
> > > > 0000004-151104124010010-oozie-oozi-W
> > > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No
> Notification
> > > > URL is defined. Therefore nothing to notify for job
> > > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > >
> > > >
> > > >
> > > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > > jaydeep.vishwakarma@inmobi.com> wrote:
> > > >
> > > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > > >> There you will find "Console URL" , Open that URL on browser. You
> will
> > > get
> > > >> the Launcher mapper logs.
> > > >>
> > > >>
> > > >>
> > > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <
> jeetendra.g@housing.com>
> > > >> wrote:
> > > >>
> > > >> > This is the log i am getting repeatedly
> > > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > Notification
> > > >> URL
> > > >> > is
> > > >> > defined. Therefore nothing to notify for job
> > > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > >> is
> > > >> > defined. Therefore nothing to notify for job
> > > >> > 0000040-151015123257993-oozie-oozi-W
> > > >> >
> > > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > > >> >
> > > >> > > Have you checked Launcher Mapper logs?. What it says?
> > > >> > >
> > > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > > jeetendra.g@housing.com>
> > > >> > > wrote:
> > > >> > >
> > > >> > > > does anybody have any idea? i have been trying this from 10
> days
> > > >> > nothing
> > > >> > > > worked out.
> > > >> > > >
> > > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > > >> jeetendra.g@housing.com>
> > > >> > > > wrote:
> > > >> > > >
> > > >> > > > > my workflow.xml
> > > >> > > > >
> > > >> > > > >
> > > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > > name="java-main-wf">
> > > >> > > > > <start to="java-node"/>
> > > >> > > > > <action name="java-node">
> > > >> > > > > <java>
> > > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > >> > > > > <name-node>${nameNode}</name-node>
> > > >> > > > >
> > > <main-class>com.housing.common.JSONMerger</main-class>
> > > >> > > > >
> <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > > >> > > > >
> > > >> > > > > </java>
> > > >> > > > > <ok to="end"/>
> > > >> > > > > <error to="fail"/>
> > > >> > > > > </action>
> > > >> > > > > <kill name="fail">
> > > >> > > > > <message>Java failed, error
> > > >> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > >> > > > > </kill>
> > > >> > > > > <end name="end"/>
> > > >> > > > > </workflow-app>
> > > >> > > > >
> > > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > > >> > jeetendra.g@housing.com>
> > > >> > > > > wrote:
> > > >> > > > >
> > > >> > > > >> Hi All,
> > > >> > > > >>
> > > >> > > > >> I am running java workflow job using oozie.
> > > >> > > > >> I have Ambari server and I have installed oozie from
> Ambari.
> > > >> > > > >> When i ran the job it say succeeded but its not running my
> > java
> > > >> > class
> > > >> > > > >> which I mentioned inside workflow.xml. Also when I get
> oozie
> > > >> > nothing
> > > >> > > > can
> > > >> > > > >> be find pasting log beow, can anybody help here?
> > > >> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie
> > -log
> > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start
> > > >> action
> > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> > user-retry
> > > >> > state
> > > >> > > :
> > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> [10]
> > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> > > >> > > status=DONE
> > > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> > > >> updated
> > > >> > in
> > > >> > > > DB!
> > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > >> > > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > > >> > Notification
> > > >> > > > URL
> > > >> > > > >> is defined. Therefore nothing to notify for job
> > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > >> > > > >> 2015-10-29 16:39:11,095 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > >> > > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > >> Notification
> > > >> > URL
> > > >> > > > is
> > > >> > > > >> defined. Therefore nothing to notify for job
> > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> Start
> > > >> action
> > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > > user-retry
> > > >> > > state
> > > >> > > > :
> > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> [10]
> > > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > checking
> > > >> > > action,
> > > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> ***]Action
> > > >> > > > >> status=RUNNING
> > > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node
> ***]Action
> > > >> > updated
> > > >> > > in
> > > >> > > > >> DB!
> > > >> > > > >> 2015-10-29 16:39:12,229 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > >> > > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > > >> > > Notification
> > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > callback
> > > >> for
> > > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > action
> > > >> > > > completed,
> > > >> > > > >> external ID [job_1444892488693_0073]
> > > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> > action
> > > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry
> > > >> state :
> > > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval
> [10]
> > > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > > >> status=DONE
> > > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > > >> APP[java-main-wf]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > updated
> > > >> in
> > > >> > DB!
> > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > >> > > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > > Notification
> > > >> > URL
> > > >> > > is
> > > >> > > > >> defined. Therefore nothing to notify for job
> > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > >> > > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > > >> Notification
> > > >> > URL
> > > >> > > > is
> > > >> > > > >> defined. Therefore nothing to notify for job
> > > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> > > > >> 2015-10-29 16:39:25,522 INFO
> > WorkflowNotificationXCommand:520
> > > -
> > > >> > > SERVER[
> > > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > > >> > > Notification
> > > >> > > > >> URL is defined. Therefore nothing to notify for job
> > > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > >> > > > >>
> > > >> > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> > > --
> > > >> > > _____________________________________________________________
> > > >> > > The information contained in this communication is intended
> solely
> > > for
> > > >> > the
> > > >> > > use of the individual or entity to whom it is addressed and
> others
> > > >> > > authorized to receive it. It may contain confidential or legally
> > > >> > privileged
> > > >> > > information. If you are not the intended recipient you are
> hereby
> > > >> > notified
> > > >> > > that any disclosure, copying, distribution or taking any action
> in
> > > >> > reliance
> > > >> > > on the contents of this information is strictly prohibited and
> may
> > > be
> > > >> > > unlawful. If you have received this communication in error,
> please
> > > >> notify
> > > >> > > us immediately by responding to this email and then delete it
> from
> > > >> your
> > > >> > > system. The firm is neither liable for the proper and complete
> > > >> > transmission
> > > >> > > of the information contained in this communication nor for any
> > delay
> > > >> in
> > > >> > its
> > > >> > > receipt.
> > > >> > >
> > > >> >
> > > >>
> > > >> --
> > > >> _____________________________________________________________
> > > >> The information contained in this communication is intended solely
> for
> > > the
> > > >> use of the individual or entity to whom it is addressed and others
> > > >> authorized to receive it. It may contain confidential or legally
> > > >> privileged
> > > >> information. If you are not the intended recipient you are hereby
> > > notified
> > > >> that any disclosure, copying, distribution or taking any action in
> > > >> reliance
> > > >> on the contents of this information is strictly prohibited and may
> be
> > > >> unlawful. If you have received this communication in error, please
> > > notify
> > > >> us immediately by responding to this email and then delete it from
> > your
> > > >> system. The firm is neither liable for the proper and complete
> > > >> transmission
> > > >> of the information contained in this communication nor for any delay
> > in
> > > >> its
> > > >> receipt.
> > > >>
> > > >
> > > >
> > >
> >
> > --
> > _____________________________________________________________
> > The information contained in this communication is intended solely for
> the
> > use of the individual or entity to whom it is addressed and others
> > authorized to receive it. It may contain confidential or legally
> privileged
> > information. If you are not the intended recipient you are hereby
> notified
> > that any disclosure, copying, distribution or taking any action in
> reliance
> > on the contents of this information is strictly prohibited and may be
> > unlawful. If you have received this communication in error, please notify
> > us immediately by responding to this email and then delete it from your
> > system. The firm is neither liable for the proper and complete
> transmission
> > of the information contained in this communication nor for any delay in
> its
> > receipt.
> >
>
Re: Java action in Ooozie
Posted by Serega Sheypak <se...@gmail.com>.
Can you go to oozie server and grab logs from there? My assumption that
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
have incorrect values. Probably ${jobTracker} is wrong and oozie can't even
start launcher mapper.
2015-11-04 13:43 GMT+01:00 Jaydeep Vishwakarma <
jaydeep.vishwakarma@inmobi.com>:
> You are doing -log. Can you give the command as below and get the job url
> (application launcher url).
>
> *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
>
>
>
> On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > and in job error log tab its saying error log is disables? by default why
> > error log is disables? i am using hortonworks
> >
> > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > same error.
> > >
> > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
> > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry state :
> > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action status=DONE
> > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated in
> > DB!
> > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No Notification
> URL
> > > is defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL
> is
> > > defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W
> > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start action
> > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> state :
> > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> action,
> > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > status=RUNNING
> > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action updated
> in
> > > DB!
> > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification
> > > URL is defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback for
> > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> completed,
> > > external ID [job_1446620926630_0016]
> > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
> > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > [***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
> > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated in DB!
> > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification URL
> is
> > > defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W@end
> > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL
> is
> > > defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W
> > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification
> > > URL is defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W@java-node
> > >
> > >
> > >
> > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > jaydeep.vishwakarma@inmobi.com> wrote:
> > >
> > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > >> There you will find "Console URL" , Open that URL on browser. You will
> > get
> > >> the Launcher mapper logs.
> > >>
> > >>
> > >>
> > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <je...@housing.com>
> > >> wrote:
> > >>
> > >> > This is the log i am getting repeatedly
> > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> Notification
> > >> URL
> > >> > is
> > >> > defined. Therefore nothing to notify for job
> > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification
> URL
> > >> is
> > >> > defined. Therefore nothing to notify for job
> > >> > 0000040-151015123257993-oozie-oozi-W
> > >> >
> > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > >> >
> > >> > > Have you checked Launcher Mapper logs?. What it says?
> > >> > >
> > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > jeetendra.g@housing.com>
> > >> > > wrote:
> > >> > >
> > >> > > > does anybody have any idea? i have been trying this from 10 days
> > >> > nothing
> > >> > > > worked out.
> > >> > > >
> > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > >> jeetendra.g@housing.com>
> > >> > > > wrote:
> > >> > > >
> > >> > > > > my workflow.xml
> > >> > > > >
> > >> > > > >
> > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > name="java-main-wf">
> > >> > > > > <start to="java-node"/>
> > >> > > > > <action name="java-node">
> > >> > > > > <java>
> > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > >> > > > > <name-node>${nameNode}</name-node>
> > >> > > > >
> > <main-class>com.housing.common.JSONMerger</main-class>
> > >> > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > >> > > > >
> > >> > > > > </java>
> > >> > > > > <ok to="end"/>
> > >> > > > > <error to="fail"/>
> > >> > > > > </action>
> > >> > > > > <kill name="fail">
> > >> > > > > <message>Java failed, error
> > >> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > >> > > > > </kill>
> > >> > > > > <end name="end"/>
> > >> > > > > </workflow-app>
> > >> > > > >
> > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > >> > jeetendra.g@housing.com>
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > >> Hi All,
> > >> > > > >>
> > >> > > > >> I am running java workflow job using oozie.
> > >> > > > >> I have Ambari server and I have installed oozie from Ambari.
> > >> > > > >> When i ran the job it say succeeded but its not running my
> java
> > >> > class
> > >> > > > >> which I mentioned inside workflow.xml. Also when I get oozie
> > >> > nothing
> > >> > > > can
> > >> > > > >> be find pasting log beow, can anybody help here?
> > >> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie
> -log
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start
> > >> action
> > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> user-retry
> > >> > state
> > >> > > :
> > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> > >> > > status=DONE
> > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> > >> updated
> > >> > in
> > >> > > > DB!
> > >> > > > >> 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > >> > Notification
> > >> > > > URL
> > >> > > > >> is defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > >> > > > >> 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > >> Notification
> > >> > URL
> > >> > > > is
> > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start
> > >> action
> > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > user-retry
> > >> > > state
> > >> > > > :
> > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > checking
> > >> > > action,
> > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> > >> > > > >> status=RUNNING
> > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> > >> > updated
> > >> > > in
> > >> > > > >> DB!
> > >> > > > >> 2015-10-29 16:39:12,229 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > >> > > Notification
> > >> > > > >> URL is defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > callback
> > >> for
> > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> action
> > >> > > > completed,
> > >> > > > >> external ID [job_1444892488693_0073]
> > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> action
> > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry
> > >> state :
> > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > >> status=DONE
> > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> updated
> > >> in
> > >> > DB!
> > >> > > > >> 2015-10-29 16:39:25,522 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > Notification
> > >> > URL
> > >> > > is
> > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > >> > > > >> 2015-10-29 16:39:25,522 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > >> Notification
> > >> > URL
> > >> > > > is
> > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > >> 2015-10-29 16:39:25,522 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > >> > > Notification
> > >> > > > >> URL is defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > >>
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> > > --
> > >> > > _____________________________________________________________
> > >> > > The information contained in this communication is intended solely
> > for
> > >> > the
> > >> > > use of the individual or entity to whom it is addressed and others
> > >> > > authorized to receive it. It may contain confidential or legally
> > >> > privileged
> > >> > > information. If you are not the intended recipient you are hereby
> > >> > notified
> > >> > > that any disclosure, copying, distribution or taking any action in
> > >> > reliance
> > >> > > on the contents of this information is strictly prohibited and may
> > be
> > >> > > unlawful. If you have received this communication in error, please
> > >> notify
> > >> > > us immediately by responding to this email and then delete it from
> > >> your
> > >> > > system. The firm is neither liable for the proper and complete
> > >> > transmission
> > >> > > of the information contained in this communication nor for any
> delay
> > >> in
> > >> > its
> > >> > > receipt.
> > >> > >
> > >> >
> > >>
> > >> --
> > >> _____________________________________________________________
> > >> The information contained in this communication is intended solely for
> > the
> > >> use of the individual or entity to whom it is addressed and others
> > >> authorized to receive it. It may contain confidential or legally
> > >> privileged
> > >> information. If you are not the intended recipient you are hereby
> > notified
> > >> that any disclosure, copying, distribution or taking any action in
> > >> reliance
> > >> on the contents of this information is strictly prohibited and may be
> > >> unlawful. If you have received this communication in error, please
> > notify
> > >> us immediately by responding to this email and then delete it from
> your
> > >> system. The firm is neither liable for the proper and complete
> > >> transmission
> > >> of the information contained in this communication nor for any delay
> in
> > >> its
> > >> receipt.
> > >>
> > >
> > >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
Hey Jaydeep no i am not doing -log
[hdfs@hadoop07 root]$ oozie job --oozie
http://hadoop03.housing.com:11000/oozie -config
oozie-workflow-jobs/java-JsonMergeJob/job.properties -info
0000003-151104124010010-oozie-oozi-W@java-node
ID : 0000003-151104124010010-oozie-oozi-W@java-node
------------------------------------------------------------------------------------------------------------------------------------
Console URL :
http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/
Error Code : -
Error Message : -
External ID : job_1446620926630_0014
External Status : SUCCEEDED
Name : java-node
Retries : 0
Tracker URI : hadoop02.housing.com:8050
Type : java
Started : 2015-11-04 08:13 GMT
Status : OK
Ended : 2015-11-04 08:13 GMT
Then I am checking "
http://hadoop02.housing.com:8088/proxy/application_1446620926630_0014/"
On Wed, Nov 4, 2015 at 6:13 PM, Jaydeep Vishwakarma <
jaydeep.vishwakarma@inmobi.com> wrote:
> You are doing -log. Can you give the command as below and get the job url
> (application launcher url).
>
> *oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
>
>
>
> On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > and in job error log tab its saying error log is disables? by default why
> > error log is disables? i am using hortonworks
> >
> > On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > same error.
> > >
> > > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
> > > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry state :
> > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action status=DONE
> > > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated in
> > DB!
> > > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No Notification
> URL
> > > is defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W@:start:
> > > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL
> is
> > > defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W
> > > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start action
> > > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry
> state :
> > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking
> action,
> > > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > > status=RUNNING
> > > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action updated
> in
> > > DB!
> > > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification
> > > URL is defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W@java-node
> > > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback for
> > > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action
> completed,
> > > external ID [job_1446620926630_0016]
> > > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > > [0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
> > > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > [***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
> > > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated in DB!
> > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification URL
> is
> > > defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W@end
> > > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL
> is
> > > defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W
> > > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > JOB[0000004-151104124010010-oozie-oozi-W]
> > > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification
> > > URL is defined. Therefore nothing to notify for job
> > > 0000004-151104124010010-oozie-oozi-W@java-node
> > >
> > >
> > >
> > > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > > jaydeep.vishwakarma@inmobi.com> wrote:
> > >
> > >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> > >> There you will find "Console URL" , Open that URL on browser. You will
> > get
> > >> the Launcher mapper logs.
> > >>
> > >>
> > >>
> > >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <je...@housing.com>
> > >> wrote:
> > >>
> > >> > This is the log i am getting repeatedly
> > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> Notification
> > >> URL
> > >> > is
> > >> > defined. Therefore nothing to notify for job
> > >> > 0000040-151015123257993-oozie-oozi-W@:start:
> > >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification
> URL
> > >> is
> > >> > defined. Therefore nothing to notify for job
> > >> > 0000040-151015123257993-oozie-oozi-W
> > >> >
> > >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > >> > jaydeep.vishwakarma@inmobi.com> wrote:
> > >> >
> > >> > > Have you checked Launcher Mapper logs?. What it says?
> > >> > >
> > >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> > jeetendra.g@housing.com>
> > >> > > wrote:
> > >> > >
> > >> > > > does anybody have any idea? i have been trying this from 10 days
> > >> > nothing
> > >> > > > worked out.
> > >> > > >
> > >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> > >> jeetendra.g@housing.com>
> > >> > > > wrote:
> > >> > > >
> > >> > > > > my workflow.xml
> > >> > > > >
> > >> > > > >
> > >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> > name="java-main-wf">
> > >> > > > > <start to="java-node"/>
> > >> > > > > <action name="java-node">
> > >> > > > > <java>
> > >> > > > > <job-tracker>${jobTracker}</job-tracker>
> > >> > > > > <name-node>${nameNode}</name-node>
> > >> > > > >
> > <main-class>com.housing.common.JSONMerger</main-class>
> > >> > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > >> > > > > -Dyyyymmdd=20151029</java-opts>
> > >> > > > >
> > >> > > > > </java>
> > >> > > > > <ok to="end"/>
> > >> > > > > <error to="fail"/>
> > >> > > > > </action>
> > >> > > > > <kill name="fail">
> > >> > > > > <message>Java failed, error
> > >> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > >> > > > > </kill>
> > >> > > > > <end name="end"/>
> > >> > > > > </workflow-app>
> > >> > > > >
> > >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > >> > jeetendra.g@housing.com>
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > >> Hi All,
> > >> > > > >>
> > >> > > > >> I am running java workflow job using oozie.
> > >> > > > >> I have Ambari server and I have installed oozie from Ambari.
> > >> > > > >> When i ran the job it say succeeded but its not running my
> java
> > >> > class
> > >> > > > >> which I mentioned inside workflow.xml. Also when I get oozie
> > >> > nothing
> > >> > > > can
> > >> > > > >> be find pasting log beow, can anybody help here?
> > >> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie
> -log
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start
> > >> action
> > >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with
> user-retry
> > >> > state
> > >> > > :
> > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> > >> > > status=DONE
> > >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> > >> updated
> > >> > in
> > >> > > > DB!
> > >> > > > >> 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > >> > Notification
> > >> > > > URL
> > >> > > > >> is defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > >> > > > >> 2015-10-29 16:39:11,095 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > >> Notification
> > >> > URL
> > >> > > > is
> > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start
> > >> action
> > >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> > user-retry
> > >> > > state
> > >> > > > :
> > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > checking
> > >> > > action,
> > >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> > >> > > > >> status=RUNNING
> > >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> > >> > updated
> > >> > > in
> > >> > > > >> DB!
> > >> > > > >> 2015-10-29 16:39:12,229 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > >> > > Notification
> > >> > > > >> URL is defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > callback
> > >> for
> > >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> action
> > >> > > > completed,
> > >> > > > >> external ID [job_1444892488693_0073]
> > >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start
> action
> > >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry
> > >> state :
> > >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> > >> status=DONE
> > >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 -
> SERVER[
> > >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> > >> APP[java-main-wf]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> updated
> > >> in
> > >> > DB!
> > >> > > > >> 2015-10-29 16:39:25,522 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> > Notification
> > >> > URL
> > >> > > is
> > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > >> > > > >> 2015-10-29 16:39:25,522 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> > >> Notification
> > >> > URL
> > >> > > > is
> > >> > > > >> defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W
> > >> > > > >> 2015-10-29 16:39:25,522 INFO
> WorkflowNotificationXCommand:520
> > -
> > >> > > SERVER[
> > >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > >> > > Notification
> > >> > > > >> URL is defined. Therefore nothing to notify for job
> > >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> > > > >>
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> > > --
> > >> > > _____________________________________________________________
> > >> > > The information contained in this communication is intended solely
> > for
> > >> > the
> > >> > > use of the individual or entity to whom it is addressed and others
> > >> > > authorized to receive it. It may contain confidential or legally
> > >> > privileged
> > >> > > information. If you are not the intended recipient you are hereby
> > >> > notified
> > >> > > that any disclosure, copying, distribution or taking any action in
> > >> > reliance
> > >> > > on the contents of this information is strictly prohibited and may
> > be
> > >> > > unlawful. If you have received this communication in error, please
> > >> notify
> > >> > > us immediately by responding to this email and then delete it from
> > >> your
> > >> > > system. The firm is neither liable for the proper and complete
> > >> > transmission
> > >> > > of the information contained in this communication nor for any
> delay
> > >> in
> > >> > its
> > >> > > receipt.
> > >> > >
> > >> >
> > >>
> > >> --
> > >> _____________________________________________________________
> > >> The information contained in this communication is intended solely for
> > the
> > >> use of the individual or entity to whom it is addressed and others
> > >> authorized to receive it. It may contain confidential or legally
> > >> privileged
> > >> information. If you are not the intended recipient you are hereby
> > notified
> > >> that any disclosure, copying, distribution or taking any action in
> > >> reliance
> > >> on the contents of this information is strictly prohibited and may be
> > >> unlawful. If you have received this communication in error, please
> > notify
> > >> us immediately by responding to this email and then delete it from
> your
> > >> system. The firm is neither liable for the proper and complete
> > >> transmission
> > >> of the information contained in this communication nor for any delay
> in
> > >> its
> > >> receipt.
> > >>
> > >
> > >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
Re: Java action in Ooozie
Posted by Jaydeep Vishwakarma <ja...@inmobi.com>.
You are doing -log. Can you give the command as below and get the job url
(application launcher url).
*oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node*
On Wed, Nov 4, 2015 at 5:53 PM, Jeetendra G <je...@housing.com> wrote:
> and in job error log tab its saying error log is disables? by default why
> error log is disables? i am using hortonworks
>
> On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > same error.
> >
> > 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
> > [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry state :
> > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action status=DONE
> > 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> > [***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated in
> DB!
> > 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No Notification URL
> > is defined. Therefore nothing to notify for job
> > 0000004-151104124010010-oozie-oozi-W@:start:
> > 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL is
> > defined. Therefore nothing to notify for job
> > 0000004-151104124010010-oozie-oozi-W
> > 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start action
> > [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry state :
> > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking action,
> > hadoop job ID [job_1446620926630_0016] status [RUNNING]
> > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> > status=RUNNING
> > 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> > [***0000004-151104124010010-oozie-oozi-W@java-node***]Action updated in
> > DB!
> > 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification
> > URL is defined. Therefore nothing to notify for job
> > 0000004-151104124010010-oozie-oozi-W@java-node
> > 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback for
> > action [0000004-151104124010010-oozie-oozi-W@java-node]
> > 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action completed,
> > external ID [job_1446620926630_0016]
> > 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> > [0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
> > userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > [***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
> > 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@end]
> > [***0000004-151104124010010-oozie-oozi-W@end***]Action updated in DB!
> > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification URL is
> > defined. Therefore nothing to notify for job
> > 0000004-151104124010010-oozie-oozi-W@end
> > 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL is
> > defined. Therefore nothing to notify for job
> > 0000004-151104124010010-oozie-oozi-W
> > 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000004-151104124010010-oozie-oozi-W]
> > ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification
> > URL is defined. Therefore nothing to notify for job
> > 0000004-151104124010010-oozie-oozi-W@java-node
> >
> >
> >
> > On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> > jaydeep.vishwakarma@inmobi.com> wrote:
> >
> >> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> >> There you will find "Console URL" , Open that URL on browser. You will
> get
> >> the Launcher mapper logs.
> >>
> >>
> >>
> >> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <je...@housing.com>
> >> wrote:
> >>
> >> > This is the log i am getting repeatedly
> >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > JOB[0000040-151015123257993-oozie-oozi-W]
> >> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification
> >> URL
> >> > is
> >> > defined. Therefore nothing to notify for job
> >> > 0000040-151015123257993-oozie-oozi-W@:start:
> >> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> >> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL
> >> is
> >> > defined. Therefore nothing to notify for job
> >> > 0000040-151015123257993-oozie-oozi-W
> >> >
> >> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> >> > jaydeep.vishwakarma@inmobi.com> wrote:
> >> >
> >> > > Have you checked Launcher Mapper logs?. What it says?
> >> > >
> >> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <
> jeetendra.g@housing.com>
> >> > > wrote:
> >> > >
> >> > > > does anybody have any idea? i have been trying this from 10 days
> >> > nothing
> >> > > > worked out.
> >> > > >
> >> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> >> jeetendra.g@housing.com>
> >> > > > wrote:
> >> > > >
> >> > > > > my workflow.xml
> >> > > > >
> >> > > > >
> >> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2"
> name="java-main-wf">
> >> > > > > <start to="java-node"/>
> >> > > > > <action name="java-node">
> >> > > > > <java>
> >> > > > > <job-tracker>${jobTracker}</job-tracker>
> >> > > > > <name-node>${nameNode}</name-node>
> >> > > > >
> <main-class>com.housing.common.JSONMerger</main-class>
> >> > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> >> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> >> > > > > -Dyyyymmdd=20151029</java-opts>
> >> > > > >
> >> > > > > </java>
> >> > > > > <ok to="end"/>
> >> > > > > <error to="fail"/>
> >> > > > > </action>
> >> > > > > <kill name="fail">
> >> > > > > <message>Java failed, error
> >> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> >> > > > > </kill>
> >> > > > > <end name="end"/>
> >> > > > > </workflow-app>
> >> > > > >
> >> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> >> > jeetendra.g@housing.com>
> >> > > > > wrote:
> >> > > > >
> >> > > > >> Hi All,
> >> > > > >>
> >> > > > >> I am running java workflow job using oozie.
> >> > > > >> I have Ambari server and I have installed oozie from Ambari.
> >> > > > >> When i ran the job it say succeeded but its not running my java
> >> > class
> >> > > > >> which I mentioned inside workflow.xml. Also when I get oozie
> >> > nothing
> >> > > > can
> >> > > > >> be find pasting log beow, can anybody help here?
> >> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
> >> > > > >> 0000040-151015123257993-oozie-oozi-W
> >> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start
> >> action
> >> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with user-retry
> >> > state
> >> > > :
> >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> >> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> >> > > status=DONE
> >> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> >> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> >> updated
> >> > in
> >> > > > DB!
> >> > > > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520
> -
> >> > > SERVER[
> >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> >> > Notification
> >> > > > URL
> >> > > > >> is defined. Therefore nothing to notify for job
> >> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> >> > > > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520
> -
> >> > > SERVER[
> >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> >> Notification
> >> > URL
> >> > > > is
> >> > > > >> defined. Therefore nothing to notify for job
> >> > > > >> 0000040-151015123257993-oozie-oozi-W
> >> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start
> >> action
> >> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with
> user-retry
> >> > > state
> >> > > > :
> >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> >> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> checking
> >> > > action,
> >> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> >> > > > >> status=RUNNING
> >> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> >> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> >> > updated
> >> > > in
> >> > > > >> DB!
> >> > > > >> 2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520
> -
> >> > > SERVER[
> >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> >> > > Notification
> >> > > > >> URL is defined. Therefore nothing to notify for job
> >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> >> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> callback
> >> for
> >> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> >> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action
> >> > > > completed,
> >> > > > >> external ID [job_1444892488693_0073]
> >> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
> >> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry
> >> state :
> >> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> >> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> >> status=DONE
> >> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
> >> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> >> APP[java-main-wf]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> >> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action updated
> >> in
> >> > DB!
> >> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520
> -
> >> > > SERVER[
> >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No
> Notification
> >> > URL
> >> > > is
> >> > > > >> defined. Therefore nothing to notify for job
> >> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> >> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520
> -
> >> > > SERVER[
> >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
> >> Notification
> >> > URL
> >> > > > is
> >> > > > >> defined. Therefore nothing to notify for job
> >> > > > >> 0000040-151015123257993-oozie-oozi-W
> >> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520
> -
> >> > > SERVER[
> >> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> >> > > Notification
> >> > > > >> URL is defined. Therefore nothing to notify for job
> >> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> >> > > > >>
> >> > > > >
> >> > > > >
> >> > > >
> >> > >
> >> > > --
> >> > > _____________________________________________________________
> >> > > The information contained in this communication is intended solely
> for
> >> > the
> >> > > use of the individual or entity to whom it is addressed and others
> >> > > authorized to receive it. It may contain confidential or legally
> >> > privileged
> >> > > information. If you are not the intended recipient you are hereby
> >> > notified
> >> > > that any disclosure, copying, distribution or taking any action in
> >> > reliance
> >> > > on the contents of this information is strictly prohibited and may
> be
> >> > > unlawful. If you have received this communication in error, please
> >> notify
> >> > > us immediately by responding to this email and then delete it from
> >> your
> >> > > system. The firm is neither liable for the proper and complete
> >> > transmission
> >> > > of the information contained in this communication nor for any delay
> >> in
> >> > its
> >> > > receipt.
> >> > >
> >> >
> >>
> >> --
> >> _____________________________________________________________
> >> The information contained in this communication is intended solely for
> the
> >> use of the individual or entity to whom it is addressed and others
> >> authorized to receive it. It may contain confidential or legally
> >> privileged
> >> information. If you are not the intended recipient you are hereby
> notified
> >> that any disclosure, copying, distribution or taking any action in
> >> reliance
> >> on the contents of this information is strictly prohibited and may be
> >> unlawful. If you have received this communication in error, please
> notify
> >> us immediately by responding to this email and then delete it from your
> >> system. The firm is neither liable for the proper and complete
> >> transmission
> >> of the information contained in this communication nor for any delay in
> >> its
> >> receipt.
> >>
> >
> >
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
and in job error log tab its saying error log is disables? by default why
error log is disables? i am using hortonworks
On Wed, Nov 4, 2015 at 5:50 PM, Jeetendra G <je...@housing.com> wrote:
> same error.
>
> 2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
> [0000004-151104124010010-oozie-oozi-W@:start:] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> [***0000004-151104124010010-oozie-oozi-W@:start:***]Action status=DONE
> 2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
> [***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated in DB!
> 2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No Notification URL
> is defined. Therefore nothing to notify for job
> 0000004-151104124010010-oozie-oozi-W@:start:
> 2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL is
> defined. Therefore nothing to notify for job
> 0000004-151104124010010-oozie-oozi-W
> 2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start action
> [0000004-151104124010010-oozie-oozi-W@java-node] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking action,
> hadoop job ID [job_1446620926630_0016] status [RUNNING]
> 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> [***0000004-151104124010010-oozie-oozi-W@java-node***]Action
> status=RUNNING
> 2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
> [***0000004-151104124010010-oozie-oozi-W@java-node***]Action updated in
> DB!
> 2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification
> URL is defined. Therefore nothing to notify for job
> 0000004-151104124010010-oozie-oozi-W@java-node
> 2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback for
> action [0000004-151104124010010-oozie-oozi-W@java-node]
> 2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action completed,
> external ID [job_1446620926630_0016]
> 2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
> [0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@end]
> [***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
> 2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@end]
> [***0000004-151104124010010-oozie-oozi-W@end***]Action updated in DB!
> 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification URL is
> defined. Therefore nothing to notify for job
> 0000004-151104124010010-oozie-oozi-W@end
> 2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL is
> defined. Therefore nothing to notify for job
> 0000004-151104124010010-oozie-oozi-W
> 2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000004-151104124010010-oozie-oozi-W]
> ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification
> URL is defined. Therefore nothing to notify for job
> 0000004-151104124010010-oozie-oozi-W@java-node
>
>
>
> On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
> jaydeep.vishwakarma@inmobi.com> wrote:
>
>> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
>> There you will find "Console URL" , Open that URL on browser. You will get
>> the Launcher mapper logs.
>>
>>
>>
>> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <je...@housing.com>
>> wrote:
>>
>> > This is the log i am getting repeatedly
>> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
>> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > JOB[0000040-151015123257993-oozie-oozi-W]
>> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification
>> URL
>> > is
>> > defined. Therefore nothing to notify for job
>> > 0000040-151015123257993-oozie-oozi-W@:start:
>> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
>> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL
>> is
>> > defined. Therefore nothing to notify for job
>> > 0000040-151015123257993-oozie-oozi-W
>> >
>> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
>> > jaydeep.vishwakarma@inmobi.com> wrote:
>> >
>> > > Have you checked Launcher Mapper logs?. What it says?
>> > >
>> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <je...@housing.com>
>> > > wrote:
>> > >
>> > > > does anybody have any idea? i have been trying this from 10 days
>> > nothing
>> > > > worked out.
>> > > >
>> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
>> jeetendra.g@housing.com>
>> > > > wrote:
>> > > >
>> > > > > my workflow.xml
>> > > > >
>> > > > >
>> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2" name="java-main-wf">
>> > > > > <start to="java-node"/>
>> > > > > <action name="java-node">
>> > > > > <java>
>> > > > > <job-tracker>${jobTracker}</job-tracker>
>> > > > > <name-node>${nameNode}</name-node>
>> > > > > <main-class>com.housing.common.JSONMerger</main-class>
>> > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
>> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
>> > > > > -Dyyyymmdd=20151029</java-opts>
>> > > > >
>> > > > > </java>
>> > > > > <ok to="end"/>
>> > > > > <error to="fail"/>
>> > > > > </action>
>> > > > > <kill name="fail">
>> > > > > <message>Java failed, error
>> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
>> > > > > </kill>
>> > > > > <end name="end"/>
>> > > > > </workflow-app>
>> > > > >
>> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
>> > jeetendra.g@housing.com>
>> > > > > wrote:
>> > > > >
>> > > > >> Hi All,
>> > > > >>
>> > > > >> I am running java workflow job using oozie.
>> > > > >> I have Ambari server and I have installed oozie from Ambari.
>> > > > >> When i ran the job it say succeeded but its not running my java
>> > class
>> > > > >> which I mentioned inside workflow.xml. Also when I get oozie
>> > nothing
>> > > > can
>> > > > >> be find pasting log beow, can anybody help here?
>> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
>> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start
>> action
>> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with user-retry
>> > state
>> > > :
>> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
>> > > status=DONE
>> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
>> updated
>> > in
>> > > > DB!
>> > > > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
>> > > SERVER[
>> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
>> > Notification
>> > > > URL
>> > > > >> is defined. Therefore nothing to notify for job
>> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
>> > > > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
>> > > SERVER[
>> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
>> Notification
>> > URL
>> > > > is
>> > > > >> defined. Therefore nothing to notify for job
>> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start
>> action
>> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with user-retry
>> > > state
>> > > > :
>> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] checking
>> > > action,
>> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
>> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
>> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
>> > > > >> status=RUNNING
>> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
>> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
>> > updated
>> > > in
>> > > > >> DB!
>> > > > >> 2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520 -
>> > > SERVER[
>> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
>> > > Notification
>> > > > >> URL is defined. Therefore nothing to notify for job
>> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
>> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] callback
>> for
>> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
>> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action
>> > > > completed,
>> > > > >> external ID [job_1444892488693_0073]
>> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
>> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry
>> state :
>> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
>> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
>> status=DONE
>> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
>> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
>> APP[java-main-wf]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
>> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action updated
>> in
>> > DB!
>> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
>> > > SERVER[
>> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No Notification
>> > URL
>> > > is
>> > > > >> defined. Therefore nothing to notify for job
>> > > > >> 0000040-151015123257993-oozie-oozi-W@end
>> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
>> > > SERVER[
>> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No
>> Notification
>> > URL
>> > > > is
>> > > > >> defined. Therefore nothing to notify for job
>> > > > >> 0000040-151015123257993-oozie-oozi-W
>> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
>> > > SERVER[
>> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
>> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
>> > > Notification
>> > > > >> URL is defined. Therefore nothing to notify for job
>> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
>> > > > >>
>> > > > >
>> > > > >
>> > > >
>> > >
>> > > --
>> > > _____________________________________________________________
>> > > The information contained in this communication is intended solely for
>> > the
>> > > use of the individual or entity to whom it is addressed and others
>> > > authorized to receive it. It may contain confidential or legally
>> > privileged
>> > > information. If you are not the intended recipient you are hereby
>> > notified
>> > > that any disclosure, copying, distribution or taking any action in
>> > reliance
>> > > on the contents of this information is strictly prohibited and may be
>> > > unlawful. If you have received this communication in error, please
>> notify
>> > > us immediately by responding to this email and then delete it from
>> your
>> > > system. The firm is neither liable for the proper and complete
>> > transmission
>> > > of the information contained in this communication nor for any delay
>> in
>> > its
>> > > receipt.
>> > >
>> >
>>
>> --
>> _____________________________________________________________
>> The information contained in this communication is intended solely for the
>> use of the individual or entity to whom it is addressed and others
>> authorized to receive it. It may contain confidential or legally
>> privileged
>> information. If you are not the intended recipient you are hereby notified
>> that any disclosure, copying, distribution or taking any action in
>> reliance
>> on the contents of this information is strictly prohibited and may be
>> unlawful. If you have received this communication in error, please notify
>> us immediately by responding to this email and then delete it from your
>> system. The firm is neither liable for the proper and complete
>> transmission
>> of the information contained in this communication nor for any delay in
>> its
>> receipt.
>>
>
>
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
same error.
2015-11-04 14:09:00,935 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@:start:] Start action
[0000004-151104124010010-oozie-oozi-W@:start:] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
[***0000004-151104124010010-oozie-oozi-W@:start:***]Action status=DONE
2015-11-04 14:09:00,940 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@:start:]
[***0000004-151104124010010-oozie-oozi-W@:start:***]Action updated in DB!
2015-11-04 14:09:00,994 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@:start:] No Notification URL is
defined. Therefore nothing to notify for job
0000004-151104124010010-oozie-oozi-W@:start:
2015-11-04 14:09:01,004 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL is
defined. Therefore nothing to notify for job
0000004-151104124010010-oozie-oozi-W
2015-11-04 14:09:01,014 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@java-node] Start action
[0000004-151104124010010-oozie-oozi-W@java-node] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-11-04 14:09:02,916 INFO JavaActionExecutor:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@java-node] checking action,
hadoop job ID [job_1446620926630_0016] status [RUNNING]
2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
[***0000004-151104124010010-oozie-oozi-W@java-node***]Action status=RUNNING
2015-11-04 14:09:02,918 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@java-node]
[***0000004-151104124010010-oozie-oozi-W@java-node***]Action updated in DB!
2015-11-04 14:09:02,926 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification URL
is defined. Therefore nothing to notify for job
0000004-151104124010010-oozie-oozi-W@java-node
2015-11-04 14:09:17,606 INFO CallbackServlet:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@java-node] callback for action
[0000004-151104124010010-oozie-oozi-W@java-node]
2015-11-04 14:09:17,907 INFO JavaActionExecutor:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@java-node] action completed,
external ID [job_1446620926630_0016]
2015-11-04 14:09:18,029 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@end] Start action
[0000004-151104124010010-oozie-oozi-W@end] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@end]
[***0000004-151104124010010-oozie-oozi-W@end***]Action status=DONE
2015-11-04 14:09:18,034 INFO ActionStartXCommand:520 - SERVER[
hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@end]
[***0000004-151104124010010-oozie-oozi-W@end***]Action updated in DB!
2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@end] No Notification URL is
defined. Therefore nothing to notify for job
0000004-151104124010010-oozie-oozi-W@end
2015-11-04 14:09:18,104 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000004-151104124010010-oozie-oozi-W] ACTION[] No Notification URL is
defined. Therefore nothing to notify for job
0000004-151104124010010-oozie-oozi-W
2015-11-04 14:09:18,105 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000004-151104124010010-oozie-oozi-W]
ACTION[0000004-151104124010010-oozie-oozi-W@java-node] No Notification URL
is defined. Therefore nothing to notify for job
0000004-151104124010010-oozie-oozi-W@java-node
On Wed, Nov 4, 2015 at 4:26 PM, Jaydeep Vishwakarma <
jaydeep.vishwakarma@inmobi.com> wrote:
> oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
> There you will find "Console URL" , Open that URL on browser. You will get
> the Launcher mapper logs.
>
>
>
> On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > This is the log i am getting repeatedly
> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000040-151015123257993-oozie-oozi-W]
> > ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification URL
> > is
> > defined. Therefore nothing to notify for job
> > 0000040-151015123257993-oozie-oozi-W@:start:
> > 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
> > hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
> > defined. Therefore nothing to notify for job
> > 0000040-151015123257993-oozie-oozi-W
> >
> > On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> > jaydeep.vishwakarma@inmobi.com> wrote:
> >
> > > Have you checked Launcher Mapper logs?. What it says?
> > >
> > > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > > > does anybody have any idea? i have been trying this from 10 days
> > nothing
> > > > worked out.
> > > >
> > > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <
> jeetendra.g@housing.com>
> > > > wrote:
> > > >
> > > > > my workflow.xml
> > > > >
> > > > >
> > > > > <workflow-app xmlns="uri:oozie:workflow:0.2" name="java-main-wf">
> > > > > <start to="java-node"/>
> > > > > <action name="java-node">
> > > > > <java>
> > > > > <job-tracker>${jobTracker}</job-tracker>
> > > > > <name-node>${nameNode}</name-node>
> > > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > > -Dyyyymmdd=20151029</java-opts>
> > > > >
> > > > > </java>
> > > > > <ok to="end"/>
> > > > > <error to="fail"/>
> > > > > </action>
> > > > > <kill name="fail">
> > > > > <message>Java failed, error
> > > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > > </kill>
> > > > > <end name="end"/>
> > > > > </workflow-app>
> > > > >
> > > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> > jeetendra.g@housing.com>
> > > > > wrote:
> > > > >
> > > > >> Hi All,
> > > > >>
> > > > >> I am running java workflow job using oozie.
> > > > >> I have Ambari server and I have installed oozie from Ambari.
> > > > >> When i ran the job it say succeeded but its not running my java
> > class
> > > > >> which I mentioned inside workflow.xml. Also when I get oozie
> > nothing
> > > > can
> > > > >> be find pasting log beow, can anybody help here?
> > > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start action
> > > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with user-retry
> > state
> > > :
> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> > > status=DONE
> > > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> updated
> > in
> > > > DB!
> > > > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> > Notification
> > > > URL
> > > > >> is defined. Therefore nothing to notify for job
> > > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > > is
> > > > >> defined. Therefore nothing to notify for job
> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start
> action
> > > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with user-retry
> > > state
> > > > :
> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] checking
> > > action,
> > > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> > > > >> status=RUNNING
> > > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> > updated
> > > in
> > > > >> DB!
> > > > >> 2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > > Notification
> > > > >> URL is defined. Therefore nothing to notify for job
> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] callback
> for
> > > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action
> > > > completed,
> > > > >> external ID [job_1444892488693_0073]
> > > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
> > > > >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry state
> :
> > > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action
> status=DONE
> > > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
> > > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[]
> APP[java-main-wf]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action updated in
> > DB!
> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No Notification
> > URL
> > > is
> > > > >> defined. Therefore nothing to notify for job
> > > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification
> > URL
> > > > is
> > > > >> defined. Therefore nothing to notify for job
> > > > >> 0000040-151015123257993-oozie-oozi-W
> > > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> > > SERVER[
> > > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > > Notification
> > > > >> URL is defined. Therefore nothing to notify for job
> > > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> > > --
> > > _____________________________________________________________
> > > The information contained in this communication is intended solely for
> > the
> > > use of the individual or entity to whom it is addressed and others
> > > authorized to receive it. It may contain confidential or legally
> > privileged
> > > information. If you are not the intended recipient you are hereby
> > notified
> > > that any disclosure, copying, distribution or taking any action in
> > reliance
> > > on the contents of this information is strictly prohibited and may be
> > > unlawful. If you have received this communication in error, please
> notify
> > > us immediately by responding to this email and then delete it from your
> > > system. The firm is neither liable for the proper and complete
> > transmission
> > > of the information contained in this communication nor for any delay in
> > its
> > > receipt.
> > >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
Re: Java action in Ooozie
Posted by Jaydeep Vishwakarma <ja...@inmobi.com>.
oozie job -info 0000040-151015123257993-oozie-oozi-W@java-node
There you will find "Console URL" , Open that URL on browser. You will get
the Launcher mapper logs.
On Wed, Nov 4, 2015 at 4:13 PM, Jeetendra G <je...@housing.com> wrote:
> This is the log i am getting repeatedly
> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification URL
> is
> defined. Therefore nothing to notify for job
> 0000040-151015123257993-oozie-oozi-W@:start:
> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
> defined. Therefore nothing to notify for job
> 0000040-151015123257993-oozie-oozi-W
>
> On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
> jaydeep.vishwakarma@inmobi.com> wrote:
>
> > Have you checked Launcher Mapper logs?. What it says?
> >
> > On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > does anybody have any idea? i have been trying this from 10 days
> nothing
> > > worked out.
> > >
> > > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > > > my workflow.xml
> > > >
> > > >
> > > > <workflow-app xmlns="uri:oozie:workflow:0.2" name="java-main-wf">
> > > > <start to="java-node"/>
> > > > <action name="java-node">
> > > > <java>
> > > > <job-tracker>${jobTracker}</job-tracker>
> > > > <name-node>${nameNode}</name-node>
> > > > <main-class>com.housing.common.JSONMerger</main-class>
> > > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > > -Dyyyymmdd=20151029</java-opts>
> > > >
> > > > </java>
> > > > <ok to="end"/>
> > > > <error to="fail"/>
> > > > </action>
> > > > <kill name="fail">
> > > > <message>Java failed, error
> > > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > > </kill>
> > > > <end name="end"/>
> > > > </workflow-app>
> > > >
> > > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <
> jeetendra.g@housing.com>
> > > > wrote:
> > > >
> > > >> Hi All,
> > > >>
> > > >> I am running java workflow job using oozie.
> > > >> I have Ambari server and I have installed oozie from Ambari.
> > > >> When i ran the job it say succeeded but its not running my java
> class
> > > >> which I mentioned inside workflow.xml. Also when I get oozie
> nothing
> > > can
> > > >> be find pasting log beow, can anybody help here?
> > > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
> > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start action
> > > >> [0000040-151015123257993-oozie-oozi-W@:start:] with user-retry
> state
> > :
> > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> > status=DONE
> > > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action updated
> in
> > > DB!
> > > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No
> Notification
> > > URL
> > > >> is defined. Therefore nothing to notify for job
> > > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification
> URL
> > > is
> > > >> defined. Therefore nothing to notify for job
> > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start action
> > > >> [0000040-151015123257993-oozie-oozi-W@java-node] with user-retry
> > state
> > > :
> > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] checking
> > action,
> > > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> > > >> status=RUNNING
> > > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> updated
> > in
> > > >> DB!
> > > >> 2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > Notification
> > > >> URL is defined. Therefore nothing to notify for job
> > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] callback for
> > > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action
> > > completed,
> > > >> external ID [job_1444892488693_0073]
> > > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
> > > >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry state :
> > > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action status=DONE
> > > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
> > > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action updated in
> DB!
> > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No Notification
> URL
> > is
> > > >> defined. Therefore nothing to notify for job
> > > >> 0000040-151015123257993-oozie-oozi-W@end
> > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification
> URL
> > > is
> > > >> defined. Therefore nothing to notify for job
> > > >> 0000040-151015123257993-oozie-oozi-W
> > > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> > SERVER[
> > > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> > Notification
> > > >> URL is defined. Therefore nothing to notify for job
> > > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > > >>
> > > >
> > > >
> > >
> >
> > --
> > _____________________________________________________________
> > The information contained in this communication is intended solely for
> the
> > use of the individual or entity to whom it is addressed and others
> > authorized to receive it. It may contain confidential or legally
> privileged
> > information. If you are not the intended recipient you are hereby
> notified
> > that any disclosure, copying, distribution or taking any action in
> reliance
> > on the contents of this information is strictly prohibited and may be
> > unlawful. If you have received this communication in error, please notify
> > us immediately by responding to this email and then delete it from your
> > system. The firm is neither liable for the proper and complete
> transmission
> > of the information contained in this communication nor for any delay in
> its
> > receipt.
> >
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
This is the log i am getting repeatedly
2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W]
ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification URL is
defined. Therefore nothing to notify for job
0000040-151015123257993-oozie-oozi-W@:start:
2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
defined. Therefore nothing to notify for job
0000040-151015123257993-oozie-oozi-W
On Wed, Nov 4, 2015 at 4:11 PM, Jaydeep Vishwakarma <
jaydeep.vishwakarma@inmobi.com> wrote:
> Have you checked Launcher Mapper logs?. What it says?
>
> On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > does anybody have any idea? i have been trying this from 10 days nothing
> > worked out.
> >
> > On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> > > my workflow.xml
> > >
> > >
> > > <workflow-app xmlns="uri:oozie:workflow:0.2" name="java-main-wf">
> > > <start to="java-node"/>
> > > <action name="java-node">
> > > <java>
> > > <job-tracker>${jobTracker}</job-tracker>
> > > <name-node>${nameNode}</name-node>
> > > <main-class>com.housing.common.JSONMerger</main-class>
> > > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > > -Dyyyymmdd=20151029</java-opts>
> > >
> > > </java>
> > > <ok to="end"/>
> > > <error to="fail"/>
> > > </action>
> > > <kill name="fail">
> > > <message>Java failed, error
> > > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > > </kill>
> > > <end name="end"/>
> > > </workflow-app>
> > >
> > > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <je...@housing.com>
> > > wrote:
> > >
> > >> Hi All,
> > >>
> > >> I am running java workflow job using oozie.
> > >> I have Ambari server and I have installed oozie from Ambari.
> > >> When i ran the job it say succeeded but its not running my java class
> > >> which I mentioned inside workflow.xml. Also when I get oozie nothing
> > can
> > >> be find pasting log beow, can anybody help here?
> > >> oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
> > >> 0000040-151015123257993-oozie-oozi-W
> > >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start action
> > >> [0000040-151015123257993-oozie-oozi-W@:start:] with user-retry state
> :
> > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action
> status=DONE
> > >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> > >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action updated in
> > DB!
> > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification
> > URL
> > >> is defined. Therefore nothing to notify for job
> > >> 0000040-151015123257993-oozie-oozi-W@:start:
> > >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL
> > is
> > >> defined. Therefore nothing to notify for job
> > >> 0000040-151015123257993-oozie-oozi-W
> > >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start action
> > >> [0000040-151015123257993-oozie-oozi-W@java-node] with user-retry
> state
> > :
> > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] checking
> action,
> > >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> > >> status=RUNNING
> > >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> > >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action updated
> in
> > >> DB!
> > >> 2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> Notification
> > >> URL is defined. Therefore nothing to notify for job
> > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] callback for
> > >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> > >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action
> > completed,
> > >> external ID [job_1444892488693_0073]
> > >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
> > >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry state :
> > >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> > >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action status=DONE
> > >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
> > >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> > >> [***0000040-151015123257993-oozie-oozi-W@end***]Action updated in DB!
> > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No Notification URL
> is
> > >> defined. Therefore nothing to notify for job
> > >> 0000040-151015123257993-oozie-oozi-W@end
> > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL
> > is
> > >> defined. Therefore nothing to notify for job
> > >> 0000040-151015123257993-oozie-oozi-W
> > >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 -
> SERVER[
> > >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> > >> JOB[0000040-151015123257993-oozie-oozi-W]
> > >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No
> Notification
> > >> URL is defined. Therefore nothing to notify for job
> > >> 0000040-151015123257993-oozie-oozi-W@java-node
> > >>
> > >
> > >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
Re: Java action in Ooozie
Posted by Jaydeep Vishwakarma <ja...@inmobi.com>.
Have you checked Launcher Mapper logs?. What it says?
On Wed, Nov 4, 2015 at 4:04 PM, Jeetendra G <je...@housing.com> wrote:
> does anybody have any idea? i have been trying this from 10 days nothing
> worked out.
>
> On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <je...@housing.com>
> wrote:
>
> > my workflow.xml
> >
> >
> > <workflow-app xmlns="uri:oozie:workflow:0.2" name="java-main-wf">
> > <start to="java-node"/>
> > <action name="java-node">
> > <java>
> > <job-tracker>${jobTracker}</job-tracker>
> > <name-node>${nameNode}</name-node>
> > <main-class>com.housing.common.JSONMerger</main-class>
> > <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> > 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> > -Dyyyymmdd=20151029</java-opts>
> >
> > </java>
> > <ok to="end"/>
> > <error to="fail"/>
> > </action>
> > <kill name="fail">
> > <message>Java failed, error
> > message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> > </kill>
> > <end name="end"/>
> > </workflow-app>
> >
> > On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <je...@housing.com>
> > wrote:
> >
> >> Hi All,
> >>
> >> I am running java workflow job using oozie.
> >> I have Ambari server and I have installed oozie from Ambari.
> >> When i ran the job it say succeeded but its not running my java class
> >> which I mentioned inside workflow.xml. Also when I get oozie nothing
> can
> >> be find pasting log beow, can anybody help here?
> >> oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
> >> 0000040-151015123257993-oozie-oozi-W
> >> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start action
> >> [0000040-151015123257993-oozie-oozi-W@:start:] with user-retry state :
> >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action status=DONE
> >> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> >> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action updated in
> DB!
> >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification
> URL
> >> is defined. Therefore nothing to notify for job
> >> 0000040-151015123257993-oozie-oozi-W@:start:
> >> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL
> is
> >> defined. Therefore nothing to notify for job
> >> 0000040-151015123257993-oozie-oozi-W
> >> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start action
> >> [0000040-151015123257993-oozie-oozi-W@java-node] with user-retry state
> :
> >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> >> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] checking action,
> >> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> >> status=RUNNING
> >> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> >> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action updated in
> >> DB!
> >> 2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No Notification
> >> URL is defined. Therefore nothing to notify for job
> >> 0000040-151015123257993-oozie-oozi-W@java-node
> >> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] callback for
> >> action [0000040-151015123257993-oozie-oozi-W@java-node]
> >> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action
> completed,
> >> external ID [job_1444892488693_0073]
> >> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
> >> [0000040-151015123257993-oozie-oozi-W@end] with user-retry state :
> >> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> >> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> >> [***0000040-151015123257993-oozie-oozi-W@end***]Action status=DONE
> >> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> >> [***0000040-151015123257993-oozie-oozi-W@end***]Action updated in DB!
> >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@end] No Notification URL is
> >> defined. Therefore nothing to notify for job
> >> 0000040-151015123257993-oozie-oozi-W@end
> >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL
> is
> >> defined. Therefore nothing to notify for job
> >> 0000040-151015123257993-oozie-oozi-W
> >> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
> >> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> >> JOB[0000040-151015123257993-oozie-oozi-W]
> >> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No Notification
> >> URL is defined. Therefore nothing to notify for job
> >> 0000040-151015123257993-oozie-oozi-W@java-node
> >>
> >
> >
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
does anybody have any idea? i have been trying this from 10 days nothing
worked out.
On Thu, Oct 29, 2015 at 6:02 PM, Jeetendra G <je...@housing.com>
wrote:
> my workflow.xml
>
>
> <workflow-app xmlns="uri:oozie:workflow:0.2" name="java-main-wf">
> <start to="java-node"/>
> <action name="java-node">
> <java>
> <job-tracker>${jobTracker}</job-tracker>
> <name-node>${nameNode}</name-node>
> <main-class>com.housing.common.JSONMerger</main-class>
> <java-opts>-Dhadoop.custom.configuration.file=hdfs://
> 10.1.6.186:8020/configuration/jsonmerger-dev.conf
> -Dyyyymmdd=20151029</java-opts>
>
> </java>
> <ok to="end"/>
> <error to="fail"/>
> </action>
> <kill name="fail">
> <message>Java failed, error
> message[${wf:errorMessage(wf:lastErrorNode())}]</message>
> </kill>
> <end name="end"/>
> </workflow-app>
>
> On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <je...@housing.com>
> wrote:
>
>> Hi All,
>>
>> I am running java workflow job using oozie.
>> I have Ambari server and I have installed oozie from Ambari.
>> When i ran the job it say succeeded but its not running my java class
>> which I mentioned inside workflow.xml. Also when I get oozie nothing can
>> be find pasting log beow, can anybody help here?
>> oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
>> 0000040-151015123257993-oozie-oozi-W
>> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start action
>> [0000040-151015123257993-oozie-oozi-W@:start:] with user-retry state :
>> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action status=DONE
>> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
>> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action updated in DB!
>> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification URL
>> is defined. Therefore nothing to notify for job
>> 0000040-151015123257993-oozie-oozi-W@:start:
>> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
>> defined. Therefore nothing to notify for job
>> 0000040-151015123257993-oozie-oozi-W
>> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start action
>> [0000040-151015123257993-oozie-oozi-W@java-node] with user-retry state :
>> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] checking action,
>> hadoop job ID [job_1444892488693_0073] status [RUNNING]
>> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
>> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
>> status=RUNNING
>> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
>> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action updated in
>> DB!
>> 2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No Notification
>> URL is defined. Therefore nothing to notify for job
>> 0000040-151015123257993-oozie-oozi-W@java-node
>> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
>> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] callback for
>> action [0000040-151015123257993-oozie-oozi-W@java-node]
>> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action completed,
>> external ID [job_1444892488693_0073]
>> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
>> [0000040-151015123257993-oozie-oozi-W@end] with user-retry state :
>> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@end]
>> [***0000040-151015123257993-oozie-oozi-W@end***]Action status=DONE
>> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@end]
>> [***0000040-151015123257993-oozie-oozi-W@end***]Action updated in DB!
>> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@end] No Notification URL is
>> defined. Therefore nothing to notify for job
>> 0000040-151015123257993-oozie-oozi-W@end
>> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
>> defined. Therefore nothing to notify for job
>> 0000040-151015123257993-oozie-oozi-W
>> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
>> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
>> JOB[0000040-151015123257993-oozie-oozi-W]
>> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No Notification
>> URL is defined. Therefore nothing to notify for job
>> 0000040-151015123257993-oozie-oozi-W@java-node
>>
>
>
Re: Java action in Ooozie
Posted by Jeetendra G <je...@housing.com>.
my workflow.xml
<workflow-app xmlns="uri:oozie:workflow:0.2" name="java-main-wf">
<start to="java-node"/>
<action name="java-node">
<java>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<main-class>com.housing.common.JSONMerger</main-class>
<java-opts>-Dhadoop.custom.configuration.file=hdfs://
10.1.6.186:8020/configuration/jsonmerger-dev.conf
-Dyyyymmdd=20151029</java-opts>
</java>
<ok to="end"/>
<error to="fail"/>
</action>
<kill name="fail">
<message>Java failed, error
message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>
On Thu, Oct 29, 2015 at 4:53 PM, Jeetendra G <je...@housing.com>
wrote:
> Hi All,
>
> I am running java workflow job using oozie.
> I have Ambari server and I have installed oozie from Ambari.
> When i ran the job it say succeeded but its not running my java class
> which I mentioned inside workflow.xml. Also when I get oozie nothing can
> be find pasting log beow, can anybody help here?
> oozie job -oozie http://hadoop03.housing.com:11000/oozie -log
> 0000040-151015123257993-oozie-oozi-W
> 2015-10-29 16:39:11,058 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] Start action
> [0000040-151015123257993-oozie-oozi-W@:start:] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action status=DONE
> 2015-10-29 16:39:11,061 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@:start:]
> [***0000040-151015123257993-oozie-oozi-W@:start:***]Action updated in DB!
> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@:start:] No Notification URL
> is defined. Therefore nothing to notify for job
> 0000040-151015123257993-oozie-oozi-W@:start:
> 2015-10-29 16:39:11,095 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
> defined. Therefore nothing to notify for job
> 0000040-151015123257993-oozie-oozi-W
> 2015-10-29 16:39:11,107 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] Start action
> [0000040-151015123257993-oozie-oozi-W@java-node] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2015-10-29 16:39:12,222 INFO JavaActionExecutor:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] checking action,
> hadoop job ID [job_1444892488693_0073] status [RUNNING]
> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action
> status=RUNNING
> 2015-10-29 16:39:12,224 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node]
> [***0000040-151015123257993-oozie-oozi-W@java-node***]Action updated in
> DB!
> 2015-10-29 16:39:12,229 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No Notification
> URL is defined. Therefore nothing to notify for job
> 0000040-151015123257993-oozie-oozi-W@java-node
> 2015-10-29 16:39:25,192 INFO CallbackServlet:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] callback for
> action [0000040-151015123257993-oozie-oozi-W@java-node]
> 2015-10-29 16:39:25,393 INFO JavaActionExecutor:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] action completed,
> external ID [job_1444892488693_0073]
> 2015-10-29 16:39:25,462 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@end] Start action
> [0000040-151015123257993-oozie-oozi-W@end] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2015-10-29 16:39:25,464 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> [***0000040-151015123257993-oozie-oozi-W@end***]Action status=DONE
> 2015-10-29 16:39:25,465 INFO ActionStartXCommand:520 - SERVER[
> hadoop03.housing.com] USER[hdfs] GROUP[-] TOKEN[] APP[java-main-wf]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@end]
> [***0000040-151015123257993-oozie-oozi-W@end***]Action updated in DB!
> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@end] No Notification URL is
> defined. Therefore nothing to notify for job
> 0000040-151015123257993-oozie-oozi-W@end
> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W] ACTION[] No Notification URL is
> defined. Therefore nothing to notify for job
> 0000040-151015123257993-oozie-oozi-W
> 2015-10-29 16:39:25,522 INFO WorkflowNotificationXCommand:520 - SERVER[
> hadoop03.housing.com] USER[-] GROUP[-] TOKEN[-] APP[-]
> JOB[0000040-151015123257993-oozie-oozi-W]
> ACTION[0000040-151015123257993-oozie-oozi-W@java-node] No Notification
> URL is defined. Therefore nothing to notify for job
> 0000040-151015123257993-oozie-oozi-W@java-node
>