You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Li Yang <li...@apache.org> on 2017/02/04 09:47:00 UTC
Re: kylin build cube failed at step12 with counter errors
> Failed map tasks=4
You want to analyze the failed map tasks. Try dig in the mapper task log.
Cheers
On Wed, Jan 25, 2017 at 8:42 AM, BigdataGR <bi...@gmail.com> wrote:
> Hi,
>
> I have installed kylin 1.6 on hortonworks sandbox and have created a my own
> cube but build cube is failing with below error.
>
> Counters: 16
> Job Counters
> Failed map tasks=4
> Killed reduce tasks=1
> Launched map tasks=4
> Other local map tasks=3
> Data-local map tasks=1
> Total time spent by all maps in occupied slots (ms)=39075
> Total time spent by all reduces in occupied slots (ms)=0
> Total time spent by all map tasks (ms)=7815
> Total time spent by all reduce tasks (ms)=0
> Total vcore-seconds taken by all map tasks=7815
> Total vcore-seconds taken by all reduce tasks=0
> Total megabyte-seconds taken by all map tasks=8002560
> Total megabyte-seconds taken by all reduce tasks=0
> Map-Reduce Framework
> CPU time spent (ms)=0
> Physical memory (bytes) snapshot=0
> Virtual memory (bytes) snapshot=0
>
>
> Here is the log i took from mapr job
>
> 2017-01-25 00:22:05,475 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for
> application appattempt_1485302663172_0006_000001
> 2017-01-25 00:22:06,129 WARN [main] org.apache.hadoop.util.
> NativeCodeLoader:
> Unable to load native-hadoop library for your platform... using
> builtin-java
> classes where applicable
> 2017-01-25 00:22:06,221 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
> 2017-01-25 00:22:06,384 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN,
> Service: , Ident: (appAttemptId { application_id { id: 6 cluster_timestamp:
> 1485302663172 } attemptId: 1 } keyId: 832873100)
> 2017-01-25 00:22:06,408 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred
> newApiCommitter.
> 2017-01-25 00:22:06,411 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
> config null
> 2017-01-25 00:22:06,473 INFO [main]
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output
> Committer Algorithm version is 1
> 2017-01-25 00:22:06,473 INFO [main]
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:
> FileOutputCommitter skip cleanup _temporary folders under output
> directory:false, ignore cleanup failures: false
> 2017-01-25 00:22:07,459 WARN [main]
> org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit
> local reads feature cannot be used because libhadoop cannot be loaded.
> 2017-01-25 00:22:07,469 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 2017-01-25 00:22:07,661 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.jobhistory.EventType for class
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> 2017-01-25 00:22:07,662 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> 2017-01-25 00:22:07,663 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> 2017-01-25 00:22:07,664 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> 2017-01-25 00:22:07,664 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> 2017-01-25 00:22:07,665 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> 2017-01-25 00:22:07,665 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> 2017-01-25 00:22:07,666 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> for
> class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$
> ContainerLauncherRouter
> 2017-01-25 00:22:07,689 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
> system is set solely by core-default.xml therefore - ignoring
> 2017-01-25 00:22:07,710 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
> system is set solely by core-default.xml therefore - ignoring
> 2017-01-25 00:22:07,735 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
> system is set solely by core-default.xml therefore - ignoring
> 2017-01-25 00:22:07,760 INFO [main]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting
> job
> history data to the timeline server is not enabled
> 2017-01-25 00:22:07,804 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> 2017-01-25 00:22:08,150 WARN [main]
> org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> configuration:
> tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> 2017-01-25 00:22:08,290 INFO [main]
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period
> at 10 second(s).
> 2017-01-25 00:22:08,290 INFO [main]
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
> system started
> 2017-01-25 00:22:08,298 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for
> job_1485302663172_0006 to jobTokenSecretManager
> 2017-01-25 00:22:08,444 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
> job_1485302663172_0006 because: not enabled; too much RAM;
> 2017-01-25 00:22:08,460 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job
> job_1485302663172_0006 = 439. Number of splits = 1
> 2017-01-25 00:22:08,461 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for
> job job_1485302663172_0006 = 1
> 2017-01-25 00:22:08,461 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1485302663172_0006Job Transitioned from NEW to INITED
> 2017-01-25 00:22:08,462 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
> normal, non-uberized, multi-container job job_1485302663172_0006.
> 2017-01-25 00:22:08,490 INFO [main] org.apache.hadoop.ipc.
> CallQueueManager:
> Using callQueue class java.util.concurrent.LinkedBlockingQueue
> 2017-01-25 00:22:08,509 INFO [Socket Reader #1 for port 51481]
> org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 51481
> 2017-01-25 00:22:08,542 INFO [main]
> org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding
> protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the
> server
> 2017-01-25 00:22:08,543 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> 2017-01-25 00:22:08,548 INFO [IPC Server listener on 51481]
> org.apache.hadoop.ipc.Server: IPC Server listener on 51481: starting
> 2017-01-25 00:22:08,552 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated
> MRClientService at sandbox.hortonworks.com/10.0.2.15:51481
> 2017-01-25 00:22:08,701 INFO [main] org.mortbay.log: Logging to
> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> org.mortbay.log.Slf4jLog
> 2017-01-25 00:22:08,727 INFO [main]
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> Unable to initialize FileSignerSecretProvider, falling back to use random
> secrets.
> 2017-01-25 00:22:08,734 WARN [main] org.apache.hadoop.http.HttpRequestLog:
> Jetty request log can only be enabled using Log4j
> 2017-01-25 00:22:08,740 INFO [main] org.apache.hadoop.http.HttpServer2:
> Added global filter 'safety'
> (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> 2017-01-25 00:22:08,746 INFO [main] org.apache.hadoop.http.HttpServer2:
> Added filter AM_PROXY_FILTER
> (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> context mapreduce
> 2017-01-25 00:22:08,747 INFO [main] org.apache.hadoop.http.HttpServer2:
> Added filter AM_PROXY_FILTER
> (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> context static
> 2017-01-25 00:22:08,751 INFO [main] org.apache.hadoop.http.HttpServer2:
> adding path spec: /mapreduce/*
> 2017-01-25 00:22:08,751 INFO [main] org.apache.hadoop.http.HttpServer2:
> adding path spec: /ws/*
> 2017-01-25 00:22:09,103 INFO [main] org.apache.hadoop.yarn.webapp.WebApps:
> Registered webapp guice modules
> 2017-01-25 00:22:09,105 INFO [main] org.apache.hadoop.http.HttpServer2:
> Jetty bound to port 39514
> 2017-01-25 00:22:09,105 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
> 2017-01-25 00:22:09,142 INFO [main] org.mortbay.log: Extract
> jar:file:/hadoop/yarn/local/filecache/11/mapreduce.tar.gz/
> hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.4.
> 0.0-169.jar!/webapps/mapreduce
> to
> /hadoop/yarn/local/usercache/root/appcache/application_
> 1485302663172_0006/container_e69_1485302663172_0006_01_
> 000001/tmp/Jetty_0_0_0_0_39514_mapreduce____1jyrk7/webapp
> 2017-01-25 00:22:10,519 INFO [main] org.mortbay.log: Started
> HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:39514
> 2017-01-25 00:22:10,520 INFO [main] org.apache.hadoop.yarn.webapp.WebApps:
> Web app mapreduce started at 39514
> 2017-01-25 00:22:10,530 INFO [main] org.apache.hadoop.ipc.
> CallQueueManager:
> Using callQueue class java.util.concurrent.LinkedBlockingQueue
> 2017-01-25 00:22:10,531 INFO [Socket Reader #1 for port 48188]
> org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 48188
> 2017-01-25 00:22:10,536 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> 2017-01-25 00:22:10,536 INFO [IPC Server listener on 48188]
> org.apache.hadoop.ipc.Server: IPC Server listener on 48188: starting
> 2017-01-25 00:22:10,571 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> nodeBlacklistingEnabled:true
> 2017-01-25 00:22:10,571 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> maxTaskFailuresPerNode is 3
> 2017-01-25 00:22:10,571 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> blacklistDisablePercent is 33
> 2017-01-25 00:22:10,619 INFO [main] org.apache.hadoop.yarn.client.RMProxy:
> Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8030
> 2017-01-25 00:22:10,701 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> maxContainerCapability: <memory:2250, vCores:8>
> 2017-01-25 00:22:10,701 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
> 2017-01-25 00:22:10,706 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper
> limit on the thread pool size is 500
> 2017-01-25 00:22:10,706 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
> thread pool initial size is 10
> 2017-01-25 00:22:10,711 INFO [main]
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> yarn.client.max-cached-nodemanagers-proxies : 0
> 2017-01-25 00:22:10,720 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1485302663172_0006Job Transitioned from INITED to SETUP
> 2017-01-25 00:22:10,721 INFO [CommitterEvent Processor #0]
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> Processing
> the event EventType: JOB_SETUP
> 2017-01-25 00:22:10,732 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1485302663172_0006Job Transitioned from SETUP to RUNNING
> 2017-01-25 00:22:10,813 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.yarn.util.RackResolver: Resolved sandbox.hortonworks.com
> to /default-rack
> 2017-01-25 00:22:10,816 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1485302663172_0006_m_000000 Task Transitioned from NEW to SCHEDULED
> 2017-01-25 00:22:10,817 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1485302663172_0006_r_000000 Task Transitioned from NEW to SCHEDULED
> 2017-01-25 00:22:10,819 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from NEW to
> UNASSIGNED
> 2017-01-25 00:22:10,819 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_r_000000_0 TaskAttempt Transitioned from NEW to
> UNASSIGNED
> 2017-01-25 00:22:10,828 INFO [Thread-51]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> mapResourceRequest:<memory:1024, vCores:1>
> 2017-01-25 00:22:10,841 INFO [Thread-51]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> reduceResourceRequest:<memory:250, vCores:1>
> 2017-01-25 00:22:10,842 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
> Writer
> setup for JobId: job_1485302663172_0006, File:
> hdfs://sandbox.hortonworks.com:8020/user/root/.staging/
> job_1485302663172_0006/job_1485302663172_0006_1.jhist
> 2017-01-25 00:22:11,706 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0
> AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0
> HostLocal:0 RackLocal:0
> 2017-01-25 00:22:11,888 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources()
> for application_1485302663172_0006: ask=3 release= 0 newContainers=0
> finishedContainers=0 resourcelimit=<memory:2000, vCores:1> knownNMs=1
> 2017-01-25 00:22:11,891 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
> schedule, headroom=<memory:2000, vCores:1>
> 2017-01-25 00:22:11,892 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
> start threshold not met. completedMapsForReduceSlowstart 1
> 2017-01-25 00:22:12,943 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated
> containers 1
> 2017-01-25 00:22:12,952 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
> container container_e69_1485302663172_0006_01_000002 to
> attempt_1485302663172_0006_m_000000_0
> 2017-01-25 00:22:12,959 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
> schedule, headroom=<memory:750, vCores:1>
> 2017-01-25 00:22:12,960 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
> start threshold not met. completedMapsForReduceSlowstart 1
> 2017-01-25 00:22:12,960 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
> AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
> HostLocal:1 RackLocal:0
> 2017-01-25 00:22:13,118 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.yarn.util.RackResolver: Resolved sandbox.hortonworks.com
> to /default-rack
> 2017-01-25 00:22:13,175 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar
> file on the remote FS is
> hdfs://sandbox.hortonworks.com:8020/user/root/.staging/
> job_1485302663172_0006/job.jar
> 2017-01-25 00:22:13,186 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf
> file on the remote FS is /user/root/.staging/job_
> 1485302663172_0006/job.xml
> 2017-01-25 00:22:13,231 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0
> tokens and #1 secret keys for NM use for launching container
> 2017-01-25 00:22:13,232 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
> containertokens_dob is 1
> 2017-01-25 00:22:13,232 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
> shuffle
> token in serviceData
> 2017-01-25 00:22:13,397 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from
> UNASSIGNED to ASSIGNED
> 2017-01-25 00:22:13,406 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
> container_e69_1485302663172_0006_01_000002 taskAttempt
> attempt_1485302663172_0006_m_000000_0
> 2017-01-25 00:22:13,411 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Launching
> attempt_1485302663172_0006_m_000000_0
> 2017-01-25 00:22:13,413 INFO [ContainerLauncher #0]
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> Opening proxy : sandbox.hortonworks.com:45454
> 2017-01-25 00:22:13,560 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
> port returned by ContainerManager for attempt_1485302663172_0006_m_
> 000000_0
> : 13562
> 2017-01-25 00:22:13,561 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
> [attempt_1485302663172_0006_m_000000_0] using containerId:
> [container_e69_1485302663172_0006_01_000002 on NM:
> [sandbox.hortonworks.com:45454]
> 2017-01-25 00:22:13,565 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from
> ASSIGNED
> to RUNNING
> 2017-01-25 00:22:13,566 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1485302663172_0006_m_000000 Task Transitioned from SCHEDULED to
> RUNNING
> 2017-01-25 00:22:13,970 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources()
> for application_1485302663172_0006: ask=3 release= 0 newContainers=0
> finishedContainers=0 resourcelimit=<memory:750, vCores:1> knownNMs=1
> 2017-01-25 00:22:14,995 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
> completed container container_e69_1485302663172_0006_01_000002
> 2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
> schedule, headroom=<memory:2000, vCores:1>
> 2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
> start threshold not met. completedMapsForReduceSlowstart 1
> 2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0
> AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
> HostLocal:1 RackLocal:0
> 2017-01-25 00:22:15,015 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from
> RUNNING
> to FAIL_CONTAINER_CLEANUP
> 2017-01-25 00:22:15,015 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics
> report from attempt_1485302663172_0006_m_000000_0: Exception from
> container-launch.
> Container id: container_e69_1485302663172_0006_01_000002
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
> at org.apache.hadoop.util.Shell.run(Shell.java:487)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.
> launchContainer(DefaultContainerExecutor.java:212)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.
> launcher.ContainerLaunch.call(ContainerLaunch.java:303)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.
> launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
> Container exited with a non-zero exit code 1
>
>
> Appreciate your help!!!
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/kylin-build-cube-failed-at-step12-with-counter-
> errors-tp7030.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>