You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by BigdataGR <bi...@gmail.com> on 2017/01/25 00:42:55 UTC
kylin build cube failed at step12 with counter errors
Hi,
I have installed kylin 1.6 on hortonworks sandbox and have created a my own
cube but build cube is failing with below error.
Counters: 16
Job Counters
Failed map tasks=4
Killed reduce tasks=1
Launched map tasks=4
Other local map tasks=3
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=39075
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=7815
Total time spent by all reduce tasks (ms)=0
Total vcore-seconds taken by all map tasks=7815
Total vcore-seconds taken by all reduce tasks=0
Total megabyte-seconds taken by all map tasks=8002560
Total megabyte-seconds taken by all reduce tasks=0
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
Here is the log i took from mapr job
2017-01-25 00:22:05,475 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for
application appattempt_1485302663172_0006_000001
2017-01-25 00:22:06,129 WARN [main] org.apache.hadoop.util.NativeCodeLoader:
Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable
2017-01-25 00:22:06,221 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2017-01-25 00:22:06,384 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN,
Service: , Ident: (appAttemptId { application_id { id: 6 cluster_timestamp:
1485302663172 } attemptId: 1 } keyId: 832873100)
2017-01-25 00:22:06,408 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred
newApiCommitter.
2017-01-25 00:22:06,411 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
config null
2017-01-25 00:22:06,473 INFO [main]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output
Committer Algorithm version is 1
2017-01-25 00:22:06,473 INFO [main]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:
FileOutputCommitter skip cleanup _temporary folders under output
directory:false, ignore cleanup failures: false
2017-01-25 00:22:07,459 WARN [main]
org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit
local reads feature cannot be used because libhadoop cannot be loaded.
2017-01-25 00:22:07,469 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2017-01-25 00:22:07,661 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.jobhistory.EventType for class
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2017-01-25 00:22:07,662 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2017-01-25 00:22:07,663 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2017-01-25 00:22:07,664 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2017-01-25 00:22:07,664 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2017-01-25 00:22:07,665 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2017-01-25 00:22:07,665 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2017-01-25 00:22:07,666 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2017-01-25 00:22:07,689 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
system is set solely by core-default.xml therefore - ignoring
2017-01-25 00:22:07,710 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
system is set solely by core-default.xml therefore - ignoring
2017-01-25 00:22:07,735 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
system is set solely by core-default.xml therefore - ignoring
2017-01-25 00:22:07,760 INFO [main]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job
history data to the timeline server is not enabled
2017-01-25 00:22:07,804 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2017-01-25 00:22:08,150 WARN [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration:
tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
2017-01-25 00:22:08,290 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
at 10 second(s).
2017-01-25 00:22:08,290 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
system started
2017-01-25 00:22:08,298 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for
job_1485302663172_0006 to jobTokenSecretManager
2017-01-25 00:22:08,444 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
job_1485302663172_0006 because: not enabled; too much RAM;
2017-01-25 00:22:08,460 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job
job_1485302663172_0006 = 439. Number of splits = 1
2017-01-25 00:22:08,461 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for
job job_1485302663172_0006 = 1
2017-01-25 00:22:08,461 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1485302663172_0006Job Transitioned from NEW to INITED
2017-01-25 00:22:08,462 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
normal, non-uberized, multi-container job job_1485302663172_0006.
2017-01-25 00:22:08,490 INFO [main] org.apache.hadoop.ipc.CallQueueManager:
Using callQueue class java.util.concurrent.LinkedBlockingQueue
2017-01-25 00:22:08,509 INFO [Socket Reader #1 for port 51481]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 51481
2017-01-25 00:22:08,542 INFO [main]
org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding
protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
2017-01-25 00:22:08,543 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-01-25 00:22:08,548 INFO [IPC Server listener on 51481]
org.apache.hadoop.ipc.Server: IPC Server listener on 51481: starting
2017-01-25 00:22:08,552 INFO [main]
org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated
MRClientService at sandbox.hortonworks.com/10.0.2.15:51481
2017-01-25 00:22:08,701 INFO [main] org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2017-01-25 00:22:08,727 INFO [main]
org.apache.hadoop.security.authentication.server.AuthenticationFilter:
Unable to initialize FileSignerSecretProvider, falling back to use random
secrets.
2017-01-25 00:22:08,734 WARN [main] org.apache.hadoop.http.HttpRequestLog:
Jetty request log can only be enabled using Log4j
2017-01-25 00:22:08,740 INFO [main] org.apache.hadoop.http.HttpServer2:
Added global filter 'safety'
(class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2017-01-25 00:22:08,746 INFO [main] org.apache.hadoop.http.HttpServer2:
Added filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context mapreduce
2017-01-25 00:22:08,747 INFO [main] org.apache.hadoop.http.HttpServer2:
Added filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context static
2017-01-25 00:22:08,751 INFO [main] org.apache.hadoop.http.HttpServer2:
adding path spec: /mapreduce/*
2017-01-25 00:22:08,751 INFO [main] org.apache.hadoop.http.HttpServer2:
adding path spec: /ws/*
2017-01-25 00:22:09,103 INFO [main] org.apache.hadoop.yarn.webapp.WebApps:
Registered webapp guice modules
2017-01-25 00:22:09,105 INFO [main] org.apache.hadoop.http.HttpServer2:
Jetty bound to port 39514
2017-01-25 00:22:09,105 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
2017-01-25 00:22:09,142 INFO [main] org.mortbay.log: Extract
jar:file:/hadoop/yarn/local/filecache/11/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.4.0.0-169.jar!/webapps/mapreduce
to
/hadoop/yarn/local/usercache/root/appcache/application_1485302663172_0006/container_e69_1485302663172_0006_01_000001/tmp/Jetty_0_0_0_0_39514_mapreduce____1jyrk7/webapp
2017-01-25 00:22:10,519 INFO [main] org.mortbay.log: Started
HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:39514
2017-01-25 00:22:10,520 INFO [main] org.apache.hadoop.yarn.webapp.WebApps:
Web app mapreduce started at 39514
2017-01-25 00:22:10,530 INFO [main] org.apache.hadoop.ipc.CallQueueManager:
Using callQueue class java.util.concurrent.LinkedBlockingQueue
2017-01-25 00:22:10,531 INFO [Socket Reader #1 for port 48188]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 48188
2017-01-25 00:22:10,536 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-01-25 00:22:10,536 INFO [IPC Server listener on 48188]
org.apache.hadoop.ipc.Server: IPC Server listener on 48188: starting
2017-01-25 00:22:10,571 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
nodeBlacklistingEnabled:true
2017-01-25 00:22:10,571 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
maxTaskFailuresPerNode is 3
2017-01-25 00:22:10,571 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
blacklistDisablePercent is 33
2017-01-25 00:22:10,619 INFO [main] org.apache.hadoop.yarn.client.RMProxy:
Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8030
2017-01-25 00:22:10,701 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
maxContainerCapability: <memory:2250, vCores:8>
2017-01-25 00:22:10,701 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
2017-01-25 00:22:10,706 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper
limit on the thread pool size is 500
2017-01-25 00:22:10,706 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
thread pool initial size is 10
2017-01-25 00:22:10,711 INFO [main]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
yarn.client.max-cached-nodemanagers-proxies : 0
2017-01-25 00:22:10,720 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1485302663172_0006Job Transitioned from INITED to SETUP
2017-01-25 00:22:10,721 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: JOB_SETUP
2017-01-25 00:22:10,732 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1485302663172_0006Job Transitioned from SETUP to RUNNING
2017-01-25 00:22:10,813 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved sandbox.hortonworks.com
to /default-rack
2017-01-25 00:22:10,816 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1485302663172_0006_m_000000 Task Transitioned from NEW to SCHEDULED
2017-01-25 00:22:10,817 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1485302663172_0006_r_000000 Task Transitioned from NEW to SCHEDULED
2017-01-25 00:22:10,819 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from NEW to
UNASSIGNED
2017-01-25 00:22:10,819 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1485302663172_0006_r_000000_0 TaskAttempt Transitioned from NEW to
UNASSIGNED
2017-01-25 00:22:10,828 INFO [Thread-51]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
mapResourceRequest:<memory:1024, vCores:1>
2017-01-25 00:22:10,841 INFO [Thread-51]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
reduceResourceRequest:<memory:250, vCores:1>
2017-01-25 00:22:10,842 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer
setup for JobId: job_1485302663172_0006, File:
hdfs://sandbox.hortonworks.com:8020/user/root/.staging/job_1485302663172_0006/job_1485302663172_0006_1.jhist
2017-01-25 00:22:11,706 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0
HostLocal:0 RackLocal:0
2017-01-25 00:22:11,888 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources()
for application_1485302663172_0006: ask=3 release= 0 newContainers=0
finishedContainers=0 resourcelimit=<memory:2000, vCores:1> knownNMs=1
2017-01-25 00:22:11,891 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
schedule, headroom=<memory:2000, vCores:1>
2017-01-25 00:22:11,892 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
start threshold not met. completedMapsForReduceSlowstart 1
2017-01-25 00:22:12,943 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated
containers 1
2017-01-25 00:22:12,952 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_e69_1485302663172_0006_01_000002 to
attempt_1485302663172_0006_m_000000_0
2017-01-25 00:22:12,959 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
schedule, headroom=<memory:750, vCores:1>
2017-01-25 00:22:12,960 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
start threshold not met. completedMapsForReduceSlowstart 1
2017-01-25 00:22:12,960 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
HostLocal:1 RackLocal:0
2017-01-25 00:22:13,118 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved sandbox.hortonworks.com
to /default-rack
2017-01-25 00:22:13,175 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar
file on the remote FS is
hdfs://sandbox.hortonworks.com:8020/user/root/.staging/job_1485302663172_0006/job.jar
2017-01-25 00:22:13,186 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf
file on the remote FS is /user/root/.staging/job_1485302663172_0006/job.xml
2017-01-25 00:22:13,231 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0
tokens and #1 secret keys for NM use for launching container
2017-01-25 00:22:13,232 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
containertokens_dob is 1
2017-01-25 00:22:13,232 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle
token in serviceData
2017-01-25 00:22:13,397 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED
2017-01-25 00:22:13,406 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_e69_1485302663172_0006_01_000002 taskAttempt
attempt_1485302663172_0006_m_000000_0
2017-01-25 00:22:13,411 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1485302663172_0006_m_000000_0
2017-01-25 00:22:13,413 INFO [ContainerLauncher #0]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : sandbox.hortonworks.com:45454
2017-01-25 00:22:13,560 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1485302663172_0006_m_000000_0
: 13562
2017-01-25 00:22:13,561 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1485302663172_0006_m_000000_0] using containerId:
[container_e69_1485302663172_0006_01_000002 on NM:
[sandbox.hortonworks.com:45454]
2017-01-25 00:22:13,565 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING
2017-01-25 00:22:13,566 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1485302663172_0006_m_000000 Task Transitioned from SCHEDULED to RUNNING
2017-01-25 00:22:13,970 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources()
for application_1485302663172_0006: ask=3 release= 0 newContainers=0
finishedContainers=0 resourcelimit=<memory:750, vCores:1> knownNMs=1
2017-01-25 00:22:14,995 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
completed container container_e69_1485302663172_0006_01_000002
2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
schedule, headroom=<memory:2000, vCores:1>
2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
start threshold not met. completedMapsForReduceSlowstart 1
2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
HostLocal:1 RackLocal:0
2017-01-25 00:22:15,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from RUNNING
to FAIL_CONTAINER_CLEANUP
2017-01-25 00:22:15,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics
report from attempt_1485302663172_0006_m_000000_0: Exception from
container-launch.
Container id: container_e69_1485302663172_0006_01_000002
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
at org.apache.hadoop.util.Shell.run(Shell.java:487)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:303)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Appreciate your help!!!
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/kylin-build-cube-failed-at-step12-with-counter-errors-tp7030.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: kylin build cube failed at step12 with counter errors
Posted by Li Yang <li...@apache.org>.
> Failed map tasks=4
You want to analyze the failed map tasks. Try dig in the mapper task log.
Cheers
On Wed, Jan 25, 2017 at 8:42 AM, BigdataGR <bi...@gmail.com> wrote:
> Hi,
>
> I have installed kylin 1.6 on hortonworks sandbox and have created a my own
> cube but build cube is failing with below error.
>
> Counters: 16
> Job Counters
> Failed map tasks=4
> Killed reduce tasks=1
> Launched map tasks=4
> Other local map tasks=3
> Data-local map tasks=1
> Total time spent by all maps in occupied slots (ms)=39075
> Total time spent by all reduces in occupied slots (ms)=0
> Total time spent by all map tasks (ms)=7815
> Total time spent by all reduce tasks (ms)=0
> Total vcore-seconds taken by all map tasks=7815
> Total vcore-seconds taken by all reduce tasks=0
> Total megabyte-seconds taken by all map tasks=8002560
> Total megabyte-seconds taken by all reduce tasks=0
> Map-Reduce Framework
> CPU time spent (ms)=0
> Physical memory (bytes) snapshot=0
> Virtual memory (bytes) snapshot=0
>
>
> Here is the log i took from mapr job
>
> 2017-01-25 00:22:05,475 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for
> application appattempt_1485302663172_0006_000001
> 2017-01-25 00:22:06,129 WARN [main] org.apache.hadoop.util.
> NativeCodeLoader:
> Unable to load native-hadoop library for your platform... using
> builtin-java
> classes where applicable
> 2017-01-25 00:22:06,221 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
> 2017-01-25 00:22:06,384 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN,
> Service: , Ident: (appAttemptId { application_id { id: 6 cluster_timestamp:
> 1485302663172 } attemptId: 1 } keyId: 832873100)
> 2017-01-25 00:22:06,408 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred
> newApiCommitter.
> 2017-01-25 00:22:06,411 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
> config null
> 2017-01-25 00:22:06,473 INFO [main]
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output
> Committer Algorithm version is 1
> 2017-01-25 00:22:06,473 INFO [main]
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:
> FileOutputCommitter skip cleanup _temporary folders under output
> directory:false, ignore cleanup failures: false
> 2017-01-25 00:22:07,459 WARN [main]
> org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit
> local reads feature cannot be used because libhadoop cannot be loaded.
> 2017-01-25 00:22:07,469 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 2017-01-25 00:22:07,661 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.jobhistory.EventType for class
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
> 2017-01-25 00:22:07,662 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
> 2017-01-25 00:22:07,663 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
> 2017-01-25 00:22:07,664 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
> 2017-01-25 00:22:07,664 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
> 2017-01-25 00:22:07,665 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
> 2017-01-25 00:22:07,665 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
> class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
> 2017-01-25 00:22:07,666 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
> for
> class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$
> ContainerLauncherRouter
> 2017-01-25 00:22:07,689 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
> system is set solely by core-default.xml therefore - ignoring
> 2017-01-25 00:22:07,710 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
> system is set solely by core-default.xml therefore - ignoring
> 2017-01-25 00:22:07,735 INFO [main]
> org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file
> system is set solely by core-default.xml therefore - ignoring
> 2017-01-25 00:22:07,760 INFO [main]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting
> job
> history data to the timeline server is not enabled
> 2017-01-25 00:22:07,804 INFO [main]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> 2017-01-25 00:22:08,150 WARN [main]
> org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
> configuration:
> tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
> 2017-01-25 00:22:08,290 INFO [main]
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period
> at 10 second(s).
> 2017-01-25 00:22:08,290 INFO [main]
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
> system started
> 2017-01-25 00:22:08,298 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for
> job_1485302663172_0006 to jobTokenSecretManager
> 2017-01-25 00:22:08,444 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
> job_1485302663172_0006 because: not enabled; too much RAM;
> 2017-01-25 00:22:08,460 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job
> job_1485302663172_0006 = 439. Number of splits = 1
> 2017-01-25 00:22:08,461 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for
> job job_1485302663172_0006 = 1
> 2017-01-25 00:22:08,461 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1485302663172_0006Job Transitioned from NEW to INITED
> 2017-01-25 00:22:08,462 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
> normal, non-uberized, multi-container job job_1485302663172_0006.
> 2017-01-25 00:22:08,490 INFO [main] org.apache.hadoop.ipc.
> CallQueueManager:
> Using callQueue class java.util.concurrent.LinkedBlockingQueue
> 2017-01-25 00:22:08,509 INFO [Socket Reader #1 for port 51481]
> org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 51481
> 2017-01-25 00:22:08,542 INFO [main]
> org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding
> protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the
> server
> 2017-01-25 00:22:08,543 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> 2017-01-25 00:22:08,548 INFO [IPC Server listener on 51481]
> org.apache.hadoop.ipc.Server: IPC Server listener on 51481: starting
> 2017-01-25 00:22:08,552 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated
> MRClientService at sandbox.hortonworks.com/10.0.2.15:51481
> 2017-01-25 00:22:08,701 INFO [main] org.mortbay.log: Logging to
> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> org.mortbay.log.Slf4jLog
> 2017-01-25 00:22:08,727 INFO [main]
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> Unable to initialize FileSignerSecretProvider, falling back to use random
> secrets.
> 2017-01-25 00:22:08,734 WARN [main] org.apache.hadoop.http.HttpRequestLog:
> Jetty request log can only be enabled using Log4j
> 2017-01-25 00:22:08,740 INFO [main] org.apache.hadoop.http.HttpServer2:
> Added global filter 'safety'
> (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
> 2017-01-25 00:22:08,746 INFO [main] org.apache.hadoop.http.HttpServer2:
> Added filter AM_PROXY_FILTER
> (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> context mapreduce
> 2017-01-25 00:22:08,747 INFO [main] org.apache.hadoop.http.HttpServer2:
> Added filter AM_PROXY_FILTER
> (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
> context static
> 2017-01-25 00:22:08,751 INFO [main] org.apache.hadoop.http.HttpServer2:
> adding path spec: /mapreduce/*
> 2017-01-25 00:22:08,751 INFO [main] org.apache.hadoop.http.HttpServer2:
> adding path spec: /ws/*
> 2017-01-25 00:22:09,103 INFO [main] org.apache.hadoop.yarn.webapp.WebApps:
> Registered webapp guice modules
> 2017-01-25 00:22:09,105 INFO [main] org.apache.hadoop.http.HttpServer2:
> Jetty bound to port 39514
> 2017-01-25 00:22:09,105 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
> 2017-01-25 00:22:09,142 INFO [main] org.mortbay.log: Extract
> jar:file:/hadoop/yarn/local/filecache/11/mapreduce.tar.gz/
> hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.4.
> 0.0-169.jar!/webapps/mapreduce
> to
> /hadoop/yarn/local/usercache/root/appcache/application_
> 1485302663172_0006/container_e69_1485302663172_0006_01_
> 000001/tmp/Jetty_0_0_0_0_39514_mapreduce____1jyrk7/webapp
> 2017-01-25 00:22:10,519 INFO [main] org.mortbay.log: Started
> HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:39514
> 2017-01-25 00:22:10,520 INFO [main] org.apache.hadoop.yarn.webapp.WebApps:
> Web app mapreduce started at 39514
> 2017-01-25 00:22:10,530 INFO [main] org.apache.hadoop.ipc.
> CallQueueManager:
> Using callQueue class java.util.concurrent.LinkedBlockingQueue
> 2017-01-25 00:22:10,531 INFO [Socket Reader #1 for port 48188]
> org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 48188
> 2017-01-25 00:22:10,536 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: IPC Server Responder: starting
> 2017-01-25 00:22:10,536 INFO [IPC Server listener on 48188]
> org.apache.hadoop.ipc.Server: IPC Server listener on 48188: starting
> 2017-01-25 00:22:10,571 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> nodeBlacklistingEnabled:true
> 2017-01-25 00:22:10,571 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> maxTaskFailuresPerNode is 3
> 2017-01-25 00:22:10,571 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> blacklistDisablePercent is 33
> 2017-01-25 00:22:10,619 INFO [main] org.apache.hadoop.yarn.client.RMProxy:
> Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8030
> 2017-01-25 00:22:10,701 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
> maxContainerCapability: <memory:2250, vCores:8>
> 2017-01-25 00:22:10,701 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
> 2017-01-25 00:22:10,706 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper
> limit on the thread pool size is 500
> 2017-01-25 00:22:10,706 INFO [main]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
> thread pool initial size is 10
> 2017-01-25 00:22:10,711 INFO [main]
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> yarn.client.max-cached-nodemanagers-proxies : 0
> 2017-01-25 00:22:10,720 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1485302663172_0006Job Transitioned from INITED to SETUP
> 2017-01-25 00:22:10,721 INFO [CommitterEvent Processor #0]
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
> Processing
> the event EventType: JOB_SETUP
> 2017-01-25 00:22:10,732 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1485302663172_0006Job Transitioned from SETUP to RUNNING
> 2017-01-25 00:22:10,813 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.yarn.util.RackResolver: Resolved sandbox.hortonworks.com
> to /default-rack
> 2017-01-25 00:22:10,816 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1485302663172_0006_m_000000 Task Transitioned from NEW to SCHEDULED
> 2017-01-25 00:22:10,817 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1485302663172_0006_r_000000 Task Transitioned from NEW to SCHEDULED
> 2017-01-25 00:22:10,819 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from NEW to
> UNASSIGNED
> 2017-01-25 00:22:10,819 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_r_000000_0 TaskAttempt Transitioned from NEW to
> UNASSIGNED
> 2017-01-25 00:22:10,828 INFO [Thread-51]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> mapResourceRequest:<memory:1024, vCores:1>
> 2017-01-25 00:22:10,841 INFO [Thread-51]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> reduceResourceRequest:<memory:250, vCores:1>
> 2017-01-25 00:22:10,842 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
> Writer
> setup for JobId: job_1485302663172_0006, File:
> hdfs://sandbox.hortonworks.com:8020/user/root/.staging/
> job_1485302663172_0006/job_1485302663172_0006_1.jhist
> 2017-01-25 00:22:11,706 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0
> AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0
> HostLocal:0 RackLocal:0
> 2017-01-25 00:22:11,888 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources()
> for application_1485302663172_0006: ask=3 release= 0 newContainers=0
> finishedContainers=0 resourcelimit=<memory:2000, vCores:1> knownNMs=1
> 2017-01-25 00:22:11,891 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
> schedule, headroom=<memory:2000, vCores:1>
> 2017-01-25 00:22:11,892 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
> start threshold not met. completedMapsForReduceSlowstart 1
> 2017-01-25 00:22:12,943 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated
> containers 1
> 2017-01-25 00:22:12,952 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
> container container_e69_1485302663172_0006_01_000002 to
> attempt_1485302663172_0006_m_000000_0
> 2017-01-25 00:22:12,959 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
> schedule, headroom=<memory:750, vCores:1>
> 2017-01-25 00:22:12,960 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
> start threshold not met. completedMapsForReduceSlowstart 1
> 2017-01-25 00:22:12,960 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
> AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
> HostLocal:1 RackLocal:0
> 2017-01-25 00:22:13,118 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.yarn.util.RackResolver: Resolved sandbox.hortonworks.com
> to /default-rack
> 2017-01-25 00:22:13,175 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar
> file on the remote FS is
> hdfs://sandbox.hortonworks.com:8020/user/root/.staging/
> job_1485302663172_0006/job.jar
> 2017-01-25 00:22:13,186 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf
> file on the remote FS is /user/root/.staging/job_
> 1485302663172_0006/job.xml
> 2017-01-25 00:22:13,231 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0
> tokens and #1 secret keys for NM use for launching container
> 2017-01-25 00:22:13,232 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
> containertokens_dob is 1
> 2017-01-25 00:22:13,232 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
> shuffle
> token in serviceData
> 2017-01-25 00:22:13,397 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from
> UNASSIGNED to ASSIGNED
> 2017-01-25 00:22:13,406 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
> container_e69_1485302663172_0006_01_000002 taskAttempt
> attempt_1485302663172_0006_m_000000_0
> 2017-01-25 00:22:13,411 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
> Launching
> attempt_1485302663172_0006_m_000000_0
> 2017-01-25 00:22:13,413 INFO [ContainerLauncher #0]
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
> Opening proxy : sandbox.hortonworks.com:45454
> 2017-01-25 00:22:13,560 INFO [ContainerLauncher #0]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
> port returned by ContainerManager for attempt_1485302663172_0006_m_
> 000000_0
> : 13562
> 2017-01-25 00:22:13,561 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
> [attempt_1485302663172_0006_m_000000_0] using containerId:
> [container_e69_1485302663172_0006_01_000002 on NM:
> [sandbox.hortonworks.com:45454]
> 2017-01-25 00:22:13,565 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from
> ASSIGNED
> to RUNNING
> 2017-01-25 00:22:13,566 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1485302663172_0006_m_000000 Task Transitioned from SCHEDULED to
> RUNNING
> 2017-01-25 00:22:13,970 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources()
> for application_1485302663172_0006: ask=3 release= 0 newContainers=0
> finishedContainers=0 resourcelimit=<memory:750, vCores:1> knownNMs=1
> 2017-01-25 00:22:14,995 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
> completed container container_e69_1485302663172_0006_01_000002
> 2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
> schedule, headroom=<memory:2000, vCores:1>
> 2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
> start threshold not met. completedMapsForReduceSlowstart 1
> 2017-01-25 00:22:14,998 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
> Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0
> AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0
> HostLocal:1 RackLocal:0
> 2017-01-25 00:22:15,015 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1485302663172_0006_m_000000_0 TaskAttempt Transitioned from
> RUNNING
> to FAIL_CONTAINER_CLEANUP
> 2017-01-25 00:22:15,015 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics
> report from attempt_1485302663172_0006_m_000000_0: Exception from
> container-launch.
> Container id: container_e69_1485302663172_0006_01_000002
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
> at org.apache.hadoop.util.Shell.run(Shell.java:487)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.
> launchContainer(DefaultContainerExecutor.java:212)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.
> launcher.ContainerLaunch.call(ContainerLaunch.java:303)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.
> launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
> Container exited with a non-zero exit code 1
>
>
> Appreciate your help!!!
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/kylin-build-cube-failed-at-step12-with-counter-
> errors-tp7030.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>