Fwd: Mapreduce Exception When cube builds at step 3

[Kanivel Jayapal <ka...@troondx.com>]

Hi,

       Kylin Version: 2.6.4

       I got below exception when building cubes at step 3(Extract Fact
Table Distinct Columns).


org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 13 Job
Counters Failed map tasks=4 Killed reduce tasks=3 Launched map tasks=4
Other local map tasks=3 Data-local map tasks=1 Total time spent by all maps
in occupied slots (ms)=194628 Total time spent by all reduces in occupied
slots (ms)=0 Total time spent by all map tasks (ms)=27804 Total
vcore-milliseconds taken by all map tasks=27804 Total megabyte-milliseconds
taken by all map tasks=199299072 Map-Reduce Framework CPU time spent (ms)=0
Physical memory (bytes) snapshot=0 Virtual memory (bytes) snapshot=0 Job
Diagnostics:Task failed task_1575385745059_0009_m_000000 Job failed as
tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0
Failure task Diagnostics: [2019-12-04 07:44:23.184]Exception from
container-launch. Container id: container_e03_1575385745059_0009_01_000004
Exit code: 255 [2019-12-04 07:44:23.186]Container exited with a non-zero
exit code 255. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err
: Last 4096 bytes of stderr : [2019-12-04 07:44:23.186]Container exited
with a non-zero exit code 255. Error file: prelaunch.err. Last 4096 bytes
of prelaunch.err : Last 4096 bytes of stderr : at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:173)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)



*Environment:*

         I have setup hadoop multinode cluster through ambari .
Ambari and kylin running in master node and hive running in another aws
instance.I configured hive connection in kylin.properties.

 I can create model,can create cube.But exception occur when build
cube.Build fails at 3rd step.When I check logs it shows Mapreduce
exception.2nd step also taking more time.I have 3 tables and each have 10
records.sales,customers,products.sales is a fact table.customers and
products are dimesions table..Please look at the attached screenshots.


Below tables and records are in hive table,

CREATE SCHEMA kylinDb


CREATE TABLE IF NOT EXISTS Customers ( CustomerID int, CustomerName String)
stored as textfile;

CREATE TABLE IF NOT EXISTS Products ( ProductID int, ProductName String)
stored as textfile;

CREATE TABLE IF NOT EXISTS fact_sales (dim_customer_id int,dim_product_id
int,price int,quantity int) stored as textfile;


INSERT INTO TABLE Customers
  VALUES (1, 'Kanivel'),
         (2, 'Lakshmanan'),
         (3, 'Ganesh'),
         (4, 'Raja'),
         (5, 'Logesh'),
         (6, 'Aditya'),
         (7, 'Venkatesh'),
         (8, 'Jegan'),
         (9, 'Kulanthai'),
         (10, 'Anil');


INSERT INTO TABLE Products
  VALUES (11, 'Mobile'),
         (22, 'Watch'),
         (33, 'Drimmer'),
         (44, 'Pampers'),
         (55, 'Laptop'),
         (66, 'TV'),
         (77, 'Washing Machine'),
         (88, 'Fan'),
         (99, 'Bike'),
         (100, 'Car');


INSERT INTO TABLE fact_sales
  VALUES (1,11,10000,2),
         (2,22,5000,3),
         (3,33,3000,4),
         (4,44,2000,5),
         (5,55,50000,3),
         (6,66,60000,6),
         (7,77,25000,5),
         (8,88,4000,10),
         (9,99,100000,5),
         (10,100,500000,10);