[jira] [Commented] (KYLIN-3762) 构建cube出现error

["zhao jintao (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784332#comment-16784332 ] 

zhao jintao commented on KYLIN-3762:
------------------------------------

这是构建的哪一步出现的？

> 构建cube出现error 
> --------------
>
>                 Key: KYLIN-3762
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3762
>             Project: Kylin
>          Issue Type: Bug
>    Affects Versions: v2.5.2
>            Reporter: 王振强
>            Priority: Blocker
>         Attachments: mr_error_log.jpg
>
>
> 构建cube出现error，以下是mr的log
> 2019-01-09 14:06:43,552 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1544413042966_0495_m_000002_0 decomp: 59732393 len: 9306880 to MEMORY
> 2019-01-09 14:06:43,595 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1544413042966_0495_m_000003_0 decomp: 61855877 len: 9709575 to MEMORY
> 2019-01-09 14:06:43,625 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 59732393 bytes from map-output for attempt_1544413042966_0495_m_000002_0
> 2019-01-09 14:06:43,625 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 59732393, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->121588270
> 2019-01-09 14:06:43,872 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1544413042966_0495_m_000001_0 decomp: 60219839 len: 9341252 to MEMORY
> 2019-01-09 14:06:43,889 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 61855877 bytes from map-output for attempt_1544413042966_0495_m_000003_0
> 2019-01-09 14:06:43,889 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 61855877, inMemoryMapOutputs.size() -> 2, commitMemory -> 59732393, usedMemory ->181808109
> 2019-01-09 14:06:43,889 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: ap-cdh04:13562 freed by fetcher#2 in 579ms
> 2019-01-09 14:06:43,938 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 60219839 bytes from map-output for attempt_1544413042966_0495_m_000001_0
> 2019-01-09 14:06:43,938 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 60219839, inMemoryMapOutputs.size() -> 3, commitMemory -> 121588270, usedMemory ->181808109
> 2019-01-09 14:06:43,949 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1544413042966_0495_m_000000_0 decomp: 61659651 len: 9657307 to MEMORY
> 2019-01-09 14:06:43,994 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 61659651 bytes from map-output for attempt_1544413042966_0495_m_000000_0
> 2019-01-09 14:06:43,995 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 61659651, inMemoryMapOutputs.size() -> 4, commitMemory -> 181808109, usedMemory ->243467760
> 2019-01-09 14:06:43,995 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: ap-cdh03:13562 freed by fetcher#1 in 685ms
> 2019-01-09 14:06:44,001 INFO [EventFetcher for fetching Map Completion Events] org.apache.hadoop.mapreduce.task.reduce.EventFetcher: EventFetcher is interrupted.. Returning
> 2019-01-09 14:06:44,014 INFO [main] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: finalMerge called with 4 in-memory map-outputs and 0 on-disk map-outputs
> 2019-01-09 14:06:44,024 INFO [main] org.apache.hadoop.mapred.Merger: Merging 4 sorted segments
> 2019-01-09 14:06:44,026 INFO [main] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 4 segments left of total size: 243467522 bytes
> 2019-01-09 14:06:47,997 INFO [main] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merged 4 segments, 243467760 bytes to disk to satisfy reduce memory limit
> 2019-01-09 14:06:47,998 INFO [main] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merging 1 files, 35816160 bytes from disk
> 2019-01-09 14:06:47,998 INFO [main] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce
> 2019-01-09 14:06:47,999 INFO [main] org.apache.hadoop.mapred.Merger: Merging 1 sorted segments
> 2019-01-09 14:06:48,004 INFO [main] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 243467668 bytes
> ^@^A^@^@^V^@
>  ^@^GVERSION*(^@&container_1544413042966_0495_01_000002^H*(^@&container_1544413042966_0495_01_000039^D*(^@&container_1544413042966_0495_01_000019^F*(^@&container_1544413042966_0495_01_000025^D^Dnone^D^P¬<90>¥¬<90>¥¬<90>µ¬w ¬w ±^GÕ¬`~¬`~µhS«^O^A«^O^A^C^Qdata:BCFile.index^Dnone<90>^Px^Q((^Pdata:TFile.index^Dnone<90>^PwZÌ·Ì·^Odata:TFile.meta^Dnone<90>^PwT^F^F^@^@^@^@^@^Px9^@^A^@^@Ñ^QÓh<91>µ×¶9ßA@<92>ºáP



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)