You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 周湘伦 <ja...@gmail.com> on 2017/10/11 03:12:30 UTC
Auto merge thresholds and auto delete didn't work.
Hi,all
I have set the Auto Merge Thresholds and Retention Threshold, but it
doesn't work. Through the page, those segments are still segmented, and
the expired segment has not been deleted.
Is it necessary to configure what is in the configuration file?
Re: Auto merge thresholds and auto delete didn't work.
Posted by 周湘伦 <ja...@gmail.com>.
I found these hints in kylin.out,then i didn't find any hint.
I didn't have kylin.log.😱
Then i configured kylin-server-log4j.properties:
log4j.rootLogger=DEBUG,file
#define appenders
log4j.appender.file=org.apache.log4j.DailyRollingFileAppender
log4j.appender.file.Threshold=DEBUG
log4j.appender.file.ImmediateFlush=true
log4j.appender.file.layout=org.apache.log4j.PatternLayout
log4j.appender.file.File=/dev_yxlm_dca/kylin/apache-kylin-2.0.0-bin/logs/kylin.log
log4j.appender.file.layout.ConversionPattern=%d{ISO8601} %-5p [%t] %c{2}:%L
: %m%n
log4j.appender.file.Append=true
But it didn't work. There is no kylin.log in the logs folder.
Are those tips only displayed in kylin.log, not in kylin.out?
How should i configure kylin-server-log4j.properties to appear kylin.log?
2017-10-17 21:56 GMT+08:00 Billy Liu <bi...@apache.org>:
> It always has some hints in the log, if no hint, nobody knows what
> happened. Please check carefully.
>
> 2017-10-17 18:31 GMT+08:00 周湘伦 <ja...@gmail.com>:
>
> > Thank you.
> > Without these hints.
> > Then I manually merged the segment and succeeded.
> > But automatic merge doesn't work yet.
> > My kylin version is 2.0.
> >
> > 2017-10-12 10:40 GMT+08:00 Billy Liu <bi...@apache.org>:
> >
> > > Check the kylin.log
> > > Something like "Cube XXX doesn't need auto merge" "Cube XXX has N
> > building
> > > segments" "will submit merge job on XXX" "Not ready for merge on cube
> > XXX"
> > > "Failed to auto merge cube XXX"
> > >
> > > 2017-10-12 9:40 GMT+08:00 周湘伦 <ja...@gmail.com>:
> > >
> > > > Thank you.
> > > > My cube is incrementally built. But all of these incremental build
> > > segments
> > > > are still segmented.When i built these cubes incrementally,these
> > segments
> > > > under these cubes are not merged.Expired segments have not been
> > deleted.
> > > >
> > > > 2017-10-11 11:40 GMT+08:00 Billy Liu <bi...@apache.org>:
> > > >
> > > > > The auto merge works when new segment is built. It's not a daily
> > merge
> > > > job,
> > > > > but if-merge-check during each new build.
> > > > >
> > > > > 2017-10-11 11:12 GMT+08:00 周湘伦 <ja...@gmail.com>:
> > > > >
> > > > > > Hi,all
> > > > > > I have set the Auto Merge Thresholds and Retention Threshold,
> but
> > it
> > > > > > doesn't work. Through the page, those segments are still
> > segmented,
> > > > and
> > > > > > the expired segment has not been deleted.
> > > > > >
> > > > > > Is it necessary to configure what is in the configuration file?
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Auto merge thresholds and auto delete didn't work.
Posted by Billy Liu <bi...@apache.org>.
It always has some hints in the log, if no hint, nobody knows what
happened. Please check carefully.
2017-10-17 18:31 GMT+08:00 周湘伦 <ja...@gmail.com>:
> Thank you.
> Without these hints.
> Then I manually merged the segment and succeeded.
> But automatic merge doesn't work yet.
> My kylin version is 2.0.
>
> 2017-10-12 10:40 GMT+08:00 Billy Liu <bi...@apache.org>:
>
> > Check the kylin.log
> > Something like "Cube XXX doesn't need auto merge" "Cube XXX has N
> building
> > segments" "will submit merge job on XXX" "Not ready for merge on cube
> XXX"
> > "Failed to auto merge cube XXX"
> >
> > 2017-10-12 9:40 GMT+08:00 周湘伦 <ja...@gmail.com>:
> >
> > > Thank you.
> > > My cube is incrementally built. But all of these incremental build
> > segments
> > > are still segmented.When i built these cubes incrementally,these
> segments
> > > under these cubes are not merged.Expired segments have not been
> deleted.
> > >
> > > 2017-10-11 11:40 GMT+08:00 Billy Liu <bi...@apache.org>:
> > >
> > > > The auto merge works when new segment is built. It's not a daily
> merge
> > > job,
> > > > but if-merge-check during each new build.
> > > >
> > > > 2017-10-11 11:12 GMT+08:00 周湘伦 <ja...@gmail.com>:
> > > >
> > > > > Hi,all
> > > > > I have set the Auto Merge Thresholds and Retention Threshold, but
> it
> > > > > doesn't work. Through the page, those segments are still
> segmented,
> > > and
> > > > > the expired segment has not been deleted.
> > > > >
> > > > > Is it necessary to configure what is in the configuration file?
> > > > >
> > > >
> > >
> >
>
Re: Auto merge thresholds and auto delete didn't work.
Posted by 周湘伦 <ja...@gmail.com>.
Thank you.
Without these hints.
Then I manually merged the segment and succeeded.
But automatic merge doesn't work yet.
My kylin version is 2.0.
2017-10-12 10:40 GMT+08:00 Billy Liu <bi...@apache.org>:
> Check the kylin.log
> Something like "Cube XXX doesn't need auto merge" "Cube XXX has N building
> segments" "will submit merge job on XXX" "Not ready for merge on cube XXX"
> "Failed to auto merge cube XXX"
>
> 2017-10-12 9:40 GMT+08:00 周湘伦 <ja...@gmail.com>:
>
> > Thank you.
> > My cube is incrementally built. But all of these incremental build
> segments
> > are still segmented.When i built these cubes incrementally,these segments
> > under these cubes are not merged.Expired segments have not been deleted.
> >
> > 2017-10-11 11:40 GMT+08:00 Billy Liu <bi...@apache.org>:
> >
> > > The auto merge works when new segment is built. It's not a daily merge
> > job,
> > > but if-merge-check during each new build.
> > >
> > > 2017-10-11 11:12 GMT+08:00 周湘伦 <ja...@gmail.com>:
> > >
> > > > Hi,all
> > > > I have set the Auto Merge Thresholds and Retention Threshold, but it
> > > > doesn't work. Through the page, those segments are still segmented,
> > and
> > > > the expired segment has not been deleted.
> > > >
> > > > Is it necessary to configure what is in the configuration file?
> > > >
> > >
> >
>
Re: Auto merge thresholds and auto delete didn't work.
Posted by Billy Liu <bi...@apache.org>.
Check the kylin.log
Something like "Cube XXX doesn't need auto merge" "Cube XXX has N building
segments" "will submit merge job on XXX" "Not ready for merge on cube XXX"
"Failed to auto merge cube XXX"
2017-10-12 9:40 GMT+08:00 周湘伦 <ja...@gmail.com>:
> Thank you.
> My cube is incrementally built. But all of these incremental build segments
> are still segmented.When i built these cubes incrementally,these segments
> under these cubes are not merged.Expired segments have not been deleted.
>
> 2017-10-11 11:40 GMT+08:00 Billy Liu <bi...@apache.org>:
>
> > The auto merge works when new segment is built. It's not a daily merge
> job,
> > but if-merge-check during each new build.
> >
> > 2017-10-11 11:12 GMT+08:00 周湘伦 <ja...@gmail.com>:
> >
> > > Hi,all
> > > I have set the Auto Merge Thresholds and Retention Threshold, but it
> > > doesn't work. Through the page, those segments are still segmented,
> and
> > > the expired segment has not been deleted.
> > >
> > > Is it necessary to configure what is in the configuration file?
> > >
> >
>
Re: Auto merge thresholds and auto delete didn't work.
Posted by 周湘伦 <ja...@gmail.com>.
Thank you.
My cube is incrementally built. But all of these incremental build segments
are still segmented.When i built these cubes incrementally,these segments
under these cubes are not merged.Expired segments have not been deleted.
2017-10-11 11:40 GMT+08:00 Billy Liu <bi...@apache.org>:
> The auto merge works when new segment is built. It's not a daily merge job,
> but if-merge-check during each new build.
>
> 2017-10-11 11:12 GMT+08:00 周湘伦 <ja...@gmail.com>:
>
> > Hi,all
> > I have set the Auto Merge Thresholds and Retention Threshold, but it
> > doesn't work. Through the page, those segments are still segmented, and
> > the expired segment has not been deleted.
> >
> > Is it necessary to configure what is in the configuration file?
> >
>
Re: Auto merge thresholds and auto delete didn't work.
Posted by Billy Liu <bi...@apache.org>.
The auto merge works when new segment is built. It's not a daily merge job,
but if-merge-check during each new build.
2017-10-11 11:12 GMT+08:00 周湘伦 <ja...@gmail.com>:
> Hi,all
> I have set the Auto Merge Thresholds and Retention Threshold, but it
> doesn't work. Through the page, those segments are still segmented, and
> the expired segment has not been deleted.
>
> Is it necessary to configure what is in the configuration file?
>