You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by prabhu Mahendran <pr...@gmail.com> on 2017/04/11 12:36:52 UTC

MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

In NiFi-0.6.1 ,i have try to reduce size of nifi-app.log to be stored in
local directory.

In that conf\logback.xml i have configured "MaxFileSize" to be 1MB.I think
this only stores nifi-app.log should be under 1 MB Size only.But it doesn't
do like that.It always store every logs.

<appender name="APP_FILE"
class="ch.qos.logback.core.rolling.RollingFileAppender">
        <file>logs/nifi-app.log</file>
        <rollingPolicy
class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
            <!--
              For daily rollover, use 'app_%d.log'.
              For hourly rollover, use 'app_%d{yyyy-MM-dd_HH}.log'.
              To GZIP rolled files, replace '.log' with '.log.gz'.
              To ZIP rolled files, replace '.log' with '.log.zip'.
            -->
            <fileNamePattern>./logs/nifi-app_%d{yyyy-MM-dd_HH}.%i.log</fileNamePattern>
            <timeBasedFileNamingAndTriggeringPolicy
class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP">
                <maxFileSize>1MB</maxFileSize>
            </timeBasedFileNamingAndTriggeringPolicy>
            <!-- keep 30 log files worth of history -->
            <maxHistory>1</maxHistory>
        </rollingPolicy>
        <encoder class="ch.qos.logback.classic.encoder.PatternLayoutEncoder">
            <pattern>%date %level [%thread] %logger{40} %msg%n</pattern>
            <immediateFlush>true</immediateFlush>
        </encoder>
    </appender>

Now i need to set 1MB for size of an nifi-app.log.

*How to set size for nifi-app.log?*

Re: MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

Posted by Jeff <jt...@gmail.com>.
Prabhu,

You're right, NiFi has been using logback 1.1.3 for quite a while now.
Looks like we need to investigate upgrading.

I created a JIRA to address this issue:
https://issues.apache.org/jira/browse/NIFI-3699

On Wed, Apr 12, 2017 at 7:25 AM prabhu Mahendran <pr...@gmail.com>
wrote:

> For your information,I have try that same procedure in NiFi-1.1.1 also.
>
> In that also NiFi have logback-classic-1.1.3 and logback-core-1.1.3 jar
> only present.
>
> In conf\logback.xml  MaxFileSize and maxHistory in
> *TimeBasedRollingPolicy*  not work.
>
>
>
> On Wed, Apr 12, 2017 at 3:58 PM, prabhu Mahendran <prabhuu161994@gmail.com
> > wrote:
>
> Jeff,
>
> Thanks for your mail.
>
> I need to use log back 1.1.7 in NiFi-0.6.1 .
>
> Can you suggest any way to change 1.1.3 into 1.1.7?
>
> On Wed, Apr 12, 2017 at 9:42 AM, Jeff <jt...@gmail.com> wrote:
>
> Hello Prabhu,
>
> I think you're running into a logback bug [1] that is fixed with 1.1.7.
> Unfortunately, it looks like NiFi 0.6.1 is using logback 1.1.3.
>
> [1] https://jira.qos.ch/browse/LOGBACK-747
>
> On Tue, Apr 11, 2017 at 8:37 AM prabhu Mahendran <pr...@gmail.com>
> wrote:
>
> In NiFi-0.6.1 ,i have try to reduce size of nifi-app.log to be stored in
> local directory.
>
> In that conf\logback.xml i have configured "MaxFileSize" to be 1MB.I think
> this only stores nifi-app.log should be under 1 MB Size only.But it doesn't
> do like that.It always store every logs.
>
> <appender name="APP_FILE" class="ch.qos.logback.core.rolling.RollingFileAppender">
>         <file>logs/nifi-app.log</file>
>         <rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
>             <!--
>               For daily rollover, use 'app_%d.log'.
>               For hourly rollover, use 'app_%d{yyyy-MM-dd_HH}.log'.
>               To GZIP rolled files, replace '.log' with '.log.gz'.
>               To ZIP rolled files, replace '.log' with '.log.zip'.
>             -->
>             <fileNamePattern>./logs/nifi-app_%d{yyyy-MM-dd_HH}.%i.log</fileNamePattern>
>             <timeBasedFileNamingAndTriggeringPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP">
>                 <maxFileSize>1MB</maxFileSize>
>             </timeBasedFileNamingAndTriggeringPolicy>
>             <!-- keep 30 log files worth of history -->
>             <maxHistory>1</maxHistory>
>         </rollingPolicy>
>         <encoder class="ch.qos.logback.classic.encoder.PatternLayoutEncoder">
>             <pattern>%date %level [%thread] %logger{40} %msg%n</pattern>
>             <immediateFlush>true</immediateFlush>
>         </encoder>
>     </appender>
>
> Now i need to set 1MB for size of an nifi-app.log.
>
> *How to set size for nifi-app.log?*
>
>
>
>

Re: MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

Posted by prabhu Mahendran <pr...@gmail.com>.
For your information,I have try that same procedure in NiFi-1.1.1 also.

In that also NiFi have logback-classic-1.1.3 and logback-core-1.1.3 jar
only present.

In conf\logback.xml  MaxFileSize and maxHistory in *TimeBasedRollingPolicy*
not work.



On Wed, Apr 12, 2017 at 3:58 PM, prabhu Mahendran <pr...@gmail.com>
wrote:

> Jeff,
>
> Thanks for your mail.
>
> I need to use log back 1.1.7 in NiFi-0.6.1 .
>
> Can you suggest any way to change 1.1.3 into 1.1.7?
>
> On Wed, Apr 12, 2017 at 9:42 AM, Jeff <jt...@gmail.com> wrote:
>
>> Hello Prabhu,
>>
>> I think you're running into a logback bug [1] that is fixed with 1.1.7.
>> Unfortunately, it looks like NiFi 0.6.1 is using logback 1.1.3.
>>
>> [1] https://jira.qos.ch/browse/LOGBACK-747
>>
>> On Tue, Apr 11, 2017 at 8:37 AM prabhu Mahendran <pr...@gmail.com>
>> wrote:
>>
>>> In NiFi-0.6.1 ,i have try to reduce size of nifi-app.log to be stored in
>>> local directory.
>>>
>>> In that conf\logback.xml i have configured "MaxFileSize" to be 1MB.I
>>> think this only stores nifi-app.log should be under 1 MB Size only.But it
>>> doesn't do like that.It always store every logs.
>>>
>>> <appender name="APP_FILE" class="ch.qos.logback.core.rolling.RollingFileAppender">
>>>         <file>logs/nifi-app.log</file>
>>>         <rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
>>>             <!--
>>>               For daily rollover, use 'app_%d.log'.
>>>               For hourly rollover, use 'app_%d{yyyy-MM-dd_HH}.log'.
>>>               To GZIP rolled files, replace '.log' with '.log.gz'.
>>>               To ZIP rolled files, replace '.log' with '.log.zip'.
>>>             -->
>>>             <fileNamePattern>./logs/nifi-app_%d{yyyy-MM-dd_HH}.%i.log</fileNamePattern>
>>>             <timeBasedFileNamingAndTriggeringPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP">
>>>                 <maxFileSize>1MB</maxFileSize>
>>>             </timeBasedFileNamingAndTriggeringPolicy>
>>>             <!-- keep 30 log files worth of history -->
>>>             <maxHistory>1</maxHistory>
>>>         </rollingPolicy>
>>>         <encoder class="ch.qos.logback.classic.encoder.PatternLayoutEncoder">
>>>             <pattern>%date %level [%thread] %logger{40} %msg%n</pattern>
>>>             <immediateFlush>true</immediateFlush>
>>>         </encoder>
>>>     </appender>
>>>
>>> Now i need to set 1MB for size of an nifi-app.log.
>>>
>>> *How to set size for nifi-app.log?*
>>>
>>
>

Re: MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

Posted by prabhu Mahendran <pr...@gmail.com>.
Jeff,

Thanks for your mail.

I need to use log back 1.1.7 in NiFi-0.6.1 .

Can you suggest any way to change 1.1.3 into 1.1.7?

On Wed, Apr 12, 2017 at 9:42 AM, Jeff <jt...@gmail.com> wrote:

> Hello Prabhu,
>
> I think you're running into a logback bug [1] that is fixed with 1.1.7.
> Unfortunately, it looks like NiFi 0.6.1 is using logback 1.1.3.
>
> [1] https://jira.qos.ch/browse/LOGBACK-747
>
> On Tue, Apr 11, 2017 at 8:37 AM prabhu Mahendran <pr...@gmail.com>
> wrote:
>
>> In NiFi-0.6.1 ,i have try to reduce size of nifi-app.log to be stored in
>> local directory.
>>
>> In that conf\logback.xml i have configured "MaxFileSize" to be 1MB.I
>> think this only stores nifi-app.log should be under 1 MB Size only.But it
>> doesn't do like that.It always store every logs.
>>
>> <appender name="APP_FILE" class="ch.qos.logback.core.rolling.RollingFileAppender">
>>         <file>logs/nifi-app.log</file>
>>         <rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
>>             <!--
>>               For daily rollover, use 'app_%d.log'.
>>               For hourly rollover, use 'app_%d{yyyy-MM-dd_HH}.log'.
>>               To GZIP rolled files, replace '.log' with '.log.gz'.
>>               To ZIP rolled files, replace '.log' with '.log.zip'.
>>             -->
>>             <fileNamePattern>./logs/nifi-app_%d{yyyy-MM-dd_HH}.%i.log</fileNamePattern>
>>             <timeBasedFileNamingAndTriggeringPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP">
>>                 <maxFileSize>1MB</maxFileSize>
>>             </timeBasedFileNamingAndTriggeringPolicy>
>>             <!-- keep 30 log files worth of history -->
>>             <maxHistory>1</maxHistory>
>>         </rollingPolicy>
>>         <encoder class="ch.qos.logback.classic.encoder.PatternLayoutEncoder">
>>             <pattern>%date %level [%thread] %logger{40} %msg%n</pattern>
>>             <immediateFlush>true</immediateFlush>
>>         </encoder>
>>     </appender>
>>
>> Now i need to set 1MB for size of an nifi-app.log.
>>
>> *How to set size for nifi-app.log?*
>>
>

Re: MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

Posted by Jeff <jt...@gmail.com>.
Hello Prabhu,

I think you're running into a logback bug [1] that is fixed with 1.1.7.
Unfortunately, it looks like NiFi 0.6.1 is using logback 1.1.3.

[1] https://jira.qos.ch/browse/LOGBACK-747

On Tue, Apr 11, 2017 at 8:37 AM prabhu Mahendran <pr...@gmail.com>
wrote:

> In NiFi-0.6.1 ,i have try to reduce size of nifi-app.log to be stored in
> local directory.
>
> In that conf\logback.xml i have configured "MaxFileSize" to be 1MB.I think
> this only stores nifi-app.log should be under 1 MB Size only.But it doesn't
> do like that.It always store every logs.
>
> <appender name="APP_FILE" class="ch.qos.logback.core.rolling.RollingFileAppender">
>         <file>logs/nifi-app.log</file>
>         <rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
>             <!--
>               For daily rollover, use 'app_%d.log'.
>               For hourly rollover, use 'app_%d{yyyy-MM-dd_HH}.log'.
>               To GZIP rolled files, replace '.log' with '.log.gz'.
>               To ZIP rolled files, replace '.log' with '.log.zip'.
>             -->
>             <fileNamePattern>./logs/nifi-app_%d{yyyy-MM-dd_HH}.%i.log</fileNamePattern>
>             <timeBasedFileNamingAndTriggeringPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP">
>                 <maxFileSize>1MB</maxFileSize>
>             </timeBasedFileNamingAndTriggeringPolicy>
>             <!-- keep 30 log files worth of history -->
>             <maxHistory>1</maxHistory>
>         </rollingPolicy>
>         <encoder class="ch.qos.logback.classic.encoder.PatternLayoutEncoder">
>             <pattern>%date %level [%thread] %logger{40} %msg%n</pattern>
>             <immediateFlush>true</immediateFlush>
>         </encoder>
>     </appender>
>
> Now i need to set 1MB for size of an nifi-app.log.
>
> *How to set size for nifi-app.log?*
>