You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/11/30 16:12:00 UTC
[jira] [Commented] (NIFI-3975) TailFile stopped tailing file
[ https://issues.apache.org/jira/browse/NIFI-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272861#comment-16272861 ]
ASF subversion and git services commented on NIFI-3975:
-------------------------------------------------------
Commit 45df23b1e09f340fb2c7f3c3234462570ddb5f6b in nifi's branch refs/heads/master from [~markap14]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=45df23b ]
NIFI-4607, NIFI-3975, NIFI-4602, NIFI-4606: This closes #2272. Fixed bug in TailFile that caused new Primary Node to not pull current Clustered State when File Location was set to Remote. Fixed bug that caused TailFile to occasionally become 'stuck' when the file it is tailing is renamed and a new file is created with the same name. Removed the 'Rolling Strategy' property from TailFile because it is not actually used in the processor anymore. Deleted MonitorMemoryTest because the unit test was testing the behavior of FlowController more than the behavior of the reporting task itself and in order to do so had a dependency in the pom.xml on nifi-framework-core, which means that it no longer compiles when FlowController is modified.
Signed-off-by: joewitt <jo...@apache.org>
> TailFile stopped tailing file
> -----------------------------
>
> Key: NIFI-3975
> URL: https://issues.apache.org/jira/browse/NIFI-3975
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 1.2.0
> Environment: Linux
> Reporter: Mark Payne
> Assignee: Mark Payne
> Fix For: 1.5.0
>
>
> I have a TailFile processor running on a 3-node cluster. It is tailing logs/nifi-app.log. Two of the nodes seem to be working well. The third node is not picking up any data. I enabled DEBUG logging and see the following logs:
> {code}
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Recovering Rolled Off Files; total number of files rolled off = 0
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Reading lines starting at position 105133313
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] No data to consume; removed created FlowFile
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Returning LOCAL State: StandardStateMap[version=442100928, values={file.0.length=0, file.0.position=105133313, file.0.checksum=0, file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}]
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Setting LOCAL State to {file.0.length=0, file.0.position=105133313, file.0.checksum=0, file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Recovering Rolled Off Files; total number of files rolled off = 0
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Reading lines starting at position 105133313
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] No data to consume; removed created FlowFile
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Returning LOCAL State: StandardStateMap[version=442100929, values={file.0.length=0, file.0.position=105133313, file.0.checksum=0, file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}]
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Setting LOCAL State to {file.0.length=0, file.0.position=105133313, file.0.checksum=0, file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Recovering Rolled Off Files; total number of files rolled off = 0
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Reading lines starting at position 105133313
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] No data to consume; removed created FlowFile
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.TailFile TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Returning LOCAL State: StandardStateMap[version=442100930, values={file.0.length=0, file.0.position=105133313, file.0.checksum=0, file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}]
> {code}
> The file is approximately 33 MB right now. But the state indicates that the position it is at in the file is over 105 MB; also, according to state, the checksum is 0 and the file length is 0. This likely indicates that the file was about 105 MB at one point and then it rolled over and stopped processing properly, given that it thinks the checksum is 0.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)