You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Steve Stogner (Created) (JIRA)" <ji...@apache.org> on 2012/03/20 23:35:44 UTC
[jira] [Created] (FLUME-1042) Improve delim / delimMode used by
tail and tailDir to allow inclusion or exclusion of part of the delimiter
Improve delim / delimMode used by tail and tailDir to allow inclusion or exclusion of part of the delimiter
-----------------------------------------------------------------------------------------------------------
Key: FLUME-1042
URL: https://issues.apache.org/jira/browse/FLUME-1042
Project: Flume
Issue Type: Improvement
Components: Sinks+Sources
Affects Versions: v0.9.4
Reporter: Steve Stogner
Priority: Minor
I want stack dumps in a log file sent as a single event to a collector.
>From the user manual:
"Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
tail("file", delim="\\n\\d\\d\\d
d", delimMode="next")"
The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1042) Improve delim / delimMode used by
tail and tailDir to allow inclusion or exclusion of part of the delimiter
Posted by "Steve Stogner (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Stogner updated FLUME-1042:
---------------------------------
Description:
I want stack dumps in a log file sent as a single event to a collector.
>From the user manual:
{quote}
Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")
{quote}
The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
was:
I want stack dumps in a log file sent as a single event to a collector.
>From the user manual:
"Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")"
The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
> Improve delim / delimMode used by tail and tailDir to allow inclusion or exclusion of part of the delimiter
> -----------------------------------------------------------------------------------------------------------
>
> Key: FLUME-1042
> URL: https://issues.apache.org/jira/browse/FLUME-1042
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4
> Reporter: Steve Stogner
> Priority: Minor
>
> I want stack dumps in a log file sent as a single event to a collector.
> From the user manual:
> {quote}
> Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
> tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")
> {quote}
> The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1042) Improve delim / delimMode used by
tail and tailDir to allow inclusion or exclusion of part of the delimiter
Posted by "Steve Stogner (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Stogner updated FLUME-1042:
---------------------------------
Description:
I want stack dumps in a log file sent as a single event to a collector.
>From the user manual:
"Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")"
The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
was:
I want stack dumps in a log file sent as a single event to a collector.
>From the user manual:
"Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
tail("file", delim="\\n\\d\\d\\d
d", delimMode="next")"
The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
> Improve delim / delimMode used by tail and tailDir to allow inclusion or exclusion of part of the delimiter
> -----------------------------------------------------------------------------------------------------------
>
> Key: FLUME-1042
> URL: https://issues.apache.org/jira/browse/FLUME-1042
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4
> Reporter: Steve Stogner
> Priority: Minor
>
> I want stack dumps in a log file sent as a single event to a collector.
> From the user manual:
> "Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
> tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")"
> The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1042) Improve delim / delimMode used by
tail and tailDir to allow inclusion or exclusion of part of the delimiter
Posted by "Steve Stogner (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Stogner updated FLUME-1042:
---------------------------------
Description:
I want stack dumps in a log file sent as a single event to a collector.
>From the user manual:
{quote}
Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
{noformat}
tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")
{noformat}
{quote}
The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
was:
I want stack dumps in a log file sent as a single event to a collector.
>From the user manual:
{quote}
Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")
{quote}
The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
> Improve delim / delimMode used by tail and tailDir to allow inclusion or exclusion of part of the delimiter
> -----------------------------------------------------------------------------------------------------------
>
> Key: FLUME-1042
> URL: https://issues.apache.org/jira/browse/FLUME-1042
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4
> Reporter: Steve Stogner
> Priority: Minor
>
> I want stack dumps in a log file sent as a single event to a collector.
> From the user manual:
> {quote}
> Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).
> {noformat}
> tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")
> {noformat}
> {quote}
> The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira