You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/02/10 23:43:21 UTC
[GitHub] [pinot] kkrugler opened a new pull request #8191: Add support for pushFileNamePattern in pushJobSpec
kkrugler opened a new pull request #8191:
URL: https://github.com/apache/pinot/pull/8191
## Description
Support a new, optional pushFileNamePattern parameter in the pushJobSpec section of the job yaml. This will filter segments in the outputDir that are pushed to Pinot.
## Upgrade Notes
Does this PR prevent a zero down-time upgrade? (Assume upgrade order: Controller, Broker, Server, Minion)
* [ ] Yes (Please label as **<code>backward-incompat</code>**, and complete the section below on Release Notes)
Does this PR fix a zero-downtime upgrade introduced earlier?
* [ ] Yes (Please label this as **<code>backward-incompat</code>**, and complete the section below on Release Notes)
Does this PR otherwise need attention when creating release notes? Things to consider:
- New configuration options
- Deprecation of configurations
- Signature changes to public methods/interfaces
- New plugins added or old plugins removed
* [X] Yes (Please label this PR as **<code>release-notes</code>** and complete the section on Release Notes)
## Release Notes
Support for name-based filtering of segments being pushed to the Pinot cluster.
## Documentation
In the https://docs.pinot.apache.org/configuration-reference/job-specification#push-job-spec section, add:
```
pushFileNamePattern | segment name pattern for which segments to push, supported glob and regex patterns. E.g.
'glob:stats_* will push all segment files under the outputDirURI whose names start with 'stats_'.
'glob:*2022-01*' will push all the segment files under the outputDirURI whose names contain '2022-01'.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] kkrugler commented on pull request #8191: Add support for pushFileNamePattern in pushJobSpec
Posted by GitBox <gi...@apache.org>.
kkrugler commented on pull request #8191:
URL: https://github.com/apache/pinot/pull/8191#issuecomment-1039821662
Thanks @Jackie-Jiang !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang merged pull request #8191: Add support for pushFileNamePattern in pushJobSpec
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang merged pull request #8191:
URL: https://github.com/apache/pinot/pull/8191
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] kkrugler commented on pull request #8191: Add support for pushFileNamePattern in pushJobSpec
Posted by GitBox <gi...@apache.org>.
kkrugler commented on pull request #8191:
URL: https://github.com/apache/pinot/pull/8191#issuecomment-1036461997
See also #8141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang merged pull request #8191: Add support for pushFileNamePattern in pushJobSpec
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang merged pull request #8191:
URL: https://github.com/apache/pinot/pull/8191
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] kkrugler commented on pull request #8191: Add support for pushFileNamePattern in pushJobSpec
Posted by GitBox <gi...@apache.org>.
kkrugler commented on pull request #8191:
URL: https://github.com/apache/pinot/pull/8191#issuecomment-1039821662
Thanks @Jackie-Jiang !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org