You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by David Nahoopii <na...@hotmail.com> on 2017/08/09 22:51:33 UTC
NiFi RecordPath Question
https://nifi.apache.org/docs/nifi-docs/html/record-path-guide.html#filters
Apologies in advance - I'm sure this email alias isn't used for questions, but I did see it at the top of the page in the link above.
Is it possible to do any AND condition with using record path?
Given the below json object, I would like to use RecordPath in an UpdateRecord processor to get the value of /loc2[*][isEmpty(./rlp) AND ./src = 'network']/acc (meaning, src = 'network' and rlp is empty/does not exist). Using nifi 1.2, is there no AND condition to use? Has one been added in 1.3 or later?
Thanks and apologies in advance. - Dave
{
"loc2": [
{
"acc": 92,
"src": "gps",
"ll": {
"lat": 41.83173031,
"lon": -88.09725264
},
"sol": 1498861615000,
"brn": 307.7,
"alt": 191,
"spd": 2.48reddi
},
{
"acc": 18.088,
"src": "network",
"ll": {
"lat": 41.8317428,
"lon": -88.096802
},
"sol": 1498865950344,
"alt": 193.9
},
{
"acc": 18.088,
"src": "network",
"ll": {
"lat": 41.8317428,
"lon": -88.096802
},
"sol": 1498865950344,
"alt": 193.9,
"rlp": "passive"
},
{
"acc": 20,
"src": "fused",
"ll": {
"lat": 41.8317428,
"lon": -88.096802
},
"sol": 1498867975640,
"alt": 0,
"spd": 0
}
],
}
Re: NiFi RecordPath Question
Posted by Mark Payne <ma...@hotmail.com>.
Hi David,
Just wanted to chime in that what Andy describes below should indeed work to provide an 'AND'
type of functionality. If you have problems getting this to work, please let us know!
Thanks
-Mark
On Aug 9, 2017, at 9:52 PM, Andy LoPresto <al...@apache.org>> wrote:
Hi David,
This is absolutely the correct place to ask these questions. There is also a mailing list more focused on the user experience and less of the development discussion at users@nifi.apache.org<ma...@nifi.apache.org> which may help as well.
Mark Payne contributed most of the record processing code, and has written about it here [1] and here [2], and Bryan Bende has also written a tutorial [3] on using it. I am far from a record path expert, but have you tried simply combining the predicates like so? (I don’t have a 1.2 instance available right now to test with).
/loc2[*][isEmpty(./rlp)][./src = 'network']/acc
If this doesn’t work, hopefully Mark or another user can chime in with a suggestion, or if it is not currently possible, you can open a Jira ticket requesting this feature.
[1] https://blogs.apache.org/nifi/entry/record-oriented-data-with-nifi
[2] https://blogs.apache.org/nifi/entry/real-time-sql-on-event
[3] http://bryanbende.com/development/2017/06/20/apache-nifi-records-and-schema-registries
Andy LoPresto
alopresto@apache.org<ma...@apache.org>
alopresto.apache@gmail.com<ma...@gmail.com>
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
On Aug 9, 2017, at 3:51 PM, David Nahoopii <na...@hotmail.com>> wrote:
https://nifi.apache.org/docs/nifi-docs/html/record-path-guide.html#filters
Apologies in advance - I'm sure this email alias isn't used for questions, but I did see it at the top of the page in the link above.
Is it possible to do any AND condition with using record path?
Given the below json object, I would like to use RecordPath in an UpdateRecord processor to get the value of /loc2[*][isEmpty(./rlp) AND ./src = 'network']/acc (meaning, src = 'network' and rlp is empty/does not exist). Using nifi 1.2, is there no AND condition to use? Has one been added in 1.3 or later?
Thanks and apologies in advance. - Dave
{
"loc2": [
{
"acc": 92,
"src": "gps",
"ll": {
"lat": 41.83173031,
"lon": -88.09725264
},
"sol": 1498861615000,
"brn": 307.7,
"alt": 191,
"spd": 2.48reddi
},
{
"acc": 18.088,
"src": "network",
"ll": {
"lat": 41.8317428,
"lon": -88.096802
},
"sol": 1498865950344,
"alt": 193.9
},
{
"acc": 18.088,
"src": "network",
"ll": {
"lat": 41.8317428,
"lon": -88.096802
},
"sol": 1498865950344,
"alt": 193.9,
"rlp": "passive"
},
{
"acc": 20,
"src": "fused",
"ll": {
"lat": 41.8317428,
"lon": -88.096802
},
"sol": 1498867975640,
"alt": 0,
"spd": 0
}
],
}
Re: NiFi RecordPath Question
Posted by Andy LoPresto <al...@apache.org>.
Hi David,
This is absolutely the correct place to ask these questions. There is also a mailing list more focused on the user experience and less of the development discussion at users@nifi.apache.org which may help as well.
Mark Payne contributed most of the record processing code, and has written about it here [1] and here [2], and Bryan Bende has also written a tutorial [3] on using it. I am far from a record path expert, but have you tried simply combining the predicates like so? (I don’t have a 1.2 instance available right now to test with).
/loc2[*][isEmpty(./rlp)][./src = 'network']/acc
If this doesn’t work, hopefully Mark or another user can chime in with a suggestion, or if it is not currently possible, you can open a Jira ticket requesting this feature.
[1] https://blogs.apache.org/nifi/entry/record-oriented-data-with-nifi
[2] https://blogs.apache.org/nifi/entry/real-time-sql-on-event
[3] http://bryanbende.com/development/2017/06/20/apache-nifi-records-and-schema-registries <http://bryanbende.com/development/2017/06/20/apache-nifi-records-and-schema-registries>
Andy LoPresto
alopresto@apache.org
alopresto.apache@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
> On Aug 9, 2017, at 3:51 PM, David Nahoopii <na...@hotmail.com> wrote:
>
> https://nifi.apache.org/docs/nifi-docs/html/record-path-guide.html#filters
>
>
> Apologies in advance - I'm sure this email alias isn't used for questions, but I did see it at the top of the page in the link above.
> Is it possible to do any AND condition with using record path?
>
>
>
> Given the below json object, I would like to use RecordPath in an UpdateRecord processor to get the value of /loc2[*][isEmpty(./rlp) AND ./src = 'network']/acc (meaning, src = 'network' and rlp is empty/does not exist). Using nifi 1.2, is there no AND condition to use? Has one been added in 1.3 or later?
>
>
> Thanks and apologies in advance. - Dave
>
>
> {
>
> "loc2": [
> {
> "acc": 92,
> "src": "gps",
> "ll": {
> "lat": 41.83173031,
> "lon": -88.09725264
> },
> "sol": 1498861615000,
> "brn": 307.7,
> "alt": 191,
> "spd": 2.48reddi
> },
> {
> "acc": 18.088,
> "src": "network",
> "ll": {
> "lat": 41.8317428,
> "lon": -88.096802
> },
> "sol": 1498865950344,
> "alt": 193.9
> },
> {
> "acc": 18.088,
> "src": "network",
> "ll": {
> "lat": 41.8317428,
> "lon": -88.096802
> },
> "sol": 1498865950344,
> "alt": 193.9,
> "rlp": "passive"
> },
>
> {
> "acc": 20,
> "src": "fused",
> "ll": {
> "lat": 41.8317428,
> "lon": -88.096802
> },
> "sol": 1498867975640,
> "alt": 0,
> "spd": 0
> }
> ],
>
>
> }