You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Christopher Hamm <em...@christopherhamm.com> on 2015/11/06 08:33:48 UTC

Help me figure out why this wont work

I have a dataFlow setup that looks up api call using current date. I turn
it on and nothing seems to happen.. Help appreciated.



-- 
Sincerely,
Chris Hamm
(E) cehamm01@gmail.com
(Twitter) http://twitter.com/webhamm
(Linkedin) http://www.linkedin.com/in/chrishamm

Re: Help me figure out why this wont work

Posted by Joe Percivall <jo...@yahoo.com>.
Chris,

Just posted a patch to allow expression language for the URL property[1]. I also enabled expression language for the filename property since there didn't seem to be a reason not to. 

[1] https://issues.apache.org/jira/browse/NIFI-993

Hope that helps,
Joe

- - - - - - 
Joseph Percivall
linkedin.com/in/Percivall
e: joepercivall@yahoo.com




On Monday, November 9, 2015 3:26 PM, Joe Percivall <jo...@yahoo.com> wrote:
Hey Chris,

I feel your "Ugg" and I'd be happy to knock it out. I'm doing a bunch of work with InvokeHttp already so I should be able to get this done pretty quick.


Joe- - - - - - 
Joseph Percivall
linkedin.com/in/Percivall
e: joepercivall@yahoo.com





On Monday, November 9, 2015 3:23 PM, Christopher Hamm <em...@christopherhamm.com> wrote:



Ugg
https://issues.apache.org/jira/browse/NIFI-993



On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <em...@christopherhamm.com> wrote:

Ok tried that and still wont work. I think it as something to do with message of "supports expression language: false" for the url. Attached error and xml template. Any help is appreciated. I need to understand how the dynamic querying should work in order to complete an actual project. Many thanks
>
>
>
>​
>
>
>
>On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com> wrote:
>
>Christopher,
>>
>>
>>For this setup, you want to use GetHTTP. InvokeHTTP operates off of FlowFile input.  
>>
>>
>>
>>
>>On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <em...@christopherhamm.com> wrote:
>>
>>I have a dataFlow setup that looks up api call using current date. I turn it on and nothing seems to happen.. Help appreciated.
>>>
>>>
>>>
>>>
>>>
>>>-- 
>>>
>>>Sincerely,
>>>Chris Hamm
>>>(E) cehamm01@gmail.com
>>>(Twitter) http://twitter.com/webhamm
>>>(Linkedin) http://www.linkedin.com/in/chrishamm
>>
>
>
>
>-- 
>
>Sincerely,
>Chris Hamm
>(E) cehamm01@gmail.com
>(Twitter) http://twitter.com/webhamm
>(Linkedin) http://www.linkedin.com/in/chrishamm


-- 

Sincerely,
Chris Hamm
(E) cehamm01@gmail.com
(Twitter) http://twitter.com/webhamm
(Linkedin) http://www.linkedin.com/in/chrishamm

Re: Help me figure out why this wont work

Posted by Aldrin Piri <al...@gmail.com>.
Just for awareness, the processor at issue and to be addressed is GetHTTP.
InvokeHTTP supports EL but requires an input.

On Mon, Nov 9, 2015 at 3:26 PM, Joe Percivall <jo...@yahoo.com>
wrote:

> Hey Chris,
>
> I feel your "Ugg" and I'd be happy to knock it out. I'm doing a bunch of
> work with InvokeHttp already so I should be able to get this done pretty
> quick.
>
>
> Joe- - - - - -
> Joseph Percivall
> linkedin.com/in/Percivall
> e: joepercivall@yahoo.com
>
>
>
>
> On Monday, November 9, 2015 3:23 PM, Christopher Hamm <
> email@christopherhamm.com> wrote:
>
>
>
> Ugg
> https://issues.apache.org/jira/browse/NIFI-993
>
>
>
> On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <
> email@christopherhamm.com> wrote:
>
> Ok tried that and still wont work. I think it as something to do with
> message of "supports expression language: false" for the url. Attached
> error and xml template. Any help is appreciated. I need to understand how
> the dynamic querying should work in order to complete an actual project.
> Many thanks
> >
> >
> >
> >​
> >
> >
> >
> >On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com> wrote:
> >
> >Christopher,
> >>
> >>
> >>For this setup, you want to use GetHTTP. InvokeHTTP operates off of
> FlowFile input.
> >>
> >>
> >>
> >>
> >>On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <
> email@christopherhamm.com> wrote:
> >>
> >>I have a dataFlow setup that looks up api call using current date. I
> turn it on and nothing seems to happen.. Help appreciated.
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>--
> >>>
> >>>Sincerely,
> >>>Chris Hamm
> >>>(E) cehamm01@gmail.com
> >>>(Twitter) http://twitter.com/webhamm
> >>>(Linkedin) http://www.linkedin.com/in/chrishamm
> >>
> >
> >
> >
> >--
> >
> >Sincerely,
> >Chris Hamm
> >(E) cehamm01@gmail.com
> >(Twitter) http://twitter.com/webhamm
> >(Linkedin) http://www.linkedin.com/in/chrishamm
>
>
> --
>
> Sincerely,
> Chris Hamm
> (E) cehamm01@gmail.com
> (Twitter) http://twitter.com/webhamm
> (Linkedin) http://www.linkedin.com/in/chrishamm
>

Re: Help me figure out why this wont work

Posted by Joe Percivall <jo...@yahoo.com>.
Hey Chris,

I feel your "Ugg" and I'd be happy to knock it out. I'm doing a bunch of work with InvokeHttp already so I should be able to get this done pretty quick.

 
Joe- - - - - - 
Joseph Percivall
linkedin.com/in/Percivall
e: joepercivall@yahoo.com




On Monday, November 9, 2015 3:23 PM, Christopher Hamm <em...@christopherhamm.com> wrote:



Ugg
https://issues.apache.org/jira/browse/NIFI-993



On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <em...@christopherhamm.com> wrote:

Ok tried that and still wont work. I think it as something to do with message of "supports expression language: false" for the url. Attached error and xml template. Any help is appreciated. I need to understand how the dynamic querying should work in order to complete an actual project. Many thanks
>
>
>
>​
>
>
>
>On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com> wrote:
>
>Christopher,
>>
>>
>>For this setup, you want to use GetHTTP. InvokeHTTP operates off of FlowFile input.  
>>
>>
>>
>>
>>On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <em...@christopherhamm.com> wrote:
>>
>>I have a dataFlow setup that looks up api call using current date. I turn it on and nothing seems to happen.. Help appreciated.
>>>
>>>
>>>
>>>
>>>
>>>-- 
>>>
>>>Sincerely,
>>>Chris Hamm
>>>(E) cehamm01@gmail.com
>>>(Twitter) http://twitter.com/webhamm
>>>(Linkedin) http://www.linkedin.com/in/chrishamm
>>
>
>
>
>-- 
>
>Sincerely,
>Chris Hamm
>(E) cehamm01@gmail.com
>(Twitter) http://twitter.com/webhamm
>(Linkedin) http://www.linkedin.com/in/chrishamm


-- 

Sincerely,
Chris Hamm
(E) cehamm01@gmail.com
(Twitter) http://twitter.com/webhamm
(Linkedin) http://www.linkedin.com/in/chrishamm

Re: Help me figure out why this wont work

Posted by Mark Payne <ma...@hotmail.com>.
Christopher,

You can look into the EvaluateXQuery, EvaluateXPath, and TransformXml processors to extract data from XML files.

You can then use ReplaceText to build the SQL statement that you want to use and PutSQL to update the database.

Thanks
-Mark


> On Nov 9, 2015, at 3:42 PM, Christopher Hamm <ce...@gmail.com> wrote:
> 
> I just tried with 0B size set and it worked fine. Now I just need to look into parsing the xml to extract fields and update a MySql db.
> 
> Any guidance on that?
> 
> On Nov 9, 2015 3:32 PM, "Joe Witt" <joe.witt@gmail.com <ma...@gmail.com>> wrote:
> "Did you try using an invokeHTTP processor with a FlowFile input file created using the GenerateFlowFile processor?" -- Which we should admit is super hacky and we're fixing in 0.4.0 :-)
> 
> On Mon, Nov 9, 2015 at 3:30 PM, Matthew Clarke <matt.clarke.138@gmail.com <ma...@gmail.com>> wrote:
> Did you try using an invokeHTTP processor with a FlowFile input file created using the GenerateFlowFile processor?
> 
> On Mon, Nov 9, 2015 at 3:23 PM, Christopher Hamm <email@christopherhamm.com <ma...@christopherhamm.com>> wrote:
> Ugg
> https://issues.apache.org/jira/browse/NIFI-993 <https://issues.apache.org/jira/browse/NIFI-993>
> 
> On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <email@christopherhamm.com <ma...@christopherhamm.com>> wrote:
> Ok tried that and still wont work. I think it as something to do with message of "supports expression language: false" for the url. Attached error and xml template. Any help is appreciated. I need to understand how the dynamic querying should work in order to complete an actual project. Many thanks
> 
> <nifi-processor-message.png>
> ​
> 
> On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <aldrinpiri@gmail.com <ma...@gmail.com>> wrote:
> Christopher,
> 
> For this setup, you want to use GetHTTP. InvokeHTTP operates off of FlowFile input.  
> 
> 
> On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <email@christopherhamm.com <ma...@christopherhamm.com>> wrote:
> I have a dataFlow setup that looks up api call using current date. I turn it on and nothing seems to happen.. Help appreciated.
> 
> 
> 
> -- 
> Sincerely,
> Chris Hamm
> (E) cehamm01@gmail.com <ma...@gmail.com>
> (Twitter) http://twitter.com/webhamm <http://twitter.com/webhamm>
> (Linkedin) http://www.linkedin.com/in/chrishamm <http://www.linkedin.com/in/chrishamm>
> 
> 
> 
> -- 
> Sincerely,
> Chris Hamm
> (E) cehamm01@gmail.com <ma...@gmail.com>
> (Twitter) http://twitter.com/webhamm <http://twitter.com/webhamm>
> (Linkedin) http://www.linkedin.com/in/chrishamm <http://www.linkedin.com/in/chrishamm>
> 
> 
> -- 
> Sincerely,
> Chris Hamm
> (E) cehamm01@gmail.com <ma...@gmail.com>
> (Twitter) http://twitter.com/webhamm <http://twitter.com/webhamm>
> (Linkedin) http://www.linkedin.com/in/chrishamm <http://www.linkedin.com/in/chrishamm>
> 


Re: Help me figure out why this wont work

Posted by Christopher Hamm <ce...@gmail.com>.
I just tried with 0B size set and it worked fine. Now I just need to look
into parsing the xml to extract fields and update a MySql db.

Any guidance on that?
On Nov 9, 2015 3:32 PM, "Joe Witt" <jo...@gmail.com> wrote:

> "Did you try using an invokeHTTP processor with a FlowFile input file
> created using the GenerateFlowFile processor?" -- Which we should admit
> is super hacky and we're fixing in 0.4.0 :-)
>
> On Mon, Nov 9, 2015 at 3:30 PM, Matthew Clarke <ma...@gmail.com>
> wrote:
>
>> Did you try using an invokeHTTP processor with a FlowFile input file
>> created using the GenerateFlowFile processor?
>>
>> On Mon, Nov 9, 2015 at 3:23 PM, Christopher Hamm <
>> email@christopherhamm.com> wrote:
>>
>>> Ugg
>>> https://issues.apache.org/jira/browse/NIFI-993
>>>
>>> On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <
>>> email@christopherhamm.com> wrote:
>>>
>>>> Ok tried that and still wont work. I think it as something to do with
>>>> message of "supports expression language: false" for the url. Attached
>>>> error and xml template. Any help is appreciated. I need to understand how
>>>> the dynamic querying should work in order to complete an actual project.
>>>> Many thanks
>>>>
>>>>
>>>> ​
>>>>
>>>> On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com>
>>>> wrote:
>>>>
>>>>> Christopher,
>>>>>
>>>>> For this setup, you want to use GetHTTP. InvokeHTTP operates off of
>>>>> FlowFile input.
>>>>>
>>>>>
>>>>> On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <
>>>>> email@christopherhamm.com> wrote:
>>>>>
>>>>>> I have a dataFlow setup that looks up api call using current date. I
>>>>>> turn it on and nothing seems to happen.. Help appreciated.
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Sincerely,
>>>>>> Chris Hamm
>>>>>> (E) cehamm01@gmail.com
>>>>>> (Twitter) http://twitter.com/webhamm
>>>>>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Sincerely,
>>>> Chris Hamm
>>>> (E) cehamm01@gmail.com
>>>> (Twitter) http://twitter.com/webhamm
>>>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>>>
>>>
>>>
>>>
>>> --
>>> Sincerely,
>>> Chris Hamm
>>> (E) cehamm01@gmail.com
>>> (Twitter) http://twitter.com/webhamm
>>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>>
>>
>>
>

Re: Help me figure out why this wont work

Posted by Joe Witt <jo...@gmail.com>.
"Did you try using an invokeHTTP processor with a FlowFile input file
created using the GenerateFlowFile processor?" -- Which we should admit is
super hacky and we're fixing in 0.4.0 :-)

On Mon, Nov 9, 2015 at 3:30 PM, Matthew Clarke <ma...@gmail.com>
wrote:

> Did you try using an invokeHTTP processor with a FlowFile input file
> created using the GenerateFlowFile processor?
>
> On Mon, Nov 9, 2015 at 3:23 PM, Christopher Hamm <
> email@christopherhamm.com> wrote:
>
>> Ugg
>> https://issues.apache.org/jira/browse/NIFI-993
>>
>> On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <
>> email@christopherhamm.com> wrote:
>>
>>> Ok tried that and still wont work. I think it as something to do with
>>> message of "supports expression language: false" for the url. Attached
>>> error and xml template. Any help is appreciated. I need to understand how
>>> the dynamic querying should work in order to complete an actual project.
>>> Many thanks
>>>
>>>
>>> ​
>>>
>>> On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com>
>>> wrote:
>>>
>>>> Christopher,
>>>>
>>>> For this setup, you want to use GetHTTP. InvokeHTTP operates off of
>>>> FlowFile input.
>>>>
>>>>
>>>> On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <
>>>> email@christopherhamm.com> wrote:
>>>>
>>>>> I have a dataFlow setup that looks up api call using current date. I
>>>>> turn it on and nothing seems to happen.. Help appreciated.
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Sincerely,
>>>>> Chris Hamm
>>>>> (E) cehamm01@gmail.com
>>>>> (Twitter) http://twitter.com/webhamm
>>>>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Sincerely,
>>> Chris Hamm
>>> (E) cehamm01@gmail.com
>>> (Twitter) http://twitter.com/webhamm
>>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>>
>>
>>
>>
>> --
>> Sincerely,
>> Chris Hamm
>> (E) cehamm01@gmail.com
>> (Twitter) http://twitter.com/webhamm
>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>
>
>

Re: Help me figure out why this wont work

Posted by Matthew Clarke <ma...@gmail.com>.
Did you try using an invokeHTTP processor with a FlowFile input file
created using the GenerateFlowFile processor?

On Mon, Nov 9, 2015 at 3:23 PM, Christopher Hamm <em...@christopherhamm.com>
wrote:

> Ugg
> https://issues.apache.org/jira/browse/NIFI-993
>
> On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <
> email@christopherhamm.com> wrote:
>
>> Ok tried that and still wont work. I think it as something to do with
>> message of "supports expression language: false" for the url. Attached
>> error and xml template. Any help is appreciated. I need to understand how
>> the dynamic querying should work in order to complete an actual project.
>> Many thanks
>>
>>
>> ​
>>
>> On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com> wrote:
>>
>>> Christopher,
>>>
>>> For this setup, you want to use GetHTTP. InvokeHTTP operates off of
>>> FlowFile input.
>>>
>>>
>>> On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <
>>> email@christopherhamm.com> wrote:
>>>
>>>> I have a dataFlow setup that looks up api call using current date. I
>>>> turn it on and nothing seems to happen.. Help appreciated.
>>>>
>>>>
>>>>
>>>> --
>>>> Sincerely,
>>>> Chris Hamm
>>>> (E) cehamm01@gmail.com
>>>> (Twitter) http://twitter.com/webhamm
>>>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>>>
>>>
>>>
>>
>>
>> --
>> Sincerely,
>> Chris Hamm
>> (E) cehamm01@gmail.com
>> (Twitter) http://twitter.com/webhamm
>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>
>
>
>
> --
> Sincerely,
> Chris Hamm
> (E) cehamm01@gmail.com
> (Twitter) http://twitter.com/webhamm
> (Linkedin) http://www.linkedin.com/in/chrishamm
>

Re: Help me figure out why this wont work

Posted by Christopher Hamm <em...@christopherhamm.com>.
Ugg
https://issues.apache.org/jira/browse/NIFI-993

On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <em...@christopherhamm.com>
wrote:

> Ok tried that and still wont work. I think it as something to do with
> message of "supports expression language: false" for the url. Attached
> error and xml template. Any help is appreciated. I need to understand how
> the dynamic querying should work in order to complete an actual project.
> Many thanks
>
>
> ​
>
> On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com> wrote:
>
>> Christopher,
>>
>> For this setup, you want to use GetHTTP. InvokeHTTP operates off of
>> FlowFile input.
>>
>>
>> On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <
>> email@christopherhamm.com> wrote:
>>
>>> I have a dataFlow setup that looks up api call using current date. I
>>> turn it on and nothing seems to happen.. Help appreciated.
>>>
>>>
>>>
>>> --
>>> Sincerely,
>>> Chris Hamm
>>> (E) cehamm01@gmail.com
>>> (Twitter) http://twitter.com/webhamm
>>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>>
>>
>>
>
>
> --
> Sincerely,
> Chris Hamm
> (E) cehamm01@gmail.com
> (Twitter) http://twitter.com/webhamm
> (Linkedin) http://www.linkedin.com/in/chrishamm
>



-- 
Sincerely,
Chris Hamm
(E) cehamm01@gmail.com
(Twitter) http://twitter.com/webhamm
(Linkedin) http://www.linkedin.com/in/chrishamm

Re: Help me figure out why this wont work

Posted by Aldrin Piri <al...@gmail.com>.
Christopher,

Your suspicions are correct.  Attached I have done an example that pulls
via InvokeHTTP with a GenerateFlowFile acting as an "event source."  Was
going to make a ticket but saw you just replied with one that already
exists.



On Mon, Nov 9, 2015 at 3:10 PM, Christopher Hamm <em...@christopherhamm.com>
wrote:

> Ok tried that and still wont work. I think it as something to do with
> message of "supports expression language: false" for the url. Attached
> error and xml template. Any help is appreciated. I need to understand how
> the dynamic querying should work in order to complete an actual project.
> Many thanks
>
>
> ​
>
> On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com> wrote:
>
>> Christopher,
>>
>> For this setup, you want to use GetHTTP. InvokeHTTP operates off of
>> FlowFile input.
>>
>>
>> On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <
>> email@christopherhamm.com> wrote:
>>
>>> I have a dataFlow setup that looks up api call using current date. I
>>> turn it on and nothing seems to happen.. Help appreciated.
>>>
>>>
>>>
>>> --
>>> Sincerely,
>>> Chris Hamm
>>> (E) cehamm01@gmail.com
>>> (Twitter) http://twitter.com/webhamm
>>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>>
>>
>>
>
>
> --
> Sincerely,
> Chris Hamm
> (E) cehamm01@gmail.com
> (Twitter) http://twitter.com/webhamm
> (Linkedin) http://www.linkedin.com/in/chrishamm
>

Re: Help me figure out why this wont work

Posted by Christopher Hamm <em...@christopherhamm.com>.
Ok tried that and still wont work. I think it as something to do with
message of "supports expression language: false" for the url. Attached
error and xml template. Any help is appreciated. I need to understand how
the dynamic querying should work in order to complete an actual project.
Many thanks


​

On Fri, Nov 6, 2015 at 8:04 AM, Aldrin Piri <al...@gmail.com> wrote:

> Christopher,
>
> For this setup, you want to use GetHTTP. InvokeHTTP operates off of
> FlowFile input.
>
>
> On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <
> email@christopherhamm.com> wrote:
>
>> I have a dataFlow setup that looks up api call using current date. I turn
>> it on and nothing seems to happen.. Help appreciated.
>>
>>
>>
>> --
>> Sincerely,
>> Chris Hamm
>> (E) cehamm01@gmail.com
>> (Twitter) http://twitter.com/webhamm
>> (Linkedin) http://www.linkedin.com/in/chrishamm
>>
>
>


-- 
Sincerely,
Chris Hamm
(E) cehamm01@gmail.com
(Twitter) http://twitter.com/webhamm
(Linkedin) http://www.linkedin.com/in/chrishamm

Re: Help me figure out why this wont work

Posted by Aldrin Piri <al...@gmail.com>.
Christopher,

For this setup, you want to use GetHTTP. InvokeHTTP operates off of
FlowFile input.


On Fri, Nov 6, 2015 at 2:33 AM, Christopher Hamm <em...@christopherhamm.com>
wrote:

> I have a dataFlow setup that looks up api call using current date. I turn
> it on and nothing seems to happen.. Help appreciated.
>
>
>
> --
> Sincerely,
> Chris Hamm
> (E) cehamm01@gmail.com
> (Twitter) http://twitter.com/webhamm
> (Linkedin) http://www.linkedin.com/in/chrishamm
>