You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Shubham Bansal <sh...@whishworks.com> on 2015/09/04 10:33:54 UTC
Facing problem from ExecuteSQL processor
Hi,
I am using ExecuteSQL processor in my flow. Infact , that is the only
processor I have added to the flow. I have added DBCPConnectionPool service
to this processor. I am attaching screenshots for the configuration done
for these. There is no error on the connection side but I am not able to
fetch any data. Where exactly will this data go ? Please help me with this.
Thanks,
--
*Shubham Bansal*, Software Engineer,
4th Floor, Pioneer Towers, Madhapur, Hyderabad
*M: **+91 9059328793 *
*W: *ww <http://www.whishworks.com/>w.whishworks.com
<http://www.whishworks.com/>
<http://www.whishworks.com/blog/> <https://twitter.com/WHISHWORKS>
<https://www.facebook.com/whishworksit>
<https://www.linkedin.com/company/whishworks>
--
The contents of this e-mail are confidential and for the exclusive use of
the intended recipient. If you receive this e-mail in error please delete
it from your system immediately and notify us either by e-mail or
telephone. You should not copy, forward or otherwise disclose the content
of the e-mail. The views expressed in this communication may not
necessarily be the view held by WHISHWORKS.
RE: Facing problem from ExecuteSQL processor
Posted by Mark Payne <ma...@hotmail.com>.
Shubham,
I'm sorry, I just found this e-mail in my Junk mail :( Looks like it's been there for quite a long time, so I apologize for not responding sooner!
Did you ever make any headway with this issue?
The way that the processor works, it requires a FlowFile as input. It cannot be run as a "Source" Processor. There is a ticket [1] to
update the Processor so that it can in fact be used as a Source Processor. In the meantime, you could work around the issue by adding
a GenerateFlowFile ahead of it and scheduling it to run every 5 minutes or however often you want the query to run. When the
GenerateFlowFile runs, it will then send the FlowFile to ExecuteSQL so that it will perform the query.
Does this make sense?
Again, sorry for taking so long to get back to you!
-Mark
[1] https://issues.apache.org/jira/browse/NIFI-932
Date: Tue, 8 Sep 2015 13:44:23 +0530
Subject: Fwd: Facing problem from ExecuteSQL processor
From: shubham.bansal@whishworks.com
To: dev@nifi.apache.org
Hi,
Did you get a chance to look into this issue ?
Thanks,
---------- Forwarded message ----------
From: Shubham Bansal <sh...@whishworks.com>
Date: 4 September 2015 at 14:03
Subject: Facing problem from ExecuteSQL processor
To: dev@nifi.apache.org
Hi,
I am using ExecuteSQL processor in my flow. Infact , that is the only processor I have added to the flow. I have added DBCPConnectionPool service to this processor. I am attaching screenshots for the configuration done for these. There is no error on the connection side but I am not able to fetch any data. Where exactly will this data go ? Please help me with this.
Thanks,
--
Shubham Bansal, Software Engineer,
4th Floor, Pioneer Towers, Madhapur, Hyderabad
M: +91 9059328793
W: www.whishworks.com
--
Shubham Bansal, Software Engineer,
4th Floor, Pioneer Towers, Madhapur, Hyderabad
M: +91 9059328793
W: www.whishworks.com
The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you receive this e-mail in error please delete it from your system immediately and notify us either by e-mail or telephone. You should not copy, forward or otherwise disclose the content of the e-mail. The views expressed in this communication may not necessarily be the view held by WHISHWORKS.
Fwd: Facing problem from ExecuteSQL processor
Posted by Shubham Bansal <sh...@whishworks.com>.
Hi,
Did you get a chance to look into this issue ?
Thanks,
---------- Forwarded message ----------
From: Shubham Bansal <sh...@whishworks.com>
Date: 4 September 2015 at 14:03
Subject: Facing problem from ExecuteSQL processor
To: dev@nifi.apache.org
Hi,
I am using ExecuteSQL processor in my flow. Infact , that is the only
processor I have added to the flow. I have added DBCPConnectionPool service
to this processor. I am attaching screenshots for the configuration done
for these. There is no error on the connection side but I am not able to
fetch any data. Where exactly will this data go ? Please help me with this.
Thanks,
--
*Shubham Bansal*, Software Engineer,
4th Floor, Pioneer Towers, Madhapur, Hyderabad
*M: **+91 9059328793 *
*W: *ww <http://www.whishworks.com/>w.whishworks.com
<http://www.whishworks.com/>
<http://www.whishworks.com/blog/> <https://twitter.com/WHISHWORKS>
<https://www.facebook.com/whishworksit>
<https://www.linkedin.com/company/whishworks>
--
*Shubham Bansal*, Software Engineer,
4th Floor, Pioneer Towers, Madhapur, Hyderabad
*M: **+91 9059328793 *
*W: *ww <http://www.whishworks.com/>w.whishworks.com
<http://www.whishworks.com/>
<http://www.whishworks.com/blog/> <https://twitter.com/WHISHWORKS>
<https://www.facebook.com/whishworksit>
<https://www.linkedin.com/company/whishworks>
--
The contents of this e-mail are confidential and for the exclusive use of
the intended recipient. If you receive this e-mail in error please delete
it from your system immediately and notify us either by e-mail or
telephone. You should not copy, forward or otherwise disclose the content
of the e-mail. The views expressed in this communication may not
necessarily be the view held by WHISHWORKS.
Re: Facing problem from ExecuteSQL processor
Posted by Aldrin Piri <al...@gmail.com>.
Shubham,
One more note. While I was typing up the last email, it appears a ticket
was created to alter ExecuteSQL to carry out the functionality I think you
are looking for. It can be located here:
https://issues.apache.org/jira/browse/NIFI-932
On Fri, Sep 4, 2015 at 1:25 PM, Aldrin Piri <al...@gmail.com> wrote:
> Shubham,
>
> ExecuteSQL requires an input flowfile to cause processing to occur. Based
> off your message, it sounds like this is the only instance and thus there
> is no action occurring. This is certainly unclear on our behalf in terms
> of documentation on the processor. By design, this processor would receive
> input input and use its attributes in conjunction with expression language
> [1] to create "dynamic" queries.
>
> If you were interested in running a static query, you can use
> GenerateFlowFile to provide input and trigger the processor to execute.
>
> [1]
> http://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html
>
>
>
> On Fri, Sep 4, 2015 at 7:40 AM, Bryan Bende <bb...@gmail.com> wrote:
>
>> Hi Shubham,
>>
>> I believe images usually get stripped out of the emails, can you upload
>> the
>> image somewhere and provide a link?
>>
>> Generally a processor will transfer data on a relationship, and a
>> relationship is connected to another processor, or the relationship can be
>> auto-terminated which means the data has reached a point where you don't
>> want to do anything else with it.
>> For testing, you may want to connect your ExecuteSQL processor to a
>> PutFile
>> processor that writes to a directory on your local machine, this way you
>> can see what is getting produced. Once you know it is working then you can
>> reconfigure the flow how you like.
>>
>> Thanks,
>>
>> Bryan
>>
>> On Fri, Sep 4, 2015 at 4:33 AM, Shubham Bansal <
>> shubham.bansal@whishworks.com> wrote:
>>
>> > Hi,
>> >
>> > I am using ExecuteSQL processor in my flow. Infact , that is the only
>> > processor I have added to the flow. I have added DBCPConnectionPool
>> service
>> > to this processor. I am attaching screenshots for the configuration done
>> > for these. There is no error on the connection side but I am not able to
>> > fetch any data. Where exactly will this data go ? Please help me with
>> this.
>> >
>> > Thanks,
>> >
>> > --
>> >
>> >
>> >
>> > *Shubham Bansal*, Software Engineer,
>> >
>> > 4th Floor, Pioneer Towers, Madhapur, Hyderabad
>> > *M: **+91 9059328793 <%2B91%20%C2%A09059328793> *
>> > *W: *ww <http://www.whishworks.com/>w.whishworks.com
>> > <http://www.whishworks.com/>
>> >
>> > <http://www.whishworks.com/blog/> <https://twitter.com/WHISHWORKS>
>> > <https://www.facebook.com/whishworksit>
>> > <https://www.linkedin.com/company/whishworks>
>> >
>> > The contents of this e-mail are confidential and for the exclusive use
>> of
>> > the intended recipient. If you receive this e-mail in error please
>> delete
>> > it from your system immediately and notify us either by e-mail or
>> > telephone. You should not copy, forward or otherwise disclose the
>> content
>> > of the e-mail. The views expressed in this communication may not
>> > necessarily be the view held by WHISHWORKS.
>>
>
>
Re: Facing problem from ExecuteSQL processor
Posted by Aldrin Piri <al...@gmail.com>.
Shubham,
ExecuteSQL requires an input flowfile to cause processing to occur. Based
off your message, it sounds like this is the only instance and thus there
is no action occurring. This is certainly unclear on our behalf in terms
of documentation on the processor. By design, this processor would receive
input input and use its attributes in conjunction with expression language
[1] to create "dynamic" queries.
If you were interested in running a static query, you can use
GenerateFlowFile to provide input and trigger the processor to execute.
[1]
http://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html
On Fri, Sep 4, 2015 at 7:40 AM, Bryan Bende <bb...@gmail.com> wrote:
> Hi Shubham,
>
> I believe images usually get stripped out of the emails, can you upload the
> image somewhere and provide a link?
>
> Generally a processor will transfer data on a relationship, and a
> relationship is connected to another processor, or the relationship can be
> auto-terminated which means the data has reached a point where you don't
> want to do anything else with it.
> For testing, you may want to connect your ExecuteSQL processor to a PutFile
> processor that writes to a directory on your local machine, this way you
> can see what is getting produced. Once you know it is working then you can
> reconfigure the flow how you like.
>
> Thanks,
>
> Bryan
>
> On Fri, Sep 4, 2015 at 4:33 AM, Shubham Bansal <
> shubham.bansal@whishworks.com> wrote:
>
> > Hi,
> >
> > I am using ExecuteSQL processor in my flow. Infact , that is the only
> > processor I have added to the flow. I have added DBCPConnectionPool
> service
> > to this processor. I am attaching screenshots for the configuration done
> > for these. There is no error on the connection side but I am not able to
> > fetch any data. Where exactly will this data go ? Please help me with
> this.
> >
> > Thanks,
> >
> > --
> >
> >
> >
> > *Shubham Bansal*, Software Engineer,
> >
> > 4th Floor, Pioneer Towers, Madhapur, Hyderabad
> > *M: **+91 9059328793 <%2B91%20%C2%A09059328793> *
> > *W: *ww <http://www.whishworks.com/>w.whishworks.com
> > <http://www.whishworks.com/>
> >
> > <http://www.whishworks.com/blog/> <https://twitter.com/WHISHWORKS>
> > <https://www.facebook.com/whishworksit>
> > <https://www.linkedin.com/company/whishworks>
> >
> > The contents of this e-mail are confidential and for the exclusive use of
> > the intended recipient. If you receive this e-mail in error please delete
> > it from your system immediately and notify us either by e-mail or
> > telephone. You should not copy, forward or otherwise disclose the content
> > of the e-mail. The views expressed in this communication may not
> > necessarily be the view held by WHISHWORKS.
>
Re: Facing problem from ExecuteSQL processor
Posted by Bryan Bende <bb...@gmail.com>.
Hi Shubham,
I believe images usually get stripped out of the emails, can you upload the
image somewhere and provide a link?
Generally a processor will transfer data on a relationship, and a
relationship is connected to another processor, or the relationship can be
auto-terminated which means the data has reached a point where you don't
want to do anything else with it.
For testing, you may want to connect your ExecuteSQL processor to a PutFile
processor that writes to a directory on your local machine, this way you
can see what is getting produced. Once you know it is working then you can
reconfigure the flow how you like.
Thanks,
Bryan
On Fri, Sep 4, 2015 at 4:33 AM, Shubham Bansal <
shubham.bansal@whishworks.com> wrote:
> Hi,
>
> I am using ExecuteSQL processor in my flow. Infact , that is the only
> processor I have added to the flow. I have added DBCPConnectionPool service
> to this processor. I am attaching screenshots for the configuration done
> for these. There is no error on the connection side but I am not able to
> fetch any data. Where exactly will this data go ? Please help me with this.
>
> Thanks,
>
> --
>
>
>
> *Shubham Bansal*, Software Engineer,
>
> 4th Floor, Pioneer Towers, Madhapur, Hyderabad
> *M: **+91 9059328793 <%2B91%20%C2%A09059328793> *
> *W: *ww <http://www.whishworks.com/>w.whishworks.com
> <http://www.whishworks.com/>
>
> <http://www.whishworks.com/blog/> <https://twitter.com/WHISHWORKS>
> <https://www.facebook.com/whishworksit>
> <https://www.linkedin.com/company/whishworks>
>
> The contents of this e-mail are confidential and for the exclusive use of
> the intended recipient. If you receive this e-mail in error please delete
> it from your system immediately and notify us either by e-mail or
> telephone. You should not copy, forward or otherwise disclose the content
> of the e-mail. The views expressed in this communication may not
> necessarily be the view held by WHISHWORKS.