Data not loading to Redshift

[Aruna Sankaralingam <Ar...@Cormac-Corp.com>]

I am not seeing any errors in bulletin but data is not getting loaded into redshift database. Attached the nifi log. Could someone please let me what is wrong?

[cid:image001.png@01D37FD7.448772E0]

Re: Data not loading to Redshift

[Michael Moser <mo...@gmail.com>]

Yes it sounds like security group settings made the difference.  I'm glad
you figured out your problem and shared the solution with us!

Regards,
-- Mike


On Wed, Jan 3, 2018 at 3:10 PM, Aruna Sankaralingam <
Aruna.Sankaralingam@cormac-corp.com> wrote:

> Mike,
>
>
>
> I am not sure if this helped but once the Nifi IP was whitelisted on the
> security group of redshift cluster, I was able to see the data in the
> table. Do you think this would have made the difference?
>
>
>
> Thanks
>
> Aruna
>
>
>
> *From:* Michael Moser [mailto:moser.mw@gmail.com]
> *Sent:* Thursday, December 28, 2017 5:42 PM
> *To:* users@nifi.apache.org
> *Subject:* Re: Data not loading to Redshift
>
>
>
> Hello,
>
>
>
> Unfortunately the nifi-app.log that you included did not offer any clues
> to why you are experiencing a problem.
>
>
>
> If you would, please edit your nifi/conf/logback.xml file and find the
> line below.  Change the WARN to DEBUG, wait a minute for NiFi to reload the
> file, and then run your test again.  Hopefully that will produce better
> DEBUG log messages in the nifi-app.log that will help you.
>
>
>
> <logger name="org.apache.nifi.processors" level="WARN"/>
>
>
>
> -- Mike
>
>
>
>
>
>
>
> On Thu, Dec 28, 2017 at 4:14 PM, Aruna Sankaralingam <
> Aruna.Sankaralingam@cormac-corp.com> wrote:
>
> Could someone please let me know what went wrong with the flow?
>
>
>
> *From:* Aruna Sankaralingam [mailto:Aruna.Sankaralingam@Cormac-Corp.com]
> *Sent:* Thursday, December 28, 2017 12:30 PM
> *To:* users@nifi.apache.org
> *Subject:* Data not loading to Redshift
>
>
>
> I am not seeing any errors in bulletin but data is not getting loaded into
> redshift database. Attached the nifi log. Could someone please let me what
> is wrong?
>
>
>
>
>
>
>
>
>

RE: Data not loading to Redshift

[Aruna Sankaralingam <Ar...@Cormac-Corp.com>]

Mike,

I am not sure if this helped but once the Nifi IP was whitelisted on the security group of redshift cluster, I was able to see the data in the table. Do you think this would have made the difference?

Thanks
Aruna

From: Michael Moser [mailto:moser.mw@gmail.com]
Sent: Thursday, December 28, 2017 5:42 PM
To: users@nifi.apache.org
Subject: Re: Data not loading to Redshift

Hello,

Unfortunately the nifi-app.log that you included did not offer any clues to why you are experiencing a problem.

If you would, please edit your nifi/conf/logback.xml file and find the line below.  Change the WARN to DEBUG, wait a minute for NiFi to reload the file, and then run your test again.  Hopefully that will produce better DEBUG log messages in the nifi-app.log that will help you.

<logger name="org.apache.nifi.processors" level="WARN"/>

-- Mike



On Thu, Dec 28, 2017 at 4:14 PM, Aruna Sankaralingam <Ar...@cormac-corp.com>> wrote:
Could someone please let me know what went wrong with the flow?

From: Aruna Sankaralingam [mailto:Aruna.Sankaralingam@Cormac-Corp.com<ma...@Cormac-Corp.com>]
Sent: Thursday, December 28, 2017 12:30 PM
To: users@nifi.apache.org<ma...@nifi.apache.org>
Subject: Data not loading to Redshift

I am not seeing any errors in bulletin but data is not getting loaded into redshift database. Attached the nifi log. Could someone please let me what is wrong?

[cid:image001.png@01D384A4.F1D46D50]

Re: Data not loading to Redshift

[Michael Moser <mo...@gmail.com>]

Hello,

Unfortunately the nifi-app.log that you included did not offer any clues to
why you are experiencing a problem.

If you would, please edit your nifi/conf/logback.xml file and find the line
below.  Change the WARN to DEBUG, wait a minute for NiFi to reload the
file, and then run your test again.  Hopefully that will produce better
DEBUG log messages in the nifi-app.log that will help you.

<logger name="org.apache.nifi.processors" level="WARN"/>

-- Mike



On Thu, Dec 28, 2017 at 4:14 PM, Aruna Sankaralingam <
Aruna.Sankaralingam@cormac-corp.com> wrote:

> Could someone please let me know what went wrong with the flow?
>
>
>
> *From:* Aruna Sankaralingam [mailto:Aruna.Sankaralingam@Cormac-Corp.com]
> *Sent:* Thursday, December 28, 2017 12:30 PM
> *To:* users@nifi.apache.org
> *Subject:* Data not loading to Redshift
>
>
>
> I am not seeing any errors in bulletin but data is not getting loaded into
> redshift database. Attached the nifi log. Could someone please let me what
> is wrong?
>
>
>
>
>
>
>

RE: Data not loading to Redshift

[Aruna Sankaralingam <Ar...@Cormac-Corp.com>]

Could someone please let me know what went wrong with the flow?

From: Aruna Sankaralingam [mailto:Aruna.Sankaralingam@Cormac-Corp.com]
Sent: Thursday, December 28, 2017 12:30 PM
To: users@nifi.apache.org
Subject: Data not loading to Redshift

I am not seeing any errors in bulletin but data is not getting loaded into redshift database. Attached the nifi log. Could someone please let me what is wrong?

[cid:image001.png@01D37FF6.FFC3F0F0]