output port

[Rama Krishna Manne <ch...@gmail.com>]

I have an flow in which messages are emitted to an output and apache-spark
will pull the messages from the port , I see the messages are pulled by
spark but cannot see the data pulled(cannot do any computations)

I tried a different way , the messages are pushed apache kafka and spark
pulls messages from kafka queue instead of output port and this one worked.

my question is why it didn't work for output port  and using kafka instead
of output port is it a good flow ?

Re: output port

[Bryan Bende <bb...@gmail.com>]

Ok, can you describe the flow in NiFi leading up to the output port? What
kind of data is in the content of the FlowFiles?

On Tuesday, October 20, 2015, Rama Krishna Manne <
chaitanya.manne87@gmail.com> wrote:

> so you are seeing the messages reach the output port and then get removed
> from the queue
>
> yes
>
> And on the spark side the NiFi Spark receiver never receives anything? Or
> it receives message, but they have no content?
>
> It receives the data but no content to do computation
>
> On Mon, Oct 19, 2015 at 2:14 PM, Bryan Bende <bbende@gmail.com
> <javascript:_e(%7B%7D,'cvml','bbende@gmail.com');>> wrote:
>
>> Hello,
>>
>> Just to clarify, so you are seeing the messages reach the output port and
>> then get removed from the queue? And on the spark side the NiFi Spark
>> receiver never receives anything? Or it receives message, but they have no
>> content?
>>
>> -Bryan
>>
>>
>> On Monday, October 19, 2015, Rama Krishna Manne <
>> chaitanya.manne87@gmail.com
>> <javascript:_e(%7B%7D,'cvml','chaitanya.manne87@gmail.com');>> wrote:
>>
>>> I have an flow in which messages are emitted to an output and
>>> apache-spark will pull the messages from the port , I see the messages are
>>> pulled by spark but cannot see the data pulled(cannot do any computations)
>>>
>>> I tried a different way , the messages are pushed apache kafka and spark
>>> pulls messages from kafka queue instead of output port and this one worked.
>>>
>>> my question is why it didn't work for output port  and using kafka
>>> instead of output port is it a good flow ?
>>>
>>>
>>>
>>>
>>
>> --
>> Sent from Gmail Mobile
>>
>
>

-- 
Sent from Gmail Mobile

Re: output port

[Rama Krishna Manne <ch...@gmail.com>]

so you are seeing the messages reach the output port and then get removed
from the queue

yes

And on the spark side the NiFi Spark receiver never receives anything? Or
it receives message, but they have no content?

It receives the data but no content to do computation

On Mon, Oct 19, 2015 at 2:14 PM, Bryan Bende <bb...@gmail.com> wrote:

> Hello,
>
> Just to clarify, so you are seeing the messages reach the output port and
> then get removed from the queue? And on the spark side the NiFi Spark
> receiver never receives anything? Or it receives message, but they have no
> content?
>
> -Bryan
>
>
> On Monday, October 19, 2015, Rama Krishna Manne <
> chaitanya.manne87@gmail.com> wrote:
>
>> I have an flow in which messages are emitted to an output and
>> apache-spark will pull the messages from the port , I see the messages are
>> pulled by spark but cannot see the data pulled(cannot do any computations)
>>
>> I tried a different way , the messages are pushed apache kafka and spark
>> pulls messages from kafka queue instead of output port and this one worked.
>>
>> my question is why it didn't work for output port  and using kafka
>> instead of output port is it a good flow ?
>>
>>
>>
>>
>
> --
> Sent from Gmail Mobile
>

Re: output port

[Bryan Bende <bb...@gmail.com>]

Hello,

Just to clarify, so you are seeing the messages reach the output port and
then get removed from the queue? And on the spark side the NiFi Spark
receiver never receives anything? Or it receives message, but they have no
content?

-Bryan

On Monday, October 19, 2015, Rama Krishna Manne <ch...@gmail.com>
wrote:

> I have an flow in which messages are emitted to an output and apache-spark
> will pull the messages from the port , I see the messages are pulled by
> spark but cannot see the data pulled(cannot do any computations)
>
> I tried a different way , the messages are pushed apache kafka and spark
> pulls messages from kafka queue instead of output port and this one worked.
>
> my question is why it didn't work for output port  and using kafka instead
> of output port is it a good flow ?
>
>
>
>

-- 
Sent from Gmail Mobile