You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by userguy <ro...@gmail.com> on 2017/06/01 11:48:07 UTC
Re: Hdfs + apex-core
I am attaching code and ERROR when we try to consume from multiple topic
kafka2hdfs.zip
<http://apache-apex-users-list.78494.x6.nabble.com/file/n1669/kafka2hdfs.zip>
kafkalog.txt
<http://apache-apex-users-list.78494.x6.nabble.com/file/n1669/kafkalog.txt>
--
View this message in context: http://apache-apex-users-list.78494.x6.nabble.com/Fwd-Hdfs-apex-core-tp1608p1669.html
Sent from the Apache Apex Users list mailing list archive at Nabble.com.
Re: Hdfs + apex-core
Posted by Vlad Rozov <v....@datatorrent.com>.
Do you have partition.assignment.strategy set anywhere in the Kafka
operator properties?
Thank you,
Vlad
On 6/5/17 10:14, userguy wrote:
> Did any one got chance to look at the code ..
>
> or do we have template to read from multiple topics in kafka ???
>
>
>
> --
> View this message in context: http://apache-apex-users-list.78494.x6.nabble.com/Fwd-Hdfs-apex-core-tp1608p1677.html
> Sent from the Apache Apex Users list mailing list archive at Nabble.com.
Re: Hdfs + apex-core
Posted by nikhilrp <ni...@gmail.com>.
Hello chaitanya,
You are right, it is working in cluster mode. We were testing on local mode.
Thanks
Nikhil
On 06-Jun-2017 12:48 AM, "Chaitanya Chebolu [via Apache Apex Users list]" <
ml+s78494n1680h55@n6.nabble.com> wrote:
> Rohit,
>
> I think the issue is that you are launching the app in local mode. Could
> you please try to launch the app as follows:
> launch /home/apex/kafka2hdfs-1.0-SNAPSHOT.apa
>
> On Tue, Jun 6, 2017 at 12:37 AM, Guilherme Hott <[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=1680&i=0>> wrote:
>
>> Hi, I saw that your ERROR is a ClassCastException and since you are
>> consuming multiple topic, is there a chance that the topic doesn't use the
>> same class?
>>
>> On Mon, Jun 5, 2017 at 10:14 AM, userguy <[hidden email]
>> <http:///user/SendEmail.jtp?type=node&node=1680&i=1>> wrote:
>>
>>> Did any one got chance to look at the code ..
>>>
>>> or do we have template to read from multiple topics in kafka ???
>>>
>>>
>>>
>>> --
>>> View this message in context: http://apache-apex-users-list.
>>> 78494.x6.nabble.com/Fwd-Hdfs-apex-core-tp1608p1677.html
>>> Sent from the Apache Apex Users list mailing list archive at Nabble.com.
>>>
>>
>>
>>
>> --
>> *Guilherme Hott*
>> *Software Engineer*
>> Skype: guilhermehott
>> @guilhermehott
>> https://www.linkedin.com/in/guilhermehott
>>
>>
>
>
> --
>
> *Chaitanya*
>
> Software Engineer
>
> E: [hidden email] <http:///user/SendEmail.jtp?type=node&node=1680&i=2> |
> Twitter: @chaithu1403
>
> www.datatorrent.com | apex.apache.org
>
>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-apex-users-list.78494.x6.nabble.com/Fwd-Hdfs-
> apex-core-tp1608p1680.html
> To unsubscribe from Fwd: Hdfs + apex-core, click here
> <http://apache-apex-users-list.78494.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1608&code=bmlraGlsLnAubmlrQGdtYWlsLmNvbXwxNjA4fDExNDA2Nzg4NA==>
> .
> NAML
> <http://apache-apex-users-list.78494.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
View this message in context: http://apache-apex-users-list.78494.x6.nabble.com/Fwd-Hdfs-apex-core-tp1608p1684.html
Sent from the Apache Apex Users list mailing list archive at Nabble.com.
Re: Hdfs + apex-core
Posted by Chaitanya Chebolu <ch...@datatorrent.com>.
Rohit,
I think the issue is that you are launching the app in local mode. Could
you please try to launch the app as follows:
launch /home/apex/kafka2hdfs-1.0-SNAPSHOT.apa
On Tue, Jun 6, 2017 at 12:37 AM, Guilherme Hott <gu...@gmail.com>
wrote:
> Hi, I saw that your ERROR is a ClassCastException and since you are
> consuming multiple topic, is there a chance that the topic doesn't use the
> same class?
>
> On Mon, Jun 5, 2017 at 10:14 AM, userguy <ro...@gmail.com> wrote:
>
>> Did any one got chance to look at the code ..
>>
>> or do we have template to read from multiple topics in kafka ???
>>
>>
>>
>> --
>> View this message in context: http://apache-apex-users-list.
>> 78494.x6.nabble.com/Fwd-Hdfs-apex-core-tp1608p1677.html
>> Sent from the Apache Apex Users list mailing list archive at Nabble.com.
>>
>
>
>
> --
> *Guilherme Hott*
> *Software Engineer*
> Skype: guilhermehott
> @guilhermehott
> https://www.linkedin.com/in/guilhermehott
>
>
--
*Chaitanya*
Software Engineer
E: chaitanya@datatorrent.com | Twitter: @chaithu1403
www.datatorrent.com | apex.apache.org
Re: Hdfs + apex-core
Posted by Guilherme Hott <gu...@gmail.com>.
Hi, I saw that your ERROR is a ClassCastException and since you are
consuming multiple topic, is there a chance that the topic doesn't use the
same class?
On Mon, Jun 5, 2017 at 10:14 AM, userguy <ro...@gmail.com> wrote:
> Did any one got chance to look at the code ..
>
> or do we have template to read from multiple topics in kafka ???
>
>
>
> --
> View this message in context: http://apache-apex-users-list.
> 78494.x6.nabble.com/Fwd-Hdfs-apex-core-tp1608p1677.html
> Sent from the Apache Apex Users list mailing list archive at Nabble.com.
>
--
*Guilherme Hott*
*Software Engineer*
Skype: guilhermehott
@guilhermehott
https://www.linkedin.com/in/guilhermehott
Re: Hdfs + apex-core
Posted by userguy <ro...@gmail.com>.
Did any one got chance to look at the code ..
or do we have template to read from multiple topics in kafka ???
--
View this message in context: http://apache-apex-users-list.78494.x6.nabble.com/Fwd-Hdfs-apex-core-tp1608p1677.html
Sent from the Apache Apex Users list mailing list archive at Nabble.com.