You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by da...@gmail.com on 2016/03/11 21:20:09 UTC
Error Trying to Launch Example App - TopNWordsWithQueries Running on Fully Distributed Hadoop System
Hi,
I have a simple 4 node Hadoop 2.7.1 HDFS installation. I can run all the
DataTorrent demos and Ingest applications. When I moved on from demos to
learning about creating an App using Java, in the first example I run into
the following error when trying to launch it. Looks like I may need to
provide some information specific to my environment so the Queryfile object
is properly created. Any idea what would be needed? Is there API
documentation I can refer to in the future?
Thanks,
Dan
RE: Error Trying to Launch Example App - TopNWordsWithQueries Running on Fully Distributed Hadoop System
Posted by Dan Mahan <da...@gmail.com>.
That worked! Thanks.
From: Sasha Parfenov [mailto:sasha@datatorrent.com]
Sent: Friday, March 11, 2016 12:59 PM
To: users@apex.incubator.apache.org
Cc: ram@datatorrent.com
Subject: Re: Error Trying to Launch Example App - TopNWordsWithQueries Running on Fully Distributed Hadoop System
Dan,
There is a small difference between the name of the operator you used and the one in the tutorial. Your operator name is "Queryfile", and the properties you are using are setting topic for "QueryFile". If you update your operator name in the code to use upper case "F" in "QueryFile", application should launch successfully.
Thanks,
Sasha
On Fri, Mar 11, 2016 at 12:48 PM, Dan Mahan <dan.mahan.1@gmail.com <ma...@gmail.com> > wrote:
Hi Ram,
I am following the tutorial step by step. Here are my current properties.xml entries:
Thanks,
Dan
From: Munagala Ramanath [mailto:ram@datatorrent.com <ma...@datatorrent.com> ]
Sent: Friday, March 11, 2016 12:40 PM
To: users@apex.incubator.apache.org <ma...@apex.incubator.apache.org>
Subject: Re: Error Trying to Launch Example App - TopNWordsWithQueries Running on Fully Distributed Hadoop System
Dan,
Your properties file needs entries like this:
</property> <property>
<name>dt.application.TopNWordsWithQueries.operator.QueryFile.topic</name>
<value>TopNWordsQueryFile</value>
</property> <property>
<name>dt.application.TopNWordsWithQueries.operator.wsResultFile.topic</name>
<value>TopNWordsQueryFileResult</value>
</property> <property>
<name>dt.application.TopNWordsWithQueries.operator.QueryGlobal.topic</name>
<value>TopNWordsQueryGlobal</value>
</property> <property>
<name>dt.application.TopNWordsWithQueries.operator.wsResultGlobal.topic</name>
<value>TopNWordsQueryGlobalResult</value>
</property>
The TopNWords tutorial at http://docs.datatorrent.com/tutorials/topnwords-c2/
discusses these properties briefly in "Step IV: Customize the application and operators"
Ram
On Fri, Mar 11, 2016 at 12:20 PM, <dan.mahan.1@gmail.com <ma...@gmail.com> > wrote:
Hi,
I have a simple 4 node Hadoop 2.7.1 HDFS installation. I can run all the DataTorrent demos and Ingest applications. When I moved on from demos to learning about creating an App using Java, in the first example I run into the following error when trying to launch it. Looks like I may need to provide some information specific to my environment so the Queryfile object is properly created. Any idea what would be needed? Is there API documentation I can refer to in the future?
Thanks,
Dan
--
Sasha Parfenov
Software Engineer, DataTorrent Inc.
3200 Patrick Henry Drive, 2nd floor
Santa Clara, CA 95054
sasha@datatorrent.com <ma...@datatorrent.com>
https://www.datatorrent.com/
Re: Error Trying to Launch Example App - TopNWordsWithQueries Running
on Fully Distributed Hadoop System
Posted by Sasha Parfenov <sa...@datatorrent.com>.
Dan,
There is a small difference between the name of the operator you used and
the one in the tutorial. Your operator name is "Queryfile", and the
properties you are using are setting topic for "QueryFile". If you update
your operator name in the code to use upper case "F" in "QueryFile",
application should launch successfully.
Thanks,
Sasha
On Fri, Mar 11, 2016 at 12:48 PM, Dan Mahan <da...@gmail.com> wrote:
> Hi Ram,
>
>
>
> I am following the tutorial step by step. Here are my current
> properties.xml entries:
>
>
>
>
>
> Thanks,
>
> Dan
>
>
>
> *From:* Munagala Ramanath [mailto:ram@datatorrent.com]
> *Sent:* Friday, March 11, 2016 12:40 PM
> *To:* users@apex.incubator.apache.org
> *Subject:* Re: Error Trying to Launch Example App - TopNWordsWithQueries
> Running on Fully Distributed Hadoop System
>
>
>
> Dan,
>
>
>
> Your properties file needs entries like this:
>
>
>
> </property> <property>
>
> <name>dt.application.TopNWordsWithQueries.operator.QueryFile.topic
> </name>
>
> <value>TopNWordsQueryFile</value>
>
> </property> <property>
>
> <name>dt.application.TopNWordsWithQueries.operator.wsResultFile.topic
> </name>
>
> <value>TopNWordsQueryFileResult</value>
>
> </property> <property>
>
> <name>dt.application.TopNWordsWithQueries.operator.QueryGlobal.topic
> </name>
>
> <value>TopNWordsQueryGlobal</value>
>
> </property> <property>
>
> <name>dt.application.TopNWordsWithQueries.operator.wsResultGlobal.topic
> </name>
>
> <value>TopNWordsQueryGlobalResult</value>
>
> </property>
>
>
>
> The TopNWords tutorial at
> http://docs.datatorrent.com/tutorials/topnwords-c2/
>
> discusses these properties briefly in "*Step IV: Customize the
> application and operators*"
>
>
>
> Ram
>
>
>
> On Fri, Mar 11, 2016 at 12:20 PM, <da...@gmail.com> wrote:
>
> Hi,
>
>
>
> I have a simple 4 node Hadoop 2.7.1 HDFS installation. I can run all the
> DataTorrent demos and Ingest applications. When I moved on from demos to
> learning about creating an App using Java, in the first example I run into
> the following error when trying to launch it. Looks like I may need to
> provide some information specific to my environment so the Queryfile object
> is properly created. Any idea what would be needed? Is there API
> documentation I can refer to in the future?
>
>
>
> Thanks,
>
> Dan
>
>
>
>
>
>
>
>
>
--
*Sasha Parfenov*
Software Engineer, DataTorrent Inc.
3200 Patrick Henry Drive, 2nd floor
Santa Clara, CA 95054
sasha@datatorrent.com
https://www.datatorrent.com/
RE: Error Trying to Launch Example App - TopNWordsWithQueries Running on Fully Distributed Hadoop System
Posted by Dan Mahan <da...@gmail.com>.
Hi Ram,
I am following the tutorial step by step. Here are my current properties.xml entries:
Thanks,
Dan
From: Munagala Ramanath [mailto:ram@datatorrent.com]
Sent: Friday, March 11, 2016 12:40 PM
To: users@apex.incubator.apache.org
Subject: Re: Error Trying to Launch Example App - TopNWordsWithQueries Running on Fully Distributed Hadoop System
Dan,
Your properties file needs entries like this:
</property> <property>
<name>dt.application.TopNWordsWithQueries.operator.QueryFile.topic</name>
<value>TopNWordsQueryFile</value>
</property> <property>
<name>dt.application.TopNWordsWithQueries.operator.wsResultFile.topic</name>
<value>TopNWordsQueryFileResult</value>
</property> <property>
<name>dt.application.TopNWordsWithQueries.operator.QueryGlobal.topic</name>
<value>TopNWordsQueryGlobal</value>
</property> <property>
<name>dt.application.TopNWordsWithQueries.operator.wsResultGlobal.topic</name>
<value>TopNWordsQueryGlobalResult</value>
</property>
The TopNWords tutorial at http://docs.datatorrent.com/tutorials/topnwords-c2/
discusses these properties briefly in "Step IV: Customize the application and operators"
Ram
On Fri, Mar 11, 2016 at 12:20 PM, <dan.mahan.1@gmail.com <ma...@gmail.com> > wrote:
Hi,
I have a simple 4 node Hadoop 2.7.1 HDFS installation. I can run all the DataTorrent demos and Ingest applications. When I moved on from demos to learning about creating an App using Java, in the first example I run into the following error when trying to launch it. Looks like I may need to provide some information specific to my environment so the Queryfile object is properly created. Any idea what would be needed? Is there API documentation I can refer to in the future?
Thanks,
Dan
Re: Error Trying to Launch Example App - TopNWordsWithQueries Running
on Fully Distributed Hadoop System
Posted by Munagala Ramanath <ra...@datatorrent.com>.
Dan,
Your properties file needs entries like this:
</property> <property> <name>
dt.application.TopNWordsWithQueries.operator.QueryFile.topic</name> <value>
TopNWordsQueryFile</value> </property> <property> <name>
dt.application.TopNWordsWithQueries.operator.wsResultFile.topic</name>
<value>TopNWordsQueryFileResult</value> </property> <property>
<name>dt.application.TopNWordsWithQueries.operator.QueryGlobal.topic</name>
<value>TopNWordsQueryGlobal</value> </property> <property> <name>
dt.application.TopNWordsWithQueries.operator.wsResultGlobal.topic</name>
<value>TopNWordsQueryGlobalResult</value> </property>
The TopNWords tutorial at
http://docs.datatorrent.com/tutorials/topnwords-c2/
discusses these properties briefly in "*Step IV: Customize the application
and operators*"
Ram
On Fri, Mar 11, 2016 at 12:20 PM, <da...@gmail.com> wrote:
> Hi,
>
>
>
> I have a simple 4 node Hadoop 2.7.1 HDFS installation. I can run all the
> DataTorrent demos and Ingest applications. When I moved on from demos to
> learning about creating an App using Java, in the first example I run into
> the following error when trying to launch it. Looks like I may need to
> provide some information specific to my environment so the Queryfile object
> is properly created. Any idea what would be needed? Is there API
> documentation I can refer to in the future?
>
>
>
> Thanks,
>
> Dan
>
>
>
>
>
>
>
>