You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by "Yves S. Garret" <yo...@gmail.com> on 2013/04/13 03:02:24 UTC
Trying to output to db in MS-SQL on Azure
I took the following tutorial [ http://nlp.solutions.asia/?p=180 ] and
modified parts of it in order to output into a MS-SQL database hosted on
Azure.
This is my gora.properties that's enabled (yes, some of the necessary info
was changed):
gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
423fsdff23.database.windows.net:1433/nutchtest
gora.sqlstore.jdbc.user=developer
gora.sqlstore.jdbc.password=secret-pass
I don't understand where I'm going wrong. Any suggestions?
Fwd: Trying to output to db in MS-SQL on Azure
Posted by "Yves S. Garret" <yo...@gmail.com>.
This is the error that I'm getting [ http://bin.cakephp.org/view/1459689043 ].
This is my ivy/ivy.xml file [ http://bin.cakephp.org/view/1484213488 ].
Why is this happening? The database that I'm trying to output to is MS-SQL
in MS Azure.
---------- Forwarded message ----------
From: Yves S. Garret <yo...@gmail.com>
Date: Fri, Apr 12, 2013 at 9:02 PM
Subject: Trying to output to db in MS-SQL on Azure
To: user@nutch.apache.org
I took the following tutorial [ http://nlp.solutions.asia/?p=180 ] and
modified parts of it in order to output into a MS-SQL database hosted on
Azure.
This is my gora.properties that's enabled (yes, some of the necessary info
was changed):
gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
423fsdff23.database.windows.net:1433/nutchtest
gora.sqlstore.jdbc.user=developer
gora.sqlstore.jdbc.password=secret-pass
I don't understand where I'm going wrong. Any suggestions?
Re: Trying to output to db in MS-SQL on Azure
Posted by "Yves S. Garret" <yo...@gmail.com>.
Hi Lewis,
Thanks for your reply. Forgive me for being so clueless, but there's much
that I still don't know about Apache Nutch (and Hadoop for that matter, but
I'm
learning). However, I have heard of people getting MS-SQL (hosted as a
database in MS Azure) to work with Apache Nutch. My short-term problem is
getting to work with MS-SQL :) .
I do have one question for you, is my task in this case flat-out impossible?
I look forward to you guys making that change.
--Yves
On Tue, Apr 16, 2013 at 3:44 PM, Lewis John Mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> Hi Yves,
> This has nothing to do with Nutch. It strictly has to do with Gora. That
> was my justification for moving a similar thread (it may actually even have
> been this one) over to user@gora.
> As Renato explained, by the looks of it Microsoft Azure platform has a
> client library which enables you to interact with any products residing in
> there.
> None of this has been written into Gora, therefore this is most likely whit
> it is not working.
> It is difficult (without writing the individual client implementations) to
> get a storage abstraction layer which provides you with similar
> functionality over several SQL datastores. It was our plan to re-write
> gora-sql module with the JOOQ sql library (which is ASL v2.0 licensed IIRC)
> however again this would not cover your use case I don't think.
> Currently I don't think that MS-SQL will work with the Gora SQL module.
> Lewis
>
>
> On Tue, Apr 16, 2013 at 12:36 PM, Yves S. Garret <
> yoursurrogategod@gmail.com
> > wrote:
>
> > Hi, this is what happens after I specified where the jar file that I need
> > should be located.
> >
> > http://bin.cakephp.org/view/1051380
> >
> > It's not easy to figure out what the problem is if the only error that
> you
> > get is a Java error :) .
> >
> > Also, as a general question, has anyone ever had Nutch outputting
> > information into some other database besides MySQL? How about MS-SQL?
> How
> > did you configure Nutch and the database?
> >
> >
> > On Tue, Apr 16, 2013 at 1:27 PM, Renato Marroquín Mogrovejo <
> > renatoj.marroquin@gmail.com> wrote:
> >
> > > Hi all,
> > >
> > > I think the problem is the drivers Microsoft Azure requires. Right now
> > > Gora supports HDSQL but Azure needs some of the following clients [1],
> > > and right now we have no support in any of those clients :(
> > > Maybe you could try playing around with these clients inside Gora and
> > > give it a shot? I would be happy to help you trying this out man.
> > >
> > >
> > > Renato M.
> > >
> > >
> > > [1]
> > >
> http://msdn.microsoft.com/en-us/library/windowsazure/ee336245.aspx#dlaps
> > >
> > > 2013/4/16 Yves S. Garret <yo...@gmail.com>:
> > > > I just tried what you suggested and this is the error that I got:
> > > >
> > > > http://bin.cakephp.org/view/1346910103
> > > >
> > > >
> > > > On Tue, Apr 16, 2013 at 1:18 AM, Canan GİRGİN <
> canankaragoz@gmail.com
> > > >wrote:
> > > >
> > > >> I think, your connection parameters must be like this:
> > > >>
> > > >> gora.sqlstore.jdbc.driver=com.mysql.jdbc.Driver
> > > >> gora.sqlstore.jdbc.url=jdbc:mysql://
> > > >> 423fsdff23.database.windows.net:1433/nutchtest
> > > >> gora.sqlstore.jdbc.user=developer
> > > >> gora.sqlstore.jdbc.password=secret-pass
> > > >>
> > > >> ---------- Forwarded message ----------
> > > >> From: Yves S. Garret <yo...@gmail.com>
> > > >> Date: Sat, Apr 13, 2013 at 4:02 AM
> > > >> Subject: Trying to output to db in MS-SQL on Azure
> > > >> To: user@nutch.apache.org
> > > >>
> > > >>
> > > >> I took the following tutorial [ http://nlp.solutions.asia/?p=180 ]
> > and
> > > >> modified parts of it in order to output into a MS-SQL database
> hosted
> > on
> > > >> Azure.
> > > >>
> > > >> This is my gora.properties that's enabled (yes, some of the
> necessary
> > > info
> > > >> was changed):
> > > >> gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
> > > >> gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
> > > >> 423fsdff23.database.windows.net:1433/nutchtest
> > > >> gora.sqlstore.jdbc.user=developer
> > > >> gora.sqlstore.jdbc.password=secret-pass
> > > >>
> > > >> I don't understand where I'm going wrong. Any suggestions?
> > > >>
> > >
> >
>
>
>
> --
> *Lewis*
>
Re: Trying to output to db in MS-SQL on Azure
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Yves,
This has nothing to do with Nutch. It strictly has to do with Gora. That
was my justification for moving a similar thread (it may actually even have
been this one) over to user@gora.
As Renato explained, by the looks of it Microsoft Azure platform has a
client library which enables you to interact with any products residing in
there.
None of this has been written into Gora, therefore this is most likely whit
it is not working.
It is difficult (without writing the individual client implementations) to
get a storage abstraction layer which provides you with similar
functionality over several SQL datastores. It was our plan to re-write
gora-sql module with the JOOQ sql library (which is ASL v2.0 licensed IIRC)
however again this would not cover your use case I don't think.
Currently I don't think that MS-SQL will work with the Gora SQL module.
Lewis
On Tue, Apr 16, 2013 at 12:36 PM, Yves S. Garret <yoursurrogategod@gmail.com
> wrote:
> Hi, this is what happens after I specified where the jar file that I need
> should be located.
>
> http://bin.cakephp.org/view/1051380
>
> It's not easy to figure out what the problem is if the only error that you
> get is a Java error :) .
>
> Also, as a general question, has anyone ever had Nutch outputting
> information into some other database besides MySQL? How about MS-SQL? How
> did you configure Nutch and the database?
>
>
> On Tue, Apr 16, 2013 at 1:27 PM, Renato Marroquín Mogrovejo <
> renatoj.marroquin@gmail.com> wrote:
>
> > Hi all,
> >
> > I think the problem is the drivers Microsoft Azure requires. Right now
> > Gora supports HDSQL but Azure needs some of the following clients [1],
> > and right now we have no support in any of those clients :(
> > Maybe you could try playing around with these clients inside Gora and
> > give it a shot? I would be happy to help you trying this out man.
> >
> >
> > Renato M.
> >
> >
> > [1]
> > http://msdn.microsoft.com/en-us/library/windowsazure/ee336245.aspx#dlaps
> >
> > 2013/4/16 Yves S. Garret <yo...@gmail.com>:
> > > I just tried what you suggested and this is the error that I got:
> > >
> > > http://bin.cakephp.org/view/1346910103
> > >
> > >
> > > On Tue, Apr 16, 2013 at 1:18 AM, Canan GİRGİN <canankaragoz@gmail.com
> > >wrote:
> > >
> > >> I think, your connection parameters must be like this:
> > >>
> > >> gora.sqlstore.jdbc.driver=com.mysql.jdbc.Driver
> > >> gora.sqlstore.jdbc.url=jdbc:mysql://
> > >> 423fsdff23.database.windows.net:1433/nutchtest
> > >> gora.sqlstore.jdbc.user=developer
> > >> gora.sqlstore.jdbc.password=secret-pass
> > >>
> > >> ---------- Forwarded message ----------
> > >> From: Yves S. Garret <yo...@gmail.com>
> > >> Date: Sat, Apr 13, 2013 at 4:02 AM
> > >> Subject: Trying to output to db in MS-SQL on Azure
> > >> To: user@nutch.apache.org
> > >>
> > >>
> > >> I took the following tutorial [ http://nlp.solutions.asia/?p=180 ]
> and
> > >> modified parts of it in order to output into a MS-SQL database hosted
> on
> > >> Azure.
> > >>
> > >> This is my gora.properties that's enabled (yes, some of the necessary
> > info
> > >> was changed):
> > >> gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
> > >> gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
> > >> 423fsdff23.database.windows.net:1433/nutchtest
> > >> gora.sqlstore.jdbc.user=developer
> > >> gora.sqlstore.jdbc.password=secret-pass
> > >>
> > >> I don't understand where I'm going wrong. Any suggestions?
> > >>
> >
>
--
*Lewis*
Re: Trying to output to db in MS-SQL on Azure
Posted by "Yves S. Garret" <yo...@gmail.com>.
Hi, this is what happens after I specified where the jar file that I need
should be located.
http://bin.cakephp.org/view/1051380
It's not easy to figure out what the problem is if the only error that you
get is a Java error :) .
Also, as a general question, has anyone ever had Nutch outputting
information into some other database besides MySQL? How about MS-SQL? How
did you configure Nutch and the database?
On Tue, Apr 16, 2013 at 1:27 PM, Renato Marroquín Mogrovejo <
renatoj.marroquin@gmail.com> wrote:
> Hi all,
>
> I think the problem is the drivers Microsoft Azure requires. Right now
> Gora supports HDSQL but Azure needs some of the following clients [1],
> and right now we have no support in any of those clients :(
> Maybe you could try playing around with these clients inside Gora and
> give it a shot? I would be happy to help you trying this out man.
>
>
> Renato M.
>
>
> [1]
> http://msdn.microsoft.com/en-us/library/windowsazure/ee336245.aspx#dlaps
>
> 2013/4/16 Yves S. Garret <yo...@gmail.com>:
> > I just tried what you suggested and this is the error that I got:
> >
> > http://bin.cakephp.org/view/1346910103
> >
> >
> > On Tue, Apr 16, 2013 at 1:18 AM, Canan GİRGİN <canankaragoz@gmail.com
> >wrote:
> >
> >> I think, your connection parameters must be like this:
> >>
> >> gora.sqlstore.jdbc.driver=com.mysql.jdbc.Driver
> >> gora.sqlstore.jdbc.url=jdbc:mysql://
> >> 423fsdff23.database.windows.net:1433/nutchtest
> >> gora.sqlstore.jdbc.user=developer
> >> gora.sqlstore.jdbc.password=secret-pass
> >>
> >> ---------- Forwarded message ----------
> >> From: Yves S. Garret <yo...@gmail.com>
> >> Date: Sat, Apr 13, 2013 at 4:02 AM
> >> Subject: Trying to output to db in MS-SQL on Azure
> >> To: user@nutch.apache.org
> >>
> >>
> >> I took the following tutorial [ http://nlp.solutions.asia/?p=180 ] and
> >> modified parts of it in order to output into a MS-SQL database hosted on
> >> Azure.
> >>
> >> This is my gora.properties that's enabled (yes, some of the necessary
> info
> >> was changed):
> >> gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
> >> gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
> >> 423fsdff23.database.windows.net:1433/nutchtest
> >> gora.sqlstore.jdbc.user=developer
> >> gora.sqlstore.jdbc.password=secret-pass
> >>
> >> I don't understand where I'm going wrong. Any suggestions?
> >>
>
Re: Trying to output to db in MS-SQL on Azure
Posted by "Yves S. Garret" <yo...@gmail.com>.
Hi, thanks for your help. Once you download the JDBC driver, what next?
I've read up to step #5 in the instructions to install... not sure what to
do
next since installing this stuff isn't very well described. I'll keep
looking
into this problem, trying to resolve it.
On Tue, Apr 16, 2013 at 1:27 PM, Renato Marroquín Mogrovejo <
renatoj.marroquin@gmail.com> wrote:
> Hi all,
>
> I think the problem is the drivers Microsoft Azure requires. Right now
> Gora supports HDSQL but Azure needs some of the following clients [1],
> and right now we have no support in any of those clients :(
> Maybe you could try playing around with these clients inside Gora and
> give it a shot? I would be happy to help you trying this out man.
>
>
> Renato M.
>
>
> [1]
> http://msdn.microsoft.com/en-us/library/windowsazure/ee336245.aspx#dlaps
>
> 2013/4/16 Yves S. Garret <yo...@gmail.com>:
> > I just tried what you suggested and this is the error that I got:
> >
> > http://bin.cakephp.org/view/1346910103
> >
> >
> > On Tue, Apr 16, 2013 at 1:18 AM, Canan GİRGİN <canankaragoz@gmail.com
> >wrote:
> >
> >> I think, your connection parameters must be like this:
> >>
> >> gora.sqlstore.jdbc.driver=com.mysql.jdbc.Driver
> >> gora.sqlstore.jdbc.url=jdbc:mysql://
> >> 423fsdff23.database.windows.net:1433/nutchtest
> >> gora.sqlstore.jdbc.user=developer
> >> gora.sqlstore.jdbc.password=secret-pass
> >>
> >> ---------- Forwarded message ----------
> >> From: Yves S. Garret <yo...@gmail.com>
> >> Date: Sat, Apr 13, 2013 at 4:02 AM
> >> Subject: Trying to output to db in MS-SQL on Azure
> >> To: user@nutch.apache.org
> >>
> >>
> >> I took the following tutorial [ http://nlp.solutions.asia/?p=180 ] and
> >> modified parts of it in order to output into a MS-SQL database hosted on
> >> Azure.
> >>
> >> This is my gora.properties that's enabled (yes, some of the necessary
> info
> >> was changed):
> >> gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
> >> gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
> >> 423fsdff23.database.windows.net:1433/nutchtest
> >> gora.sqlstore.jdbc.user=developer
> >> gora.sqlstore.jdbc.password=secret-pass
> >>
> >> I don't understand where I'm going wrong. Any suggestions?
> >>
>
Re: Trying to output to db in MS-SQL on Azure
Posted by Renato Marroquín Mogrovejo <re...@gmail.com>.
Hi all,
I think the problem is the drivers Microsoft Azure requires. Right now
Gora supports HDSQL but Azure needs some of the following clients [1],
and right now we have no support in any of those clients :(
Maybe you could try playing around with these clients inside Gora and
give it a shot? I would be happy to help you trying this out man.
Renato M.
[1] http://msdn.microsoft.com/en-us/library/windowsazure/ee336245.aspx#dlaps
2013/4/16 Yves S. Garret <yo...@gmail.com>:
> I just tried what you suggested and this is the error that I got:
>
> http://bin.cakephp.org/view/1346910103
>
>
> On Tue, Apr 16, 2013 at 1:18 AM, Canan GİRGİN <ca...@gmail.com>wrote:
>
>> I think, your connection parameters must be like this:
>>
>> gora.sqlstore.jdbc.driver=com.mysql.jdbc.Driver
>> gora.sqlstore.jdbc.url=jdbc:mysql://
>> 423fsdff23.database.windows.net:1433/nutchtest
>> gora.sqlstore.jdbc.user=developer
>> gora.sqlstore.jdbc.password=secret-pass
>>
>> ---------- Forwarded message ----------
>> From: Yves S. Garret <yo...@gmail.com>
>> Date: Sat, Apr 13, 2013 at 4:02 AM
>> Subject: Trying to output to db in MS-SQL on Azure
>> To: user@nutch.apache.org
>>
>>
>> I took the following tutorial [ http://nlp.solutions.asia/?p=180 ] and
>> modified parts of it in order to output into a MS-SQL database hosted on
>> Azure.
>>
>> This is my gora.properties that's enabled (yes, some of the necessary info
>> was changed):
>> gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
>> gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
>> 423fsdff23.database.windows.net:1433/nutchtest
>> gora.sqlstore.jdbc.user=developer
>> gora.sqlstore.jdbc.password=secret-pass
>>
>> I don't understand where I'm going wrong. Any suggestions?
>>
Re: Trying to output to db in MS-SQL on Azure
Posted by "Yves S. Garret" <yo...@gmail.com>.
I just tried what you suggested and this is the error that I got:
http://bin.cakephp.org/view/1346910103
On Tue, Apr 16, 2013 at 1:18 AM, Canan GİRGİN <ca...@gmail.com>wrote:
> I think, your connection parameters must be like this:
>
> gora.sqlstore.jdbc.driver=com.mysql.jdbc.Driver
> gora.sqlstore.jdbc.url=jdbc:mysql://
> 423fsdff23.database.windows.net:1433/nutchtest
> gora.sqlstore.jdbc.user=developer
> gora.sqlstore.jdbc.password=secret-pass
>
> ---------- Forwarded message ----------
> From: Yves S. Garret <yo...@gmail.com>
> Date: Sat, Apr 13, 2013 at 4:02 AM
> Subject: Trying to output to db in MS-SQL on Azure
> To: user@nutch.apache.org
>
>
> I took the following tutorial [ http://nlp.solutions.asia/?p=180 ] and
> modified parts of it in order to output into a MS-SQL database hosted on
> Azure.
>
> This is my gora.properties that's enabled (yes, some of the necessary info
> was changed):
> gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
> gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
> 423fsdff23.database.windows.net:1433/nutchtest
> gora.sqlstore.jdbc.user=developer
> gora.sqlstore.jdbc.password=secret-pass
>
> I don't understand where I'm going wrong. Any suggestions?
>
Re: Trying to output to db in MS-SQL on Azure
Posted by Canan GİRGİN <ca...@gmail.com>.
I think, your connection parameters must be like this:
gora.sqlstore.jdbc.driver=com.mysql.jdbc.Driver
gora.sqlstore.jdbc.url=jdbc:mysql://
423fsdff23.database.windows.net:1433/nutchtest
gora.sqlstore.jdbc.user=developer
gora.sqlstore.jdbc.password=secret-pass
---------- Forwarded message ----------
From: Yves S. Garret <yo...@gmail.com>
Date: Sat, Apr 13, 2013 at 4:02 AM
Subject: Trying to output to db in MS-SQL on Azure
To: user@nutch.apache.org
I took the following tutorial [ http://nlp.solutions.asia/?p=180 ] and
modified parts of it in order to output into a MS-SQL database hosted on
Azure.
This is my gora.properties that's enabled (yes, some of the necessary info
was changed):
gora.sqlstore.jdbc.driver=org.hsqldb.jdbc.JDBCDriver
gora.sqlstore.jdbc.url=jdbc:hsqldb:hsql://
423fsdff23.database.windows.net:1433/nutchtest
gora.sqlstore.jdbc.user=developer
gora.sqlstore.jdbc.password=secret-pass
I don't understand where I'm going wrong. Any suggestions?