You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by apachenutch <po...@gmail.com> on 2012/02/17 08:13:30 UTC
Nutch setup on Cassandra error
I get the below error when trying to setup Nutch on Cassandra. I am referring
to the below link -
http://techvineyard.blogspot.com/2010/12/build-nutch-20.html
Can somebody please help?
[default@unknown] use webpage;
Keyspace 'webpage' not found.
[default@unknown] update column family p with key_validation_class=UTF8Type;
Not authenticated to a working keyspace.
[default@unknown] create keyspace webpage;
dbf830c0-5935-11e1-0000-242d50cf1fbc
Waiting for schema agreement...
... schemas agree across the cluster
[default@unknown] update column family p with key_validation_class=UTF8Type;
Not authenticated to a working keypace.
[default@unknown] use webpage;
Authenticated to keyspace: webpage
[default@webpage] update column family p with key_validation_class=UTF8Type;
p not found in current keyspace.
--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-setup-on-Cassandra-error-tp3752891p3752891.html
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: Nutch setup on Cassandra error
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi,
On Sun, Feb 19, 2012 at 8:44 PM, apachenutch <po...@gmail.com> wrote:
>
> ERROR 12:37:59,770 Fatal configuration error
> org.apache.cassandra.config.ConfigurationException: localhost/
> 127.0.0.1:7000
> is in use by another process. Change listen_address:storage_port in
> cassandra.yaml to values that do not conflict with other services
> ....
> localhost/127.0.0.1:7000 is in use by another process. Change
> listen_address:storage_port in cassandra.yaml to values that do not
> conflict
> with other services
>
Please ensure that the TCP or SSL ports in the cassandra .yaml file do not
conflict with existing processes. E.g. change
storage_port:7000 to 8000 or something else.
Re: Nutch setup on Cassandra error
Posted by apachenutch <po...@gmail.com>.
I installed cassandra via tarball per your suggestion. I get the below error
during the install.
ubuntu:~/cassandra$ bin/cassandra -f
INFO 12:37:58,932 Logging initialized
INFO 12:37:58,936 JVM vendor/version: Java HotSpot(TM) Server VM/1.6.0_30
INFO 12:37:58,936 Heap size: 1046937600/1046937600
INFO 12:37:58,937 Classpath:
bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/apache-cassandra-1.0.7.jar:bin/../lib/apache-cassandra-clientutil-1.0.7.jar:bin/../lib/apache-cassandra-thrift-1.0.7.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
INFO 12:37:58,938 JNA not found. Native methods will be disabled.
INFO 12:37:58,946 Loading settings from
file:/home/pooja/cassandra/conf/cassandra.yaml
ERROR 12:37:59,770 Fatal configuration error
org.apache.cassandra.config.ConfigurationException: localhost/127.0.0.1:7000
is in use by another process. Change listen_address:storage_port in
cassandra.yaml to values that do not conflict with other services
at
org.apache.cassandra.net.MessagingService.getServerSocket(MessagingService.java:262)
at
org.apache.cassandra.net.MessagingService.listen(MessagingService.java:232)
at
org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:507)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:484)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:395)
at
org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:234)
at
org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:356)
at
org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:107)
localhost/127.0.0.1:7000 is in use by another process. Change
listen_address:storage_port in cassandra.yaml to values that do not conflict
with other services
Fatal configuration error; unable to start server. See log for stacktrace.
INFO 12:37:59,773 Waiting for messaging service to quiesce
Please suggest.
--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-setup-on-Cassandra-error-tp3752891p3758839.html
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: Nutch setup on Cassandra error
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi,
On Sun, Feb 19, 2012 at 4:23 PM, apachenutch <po...@gmail.com> wrote:
> I see the web page keyspace created, but I dont see any records after
> configuring the crawler :(
>
How are you verifying this? Please be as verbose as possible when
discussing Nutchgora branch.
I performed a nutch inject, fetch and generate, but don't see data populated
> in my solr index. I am thinking if the issue is with my cassandra DB.
>
You mean inject, generate, fetch... if you've not executed the the
solrindex command then it won't get sent to your Solr server. Prior to
this, you haven't mentioned a parse stage either.
>
> I installed cassandra by referring to the below link
> - http://wiki.apache.org/cassandra/DebianPackaging
>
I've always used Cassandra locally, installed via tarball so I can't help
you there I'm sorry.
> In the link, as you can see, the DB installation is being performed as
> root.
> Is that causing an issue?
>
I would not think so no. This is giving you su permissions, meaning the
opposite of what you describe above.
Re: Nutch setup on Cassandra error
Posted by apachenutch <po...@gmail.com>.
I see the web page keyspace created, but I dont see any records after
configuring the crawler :(
I performed a nutch inject, fetch and generate, but don't see data populated
in my solr index. I am thinking if the issue is with my cassandra DB.
I installed cassandra by referring to the below link
- http://wiki.apache.org/cassandra/DebianPackaging
In the link, as you can see, the DB installation is being performed as root.
Is that causing an issue?
--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-setup-on-Cassandra-error-tp3752891p3758306.html
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: Nutch setup on Cassandra error
Posted by apachenutch <po...@gmail.com>.
Thank you Sujit Pal. It worked )
--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-setup-on-Cassandra-error-tp3752891p3757370.html
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: Nutch setup on Cassandra error
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi,
cassandra-mapping.xml should already be in your $nutchgora/conf directory,
as per here [1]. When you build the project it will be copied over to
runtime/local/conf and will then be on your classpath.
On Fri, Feb 17, 2012 at 6:53 PM, apachenutch <po...@gmail.com> wrote:
> /Please place gora-cassandra-mapping.xml in your Nutch conf directory which
> is included in the classpath. This configuration defines how Avro fields
> are
> stored in Cassandra. This the content of gora-cassandra-mapping.xml file:/
>
At what stage of executing what command are you getting the above output?
[1]
https://svn.apache.org/viewvc/nutch/branches/nutchgora/conf/gora-cassandra-mapping.xml?view=markup
Re: Nutch setup on Cassandra error
Posted by apachenutch <po...@gmail.com>.
I am sorry about posting this seperately. Since this was different from what
I posted earlier, I opened a new thread. Sorry about that. I am basically
trying to setup Nutch on Cassandra in Eclipse. I am referring to the link -
http://techvineyard.blogspot.com/2010/12/build-nutch-20.html#Cassandra since
its the official Apache site for instructions (When I click on
http://wiki.apache.org/nutch/#Nutch_2.0, and later Build Nutch 2.0 in
Eclipse in that post, I am taken to the techvineyard post)
Per the techvineyard post, I am configuring Nutch on Cassandra. I installed
all the plugins in Eclipse. I am getting the above error in the below step -
/Please place gora-cassandra-mapping.xml in your Nutch conf directory which
is included in the classpath. This configuration defines how Avro fields are
stored in Cassandra. This the content of gora-cassandra-mapping.xml file:/
I have gora-cassandra-mapping.xml file in runtime/local/conf directory, and
the file has all the contents mentioned in the post.
I have no idea what I am doing wrong :( I have been up all night trying to
fix it.
Questions -
1. Any post I could refer to in order to setup Nutch in eclipse for
Cassandra DB?
Thank you once again for your help.
--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-setup-on-Cassandra-error-tp3752891p3754606.html
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: Nutch setup on Cassandra error
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi,
I'm afraid you need to be more verbose about where and when you are using
this from. It looks like this is taken from the cassandra CLI?
This tutorial may be somewhat dated, it also onyl covers Nutchgora Gora &
Cassandra use within Eclipse IDE, which was required at this time because
Gora was still pretty unstable and not available in a maven2 repo (if I
remember correctly).
As I suggested in my previous reply, you may be better operating this via
CLI instead of in Eclipse.
Also it's best practice to keep one discussion to one thread, that way it
is easier for other's (including myself) to keep track of the conversation.
Thank you
On Fri, Feb 17, 2012 at 7:13 AM, apachenutch <po...@gmail.com> wrote:
> I get the below error when trying to setup Nutch on Cassandra. I am
> referring
> to the below link -
> http://techvineyard.blogspot.com/2010/12/build-nutch-20.html
>
> Can somebody please help?
>
> [default@unknown] use webpage;
> Keyspace 'webpage' not found.
> [default@unknown] update column family p with
> key_validation_class=UTF8Type;
> Not authenticated to a working keyspace.
> [default@unknown] create keyspace webpage;
> dbf830c0-5935-11e1-0000-242d50cf1fbc
> Waiting for schema agreement...
> ... schemas agree across the cluster
> [default@unknown] update column family p with
> key_validation_class=UTF8Type;
> Not authenticated to a working keypace.
> [default@unknown] use webpage;
> Authenticated to keyspace: webpage
> [default@webpage] update column family p with
> key_validation_class=UTF8Type;
> p not found in current keyspace.
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Nutch-setup-on-Cassandra-error-tp3752891p3752891.html
> Sent from the Nutch - User mailing list archive at Nabble.com.
>
--
*Lewis*
Re: Nutch setup on Cassandra error
Posted by SUJIT PAL <su...@comcast.net>.
Hi apachenutch,
You can just let Nutch create the schema for you... just run a nutch inject against an empty cassandra keyspace (define the storage.data.store.class to org.apache.gora.cassandra.CassandraDataStore as Alex's blog (techvineyard) says).
-sujit
On Feb 16, 2012, at 11:13 PM, apachenutch wrote:
> I get the below error when trying to setup Nutch on Cassandra. I am referring
> to the below link -
> http://techvineyard.blogspot.com/2010/12/build-nutch-20.html
>
> Can somebody please help?
>
> [default@unknown] use webpage;
> Keyspace 'webpage' not found.
> [default@unknown] update column family p with key_validation_class=UTF8Type;
> Not authenticated to a working keyspace.
> [default@unknown] create keyspace webpage;
> dbf830c0-5935-11e1-0000-242d50cf1fbc
> Waiting for schema agreement...
> ... schemas agree across the cluster
> [default@unknown] update column family p with key_validation_class=UTF8Type;
> Not authenticated to a working keypace.
> [default@unknown] use webpage;
> Authenticated to keyspace: webpage
> [default@webpage] update column family p with key_validation_class=UTF8Type;
> p not found in current keyspace.
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Nutch-setup-on-Cassandra-error-tp3752891p3752891.html
> Sent from the Nutch - User mailing list archive at Nabble.com.