You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by cynosure <cy...@gmail.com> on 2013/12/12 08:11:07 UTC

Load existing HDFS files into solr?

Folks,
Our current data is stored in hive tables. Is there a way to specify solr
to index the existing hdfs files directly? or I have to import each hive
table to solr?
Can any one point to me some reference?
Thank you very much!
Chen

RE: Load existing HDFS files into solr?

Posted by Tim Potter <ti...@lucidworks.com>.
Hi Chen,

I'm not aware of any direct integration between the two at this time. You might ping the Hive user list with this question too. That said, I've been thinking whether it makes sense to build a Hive StorageHandler for Solr? That at least seems like a quick way to go. However, it might also be possible to just plug a Hive InputFormat into Mark's MapReduce/Solr stuff?

See: https://github.com/markrmiller/solr-map-reduce-example 

Cheers,

Timothy Potter
www.lucidworks.com

________________________________________
From: cynosure <cy...@gmail.com>
Sent: Thursday, December 12, 2013 12:11 AM
To: solr-user@lucene.apache.org
Subject: Load existing HDFS files into solr?

Folks,
Our current data is stored in hive tables. Is there a way to specify solr
to index the existing hdfs files directly? or I have to import each hive
table to solr?
Can any one point to me some reference?
Thank you very much!
Chen