You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by cynosure <cy...@gmail.com> on 2013/12/12 08:11:07 UTC
Load existing HDFS files into solr?
Folks,
Our current data is stored in hive tables. Is there a way to specify solr
to index the existing hdfs files directly? or I have to import each hive
table to solr?
Can any one point to me some reference?
Thank you very much!
Chen
RE: Load existing HDFS files into solr?
Posted by Tim Potter <ti...@lucidworks.com>.
Hi Chen,
I'm not aware of any direct integration between the two at this time. You might ping the Hive user list with this question too. That said, I've been thinking whether it makes sense to build a Hive StorageHandler for Solr? That at least seems like a quick way to go. However, it might also be possible to just plug a Hive InputFormat into Mark's MapReduce/Solr stuff?
See: https://github.com/markrmiller/solr-map-reduce-example
Cheers,
Timothy Potter
www.lucidworks.com
________________________________________
From: cynosure <cy...@gmail.com>
Sent: Thursday, December 12, 2013 12:11 AM
To: solr-user@lucene.apache.org
Subject: Load existing HDFS files into solr?
Folks,
Our current data is stored in hive tables. Is there a way to specify solr
to index the existing hdfs files directly? or I have to import each hive
table to solr?
Can any one point to me some reference?
Thank you very much!
Chen