Map-Reduce Solr Kerberos Authentication

[Adam Higginson <Ad...@bjss.com>]

Hi all,

As a bit of background, we're trying to run a map-reduce job on a Hadoop cluster (CDH version 4.5.0) which involved reading/writing from Solr during both the Map and Reduce phase. To accomplish this, we are using the Solrj library with version 4.4.0-search-1.3.0. In a separate application, we have managed to get solrj to authenticate correctly with Kerberos by following the guide here: http://www.cloudera.com/content/cloudera/en/documentation/cloudera-search/v1-latest/Cloudera-Search-User-Guide/csug_using_kerberos.html, creating a jaas file which points to a previously created keytab file. However, the distributed map-reduce job will not have the jaas file or keytab file on the worker nodes it will be distributed to. We were wondering whether it is possible to set up Kerberos with Solrj in the driver step of a map-reduce job, so that the individual mappers and reducers remain authenticated during the running process?

Thanks and kind regards,

Adam

The information included in this email and any files transmitted with it may contain information that is confidential and it must not be used by, or its contents or attachments copied or disclosed, to persons other than the intended addressee. If you have received this email in error, please notify BJSS. In the absence of written agreement to the contrary BJSS' relevant standard terms of contract for any work to be undertaken will apply. Please carry out virus or such other checks as you consider appropriate in respect of this email. BJSS do not accept responsibility for any adverse effect upon your system or data in relation to this email or any files transmitted with it. BJSS Limited, a company registered in England and Wales (Company Number 2777575), VAT Registration Number 613295452, Registered Office Address, First Floor, Coronet House, Queen Street, Leeds, LS1 2TW