Hadoop Pipes with distributed cache using dlopen

[Upendra Dadi <ud...@gmu.edu>]

Hi,
  I am facing some problems with using distributed cache archive with Pipes 
job. In my configuration file I have the following two properties:

<property>
  <name>mapred.create.symlink</name>
  <value>yes</value>
</property>

<property>
  <name>mapred.cache.archives</name>
  <value>hdfs://localhost:9000/user/upendra/archive/pipeArchive.zip#pipeSym</value>
</property>

The zip archive contains two folders lib and share. lib folder contains some 
shared libraries. In my Pipes C++ code, I have added the following 
statements to
use the shared libraries:

int main(int argc, char *argv[]) {
  dlopen("pipeSym/lib/libmant.so.1",RTLD_LAZY);
  ...

The shared library is not getting loaded during execution. It spits the 
error that the shared library is not found. What is the problem with
 the above steps? Can anyone please shed some light on what might be causing 
the problem. Thanks.

Upendra