You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Rajat Jain <ra...@gmail.com> on 2015/05/17 03:39:24 UTC

Pig 11 not picking up correct hadoop-2 config property

Hello,

I am trying to run pig-11 on a hadoop2 (2.6.0) cluster but I'm getting a
weird error.

My hadoop2 core-site.xml looks like this:

<property>
    <name>master.hostname</name>
    <value>ec2-.....amazonaws.com</value>
</property>

<property>
    <name>fs.defaultFS</name>
    <value>hdfs://${master.hostname:9000}
</property>

This works perfectly for many applications hive, tez, MR, hbase etc. But
for Pig11 it throws this error:

2015-05-17 01:34:39,545 [main] INFO
 org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to hadoop file system at: hdfs://${master.hostname}:9000

Ultimately, queries fail because the above is not a valid hostname. If I
set fs.defaultFS to the actual hostname then everything works fine. I'm
wondering why is that.

Thanks,
Rajat