You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Anand Murali <an...@yahoo.com> on 2015/05/12 09:06:03 UTC

Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Hi All:
I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop
export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
export HADOOP\_PREFIX=/home/anand_vihar/hadoop-2.6.0
export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
export PIG_HOME=/home/anand_vihar/pig-0.14.0
export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin 
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
echo $HADOOP_HOME
echo $JAVA_HOME
echo $HADOOP_INSTALL
echo $PIG_HOME
echo $PIG_INSTALL
echo $PIG_CLASSPATH
echo $HIVE_HOME
echo $PATH
Core-site.xml<configuration>
 <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

Hdfs-site.xml<configuration>
<property>
        <name>dfs.replication</name>
        <value>1</value>
</property>
<property>
    <name>dfs.name.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
</property>

<property>
    <name>dfs.data.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
</property>

<property>
    <name>dfs.webhdfs.enabled</name>
    <value>true</value>
</property>

</configuration>
Mapred-site.xml<configuration>
 <property>
        <name>mapreduce.jobtracker.address</name>
        <value>localhost:9000</value>
    </property>
</configuration>
Erroranand_vihar@Latitude-E5540:~$ pig
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
grunt> records = load '/user/anand_vihar/max/input/1901'
>> as (year:chararray,temperature:int,quality:int);
2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS

Somebody please advise. Thanks
Regards

 Anand Murali  11/7, 'Anand Vihar', Kandasamy St, MylaporeChennai - 600 004, IndiaPh: (044)- 28474593/ 43526162 (voicemail)

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Prashant Kommireddi <pr...@gmail.com>.
Something that needs correction, just that no one has gotten around to
doing it. Please feel free to open a JIRA, even better if you would like to
contribute a fix.

On Tuesday, May 12, 2015, Anand Murali <an...@yahoo.com> wrote:

> Oliver:
>
> Many thanks for reply. If it is not an error why is the info repeated
> again and again. All defaults have been set in *.xml, which if it is
> picking, why mention deprecation, which I don't understand.
>
> Regards
>
> Anand
>
> Sent from my iPhone
>
> On 12-May-2015, at 1:10 pm, Olivier Renault <orenault@hortonworks.com
> <javascript:_e(%7B%7D,'cvml','orenault@hortonworks.com');>> wrote:
>
> You don't have an error. You are seeing normal info messages.
>
> Thanks,
> Olivier
>  _____________________________
> From:Anand Murali
> Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
> To:user@hadoop.apache.org"
>
>
>  Hi All:
>
>  I have installed above and made corresponding changes to
> core-site,hdfs-site and mapred-site.xml and still get deprecation error. On
> system startup I run . .hadoop
>
>  export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
> export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
> export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0
> export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
> export PIG_HOME=/home/anand_vihar/pig-0.14.0
> export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
> export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
> export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin
> export
> PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
>
> echo $HADOOP_HOME
> echo $JAVA_HOME
> echo $HADOOP_INSTALL
> echo $PIG_HOME
> echo $PIG_INSTALL
> echo $PIG_CLASSPATH
> echo $HIVE_HOME
> echo $PATH
>
>  *Core-site.xml*
> <configuration>
>  <property>
>         <name>fs.defaultFS</name>
>         <value>hdfs://localhost:9000</value>
>     </property>
> </configuration>
>
>  *Hdfs-site.xml*
> <configuration>
> <property>
>         <name>dfs.replication</name>
>         <value>1</value>
> </property>
> <property>
>     <name>dfs.name.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
> </property>
>
> <property>
>     <name>dfs.data.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
> </property>
>
> <property>
>     <name>dfs.webhdfs.enabled</name>
>     <value>true</value>
> </property>
>
> </configuration>
>
>  *Mapred-site.xml*
> <configuration>
>  <property>
>         <name>mapreduce.jobtracker.address</name>
>         <value>localhost:9000</value>
>     </property>
> </configuration>
>
>  *Error*
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *anand_vihar@Latitude-E5540:~$ pig 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Trying ExecType : LOCAL 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType 2015-05-12
> 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0
> (r1640057) compiled Nov 16 2014, 18:02:05 2015-05-12 12:12:54,401 [main]
> INFO  org.apache.pig.Main - Logging error messages to:
> /home/anand_vihar/pig_1431412974400.log 2015-05-12 12:12:54,419 [main]
> INFO  org.apache.pig.impl.util.Utils - Default bootup file
> /home/anand_vihar/.pigbootup not found 2015-05-12 12:12:54,871 [main] INFO
> org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is
> deprecated. Instead, use mapreduce.jobtracker.address 2015-05-12
> 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation
> - fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS 2015-05-12 12:12:54,871 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting
> to hadoop file system at: hdfs://localhost:9000 2015-05-12 12:12:55,495
> [main] INFO  org.apache.hadoop.conf.Configuration.deprecation -
> fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS grunt> records = load '/user/anand_vihar/max/input/1901' >> as
> (year:chararray,temperature:int,quality:int); 2015-05-12 12:23:42,501
> [main] INFO  org.apache.hadoop.conf.Configuration.deprecation -
> fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS *
>
>  Somebody please advise. Thanks
>
>  Regards
>
>
>  Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Prashant Kommireddi <pr...@gmail.com>.
Something that needs correction, just that no one has gotten around to
doing it. Please feel free to open a JIRA, even better if you would like to
contribute a fix.

On Tuesday, May 12, 2015, Anand Murali <an...@yahoo.com> wrote:

> Oliver:
>
> Many thanks for reply. If it is not an error why is the info repeated
> again and again. All defaults have been set in *.xml, which if it is
> picking, why mention deprecation, which I don't understand.
>
> Regards
>
> Anand
>
> Sent from my iPhone
>
> On 12-May-2015, at 1:10 pm, Olivier Renault <orenault@hortonworks.com
> <javascript:_e(%7B%7D,'cvml','orenault@hortonworks.com');>> wrote:
>
> You don't have an error. You are seeing normal info messages.
>
> Thanks,
> Olivier
>  _____________________________
> From:Anand Murali
> Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
> To:user@hadoop.apache.org"
>
>
>  Hi All:
>
>  I have installed above and made corresponding changes to
> core-site,hdfs-site and mapred-site.xml and still get deprecation error. On
> system startup I run . .hadoop
>
>  export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
> export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
> export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0
> export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
> export PIG_HOME=/home/anand_vihar/pig-0.14.0
> export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
> export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
> export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin
> export
> PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
>
> echo $HADOOP_HOME
> echo $JAVA_HOME
> echo $HADOOP_INSTALL
> echo $PIG_HOME
> echo $PIG_INSTALL
> echo $PIG_CLASSPATH
> echo $HIVE_HOME
> echo $PATH
>
>  *Core-site.xml*
> <configuration>
>  <property>
>         <name>fs.defaultFS</name>
>         <value>hdfs://localhost:9000</value>
>     </property>
> </configuration>
>
>  *Hdfs-site.xml*
> <configuration>
> <property>
>         <name>dfs.replication</name>
>         <value>1</value>
> </property>
> <property>
>     <name>dfs.name.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
> </property>
>
> <property>
>     <name>dfs.data.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
> </property>
>
> <property>
>     <name>dfs.webhdfs.enabled</name>
>     <value>true</value>
> </property>
>
> </configuration>
>
>  *Mapred-site.xml*
> <configuration>
>  <property>
>         <name>mapreduce.jobtracker.address</name>
>         <value>localhost:9000</value>
>     </property>
> </configuration>
>
>  *Error*
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *anand_vihar@Latitude-E5540:~$ pig 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Trying ExecType : LOCAL 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType 2015-05-12
> 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0
> (r1640057) compiled Nov 16 2014, 18:02:05 2015-05-12 12:12:54,401 [main]
> INFO  org.apache.pig.Main - Logging error messages to:
> /home/anand_vihar/pig_1431412974400.log 2015-05-12 12:12:54,419 [main]
> INFO  org.apache.pig.impl.util.Utils - Default bootup file
> /home/anand_vihar/.pigbootup not found 2015-05-12 12:12:54,871 [main] INFO
> org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is
> deprecated. Instead, use mapreduce.jobtracker.address 2015-05-12
> 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation
> - fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS 2015-05-12 12:12:54,871 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting
> to hadoop file system at: hdfs://localhost:9000 2015-05-12 12:12:55,495
> [main] INFO  org.apache.hadoop.conf.Configuration.deprecation -
> fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS grunt> records = load '/user/anand_vihar/max/input/1901' >> as
> (year:chararray,temperature:int,quality:int); 2015-05-12 12:23:42,501
> [main] INFO  org.apache.hadoop.conf.Configuration.deprecation -
> fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS *
>
>  Somebody please advise. Thanks
>
>  Regards
>
>
>  Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Prashant Kommireddi <pr...@gmail.com>.
Something that needs correction, just that no one has gotten around to
doing it. Please feel free to open a JIRA, even better if you would like to
contribute a fix.

On Tuesday, May 12, 2015, Anand Murali <an...@yahoo.com> wrote:

> Oliver:
>
> Many thanks for reply. If it is not an error why is the info repeated
> again and again. All defaults have been set in *.xml, which if it is
> picking, why mention deprecation, which I don't understand.
>
> Regards
>
> Anand
>
> Sent from my iPhone
>
> On 12-May-2015, at 1:10 pm, Olivier Renault <orenault@hortonworks.com
> <javascript:_e(%7B%7D,'cvml','orenault@hortonworks.com');>> wrote:
>
> You don't have an error. You are seeing normal info messages.
>
> Thanks,
> Olivier
>  _____________________________
> From:Anand Murali
> Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
> To:user@hadoop.apache.org"
>
>
>  Hi All:
>
>  I have installed above and made corresponding changes to
> core-site,hdfs-site and mapred-site.xml and still get deprecation error. On
> system startup I run . .hadoop
>
>  export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
> export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
> export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0
> export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
> export PIG_HOME=/home/anand_vihar/pig-0.14.0
> export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
> export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
> export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin
> export
> PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
>
> echo $HADOOP_HOME
> echo $JAVA_HOME
> echo $HADOOP_INSTALL
> echo $PIG_HOME
> echo $PIG_INSTALL
> echo $PIG_CLASSPATH
> echo $HIVE_HOME
> echo $PATH
>
>  *Core-site.xml*
> <configuration>
>  <property>
>         <name>fs.defaultFS</name>
>         <value>hdfs://localhost:9000</value>
>     </property>
> </configuration>
>
>  *Hdfs-site.xml*
> <configuration>
> <property>
>         <name>dfs.replication</name>
>         <value>1</value>
> </property>
> <property>
>     <name>dfs.name.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
> </property>
>
> <property>
>     <name>dfs.data.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
> </property>
>
> <property>
>     <name>dfs.webhdfs.enabled</name>
>     <value>true</value>
> </property>
>
> </configuration>
>
>  *Mapred-site.xml*
> <configuration>
>  <property>
>         <name>mapreduce.jobtracker.address</name>
>         <value>localhost:9000</value>
>     </property>
> </configuration>
>
>  *Error*
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *anand_vihar@Latitude-E5540:~$ pig 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Trying ExecType : LOCAL 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType 2015-05-12
> 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0
> (r1640057) compiled Nov 16 2014, 18:02:05 2015-05-12 12:12:54,401 [main]
> INFO  org.apache.pig.Main - Logging error messages to:
> /home/anand_vihar/pig_1431412974400.log 2015-05-12 12:12:54,419 [main]
> INFO  org.apache.pig.impl.util.Utils - Default bootup file
> /home/anand_vihar/.pigbootup not found 2015-05-12 12:12:54,871 [main] INFO
> org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is
> deprecated. Instead, use mapreduce.jobtracker.address 2015-05-12
> 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation
> - fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS 2015-05-12 12:12:54,871 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting
> to hadoop file system at: hdfs://localhost:9000 2015-05-12 12:12:55,495
> [main] INFO  org.apache.hadoop.conf.Configuration.deprecation -
> fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS grunt> records = load '/user/anand_vihar/max/input/1901' >> as
> (year:chararray,temperature:int,quality:int); 2015-05-12 12:23:42,501
> [main] INFO  org.apache.hadoop.conf.Configuration.deprecation -
> fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS *
>
>  Somebody please advise. Thanks
>
>  Regards
>
>
>  Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Prashant Kommireddi <pr...@gmail.com>.
Something that needs correction, just that no one has gotten around to
doing it. Please feel free to open a JIRA, even better if you would like to
contribute a fix.

On Tuesday, May 12, 2015, Anand Murali <an...@yahoo.com> wrote:

> Oliver:
>
> Many thanks for reply. If it is not an error why is the info repeated
> again and again. All defaults have been set in *.xml, which if it is
> picking, why mention deprecation, which I don't understand.
>
> Regards
>
> Anand
>
> Sent from my iPhone
>
> On 12-May-2015, at 1:10 pm, Olivier Renault <orenault@hortonworks.com
> <javascript:_e(%7B%7D,'cvml','orenault@hortonworks.com');>> wrote:
>
> You don't have an error. You are seeing normal info messages.
>
> Thanks,
> Olivier
>  _____________________________
> From:Anand Murali
> Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
> To:user@hadoop.apache.org"
>
>
>  Hi All:
>
>  I have installed above and made corresponding changes to
> core-site,hdfs-site and mapred-site.xml and still get deprecation error. On
> system startup I run . .hadoop
>
>  export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
> export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
> export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0
> export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
> export PIG_HOME=/home/anand_vihar/pig-0.14.0
> export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
> export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
> export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin
> export
> PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
>
> echo $HADOOP_HOME
> echo $JAVA_HOME
> echo $HADOOP_INSTALL
> echo $PIG_HOME
> echo $PIG_INSTALL
> echo $PIG_CLASSPATH
> echo $HIVE_HOME
> echo $PATH
>
>  *Core-site.xml*
> <configuration>
>  <property>
>         <name>fs.defaultFS</name>
>         <value>hdfs://localhost:9000</value>
>     </property>
> </configuration>
>
>  *Hdfs-site.xml*
> <configuration>
> <property>
>         <name>dfs.replication</name>
>         <value>1</value>
> </property>
> <property>
>     <name>dfs.name.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
> </property>
>
> <property>
>     <name>dfs.data.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
> </property>
>
> <property>
>     <name>dfs.webhdfs.enabled</name>
>     <value>true</value>
> </property>
>
> </configuration>
>
>  *Mapred-site.xml*
> <configuration>
>  <property>
>         <name>mapreduce.jobtracker.address</name>
>         <value>localhost:9000</value>
>     </property>
> </configuration>
>
>  *Error*
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *anand_vihar@Latitude-E5540:~$ pig 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Trying ExecType : LOCAL 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 15/05/12 12:12:54 INFO
> pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType 2015-05-12
> 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0
> (r1640057) compiled Nov 16 2014, 18:02:05 2015-05-12 12:12:54,401 [main]
> INFO  org.apache.pig.Main - Logging error messages to:
> /home/anand_vihar/pig_1431412974400.log 2015-05-12 12:12:54,419 [main]
> INFO  org.apache.pig.impl.util.Utils - Default bootup file
> /home/anand_vihar/.pigbootup not found 2015-05-12 12:12:54,871 [main] INFO
> org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is
> deprecated. Instead, use mapreduce.jobtracker.address 2015-05-12
> 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation
> - fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS 2015-05-12 12:12:54,871 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting
> to hadoop file system at: hdfs://localhost:9000 2015-05-12 12:12:55,495
> [main] INFO  org.apache.hadoop.conf.Configuration.deprecation -
> fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS grunt> records = load '/user/anand_vihar/max/input/1901' >> as
> (year:chararray,temperature:int,quality:int); 2015-05-12 12:23:42,501
> [main] INFO  org.apache.hadoop.conf.Configuration.deprecation -
> fs.default.name <http://fs.default.name> is deprecated. Instead, use
> fs.defaultFS *
>
>  Somebody please advise. Thanks
>
>  Regards
>
>
>  Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Anand Murali <an...@yahoo.com>.
Oliver:

Many thanks for reply. If it is not an error why is the info repeated again and again. All defaults have been set in *.xml, which if it is picking, why mention deprecation, which I don't understand.

Regards

Anand

Sent from my iPhone

> On 12-May-2015, at 1:10 pm, Olivier Renault <or...@hortonworks.com> wrote:
> 
> You don't have an error. You are seeing normal info messages. 
> 
> Thanks, 
> Olivier 
> _____________________________
> From:Anand Murali
> Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
> To:user@hadoop.apache.org"
> 
> 
> Hi All:
> 
> I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop
> 
> export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0 
> export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/ 
> export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0 
> export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0 
> export PIG_HOME=/home/anand_vihar/pig-0.14.0 
> export PIG_INSTALL=/home/anand_vihar/pig-0.14.0 
> export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/ 
> export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin 
> export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME 
> echo $HADOOP_HOME 
> echo $JAVA_HOME 
> echo $HADOOP_INSTALL 
> echo $PIG_HOME 
> echo $PIG_INSTALL 
> echo $PIG_CLASSPATH 
> echo $HIVE_HOME 
> echo $PATH
> 
> Core-site.xml
> <configuration> 
>  <property> 
>         <name>fs.defaultFS</name> 
>         <value>hdfs://localhost:9000</value> 
>     </property> 
> </configuration> 
> 
> Hdfs-site.xml
> <configuration>
> <property>
>         <name>dfs.replication</name>
>         <value>1</value>
> </property>
> <property>
>     <name>dfs.name.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
> </property>
> 
> <property>
>     <name>dfs.data.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
> </property>
> 
> <property>
>     <name>dfs.webhdfs.enabled</name>
>     <value>true</value>
> </property>
> 
> </configuration>
> 
> Mapred-site.xml
> <configuration>
>  <property>
>         <name>mapreduce.jobtracker.address</name>
>         <value>localhost:9000</value>
>     </property>
> </configuration>
> 
> Error
> anand_vihar@Latitude-E5540:~$ pig
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
> 2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
> 2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
> 2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
> 2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> grunt> records = load '/user/anand_vihar/max/input/1901'
> >> as (year:chararray,temperature:int,quality:int);
> 2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> 
> Somebody please advise. Thanks
> 
> Regards 
> 
>  
> Anand Murali  
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
> 
> 

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Anand Murali <an...@yahoo.com>.
Oliver:

Many thanks for reply. If it is not an error why is the info repeated again and again. All defaults have been set in *.xml, which if it is picking, why mention deprecation, which I don't understand.

Regards

Anand

Sent from my iPhone

> On 12-May-2015, at 1:10 pm, Olivier Renault <or...@hortonworks.com> wrote:
> 
> You don't have an error. You are seeing normal info messages. 
> 
> Thanks, 
> Olivier 
> _____________________________
> From:Anand Murali
> Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
> To:user@hadoop.apache.org"
> 
> 
> Hi All:
> 
> I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop
> 
> export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0 
> export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/ 
> export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0 
> export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0 
> export PIG_HOME=/home/anand_vihar/pig-0.14.0 
> export PIG_INSTALL=/home/anand_vihar/pig-0.14.0 
> export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/ 
> export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin 
> export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME 
> echo $HADOOP_HOME 
> echo $JAVA_HOME 
> echo $HADOOP_INSTALL 
> echo $PIG_HOME 
> echo $PIG_INSTALL 
> echo $PIG_CLASSPATH 
> echo $HIVE_HOME 
> echo $PATH
> 
> Core-site.xml
> <configuration> 
>  <property> 
>         <name>fs.defaultFS</name> 
>         <value>hdfs://localhost:9000</value> 
>     </property> 
> </configuration> 
> 
> Hdfs-site.xml
> <configuration>
> <property>
>         <name>dfs.replication</name>
>         <value>1</value>
> </property>
> <property>
>     <name>dfs.name.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
> </property>
> 
> <property>
>     <name>dfs.data.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
> </property>
> 
> <property>
>     <name>dfs.webhdfs.enabled</name>
>     <value>true</value>
> </property>
> 
> </configuration>
> 
> Mapred-site.xml
> <configuration>
>  <property>
>         <name>mapreduce.jobtracker.address</name>
>         <value>localhost:9000</value>
>     </property>
> </configuration>
> 
> Error
> anand_vihar@Latitude-E5540:~$ pig
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
> 2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
> 2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
> 2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
> 2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> grunt> records = load '/user/anand_vihar/max/input/1901'
> >> as (year:chararray,temperature:int,quality:int);
> 2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> 
> Somebody please advise. Thanks
> 
> Regards 
> 
>  
> Anand Murali  
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
> 
> 

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Anand Murali <an...@yahoo.com>.
Oliver:

Many thanks for reply. If it is not an error why is the info repeated again and again. All defaults have been set in *.xml, which if it is picking, why mention deprecation, which I don't understand.

Regards

Anand

Sent from my iPhone

> On 12-May-2015, at 1:10 pm, Olivier Renault <or...@hortonworks.com> wrote:
> 
> You don't have an error. You are seeing normal info messages. 
> 
> Thanks, 
> Olivier 
> _____________________________
> From:Anand Murali
> Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
> To:user@hadoop.apache.org"
> 
> 
> Hi All:
> 
> I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop
> 
> export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0 
> export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/ 
> export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0 
> export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0 
> export PIG_HOME=/home/anand_vihar/pig-0.14.0 
> export PIG_INSTALL=/home/anand_vihar/pig-0.14.0 
> export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/ 
> export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin 
> export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME 
> echo $HADOOP_HOME 
> echo $JAVA_HOME 
> echo $HADOOP_INSTALL 
> echo $PIG_HOME 
> echo $PIG_INSTALL 
> echo $PIG_CLASSPATH 
> echo $HIVE_HOME 
> echo $PATH
> 
> Core-site.xml
> <configuration> 
>  <property> 
>         <name>fs.defaultFS</name> 
>         <value>hdfs://localhost:9000</value> 
>     </property> 
> </configuration> 
> 
> Hdfs-site.xml
> <configuration>
> <property>
>         <name>dfs.replication</name>
>         <value>1</value>
> </property>
> <property>
>     <name>dfs.name.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
> </property>
> 
> <property>
>     <name>dfs.data.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
> </property>
> 
> <property>
>     <name>dfs.webhdfs.enabled</name>
>     <value>true</value>
> </property>
> 
> </configuration>
> 
> Mapred-site.xml
> <configuration>
>  <property>
>         <name>mapreduce.jobtracker.address</name>
>         <value>localhost:9000</value>
>     </property>
> </configuration>
> 
> Error
> anand_vihar@Latitude-E5540:~$ pig
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
> 2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
> 2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
> 2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
> 2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> grunt> records = load '/user/anand_vihar/max/input/1901'
> >> as (year:chararray,temperature:int,quality:int);
> 2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> 
> Somebody please advise. Thanks
> 
> Regards 
> 
>  
> Anand Murali  
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
> 
> 

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Anand Murali <an...@yahoo.com>.
Oliver:

Many thanks for reply. If it is not an error why is the info repeated again and again. All defaults have been set in *.xml, which if it is picking, why mention deprecation, which I don't understand.

Regards

Anand

Sent from my iPhone

> On 12-May-2015, at 1:10 pm, Olivier Renault <or...@hortonworks.com> wrote:
> 
> You don't have an error. You are seeing normal info messages. 
> 
> Thanks, 
> Olivier 
> _____________________________
> From:Anand Murali
> Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
> To:user@hadoop.apache.org"
> 
> 
> Hi All:
> 
> I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop
> 
> export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0 
> export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/ 
> export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0 
> export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0 
> export PIG_HOME=/home/anand_vihar/pig-0.14.0 
> export PIG_INSTALL=/home/anand_vihar/pig-0.14.0 
> export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/ 
> export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin 
> export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME 
> echo $HADOOP_HOME 
> echo $JAVA_HOME 
> echo $HADOOP_INSTALL 
> echo $PIG_HOME 
> echo $PIG_INSTALL 
> echo $PIG_CLASSPATH 
> echo $HIVE_HOME 
> echo $PATH
> 
> Core-site.xml
> <configuration> 
>  <property> 
>         <name>fs.defaultFS</name> 
>         <value>hdfs://localhost:9000</value> 
>     </property> 
> </configuration> 
> 
> Hdfs-site.xml
> <configuration>
> <property>
>         <name>dfs.replication</name>
>         <value>1</value>
> </property>
> <property>
>     <name>dfs.name.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
> </property>
> 
> <property>
>     <name>dfs.data.dir</name>
>     <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
> </property>
> 
> <property>
>     <name>dfs.webhdfs.enabled</name>
>     <value>true</value>
> </property>
> 
> </configuration>
> 
> Mapred-site.xml
> <configuration>
>  <property>
>         <name>mapreduce.jobtracker.address</name>
>         <value>localhost:9000</value>
>     </property>
> </configuration>
> 
> Error
> anand_vihar@Latitude-E5540:~$ pig
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
> 15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
> 2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
> 2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
> 2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> 2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
> 2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> grunt> records = load '/user/anand_vihar/max/input/1901'
> >> as (year:chararray,temperature:int,quality:int);
> 2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
> 
> Somebody please advise. Thanks
> 
> Regards 
> 
>  
> Anand Murali  
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
> 
> 

Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Olivier Renault <or...@hortonworks.com>.
You don't have an error. You are seeing normal info messages.

Thanks,
Olivier
_____________________________
From:Anand Murali
Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
To:user@hadoop.apache.org"


Hi All:

I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop

export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0
export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
export PIG_HOME=/home/anand_vihar/pig-0.14.0
export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
echo $HADOOP_HOME
echo $JAVA_HOME
echo $HADOOP_INSTALL
echo $PIG_HOME
echo $PIG_INSTALL
echo $PIG_CLASSPATH
echo $HIVE_HOME
echo $PATH

Core-site.xml
<configuration>
 <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

Hdfs-site.xml
<configuration>
<property>
        <name>dfs.replication</name>
        <value>1</value>
</property>
<property>
    <name>dfs.name.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
</property>

<property>
    <name>dfs.data.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
</property>

<property>
    <name>dfs.webhdfs.enabled</name>
    <value>true</value>
</property>

</configuration>

Mapred-site.xml
<configuration>
 <property>
        <name>mapreduce.jobtracker.address</name>
        <value>localhost:9000</value>
    </property>
</configuration>

Error
anand_vihar@Latitude-E5540:~$ pig
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
grunt> records = load '/user/anand_vihar/max/input/1901'
>> as (year:chararray,temperature:int,quality:int);
2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS

Somebody please advise. Thanks

Regards


Anand Murali
11/7, 'Anand Vihar', Kandasamy St, Mylapore
Chennai - 600 004, India
Ph: (044)- 28474593/ 43526162 (voicemail)



Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Olivier Renault <or...@hortonworks.com>.
You don't have an error. You are seeing normal info messages.

Thanks,
Olivier
_____________________________
From:Anand Murali
Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
To:user@hadoop.apache.org"


Hi All:

I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop

export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0
export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
export PIG_HOME=/home/anand_vihar/pig-0.14.0
export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
echo $HADOOP_HOME
echo $JAVA_HOME
echo $HADOOP_INSTALL
echo $PIG_HOME
echo $PIG_INSTALL
echo $PIG_CLASSPATH
echo $HIVE_HOME
echo $PATH

Core-site.xml
<configuration>
 <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

Hdfs-site.xml
<configuration>
<property>
        <name>dfs.replication</name>
        <value>1</value>
</property>
<property>
    <name>dfs.name.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
</property>

<property>
    <name>dfs.data.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
</property>

<property>
    <name>dfs.webhdfs.enabled</name>
    <value>true</value>
</property>

</configuration>

Mapred-site.xml
<configuration>
 <property>
        <name>mapreduce.jobtracker.address</name>
        <value>localhost:9000</value>
    </property>
</configuration>

Error
anand_vihar@Latitude-E5540:~$ pig
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
grunt> records = load '/user/anand_vihar/max/input/1901'
>> as (year:chararray,temperature:int,quality:int);
2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS

Somebody please advise. Thanks

Regards


Anand Murali
11/7, 'Anand Vihar', Kandasamy St, Mylapore
Chennai - 600 004, India
Ph: (044)- 28474593/ 43526162 (voicemail)



Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Olivier Renault <or...@hortonworks.com>.
You don't have an error. You are seeing normal info messages.

Thanks,
Olivier
_____________________________
From:Anand Murali
Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
To:user@hadoop.apache.org"


Hi All:

I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop

export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0
export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
export PIG_HOME=/home/anand_vihar/pig-0.14.0
export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
echo $HADOOP_HOME
echo $JAVA_HOME
echo $HADOOP_INSTALL
echo $PIG_HOME
echo $PIG_INSTALL
echo $PIG_CLASSPATH
echo $HIVE_HOME
echo $PATH

Core-site.xml
<configuration>
 <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

Hdfs-site.xml
<configuration>
<property>
        <name>dfs.replication</name>
        <value>1</value>
</property>
<property>
    <name>dfs.name.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
</property>

<property>
    <name>dfs.data.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
</property>

<property>
    <name>dfs.webhdfs.enabled</name>
    <value>true</value>
</property>

</configuration>

Mapred-site.xml
<configuration>
 <property>
        <name>mapreduce.jobtracker.address</name>
        <value>localhost:9000</value>
    </property>
</configuration>

Error
anand_vihar@Latitude-E5540:~$ pig
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
grunt> records = load '/user/anand_vihar/max/input/1901'
>> as (year:chararray,temperature:int,quality:int);
2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS

Somebody please advise. Thanks

Regards


Anand Murali
11/7, 'Anand Vihar', Kandasamy St, Mylapore
Chennai - 600 004, India
Ph: (044)- 28474593/ 43526162 (voicemail)



Re: Pig 0.14.0 on Hadoop 2.6.0 deprecation errors

Posted by Olivier Renault <or...@hortonworks.com>.
You don't have an error. You are seeing normal info messages.

Thanks,
Olivier
_____________________________
From:Anand Murali
Subject:Pig 0.14.0 on Hadoop 2.6.0 deprecation errors
To:user@hadoop.apache.org"


Hi All:

I have installed above and made corresponding changes to core-site,hdfs-site and mapred-site.xml and still get deprecation error. On system startup I run . .hadoop

export HADOOP_HOME=/home/anand_vihar/hadoop-2.6.0
export JAVA_HOME=/home/anand_vihar/jdk1.7.0_75/
export HADOOP_PREFIX=/home/anand_vihar/hadoop-2.6.0
export HADOOP_INSTALL=/home/anand_vihar/hadoop-2.6.0
export PIG_HOME=/home/anand_vihar/pig-0.14.0
export PIG_INSTALL=/home/anand_vihar/pig-0.14.0
export PIG_CLASSPATH=/home/anand_vihar/hadoop-2.6.0/etc/hadoop/
export HIVE_HOME=/home/anand_vihar/apache-hive-1.1.0-bin
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin:$HADOOP_HOME:$JAVA_HOME:$PIG_INSTALL/bin:$PIG_CLASSPATH:$HIVE_HOME
echo $HADOOP_HOME
echo $JAVA_HOME
echo $HADOOP_INSTALL
echo $PIG_HOME
echo $PIG_INSTALL
echo $PIG_CLASSPATH
echo $HIVE_HOME
echo $PATH

Core-site.xml
<configuration>
 <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

Hdfs-site.xml
<configuration>
<property>
        <name>dfs.replication</name>
        <value>1</value>
</property>
<property>
    <name>dfs.name.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/name</value>
</property>

<property>
    <name>dfs.data.dir</name>
    <value>/home/anand_vihar/hadoop-2.6.0/hdfs/data</value>
</property>

<property>
    <name>dfs.webhdfs.enabled</name>
    <value>true</value>
</property>

</configuration>

Mapred-site.xml
<configuration>
 <property>
        <name>mapreduce.jobtracker.address</name>
        <value>localhost:9000</value>
    </property>
</configuration>

Error
anand_vihar@Latitude-E5540:~$ pig
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
15/05/12 12:12:54 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Apache Pig version 0.14.0 (r1640057) compiled Nov 16 2014, 18:02:05
2015-05-12 12:12:54,401 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/anand_vihar/pig_1431412974400.log
2015-05-12 12:12:54,419 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/anand_vihar/.pigbootup not found
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-05-12 12:12:54,871 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-05-12 12:12:54,871 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
2015-05-12 12:12:55,495 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
grunt> records = load '/user/anand_vihar/max/input/1901'
>> as (year:chararray,temperature:int,quality:int);
2015-05-12 12:23:42,501 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS

Somebody please advise. Thanks

Regards


Anand Murali
11/7, 'Anand Vihar', Kandasamy St, Mylapore
Chennai - 600 004, India
Ph: (044)- 28474593/ 43526162 (voicemail)