You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by George Pang <p0...@gmail.com> on 2009/07/20 05:28:21 UTC
Pig version mismatch after setting PIG_HADOOP_VERSION
Dear users,
My pig 0.3.0 and hadoop-0.18.3 worked fine with single node cluster, but
after I change to a 2 - nodes cluster, I got this error as I ran pig:
*org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch. (client =
11, server = 10)*
Among my environment variables: PIG_HADOOP_VERSION=18
Did I miss any thing? Thank you in advance.
George
Re: Pig version mismatch after setting PIG_HADOOP_VERSION
Posted by zhang jianfeng <zj...@gmail.com>.
So do you use the third machine as the client ?
make sure it also has the version of hadoop
On Mon, Jul 20, 2009 at 1:54 PM, George Pang <p0...@gmail.com> wrote:
> Hi Jeff,
>
> When you say server and client, do you mean my master machine and slave
> machine?
>
> And my master and slave share the same version of hadoop, I copied and
> pasted from the same flash drive.
>
> Thank you,
>
> George
>
> 2009/7/19 zhang jianfeng <zj...@gmail.com>
>
> > It looks like the versions of client and server is not the same.
> >
> > This is version number explanation from hadoop source code:
> >
> > * Version 6: change the counters representation for HADOOP-2248
> > * Version 7: added getAllJobs for HADOOP-2487
> > * Version 8: change {job|task}id's to use corresponding objects rather
> > that strings.
> > * Version 9: change the counter representation for HADOOP-1915
> > * Version 10: added getSystemDir for HADOOP-3135
> > * Version 11: changed JobProfile to include the queue name for
> > HADOOP-3698
> > * Version 12: Added getCleanupTaskReports and
> > * cleanupProgress to JobStatus as part of HADOOP-3150
> > * Version 13: Added getJobQueueInfos and getJobQueueInfo(queue name)
> > * and getAllJobs(queue) as a part of HADOOP-3930
> > * Version 14: Added setPriority for HADOOP-4124
> > * Version 15: Added KILLED status to JobStatus as part of
> > HADOOP-3924
> > * Version 16: Added getSetupTaskReports and
> >
> > You'd better copy the same version hadoop to server and client to make
> them
> > consistent.
> >
> >
> > Jeff Zhang
> >
> > On Mon, Jul 20, 2009 at 11:56 AM, George Pang <p0...@gmail.com> wrote:
> >
> > > Yes, it is, and it was fine with a single-node cluster.
> > >
> > > George
> > >
> > > 2009/7/19 zhangjiayin <zh...@360quan.com>
> > >
> > > > George Pang wrote:
> > > >
> > > >> Dear users,
> > > >>
> > > >> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node cluster,
> > but
> > > >> after I change to a 2 - nodes cluster, I got this error as I ran
> pig:
> > > >>
> > > >> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> > > >> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch.
> > (client
> > > =
> > > >> 11, server = 10)*
> > > >>
> > > >> Among my environment variables: PIG_HADOOP_VERSION=18
> > > >>
> > > >> Did I miss any thing? Thank you in advance.
> > > >>
> > > >> George
> > > >>
> > > >>
> > > >>
> > > > do you sure the hadoop run in cluster is hadoop-0.18.3
> > > >
> > >
> >
>
Re: Pig version mismatch after setting PIG_HADOOP_VERSION
Posted by George Pang <p0...@gmail.com>.
Hi Santhosh,
My version for pig: 0.3.0, version for hadoop: 0.18.3
I think thy should be bundled version, right?
George
2009/7/19 Santhosh Srinivasan <sm...@yahoo-inc.com>
> The pig.jar is bundled with a hadoop.jar. From the error message, it
> appears that the hadoop.jar bundled with the pig.jar has a higher minor
> version of hadoop.
>
> Santhosh
>
> -----Original Message-----
> From: George Pang [mailto:p0941p@gmail.com]
> Sent: Sunday, July 19, 2009 10:54 PM
> To: pig-user@hadoop.apache.org
> Subject: Re: Pig version mismatch after setting PIG_HADOOP_VERSION
>
> Hi Jeff,
>
> When you say server and client, do you mean my master machine and slave
> machine?
>
> And my master and slave share the same version of hadoop, I copied and
> pasted from the same flash drive.
>
> Thank you,
>
> George
>
> 2009/7/19 zhang jianfeng <zj...@gmail.com>
>
> > It looks like the versions of client and server is not the same.
> >
> > This is version number explanation from hadoop source code:
> >
> > * Version 6: change the counters representation for HADOOP-2248
> > * Version 7: added getAllJobs for HADOOP-2487
> > * Version 8: change {job|task}id's to use corresponding objects
> rather
> > that strings.
> > * Version 9: change the counter representation for HADOOP-1915
> > * Version 10: added getSystemDir for HADOOP-3135
> > * Version 11: changed JobProfile to include the queue name for
> > HADOOP-3698
> > * Version 12: Added getCleanupTaskReports and
> > * cleanupProgress to JobStatus as part of HADOOP-3150
> > * Version 13: Added getJobQueueInfos and getJobQueueInfo(queue name)
> > * and getAllJobs(queue) as a part of HADOOP-3930
> > * Version 14: Added setPriority for HADOOP-4124
> > * Version 15: Added KILLED status to JobStatus as part of
> > HADOOP-3924
> > * Version 16: Added getSetupTaskReports and
> >
> > You'd better copy the same version hadoop to server and client to make
> them
> > consistent.
> >
> >
> > Jeff Zhang
> >
> > On Mon, Jul 20, 2009 at 11:56 AM, George Pang <p0...@gmail.com>
> wrote:
> >
> > > Yes, it is, and it was fine with a single-node cluster.
> > >
> > > George
> > >
> > > 2009/7/19 zhangjiayin <zh...@360quan.com>
> > >
> > > > George Pang wrote:
> > > >
> > > >> Dear users,
> > > >>
> > > >> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node
> cluster,
> > but
> > > >> after I change to a 2 - nodes cluster, I got this error as I ran
> pig:
> > > >>
> > > >> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> > > >> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch.
> > (client
> > > =
> > > >> 11, server = 10)*
> > > >>
> > > >> Among my environment variables: PIG_HADOOP_VERSION=18
> > > >>
> > > >> Did I miss any thing? Thank you in advance.
> > > >>
> > > >> George
> > > >>
> > > >>
> > > >>
> > > > do you sure the hadoop run in cluster is hadoop-0.18.3
> > > >
> > >
> >
>
RE: Pig version mismatch after setting PIG_HADOOP_VERSION
Posted by Santhosh Srinivasan <sm...@yahoo-inc.com>.
The pig.jar is bundled with a hadoop.jar. From the error message, it
appears that the hadoop.jar bundled with the pig.jar has a higher minor
version of hadoop.
Santhosh
-----Original Message-----
From: George Pang [mailto:p0941p@gmail.com]
Sent: Sunday, July 19, 2009 10:54 PM
To: pig-user@hadoop.apache.org
Subject: Re: Pig version mismatch after setting PIG_HADOOP_VERSION
Hi Jeff,
When you say server and client, do you mean my master machine and slave
machine?
And my master and slave share the same version of hadoop, I copied and
pasted from the same flash drive.
Thank you,
George
2009/7/19 zhang jianfeng <zj...@gmail.com>
> It looks like the versions of client and server is not the same.
>
> This is version number explanation from hadoop source code:
>
> * Version 6: change the counters representation for HADOOP-2248
> * Version 7: added getAllJobs for HADOOP-2487
> * Version 8: change {job|task}id's to use corresponding objects
rather
> that strings.
> * Version 9: change the counter representation for HADOOP-1915
> * Version 10: added getSystemDir for HADOOP-3135
> * Version 11: changed JobProfile to include the queue name for
> HADOOP-3698
> * Version 12: Added getCleanupTaskReports and
> * cleanupProgress to JobStatus as part of HADOOP-3150
> * Version 13: Added getJobQueueInfos and getJobQueueInfo(queue name)
> * and getAllJobs(queue) as a part of HADOOP-3930
> * Version 14: Added setPriority for HADOOP-4124
> * Version 15: Added KILLED status to JobStatus as part of
> HADOOP-3924
> * Version 16: Added getSetupTaskReports and
>
> You'd better copy the same version hadoop to server and client to make
them
> consistent.
>
>
> Jeff Zhang
>
> On Mon, Jul 20, 2009 at 11:56 AM, George Pang <p0...@gmail.com>
wrote:
>
> > Yes, it is, and it was fine with a single-node cluster.
> >
> > George
> >
> > 2009/7/19 zhangjiayin <zh...@360quan.com>
> >
> > > George Pang wrote:
> > >
> > >> Dear users,
> > >>
> > >> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node
cluster,
> but
> > >> after I change to a 2 - nodes cluster, I got this error as I ran
pig:
> > >>
> > >> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> > >> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch.
> (client
> > =
> > >> 11, server = 10)*
> > >>
> > >> Among my environment variables: PIG_HADOOP_VERSION=18
> > >>
> > >> Did I miss any thing? Thank you in advance.
> > >>
> > >> George
> > >>
> > >>
> > >>
> > > do you sure the hadoop run in cluster is hadoop-0.18.3
> > >
> >
>
Re: Pig version mismatch after setting PIG_HADOOP_VERSION
Posted by George Pang <p0...@gmail.com>.
Hi Jeff,
When you say server and client, do you mean my master machine and slave
machine?
And my master and slave share the same version of hadoop, I copied and
pasted from the same flash drive.
Thank you,
George
2009/7/19 zhang jianfeng <zj...@gmail.com>
> It looks like the versions of client and server is not the same.
>
> This is version number explanation from hadoop source code:
>
> * Version 6: change the counters representation for HADOOP-2248
> * Version 7: added getAllJobs for HADOOP-2487
> * Version 8: change {job|task}id's to use corresponding objects rather
> that strings.
> * Version 9: change the counter representation for HADOOP-1915
> * Version 10: added getSystemDir for HADOOP-3135
> * Version 11: changed JobProfile to include the queue name for
> HADOOP-3698
> * Version 12: Added getCleanupTaskReports and
> * cleanupProgress to JobStatus as part of HADOOP-3150
> * Version 13: Added getJobQueueInfos and getJobQueueInfo(queue name)
> * and getAllJobs(queue) as a part of HADOOP-3930
> * Version 14: Added setPriority for HADOOP-4124
> * Version 15: Added KILLED status to JobStatus as part of
> HADOOP-3924
> * Version 16: Added getSetupTaskReports and
>
> You'd better copy the same version hadoop to server and client to make them
> consistent.
>
>
> Jeff Zhang
>
> On Mon, Jul 20, 2009 at 11:56 AM, George Pang <p0...@gmail.com> wrote:
>
> > Yes, it is, and it was fine with a single-node cluster.
> >
> > George
> >
> > 2009/7/19 zhangjiayin <zh...@360quan.com>
> >
> > > George Pang wrote:
> > >
> > >> Dear users,
> > >>
> > >> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node cluster,
> but
> > >> after I change to a 2 - nodes cluster, I got this error as I ran pig:
> > >>
> > >> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> > >> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch.
> (client
> > =
> > >> 11, server = 10)*
> > >>
> > >> Among my environment variables: PIG_HADOOP_VERSION=18
> > >>
> > >> Did I miss any thing? Thank you in advance.
> > >>
> > >> George
> > >>
> > >>
> > >>
> > > do you sure the hadoop run in cluster is hadoop-0.18.3
> > >
> >
>
Re: Pig version mismatch after setting PIG_HADOOP_VERSION
Posted by zhang jianfeng <zj...@gmail.com>.
It looks like the versions of client and server is not the same.
This is version number explanation from hadoop source code:
* Version 6: change the counters representation for HADOOP-2248
* Version 7: added getAllJobs for HADOOP-2487
* Version 8: change {job|task}id's to use corresponding objects rather
that strings.
* Version 9: change the counter representation for HADOOP-1915
* Version 10: added getSystemDir for HADOOP-3135
* Version 11: changed JobProfile to include the queue name for
HADOOP-3698
* Version 12: Added getCleanupTaskReports and
* cleanupProgress to JobStatus as part of HADOOP-3150
* Version 13: Added getJobQueueInfos and getJobQueueInfo(queue name)
* and getAllJobs(queue) as a part of HADOOP-3930
* Version 14: Added setPriority for HADOOP-4124
* Version 15: Added KILLED status to JobStatus as part of
HADOOP-3924
* Version 16: Added getSetupTaskReports and
You'd better copy the same version hadoop to server and client to make them
consistent.
Jeff Zhang
On Mon, Jul 20, 2009 at 11:56 AM, George Pang <p0...@gmail.com> wrote:
> Yes, it is, and it was fine with a single-node cluster.
>
> George
>
> 2009/7/19 zhangjiayin <zh...@360quan.com>
>
> > George Pang wrote:
> >
> >> Dear users,
> >>
> >> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node cluster, but
> >> after I change to a 2 - nodes cluster, I got this error as I ran pig:
> >>
> >> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> >> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch. (client
> =
> >> 11, server = 10)*
> >>
> >> Among my environment variables: PIG_HADOOP_VERSION=18
> >>
> >> Did I miss any thing? Thank you in advance.
> >>
> >> George
> >>
> >>
> >>
> > do you sure the hadoop run in cluster is hadoop-0.18.3
> >
>
Re: Pig version mismatch after setting PIG_HADOOP_VERSION
Posted by George Pang <p0...@gmail.com>.
Yes, it is, and it was fine with a single-node cluster.
George
2009/7/19 zhangjiayin <zh...@360quan.com>
> George Pang wrote:
>
>> Dear users,
>>
>> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node cluster, but
>> after I change to a 2 - nodes cluster, I got this error as I ran pig:
>>
>> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
>> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch. (client =
>> 11, server = 10)*
>>
>> Among my environment variables: PIG_HADOOP_VERSION=18
>>
>> Did I miss any thing? Thank you in advance.
>>
>> George
>>
>>
>>
> do you sure the hadoop run in cluster is hadoop-0.18.3
>
Re: Pig version mismatch after setting PIG_HADOOP_VERSION
Posted by zhangjiayin <zh...@360quan.com>.
George Pang wrote:
> Dear users,
>
> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node cluster, but
> after I change to a 2 - nodes cluster, I got this error as I ran pig:
>
> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch. (client =
> 11, server = 10)*
>
> Among my environment variables: PIG_HADOOP_VERSION=18
>
> Did I miss any thing? Thank you in advance.
>
> George
>
>
do you sure the hadoop run in cluster is hadoop-0.18.3