You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Something Something <ma...@gmail.com> on 2012/03/08 07:30:05 UTC
org.apache.hadoop.conf.Configuration - error parsing conf file
Hello,
I am using: hadoop-0.20.2-cdh3u2, hbase-0.90.4-cdh3u3, pig-0.8.1-cdh3u3
I have successfully loaded data into HBase tables (implying my Hadoop &
HBase setup is good). I can look at the data using HBase shell.
Now I am trying to read data from HBase via a Pig Script. My test script
looks very simple:
------------------------------------------------------------------------------------------------------------------------------
raw = LOAD 'hbase://MY_TEST_TABLE'
USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('id:*',
'-loadKey true');
STORE raw INTO '/user/temp/output';
------------------------------------------------------------------------------------------------------------------------------
When I run this locally using this:
pig -x local test.pig
I keep getting the following message:
2012-03-07 22:09:29,828 [Thread-4] FATAL
org.apache.hadoop.conf.Configuration - error parsing conf file:
com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException:
Invalid byte 2 of 2-byte UTF-8 sequence.
Sounds like it doesn't like some configuration file from Hadoop, but don't
know which one. Can someone give me some pointers, please? Thanks.
Re: org.apache.hadoop.conf.Configuration - error parsing conf file
Posted by Something Something <ma...@gmail.com>.
There's a 'quietmode' variable in org/apache/hadoop/conf/Configuration.java
class:
/**
* Set the quietness-mode.
*
* In the quiet-mode, error and informational messages might not be
logged.
*
* @param quietmode <code>true</code> to set quiet-mode on,
<code>false</code>
* to turn it off.
*/
public synchronized void setQuietMode(boolean quietmode) {
this.quietmode = quietmode;
}
Can someone tell me how to force call to this? Apologies in advance for my
dumbness.
On Wed, Mar 7, 2012 at 10:30 PM, Something Something <
mailinglists19@gmail.com> wrote:
> Hello,
>
> I am using: hadoop-0.20.2-cdh3u2, hbase-0.90.4-cdh3u3, pig-0.8.1-cdh3u3
>
> I have successfully loaded data into HBase tables (implying my Hadoop &
> HBase setup is good). I can look at the data using HBase shell.
>
> Now I am trying to read data from HBase via a Pig Script. My test script
> looks very simple:
>
>
> ------------------------------------------------------------------------------------------------------------------------------
> raw = LOAD 'hbase://MY_TEST_TABLE'
> USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('id:*',
> '-loadKey true');
>
> STORE raw INTO '/user/temp/output';
>
> ------------------------------------------------------------------------------------------------------------------------------
>
>
> When I run this locally using this:
>
> pig -x local test.pig
>
> I keep getting the following message:
>
> 2012-03-07 22:09:29,828 [Thread-4] FATAL
> org.apache.hadoop.conf.Configuration - error parsing conf file:
> com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException:
> Invalid byte 2 of 2-byte UTF-8 sequence.
>
>
> Sounds like it doesn't like some configuration file from Hadoop, but don't
> know which one. Can someone give me some pointers, please? Thanks.
>
>
>
>
>
>
Re: org.apache.hadoop.conf.Configuration - error parsing conf file
Posted by Stack <st...@duboce.net>.
On Thu, Mar 8, 2012 at 8:45 AM, Something Something
<ma...@gmail.com> wrote:
> Explicit message would be one that would tell me which configuration file
> it is ;)
Agreed.
> As for JVM:
>
> java version "1.6.0_26"
> Java(TM) SE Runtime Environment (build 1.6.0_26-b03-384-10M3425)
> Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02-384, mixed mode)
>
> on Mac Book Pro.
>
OK. Was just a notion.
St.Ack
Fwd: org.apache.hadoop.conf.Configuration - error parsing conf file
Posted by Something Something <ma...@gmail.com>.
---------- Forwarded message ----------
From: Something Something <ma...@gmail.com>
Date: Thu, Mar 8, 2012 at 8:43 AM
Subject: Re: org.apache.hadoop.conf.Configuration - error parsing conf file
To: user@pig.apache.org, manishbhoge@rocketmail.com
*Stack*:
Explicit message would be one that would tell me which configuration file
it is ;) This message tells me what's wrong but doesn't tell me the source
of the problem, even though, it (probably) knows which one it is! Anyway,
I will see if I can find the name somehow.
As for JVM:
java version "1.6.0_26"
Java(TM) SE Runtime Environment (build 1.6.0_26-b03-384-10M3425)
Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02-384, mixed mode)
on Mac Book Pro.
*Manish*:
My PIG_CLASSPATH is set as follows:
export PIG_CLASSPATH=/Users/xyz/pig-0.8.1-cdh3u3/pig-0.8.1-cdh3u3-core.jar
export PIG_CLASSPATH=”`${HADOOP_HOME}/bin/hadoop
classpath`:`${HBASE_HOME}/bin/hbase classpath`:$PIG_CLASSPATH”
Is this correct?
Thank you both for your help.
On Wed, Mar 7, 2012 at 11:53 PM, Manish Bhoge <ma...@rocketmail.com>wrote:
> Hi,
>
> There are 2 important configuration that PIG look for: namenode path and
> job tracker path. Make sure you have set up PiG_CLASSPATH for the same.
> By looking at error detail it doesn't look like configuration error. It
> talks about the utf-8 error which is related to the data which your reading
> from hbase.
>
> Thank you,
> Manish
> Sent from my BlackBerry, pls excuse typo
>
> -----Original Message-----
> From: Something Something <ma...@gmail.com>
> Date: Wed, 7 Mar 2012 22:30:05
> To: <us...@pig.apache.org>; <us...@hbase.apache.org>; <cdh-user@cloudera.org
> >
> Reply-To: user@pig.apache.org
> Subject: org.apache.hadoop.conf.Configuration - error parsing conf file
>
> Hello,
>
> I am using: hadoop-0.20.2-cdh3u2, hbase-0.90.4-cdh3u3, pig-0.8.1-cdh3u3
>
> I have successfully loaded data into HBase tables (implying my Hadoop &
> HBase setup is good). I can look at the data using HBase shell.
>
> Now I am trying to read data from HBase via a Pig Script. My test script
> looks very simple:
>
>
> ------------------------------------------------------------------------------------------------------------------------------
> raw = LOAD 'hbase://MY_TEST_TABLE'
> USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('id:*',
> '-loadKey true');
>
> STORE raw INTO '/user/temp/output';
>
> ------------------------------------------------------------------------------------------------------------------------------
>
>
> When I run this locally using this:
>
> pig -x local test.pig
>
> I keep getting the following message:
>
> 2012-03-07 22:09:29,828 [Thread-4] FATAL
> org.apache.hadoop.conf.Configuration - error parsing conf file:
> com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException:
> Invalid byte 2 of 2-byte UTF-8 sequence.
>
>
> Sounds like it doesn't like some configuration file from Hadoop, but don't
> know which one. Can someone give me some pointers, please? Thanks.
>
>
Re: org.apache.hadoop.conf.Configuration - error parsing conf file
Posted by Something Something <ma...@gmail.com>.
*Stack*:
Explicit message would be one that would tell me which configuration file
it is ;) This message tells me what's wrong but doesn't tell me the source
of the problem, even though, it (probably) knows which one it is! Anyway,
I will see if I can find the name somehow.
As for JVM:
java version "1.6.0_26"
Java(TM) SE Runtime Environment (build 1.6.0_26-b03-384-10M3425)
Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02-384, mixed mode)
on Mac Book Pro.
*Manish*:
My PIG_CLASSPATH is set as follows:
export PIG_CLASSPATH=/Users/xyz/pig-0.8.1-cdh3u3/pig-0.8.1-cdh3u3-core.jar
export PIG_CLASSPATH=”`${HADOOP_HOME}/bin/hadoop
classpath`:`${HBASE_HOME}/bin/hbase classpath`:$PIG_CLASSPATH”
Is this correct?
Thank you both for your help.
On Wed, Mar 7, 2012 at 11:53 PM, Manish Bhoge <ma...@rocketmail.com>wrote:
> Hi,
>
> There are 2 important configuration that PIG look for: namenode path and
> job tracker path. Make sure you have set up PiG_CLASSPATH for the same.
> By looking at error detail it doesn't look like configuration error. It
> talks about the utf-8 error which is related to the data which your reading
> from hbase.
>
> Thank you,
> Manish
> Sent from my BlackBerry, pls excuse typo
>
> -----Original Message-----
> From: Something Something <ma...@gmail.com>
> Date: Wed, 7 Mar 2012 22:30:05
> To: <us...@pig.apache.org>; <us...@hbase.apache.org>; <cdh-user@cloudera.org
> >
> Reply-To: user@pig.apache.org
> Subject: org.apache.hadoop.conf.Configuration - error parsing conf file
>
> Hello,
>
> I am using: hadoop-0.20.2-cdh3u2, hbase-0.90.4-cdh3u3, pig-0.8.1-cdh3u3
>
> I have successfully loaded data into HBase tables (implying my Hadoop &
> HBase setup is good). I can look at the data using HBase shell.
>
> Now I am trying to read data from HBase via a Pig Script. My test script
> looks very simple:
>
>
> ------------------------------------------------------------------------------------------------------------------------------
> raw = LOAD 'hbase://MY_TEST_TABLE'
> USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('id:*',
> '-loadKey true');
>
> STORE raw INTO '/user/temp/output';
>
> ------------------------------------------------------------------------------------------------------------------------------
>
>
> When I run this locally using this:
>
> pig -x local test.pig
>
> I keep getting the following message:
>
> 2012-03-07 22:09:29,828 [Thread-4] FATAL
> org.apache.hadoop.conf.Configuration - error parsing conf file:
> com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException:
> Invalid byte 2 of 2-byte UTF-8 sequence.
>
>
> Sounds like it doesn't like some configuration file from Hadoop, but don't
> know which one. Can someone give me some pointers, please? Thanks.
>
>
Re: org.apache.hadoop.conf.Configuration - error parsing conf file
Posted by Manish Bhoge <ma...@rocketmail.com>.
Hi,
There are 2 important configuration that PIG look for: namenode path and job tracker path. Make sure you have set up PiG_CLASSPATH for the same.
By looking at error detail it doesn't look like configuration error. It talks about the utf-8 error which is related to the data which your reading from hbase.
Thank you,
Manish
Sent from my BlackBerry, pls excuse typo
-----Original Message-----
From: Something Something <ma...@gmail.com>
Date: Wed, 7 Mar 2012 22:30:05
To: <us...@pig.apache.org>; <us...@hbase.apache.org>; <cd...@cloudera.org>
Reply-To: user@pig.apache.org
Subject: org.apache.hadoop.conf.Configuration - error parsing conf file
Hello,
I am using: hadoop-0.20.2-cdh3u2, hbase-0.90.4-cdh3u3, pig-0.8.1-cdh3u3
I have successfully loaded data into HBase tables (implying my Hadoop &
HBase setup is good). I can look at the data using HBase shell.
Now I am trying to read data from HBase via a Pig Script. My test script
looks very simple:
------------------------------------------------------------------------------------------------------------------------------
raw = LOAD 'hbase://MY_TEST_TABLE'
USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('id:*',
'-loadKey true');
STORE raw INTO '/user/temp/output';
------------------------------------------------------------------------------------------------------------------------------
When I run this locally using this:
pig -x local test.pig
I keep getting the following message:
2012-03-07 22:09:29,828 [Thread-4] FATAL
org.apache.hadoop.conf.Configuration - error parsing conf file:
com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException:
Invalid byte 2 of 2-byte UTF-8 sequence.
Sounds like it doesn't like some configuration file from Hadoop, but don't
know which one. Can someone give me some pointers, please? Thanks.
Re: org.apache.hadoop.conf.Configuration - error parsing conf file
Posted by Stack <st...@duboce.net>.
On Wed, Mar 7, 2012 at 10:30 PM, Something Something
<ma...@gmail.com> wrote:
> 2012-03-07 22:09:29,828 [Thread-4] FATAL
> org.apache.hadoop.conf.Configuration - error parsing conf file:
> com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException:
> Invalid byte 2 of 2-byte UTF-8 sequence.
>
>
> Sounds like it doesn't like some configuration file from Hadoop, but don't
> know which one. Can someone give me some pointers, please? Thanks.
Yeah. That looks like pretty explicit message. You know what I'm
going to say next.... (look at your conf files, pass them via
something like iconv or there are some web-based tools to check a file
is utf8). You might to try and figure a way for Configuration to
dump the name of the file its currently parsing when the above
happens. Also, what jvm are you using?
St.Ack
Re: org.apache.hadoop.conf.Configuration - error parsing conf file
Posted by Something Something <ma...@gmail.com>.
There's a 'quietmode' variable in org/apache/hadoop/conf/Configuration.java
class:
/**
* Set the quietness-mode.
*
* In the quiet-mode, error and informational messages might not be
logged.
*
* @param quietmode <code>true</code> to set quiet-mode on,
<code>false</code>
* to turn it off.
*/
public synchronized void setQuietMode(boolean quietmode) {
this.quietmode = quietmode;
}
Can someone tell me how to force call to this? Apologies in advance for my
dumbness.
On Wed, Mar 7, 2012 at 10:30 PM, Something Something <
mailinglists19@gmail.com> wrote:
> Hello,
>
> I am using: hadoop-0.20.2-cdh3u2, hbase-0.90.4-cdh3u3, pig-0.8.1-cdh3u3
>
> I have successfully loaded data into HBase tables (implying my Hadoop &
> HBase setup is good). I can look at the data using HBase shell.
>
> Now I am trying to read data from HBase via a Pig Script. My test script
> looks very simple:
>
>
> ------------------------------------------------------------------------------------------------------------------------------
> raw = LOAD 'hbase://MY_TEST_TABLE'
> USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('id:*',
> '-loadKey true');
>
> STORE raw INTO '/user/temp/output';
>
> ------------------------------------------------------------------------------------------------------------------------------
>
>
> When I run this locally using this:
>
> pig -x local test.pig
>
> I keep getting the following message:
>
> 2012-03-07 22:09:29,828 [Thread-4] FATAL
> org.apache.hadoop.conf.Configuration - error parsing conf file:
> com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException:
> Invalid byte 2 of 2-byte UTF-8 sequence.
>
>
> Sounds like it doesn't like some configuration file from Hadoop, but don't
> know which one. Can someone give me some pointers, please? Thanks.
>
>
>
>
>
>