FIELD_DISCARDED_TYPE_CONVERSION_FAILED for Float in Hbase/Pig

[Max Charas <ma...@gmail.com>]

Hello all,
I've got a HBase table that is loaded via the HBase Java api like so:

put.add(Bytes.toBytes(HBaseConnection.FAMILY_NAME),
Bytes.toBytes("value"), Bytes.toBytes(value));

(Where the variable value is a normal java float.)

I proceed to load this with Pig as follows:
raw = LOAD 'hbase://tableName' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage('family:value',
'-loadKey true -limit 5') AS (id:chararray, value:float);

However when I dump this with:
dump raw;

I get:
[main] WARN  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Encountered Warning FIELD_DISCARDED_TYPE_CONVERSION_FAILED 5
time(s).
for each float value. The ID's are printed fine.

Im running:
Apache Hadoop 0.20.2.05
Pig 0.9.2
Hbase 0.92.0

My question: Why cant pig handle theses float values? What am I doing wrong?

Does anyone have a clue? :)

Best regards,
Max

Re: FIELD_DISCARDED_TYPE_CONVERSION_FAILED for Float in Hbase/Pig

[Bill Graham <bi...@gmail.com>]

Try setting the caster to the HBaseBinaryConverter.

On Tue, Feb 28, 2012 at 4:38 AM, Max Charas <ma...@gmail.com> wrote:

> Hello all,
> I've got a HBase table that is loaded via the HBase Java api like so:
>
> put.add(Bytes.toBytes(HBaseConnection.FAMILY_NAME),
> Bytes.toBytes("value"), Bytes.toBytes(value));
>
> (Where the variable value is a normal java float.)
>
> I proceed to load this with Pig as follows:
> raw = LOAD 'hbase://tableName' USING
> org.apache.pig.backend.hadoop.hbase.HBaseStorage('family:value',
> '-loadKey true -limit 5') AS (id:chararray, value:float);
>
> However when I dump this with:
> dump raw;
>
> I get:
> [main] WARN
>  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Encountered Warning FIELD_DISCARDED_TYPE_CONVERSION_FAILED 5
> time(s).
> for each float value. The ID's are printed fine.
>
> Im running:
> Apache Hadoop 0.20.2.05
> Pig 0.9.2
> Hbase 0.92.0
>
> My question: Why cant pig handle theses float values? What am I doing
> wrong?
>
> Does anyone have a clue? :)
>
> Best regards,
> Max
>



-- 
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*