You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Vincent Barat <vi...@gmail.com> on 2011/07/26 19:39:47 UTC

Ramdom behavior of PIG ???

Hi,

I'm using PIG 0.8.1 with HBase 0.90 and the following script 
somethime returns an empty set, and sometimes work !

start_sessions = LOAD 'startSession' USING 
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:sid 
meta:infoid meta:imei meta:timestamp') AS (sid:chararray, 
infoid:chararray, imei:chararray, start:long);
end_sessions = LOAD 'endSession' USING 
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:sid 
meta:timestamp meta:locid') AS (sid:chararray, end:long, 
locid:chararray);
infos = LOAD 'info.mde253811.preprod.ubithere.com' USING 
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:infoid') AS 
(infoid:chararray);
sessions = JOIN start_sessions BY sid, end_sessions BY sid;
sessions = JOIN sessions BY infoid, infos BY infoid;
dump sessions;

(dumping the "infos" seems to make it work)

Any idea about this very irritating behavior ?