You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Rahul Channe <dr...@googlemail.com> on 2014/06/06 19:54:44 UTC
Error using HCatStorer()
Hi All,
I am trying to load Pig data into Hive table using HCatStorer(). The map
reduce task is showing failure but data is loaded in Hive table;
Needs input to resolve this failure message
2014-06-06 13:51:43,103 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 50% complete
2014-06-06 13:51:47,085 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 50% complete
2014-06-06 13:52:11,630 [main] WARN
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to
stop immediately on failure.
2014-06-06 13:52:11,632 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- job job_201406061310_0001 has failed! Stop running all dependent jobs
2014-06-06 13:52:11,634 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 100% complete
2014-06-06 13:52:11,658 [main] ERROR
org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
2014-06-06 13:52:11,662 [main] INFO
org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
HadoopVersion PigVersion UserId StartedAt FinishedAt
Features
1.2.0 0.11.1 user 2014-06-06 13:51:12 2014-06-06 13:52:11
UNKNOWN
Failed!
Failed Jobs:
JobId Alias Feature Message Outputs
job_201406061310_0001 weather,weather_data MAP_ONLY Message:
Job failed! Error - JobCleanup Task Failure, Task:
task_201406061310_0001_m_000001 weather_date,
Input(s):
Failed to read data from "/weatherPIG.txt"
Output(s):
Failed to produce result in "weather_date"
Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_201406061310_0001
2014-06-06 13:52:11,666 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Failed!
grunt>
Re: Error using HCatStorer()
Posted by Krishna Kalyan <kr...@gmail.com>.
Restarting Pig might work.
Also look at the jobtracker UI.
On Fri, Jun 6, 2014 at 11:24 PM, Rahul Channe <dr...@googlemail.com>
wrote:
> Hi All,
>
> I am trying to load Pig data into Hive table using HCatStorer(). The map
> reduce task is showing failure but data is loaded in Hive table;
>
> Needs input to resolve this failure message
>
>
> 2014-06-06 13:51:43,103 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 50% complete
> 2014-06-06 13:51:47,085 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 50% complete
> 2014-06-06 13:52:11,630 [main] WARN
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to
> stop immediately on failure.
> 2014-06-06 13:52:11,632 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - job job_201406061310_0001 has failed! Stop running all dependent jobs
> 2014-06-06 13:52:11,634 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 100% complete
> 2014-06-06 13:52:11,658 [main] ERROR
> org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
> 2014-06-06 13:52:11,662 [main] INFO
> org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
>
> HadoopVersion PigVersion UserId StartedAt FinishedAt
> Features
> 1.2.0 0.11.1 user 2014-06-06 13:51:12 2014-06-06 13:52:11
> UNKNOWN
>
> Failed!
>
> Failed Jobs:
> JobId Alias Feature Message Outputs
> job_201406061310_0001 weather,weather_data MAP_ONLY Message:
> Job failed! Error - JobCleanup Task Failure, Task:
> task_201406061310_0001_m_000001 weather_date,
>
> Input(s):
> Failed to read data from "/weatherPIG.txt"
>
> Output(s):
> Failed to produce result in "weather_date"
>
> Counters:
> Total records written : 0
> Total bytes written : 0
> Spillable Memory Manager spill count : 0
> Total bags proactively spilled: 0
> Total records proactively spilled: 0
>
> Job DAG:
> job_201406061310_0001
>
>
> 2014-06-06 13:52:11,666 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Failed!
> grunt>
>
Re: Error using HCatStorer()
Posted by Olivier Renault <or...@hortonworks.com>.
Are you sure that the user is able to read the input file?
Input(s):
Failed to read data from "/weatherPIG.txt"
Thanks
Olivier
On 6 Jun 2014 18:55, "Rahul Channe" <dr...@googlemail.com> wrote:
> Hi All,
>
> I am trying to load Pig data into Hive table using HCatStorer(). The map
> reduce task is showing failure but data is loaded in Hive table;
>
> Needs input to resolve this failure message
>
>
> 2014-06-06 13:51:43,103 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 50% complete
> 2014-06-06 13:51:47,085 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 50% complete
> 2014-06-06 13:52:11,630 [main] WARN
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to
> stop immediately on failure.
> 2014-06-06 13:52:11,632 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - job job_201406061310_0001 has failed! Stop running all dependent jobs
> 2014-06-06 13:52:11,634 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 100% complete
> 2014-06-06 13:52:11,658 [main] ERROR
> org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
> 2014-06-06 13:52:11,662 [main] INFO
> org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
>
> HadoopVersion PigVersion UserId StartedAt FinishedAt
> Features
> 1.2.0 0.11.1 user 2014-06-06 13:51:12 2014-06-06 13:52:11
> UNKNOWN
>
> Failed!
>
> Failed Jobs:
> JobId Alias Feature Message Outputs
> job_201406061310_0001 weather,weather_data MAP_ONLY Message:
> Job failed! Error - JobCleanup Task Failure, Task:
> task_201406061310_0001_m_000001 weather_date,
>
> Input(s):
> Failed to read data from "/weatherPIG.txt"
>
> Output(s):
> Failed to produce result in "weather_date"
>
> Counters:
> Total records written : 0
> Total bytes written : 0
> Spillable Memory Manager spill count : 0
> Total bags proactively spilled: 0
> Total records proactively spilled: 0
>
> Job DAG:
> job_201406061310_0001
>
>
> 2014-06-06 13:52:11,666 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Failed!
> grunt>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.