You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "gayathri (JIRA)" <ji...@apache.org> on 2018/02/23 04:30:02 UTC
[jira] [Commented] (PIG-5331) 2018-02-20 10:09:56,797 [main] WARN
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Encountered Warning ACCESSING_NON_EXISTENT_FIELD 2 time(s).
[ https://issues.apache.org/jira/browse/PIG-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373915#comment-16373915 ]
gayathri commented on PIG-5331:
-------------------------------
Hi,
I am having a nmon file which is an IBM monitoring file. I have a pig script in git hub.
The code is [https://github.com/Sapphirine/Using-Big-Data-Hadoop-for-Identification-of-Aberrant-Behavior-Clusters-in-Server-Performance-Time]-
I need to parse the nmon file using pig script and store in hadoop.
I am using pig version 0.12.0 and hadoop 2.6.0.
I am getting many warnings.
Only map side is executed and the job is success. it writes empty file into hdfs and the job is success.
> 2018-02-20 10:09:56,797 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Encountered Warning ACCESSING_NON_EXISTENT_FIELD 2 time(s).
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-5331
> URL: https://issues.apache.org/jira/browse/PIG-5331
> Project: Pig
> Issue Type: Bug
> Components: grunt, parser, piggybank
> Affects Versions: 0.12.0
> Environment: 2018-02-22 12:09:20,447 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_CHARARRAY 7 time(s).
> 2018-02-22 12:09:20,447 [main] WARN org.apache.pig.PigServer - Encountered Warning USING_OVERLOADED_FUNCTION 4 time(s).
> 2018-02-22 12:09:20,447 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_DOUBLE 1 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_CHARARRAY 7 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning USING_OVERLOADED_FUNCTION 4 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_DOUBLE 1 time(s).
> 2018-02-22 12:10:39,246 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases cpu_all_data,cpu_all_data_TS,cpu_all_data_raw
> 2018-02-22 12:10:39,246 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: cpu_all_data_raw[6,19],cpu_all_data[7,15],cpu_all_data_TS[8,18],cpu_all_data_TS[9,18] C: R:
> 2018-02-22 12:10:56,756 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 75% complete
> 2018-02-22 12:11:04,727 [main] INFO org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2018-02-22 12:11:04,808 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
> 2018-02-22 12:11:04,881 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
> Reporter: gayathri
> Priority: Major
> Attachments: a01gicomapp1a_170905_0000.txt, new 1.txt, pigerr.txt, pigl.txt
>
>
> 2018-02-22 12:09:20,447 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_CHARARRAY 7 time(s).
> 2018-02-22 12:09:20,447 [main] forg.apache.pig.PigServer - Encountered Warning USING_OVERLOADED_FUNCTION 4 time(s).
> 2018-02-22 12:09:20,447 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_DOUBLE 1 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_CHARARRAY 7 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning USING_OVERLOADED_FUNCTION 4 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_DOUBLE 1 time(s).
> 2018-02-22 12:10:39,246 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases cpu_all_data,cpu_all_data_TS,cpu_all_data_raw
> 2018-02-22 12:10:39,246 [main] INFO org.apache.pig.backend.had
> 2018-02-22 12:09:20,447 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_CHARARRAY 7 time(s).
> 2018-02-22 12:09:20,447 [main] WARN org.apache.pig.PigServer - Encountered Warning USING_OVERLOADED_FUNCTION 4 time(s).
> 2018-02-22 12:09:20,447 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_DOUBLE 1 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_CHARARRAY 7 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning USING_OVERLOADED_FUNCTION 4 time(s).
> 2018-02-22 12:09:20,469 [main] WARN org.apache.pig.PigServer - Encountered Warning IMPLICIT_CAST_TO_DOUBLE 1 time(s).
> 2018-02-22 12:10:39,246 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases cpu_all_data,cpu_all_data_TS,cpu_all_data_raw
> 2018-02-22 12:10:39,246 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: cpu_all_data_raw[6,19],cpu_all_data[7,15],cpu_all_data_TS[8,18],cpu_all_data_TS[9,18] C: R:
> 2018-02-22 12:10:56,756 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 75% complete
> 2018-02-22 12:11:04,727 [main] INFO org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2018-02-22 12:11:04,808 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
> 2018-02-22 12:11:04,881 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
> oop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: cpu_all_data_raw[6,19],cpu_all_data[7,15],cpu_all_data_TS[8,18],cpu_all_data_TS[9,18] C: R:
> 2018-02-22 12:10:56,756 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 75% complete
> 2018-02-22 12:11:04,727 [main] INFO org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2018-02-22 12:11:04,808 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
> 2018-02-22 12:11:04,881 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)