You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Nandor Kollar (JIRA)" <ji...@apache.org> on 2017/11/20 14:01:00 UTC

[jira] [Commented] (PIG-5316) Initialize mapred.task.id property for PoS jobs

    [ https://issues.apache.org/jira/browse/PIG-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259259#comment-16259259 ] 

Nandor Kollar commented on PIG-5316:
------------------------------------

[~xuefuz] what should be the value of {{mapred.task.id}}? Spark doesn't use this, is it enough to use {{new TaskAttemptID()}}, so it would be just a placeholder value?

> Initialize mapred.task.id property for PoS jobs
> -----------------------------------------------
>
>                 Key: PIG-5316
>                 URL: https://issues.apache.org/jira/browse/PIG-5316
>             Project: Pig
>          Issue Type: Improvement
>          Components: spark
>            Reporter: Adam Szita
>            Assignee: Nandor Kollar
>
> Some downstream systems may require the presence of {{mapred.task.id}} property (e.g. HCatalog). This is currently not set when Pig On Spark jobs are started. Let's initialise it.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)