[jira] [Commented] (PIG-3731) Ability to specify local-mode specific configuration (useful for local/auto-local mode)

["Aniket Mokashi (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887898#comment-13887898 ] 

Aniket Mokashi commented on PIG-3731:
-------------------------------------

Thinking about this again, there are two problems here-
1. "io." settings which are similar to fs settings should not be modified in local mode.
2. Some of the "io." or other settings may not be suitable across MR and local mode (eg- io.sort.mb). We should provide a mechanism so that they can be overridden (on per script basis- for users running same script in local mode and for auto local mode).

> Ability to specify local-mode specific configuration (useful for local/auto-local mode)
> ---------------------------------------------------------------------------------------
>
>                 Key: PIG-3731
>                 URL: https://issues.apache.org/jira/browse/PIG-3731
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>
> This could be done in several ways, however, adding a namespace (pig.local.) for this is better so that only a few number of jobs that require this can make use of it.
> set pig.local.io.sort.mb 50 will set io.sort.mb=50 for local mode jobs allowing many jobs to run in parallel. Another setting that might be required is - io.compression.codecs.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)