You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Benjamin Francisoud (JIRA)" <ji...@apache.org> on 2008/02/05 17:28:08 UTC

[jira] Commented: (PIG-93) Impossible to set jobconf parameters

    [ https://issues.apache.org/jira/browse/PIG-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12565794#action_12565794 ] 

Benjamin Francisoud commented on PIG-93:
----------------------------------------

2 other ways that don't work:

no connect():

{code:java}
final PigContext pigContext = new PigContext(ExecType.MAPREDUCE);
pigContext.setJobtrackerLocation(properties.get("mapred.job.tracker"));
pigContext.setJobName(properties.get("fs.default.name"));
final PigServer pigServer = new PigServer(pigContext);
{code}

{noformat}
java.lang.NullPointerException
at org.apache.pig.impl.PigContext.setJobtrackerLocation(PigContext.java:213)
...
{noformat}

using connect():

{code:java}
final PigContext pigContext = new PigContext(ExecType.MAPREDUCE);
pigContext.connect();
pigContext.setJobtrackerLocation(properties.get("mapred.job.tracker"));
pigContext.setJobName(properties.get("fs.default.name"));
final PigServer pigServer = new PigServer(pigContext);
{code}

{noformat}
java.lang.RuntimeException: Bad mapred.job.tracker: local
at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:711)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:149)
at org.apache.pig.impl.PigContext.connect(PigContext.java:180)
{noformat}


> Impossible to set jobconf parameters
> ------------------------------------
>
>                 Key: PIG-93
>                 URL: https://issues.apache.org/jira/browse/PIG-93
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.1.0
>            Reporter: Benjamin Francisoud
>            Priority: Critical
>
> I'm trying to set jobconf parameter before launching a pig job using pig api.
> I tried 2 different ways but with no success:
> {code:java}
> PigContext pigContext = new PigContext(ExecType.MAPREDUCE);
> pigContext.getExecutionEngine().getConfiguration().putAll(properties);
> PigServer pigServer = new PigServer(pigContext);
> ....
> {code}
> Throw a NPE because the internal executionEngine var is initialize only when calling connect().
> So I tried:
> {code:java}
> PigContext pigContext = new PigContext(ExecType.MAPREDUCE);
> pigContext.connect();
> pigContext.getExecutionEngine().getConfiguration().putAll(properties);
> PigServer pigServer = new PigServer(pigContext);
> ...
> {code}
> My properties have been replace with a "new JobConf()"
> {noformat}
> java.lang.RuntimeException: Bad mapred.job.tracker: local
> at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:711)
> at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:149)
> at org.apache.pig.impl.PigContext.connect(PigContext.java:180)
> {noformat}
> "properties" contains "mapred.job.tracker" and "hadoop.tmp.dir values"
> Before PIG-32 I use to do (and it was working): 
> {code:java}
> PigContext pigContext = new PigContext(ExecType.MAPREDUCE);
> pigContext.setConf(myJobConf);
> PigServer pigServer = new PigServer(pigContext);
> ...
> {code}
> Any idea before I start to work on a patch ?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.