[jira] [Comment Edited] (HIVE-21828) Tez: Use a pre-parsed TezConfiguration from DagUtils

["Gopal V (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-21828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885663#comment-16885663 ] 

Gopal V edited comment on HIVE-21828 at 7/15/19 10:25 PM:
----------------------------------------------------------

One of those failures (vector_udf1 ) is due to an NPE from 

{code}
  @Override
  public void configure(MapredContext context) {
    if (context != null) {
      if(context.getJobConf().get("hive.use.googleregex.engine").equals("true")){
        this.useGoogleRegexEngine=true;
      }
    }

  }
{code}

That needs to be replaced with org.apache.hadoop.hive.conf.HiveConf.getBoolVar(Configuration, ConfVars) instead of the String constant and Configuration.get()


was (Author: gopalv):
One of those failures is due to an NPE from 

{code}
  @Override
  public void configure(MapredContext context) {
    if (context != null) {
      if(context.getJobConf().get("hive.use.googleregex.engine").equals("true")){
        this.useGoogleRegexEngine=true;
      }
    }

  }
{code}

That needs to be replaced with org.apache.hadoop.hive.conf.HiveConf.getBoolVar(Configuration, ConfVars) instead of the String constant and Configuration.get()

> Tez: Use a pre-parsed TezConfiguration from DagUtils
> ----------------------------------------------------
>
>                 Key: HIVE-21828
>                 URL: https://issues.apache.org/jira/browse/HIVE-21828
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gopal V
>            Assignee: Attila Magyar
>            Priority: Major
>         Attachments: HIVE-21828.1.patch, HIVE-21828.2.patch, HIVE-21828.3.patch
>
>
> The HS2 tez-site.xml does not change dynamically - the XML parsed components of the config can be obtained statically and kept across sessions.
> This allows for the replacing of "new TezConfiguration()" with a HS2 local version instead.
> The configuration object however has to reference the right resource file (i.e location of tez-site.xml) without reparsing it for each query.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)