You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Josh Elser (JIRA)" <ji...@apache.org> on 2014/09/05 04:51:24 UTC

[jira] [Updated] (HIVE-7984) Configuration items from StorageHandler not passed to Tez Configuration

     [ https://issues.apache.org/jira/browse/HIVE-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Elser updated HIVE-7984:
-----------------------------
    Attachment: HIVE-7984-1.diff

Fixes the OutputFormat to be a little more resilient. Also removed a really nasty log.info statement that shouldn't have been committed in the first place.

> Configuration items from StorageHandler not passed to Tez Configuration
> -----------------------------------------------------------------------
>
>                 Key: HIVE-7984
>                 URL: https://issues.apache.org/jira/browse/HIVE-7984
>             Project: Hive
>          Issue Type: Bug
>          Components: StorageHandler, Tez
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 0.14.0
>
>         Attachments: HIVE-7984-1.diff
>
>
> Ran AccumuloStorageHandler queries with Tez and found that configuration elements that are pulled from the {{-hiveconf}} and passed to the inputJobProperties or outputJobProperties by the AccumuloStorageHandler aren't available inside of the Tez container.
> I'm guessing that there is a disconnect from the configuration that the StorageHandler creates and what the Tez container sees.
> The HBaseStorageHandler likely doesn't run into this because it expects to have hbase-site.xml available via tmpjars (and can extrapolate connection information from that file). Accumulo's site configuration file is not meant to be shared with consumers which means that this exact approach is not sufficient.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)