[jira] [Updated] (HIVE-2428) ADD ARCHIVE has no effect when query runs in local mode

["Phabricator (Updated) (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Phabricator updated HIVE-2428:
------------------------------

    Attachment: HIVE-2428.D2121.1.patch

kevinwilfong requested code review of "HIVE-2428 [jira] ADD ARCHIVE has no effect when query runs in local mode".
Reviewers: JIRA

  https://issues.apache.org/jira/browse/HIVE-2428

  Added the -archives flag to the command run when a map reduce task is run locally. It runs essentially exactly as it does for the -files flag.  This fixes the issue, I have added a test to verify that.

  When you ADD ARCHIVE a file and the query runs in local mode, the file is not available at all.

  For example running the commands

  echo '#!/bin/bash\nls -l 1>&2;read' > foo.sh

  hive -e 'ADD FILE foo.sh; ADD ARCHIVE /tmp/mapreduce_test.zip; SELECT TRANSFORM USING "sh foo.sh" FROM src'

  when the query is allowed to run in local mode, only information for foo.sh is returned.

  However, if the query is not allowed to run in local mode, information for both foo.sh and mapreduce_test.zip is returned.

TEST PLAN
  EMPTY

REVISION DETAIL
  https://reviews.facebook.net/D2121

AFFECTED FILES
  data/files/add_archive_local.zip
  data/scripts/add_archive_local_script
  ql/src/test/results/clientpositive/add_archive_local.q.out
  ql/src/test/queries/clientpositive/add_archive_local.q
  ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java

MANAGE HERALD DIFFERENTIAL RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/4599/

Tip: use the X-Herald-Rules header to filter Herald messages in your client.

                
> ADD ARCHIVE has no effect when query runs in local mode
> -------------------------------------------------------
>
>                 Key: HIVE-2428
>                 URL: https://issues.apache.org/jira/browse/HIVE-2428
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Kevin Wilfong
>            Assignee: Kevin Wilfong
>         Attachments: HIVE-2428.1.patch.txt, HIVE-2428.D2121.1.patch
>
>
> When you ADD ARCHIVE a file and the query runs in local mode, the file is not available at all.
> For example running the commands
> echo '#!/bin/bash\nls -l 1>&2;read' > foo.sh
> hive -e 'ADD FILE foo.sh; ADD ARCHIVE /tmp/mapreduce_test.zip; SELECT TRANSFORM(*) USING "sh foo.sh" FROM src'
> when the query is allowed to run in local mode, only information for foo.sh is returned.
> However, if the query is not allowed to run in local mode, information for both foo.sh and mapreduce_test.zip is returned.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira