[jira] [Created] (IMPALA-7200) Local filesystem dataload fails due to missing FILESYSTEM_PREFIX

["Joe McDonnell (JIRA)" <ji...@apache.org>]

Joe McDonnell created IMPALA-7200:
-------------------------------------

             Summary: Local filesystem dataload fails due to missing FILESYSTEM_PREFIX
                 Key: IMPALA-7200
                 URL: https://issues.apache.org/jira/browse/IMPALA-7200
             Project: IMPALA
          Issue Type: Bug
          Components: Infrastructure
    Affects Versions: Impala 3.1.0
            Reporter: Joe McDonnell


A recent local filesystem run failed during dataload with the following output:
{noformat}
14:27:43 Running custom post-load steps (logging to /data/jenkins/workspace/impala-asf-master-core-local/repos/Impala/logs/data_loading/custom-post-load-steps.log)... 
14:27:49     FAILED (Took: 0 min 6 sec)
14:27:49     'custom-post-load-steps' failed. Tail of log:
14:27:49 Log for command 'custom-post-load-steps'
14:27:49 put: `/test-warehouse/': No such file or directory: `file:///test-warehouse'{noformat}
Local filesystem tests rely on the FILESYSTEM_PREFIX being added to add HDFS calls. The fix for IMPALA-3307 included this line in testdata/bin/create-load-data.sh:
{noformat}
# IMPALA-3307: Upload test time-zone database
hadoop fs -Ddfs.block.size=1048576 -put -f ${IMPALA_HOME}/testdata/tzdb /test-warehouse/{noformat}
This needs to use ${FILESYSTEM_PREFIX}/test-warehouse rather than /test-warehouse. Local runs on /tmp. This is likely to impact s3 as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org