[jira] [Created] (HIVE-8595) Slow IO when stdout directed to NAS with large blocksize

["Kevin English (JIRA)" <ji...@apache.org>]

Kevin English created HIVE-8595:
-----------------------------------

             Summary: Slow IO when stdout directed to NAS with large blocksize
                 Key: HIVE-8595
                 URL: https://issues.apache.org/jira/browse/HIVE-8595
             Project: Hive
          Issue Type: Bug
          Components: Clients
    Affects Versions: 0.13.1
         Environment: nfs4 rsize=1048576,wsize=1048576
            Reporter: Kevin English
            Priority: Minor


Very slow IO when executing a SQL command file using the following command line when the target file system is an nfs4 mounted NAS with a large blocksize:

hive -f sqlscript.sql 2>results.log >results.tab

Work around (thousands of times faster):

hive -f sqlscript.sql 2>results.log | cat >results.tab

For instance I had a command finish 10 hours ago and I forgot to use cat and it is still writing out the output which after 10 hours is in the 180 GB range.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)