[jira] [Created] (IMPALA-6028) Document max_row_size for upgrade awareness

["Balazs Jeszenszky (JIRA)" <ji...@apache.org>]

Balazs Jeszenszky created IMPALA-6028:
-----------------------------------------

             Summary: Document max_row_size for upgrade awareness
                 Key: IMPALA-6028
                 URL: https://issues.apache.org/jira/browse/IMPALA-6028
             Project: IMPALA
          Issue Type: Bug
          Components: Docs
    Affects Versions: Impala 2.10.0
            Reporter: Balazs Jeszenszky


2.10 introduced the max_row_size query option. This is to replace the read_size startup option from earlier, both of them control the maximum width of a row impala can process. The defaults for these are different, while read_size was 8MB, the new default is 512kb. There is a tradeoff between being able to read large rows and memory usage. The 512kb is expected to work well for most use cases, having 8MB would reserve unnecessarily large chunks of memory in the new buffer pool even if the rows are smaller.

We should advise users that they may have to append query options to their workflows or change the 512kb default when upgrading to 2.10.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)