You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Yun Huang Yong (JIRA)" <ji...@apache.org> on 2010/08/25 17:46:16 UTC

[jira] Created: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

Typo of hive.merge.size.smallfiles.avgsize prevents change of value
-------------------------------------------------------------------

                 Key: HIVE-1594
                 URL: https://issues.apache.org/jira/browse/HIVE-1594
             Project: Hadoop Hive
          Issue Type: Bug
          Components: Configuration
    Affects Versions: 0.5.0, 0.6.0, 0.7.0
            Reporter: Yun Huang Yong
            Priority: Minor


The setting is described as <name>hive.merge.size.smallfiles.avgsize</name>, however common/src/java/org/apache/hadoop/hive/conf/HiveConf.java reads it as "hive.merge.smallfiles.avgsize" (note the missing '.size.') so the user's setting has no effect and the value is stuck at the default of 16MB.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902512#action_12902512 ] 

Namit Jain commented on HIVE-1594:
----------------------------------

Yes, HiveConf has the correct values always.

Can you submit a patch for this ?

> Typo of hive.merge.size.smallfiles.avgsize prevents change of value
> -------------------------------------------------------------------
>
>                 Key: HIVE-1594
>                 URL: https://issues.apache.org/jira/browse/HIVE-1594
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 0.5.0, 0.6.0, 0.7.0
>            Reporter: Yun Huang Yong
>            Priority: Minor
>
> The setting is described as <name>hive.merge.size.smallfiles.avgsize</name>, however common/src/java/org/apache/hadoop/hive/conf/HiveConf.java reads it as "hive.merge.smallfiles.avgsize" (note the missing '.size.') so the user's setting has no effect and the value is stuck at the default of 16MB.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain resolved HIVE-1594.
------------------------------

     Hadoop Flags: [Reviewed]
    Fix Version/s: 0.6.0
                   0.7.0
       Resolution: Fixed

Committed in 0.6 and trunk. Thanks Yun

> Typo of hive.merge.size.smallfiles.avgsize prevents change of value
> -------------------------------------------------------------------
>
>                 Key: HIVE-1594
>                 URL: https://issues.apache.org/jira/browse/HIVE-1594
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 0.5.0, 0.6.0, 0.7.0
>            Reporter: Yun Huang Yong
>            Assignee: Yun Huang Yong
>            Priority: Minor
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: HIVE-1594-0.5.patch, HIVE-1594.patch
>
>
> The setting is described as <name>hive.merge.size.smallfiles.avgsize</name>, however common/src/java/org/apache/hadoop/hive/conf/HiveConf.java reads it as "hive.merge.smallfiles.avgsize" (note the missing '.size.') so the user's setting has no effect and the value is stuck at the default of 16MB.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain reassigned HIVE-1594:
--------------------------------

    Assignee: Yun Huang Yong

> Typo of hive.merge.size.smallfiles.avgsize prevents change of value
> -------------------------------------------------------------------
>
>                 Key: HIVE-1594
>                 URL: https://issues.apache.org/jira/browse/HIVE-1594
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 0.5.0, 0.6.0, 0.7.0
>            Reporter: Yun Huang Yong
>            Assignee: Yun Huang Yong
>            Priority: Minor
>         Attachments: HIVE-1594-0.5.patch, HIVE-1594.patch
>
>
> The setting is described as <name>hive.merge.size.smallfiles.avgsize</name>, however common/src/java/org/apache/hadoop/hive/conf/HiveConf.java reads it as "hive.merge.smallfiles.avgsize" (note the missing '.size.') so the user's setting has no effect and the value is stuck at the default of 16MB.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902933#action_12902933 ] 

Namit Jain commented on HIVE-1594:
----------------------------------

Yun, we are not actively patching 0.5 right now.
I will review the changes for trunk and 0.6

> Typo of hive.merge.size.smallfiles.avgsize prevents change of value
> -------------------------------------------------------------------
>
>                 Key: HIVE-1594
>                 URL: https://issues.apache.org/jira/browse/HIVE-1594
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 0.5.0, 0.6.0, 0.7.0
>            Reporter: Yun Huang Yong
>            Assignee: Yun Huang Yong
>            Priority: Minor
>         Attachments: HIVE-1594-0.5.patch, HIVE-1594.patch
>
>
> The setting is described as <name>hive.merge.size.smallfiles.avgsize</name>, however common/src/java/org/apache/hadoop/hive/conf/HiveConf.java reads it as "hive.merge.smallfiles.avgsize" (note the missing '.size.') so the user's setting has no effect and the value is stuck at the default of 16MB.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

Posted by "Yun Huang Yong (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yun Huang Yong updated HIVE-1594:
---------------------------------

    Attachment: HIVE-1594.patch
                HIVE-1594-0.5.patch

HIVE-1594.patch applies cleanly to 0.6 and trunk.

Separate patch for branch 0.5 as it was missing the smallfiles.avgsize setting altogether.

> Typo of hive.merge.size.smallfiles.avgsize prevents change of value
> -------------------------------------------------------------------
>
>                 Key: HIVE-1594
>                 URL: https://issues.apache.org/jira/browse/HIVE-1594
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 0.5.0, 0.6.0, 0.7.0
>            Reporter: Yun Huang Yong
>            Priority: Minor
>         Attachments: HIVE-1594-0.5.patch, HIVE-1594.patch
>
>
> The setting is described as <name>hive.merge.size.smallfiles.avgsize</name>, however common/src/java/org/apache/hadoop/hive/conf/HiveConf.java reads it as "hive.merge.smallfiles.avgsize" (note the missing '.size.') so the user's setting has no effect and the value is stuck at the default of 16MB.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

Posted by "Yun Huang Yong (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902487#action_12902487 ] 

Yun Huang Yong commented on HIVE-1594:
--------------------------------------

Just doing a quick grep audit of other settings, I think the following is also mismatched:

In the format: hive-default.xml => HiveConf.java

hive.default.partition.name => hive.exec.default.partition.name
  - I believe HiveConf.java has the correct value

> Typo of hive.merge.size.smallfiles.avgsize prevents change of value
> -------------------------------------------------------------------
>
>                 Key: HIVE-1594
>                 URL: https://issues.apache.org/jira/browse/HIVE-1594
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 0.5.0, 0.6.0, 0.7.0
>            Reporter: Yun Huang Yong
>            Priority: Minor
>
> The setting is described as <name>hive.merge.size.smallfiles.avgsize</name>, however common/src/java/org/apache/hadoop/hive/conf/HiveConf.java reads it as "hive.merge.smallfiles.avgsize" (note the missing '.size.') so the user's setting has no effect and the value is stuck at the default of 16MB.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1594:
---------------------------------

        Fix Version/s:     (was: 0.7.0)
    Affects Version/s:     (was: 0.6.0)
                           (was: 0.7.0)

> Typo of hive.merge.size.smallfiles.avgsize prevents change of value
> -------------------------------------------------------------------
>
>                 Key: HIVE-1594
>                 URL: https://issues.apache.org/jira/browse/HIVE-1594
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 0.5.0
>            Reporter: Yun Huang Yong
>            Assignee: Yun Huang Yong
>            Priority: Minor
>             Fix For: 0.6.0
>
>         Attachments: HIVE-1594-0.5.patch, HIVE-1594.patch
>
>
> The setting is described as <name>hive.merge.size.smallfiles.avgsize</name>, however common/src/java/org/apache/hadoop/hive/conf/HiveConf.java reads it as "hive.merge.smallfiles.avgsize" (note the missing '.size.') so the user's setting has no effect and the value is stuck at the default of 16MB.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.