You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Lefty Leverenz <le...@gmail.com> on 2014/08/03 21:36:19 UTC
Nonexistent "region" parameters in the wiki
The wiki has a small section for region configuration parameters
<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Regions>,
but none of the parameters exist in any released branch -- not in
HiveConf.java, not in the old hive-default.xml file, not in the template
file.
The word "region" doesn't even exist in any HiveConf or default.xml file.
- Does anyone know where these three parameters came from?
- Can they be deleted from the wiki?
Regionshive.use.input.primary.region
>
> - Default Value: true
> - Added In:
>
> When creating a table from an input table, create the table in the input
> table's primary region.
> hive.default.region.name
>
> - Default Value: default
> - Added In:
>
> The default region name.
> hive.region.properties
>
> - Default Value: (empty)
> - Added In:
>
> The default filesystem and jobtracker for a region.
>
-- Lefty
Re: Nonexistent "region" parameters in the wiki
Posted by Lefty Leverenz <le...@gmail.com>.
Brilliant! That trick might save me a lot of time on future searches.
Thanks Lars.
-- Lefty
On Mon, Aug 4, 2014 at 3:00 AM, Lars Francke <la...@gmail.com> wrote:
> I searched through the git history of HiveConf using this command:
>
> git log -G'hive.region.properties' --
> common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
>
> Which gave the following result:
>
> commit e64554451173c4c892e53dd33c949b332b68a9a8
> Author: Ashutosh Chauhan <ha...@apache.org>
> Date: Fri Apr 20 18:07:41 2012 +0000
>
> HIVE-2965 : Revert HIVE-2612 (hashutosh)
>
> git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1328469
> 13f79535-47bb-0310-9956-ffa450edef68
>
> commit f80ed19a433f1ea676a70199a257fe0a137cf784
> Author: Namit Jain <na...@apache.org>
> Date: Sat Feb 11 07:49:28 2012 +0000
>
> HIVE-2612 support hive table/partitions exists in more than one region
> (Kevin Wilfong via namit)
>
>
>
> git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1243013
> 13f79535-47bb-0310-9956-ffa450edef68
>
>
> Cheers,
> Lars
>
>
> On Mon, Aug 4, 2014 at 4:24 AM, Lefty Leverenz <le...@gmail.com>
> wrote:
>
> > Well sleuthed, Lars! Thanks very much. How did you find it -- do you
> have
> > a way to search all the old patches?
> >
> > Instead of removing the Regions section altogether, I'll leave the
> heading
> > with an explanation. Then it can be deleted after a few more releases.
> >
> > -- Lefty
> >
> >
> > On Sun, Aug 3, 2014 at 6:16 PM, Lars Francke <la...@gmail.com>
> > wrote:
> >
> > > Hey Lefty,
> > > take a look at these two issues:
> > >
> > > <https://issues.apache.org/jira/browse/HIVE-2965>
> > > <https://issues.apache.org/jira/browse/HIVE-2612>
> > >
> > > Means that all related documentation can go. Good find!
> > >
> > > On Sun, Aug 3, 2014 at 10:55 PM, Lefty Leverenz <
> leftyleverenz@gmail.com
> > >
> > > wrote:
> > >
> > > > Carl Steinbach, when you created Configuration Properties
> > > > <
> > >
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842760>
> > > > two
> > > > years ago the first parameter in the wikidoc was
> > > *hive.region.properties*.
> > > > The other two were added in version 7
> > > > <
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842779#ConfigurationProperties-Regions
> > > > >
> > > > the same day. Were they from a jira you were working on at the time?
> > > >
> > > > -- Lefty
> > > >
> > > >
> > > > On Sun, Aug 3, 2014 at 3:36 PM, Lefty Leverenz <
> > leftyleverenz@gmail.com>
> > > > wrote:
> > > >
> > > > > The wiki has a small section for region configuration parameters
> > > > > <
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Regions
> > > > >,
> > > > > but none of the parameters exist in any released branch -- not in
> > > > > HiveConf.java, not in the old hive-default.xml file, not in the
> > > template
> > > > > file.
> > > > >
> > > > > The word "region" doesn't even exist in any HiveConf or default.xml
> > > file.
> > > > >
> > > > > - Does anyone know where these three parameters came from?
> > > > > - Can they be deleted from the wiki?
> > > > >
> > > > > Regions hive.use.input.primary.region
> > > > >>
> > > > >> - Default Value: true
> > > > >> - Added In:
> > > > >>
> > > > >> When creating a table from an input table, create the table in the
> > > input
> > > > >> table's primary region.
> > > > >> hive.default.region.name
> > > > >>
> > > > >> - Default Value: default
> > > > >> - Added In:
> > > > >>
> > > > >> The default region name.
> > > > >> hive.region.properties
> > > > >>
> > > > >> - Default Value: (empty)
> > > > >> - Added In:
> > > > >>
> > > > >> The default filesystem and jobtracker for a region.
> > > > >>
> > > > >
> > > > >
> > > > >
> > > > > -- Lefty
> > > > >
> > > >
> > >
> >
>
Re: Nonexistent "region" parameters in the wiki
Posted by Lars Francke <la...@gmail.com>.
I searched through the git history of HiveConf using this command:
git log -G'hive.region.properties' --
common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
Which gave the following result:
commit e64554451173c4c892e53dd33c949b332b68a9a8
Author: Ashutosh Chauhan <ha...@apache.org>
Date: Fri Apr 20 18:07:41 2012 +0000
HIVE-2965 : Revert HIVE-2612 (hashutosh)
git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1328469
13f79535-47bb-0310-9956-ffa450edef68
commit f80ed19a433f1ea676a70199a257fe0a137cf784
Author: Namit Jain <na...@apache.org>
Date: Sat Feb 11 07:49:28 2012 +0000
HIVE-2612 support hive table/partitions exists in more than one region
(Kevin Wilfong via namit)
git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1243013
13f79535-47bb-0310-9956-ffa450edef68
Cheers,
Lars
On Mon, Aug 4, 2014 at 4:24 AM, Lefty Leverenz <le...@gmail.com>
wrote:
> Well sleuthed, Lars! Thanks very much. How did you find it -- do you have
> a way to search all the old patches?
>
> Instead of removing the Regions section altogether, I'll leave the heading
> with an explanation. Then it can be deleted after a few more releases.
>
> -- Lefty
>
>
> On Sun, Aug 3, 2014 at 6:16 PM, Lars Francke <la...@gmail.com>
> wrote:
>
> > Hey Lefty,
> > take a look at these two issues:
> >
> > <https://issues.apache.org/jira/browse/HIVE-2965>
> > <https://issues.apache.org/jira/browse/HIVE-2612>
> >
> > Means that all related documentation can go. Good find!
> >
> > On Sun, Aug 3, 2014 at 10:55 PM, Lefty Leverenz <leftyleverenz@gmail.com
> >
> > wrote:
> >
> > > Carl Steinbach, when you created Configuration Properties
> > > <
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842760>
> > > two
> > > years ago the first parameter in the wikidoc was
> > *hive.region.properties*.
> > > The other two were added in version 7
> > > <
> > >
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842779#ConfigurationProperties-Regions
> > > >
> > > the same day. Were they from a jira you were working on at the time?
> > >
> > > -- Lefty
> > >
> > >
> > > On Sun, Aug 3, 2014 at 3:36 PM, Lefty Leverenz <
> leftyleverenz@gmail.com>
> > > wrote:
> > >
> > > > The wiki has a small section for region configuration parameters
> > > > <
> > >
> >
> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Regions
> > > >,
> > > > but none of the parameters exist in any released branch -- not in
> > > > HiveConf.java, not in the old hive-default.xml file, not in the
> > template
> > > > file.
> > > >
> > > > The word "region" doesn't even exist in any HiveConf or default.xml
> > file.
> > > >
> > > > - Does anyone know where these three parameters came from?
> > > > - Can they be deleted from the wiki?
> > > >
> > > > Regions hive.use.input.primary.region
> > > >>
> > > >> - Default Value: true
> > > >> - Added In:
> > > >>
> > > >> When creating a table from an input table, create the table in the
> > input
> > > >> table's primary region.
> > > >> hive.default.region.name
> > > >>
> > > >> - Default Value: default
> > > >> - Added In:
> > > >>
> > > >> The default region name.
> > > >> hive.region.properties
> > > >>
> > > >> - Default Value: (empty)
> > > >> - Added In:
> > > >>
> > > >> The default filesystem and jobtracker for a region.
> > > >>
> > > >
> > > >
> > > >
> > > > -- Lefty
> > > >
> > >
> >
>
Re: Nonexistent "region" parameters in the wiki
Posted by Lefty Leverenz <le...@gmail.com>.
Here's the explanation I put in the Regions section
<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Regions>
of Configuration Properties:
Reverted by HIVE-2612 in Hive 0.9.0
Icon
The configuration properties that used to be documented in this section
(hive.use.input.primary.region, hive.default.region.name, and
hive.region.properties) existed temporarily in trunk before Hive release
0.9.0 but they were removed before the release. See HIVE-2612
<https://issues.apache.org/jira/browse/HIVE-2612> and HIVE-2965
<https://issues.apache.org/jira/browse/HIVE-2965>.
Apologies for any confusion caused by their former inclusion in this
document.
Now all the parameters have version information in the wiki. Of course that
doesn't mean the wiki has all the parameters. (WIP.)
-- Lefty
On Sun, Aug 3, 2014 at 10:24 PM, Lefty Leverenz <le...@gmail.com>
wrote:
> Well sleuthed, Lars! Thanks very much. How did you find it -- do you
> have a way to search all the old patches?
>
> Instead of removing the Regions section altogether, I'll leave the heading
> with an explanation. Then it can be deleted after a few more releases.
>
> -- Lefty
>
>
> On Sun, Aug 3, 2014 at 6:16 PM, Lars Francke <la...@gmail.com>
> wrote:
>
>> Hey Lefty,
>> take a look at these two issues:
>>
>> <https://issues.apache.org/jira/browse/HIVE-2965>
>> <https://issues.apache.org/jira/browse/HIVE-2612>
>>
>> Means that all related documentation can go. Good find!
>>
>> On Sun, Aug 3, 2014 at 10:55 PM, Lefty Leverenz <le...@gmail.com>
>> wrote:
>>
>> > Carl Steinbach, when you created Configuration Properties
>> > <
>> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842760
>> >
>> > two
>> > years ago the first parameter in the wikidoc was
>> *hive.region.properties*.
>> > The other two were added in version 7
>> > <
>> >
>> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842779#ConfigurationProperties-Regions
>> > >
>> > the same day. Were they from a jira you were working on at the time?
>> >
>> > -- Lefty
>> >
>> >
>> > On Sun, Aug 3, 2014 at 3:36 PM, Lefty Leverenz <leftyleverenz@gmail.com
>> >
>> > wrote:
>> >
>> > > The wiki has a small section for region configuration parameters
>> > > <
>> >
>> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Regions
>> > >,
>> > > but none of the parameters exist in any released branch -- not in
>> > > HiveConf.java, not in the old hive-default.xml file, not in the
>> template
>> > > file.
>> > >
>> > > The word "region" doesn't even exist in any HiveConf or default.xml
>> file.
>> > >
>> > > - Does anyone know where these three parameters came from?
>> > > - Can they be deleted from the wiki?
>> > >
>> > > Regions hive.use.input.primary.region
>> > >>
>> > >> - Default Value: true
>> > >> - Added In:
>> > >>
>> > >> When creating a table from an input table, create the table in the
>> input
>> > >> table's primary region.
>> > >> hive.default.region.name
>> > >>
>> > >> - Default Value: default
>> > >> - Added In:
>> > >>
>> > >> The default region name.
>> > >> hive.region.properties
>> > >>
>> > >> - Default Value: (empty)
>> > >> - Added In:
>> > >>
>> > >> The default filesystem and jobtracker for a region.
>> > >>
>> > >
>> > >
>> > >
>> > > -- Lefty
>> > >
>> >
>>
>
>
Re: Nonexistent "region" parameters in the wiki
Posted by Lefty Leverenz <le...@gmail.com>.
Well sleuthed, Lars! Thanks very much. How did you find it -- do you have
a way to search all the old patches?
Instead of removing the Regions section altogether, I'll leave the heading
with an explanation. Then it can be deleted after a few more releases.
-- Lefty
On Sun, Aug 3, 2014 at 6:16 PM, Lars Francke <la...@gmail.com> wrote:
> Hey Lefty,
> take a look at these two issues:
>
> <https://issues.apache.org/jira/browse/HIVE-2965>
> <https://issues.apache.org/jira/browse/HIVE-2612>
>
> Means that all related documentation can go. Good find!
>
> On Sun, Aug 3, 2014 at 10:55 PM, Lefty Leverenz <le...@gmail.com>
> wrote:
>
> > Carl Steinbach, when you created Configuration Properties
> > <
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842760>
> > two
> > years ago the first parameter in the wikidoc was
> *hive.region.properties*.
> > The other two were added in version 7
> > <
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842779#ConfigurationProperties-Regions
> > >
> > the same day. Were they from a jira you were working on at the time?
> >
> > -- Lefty
> >
> >
> > On Sun, Aug 3, 2014 at 3:36 PM, Lefty Leverenz <le...@gmail.com>
> > wrote:
> >
> > > The wiki has a small section for region configuration parameters
> > > <
> >
> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Regions
> > >,
> > > but none of the parameters exist in any released branch -- not in
> > > HiveConf.java, not in the old hive-default.xml file, not in the
> template
> > > file.
> > >
> > > The word "region" doesn't even exist in any HiveConf or default.xml
> file.
> > >
> > > - Does anyone know where these three parameters came from?
> > > - Can they be deleted from the wiki?
> > >
> > > Regions hive.use.input.primary.region
> > >>
> > >> - Default Value: true
> > >> - Added In:
> > >>
> > >> When creating a table from an input table, create the table in the
> input
> > >> table's primary region.
> > >> hive.default.region.name
> > >>
> > >> - Default Value: default
> > >> - Added In:
> > >>
> > >> The default region name.
> > >> hive.region.properties
> > >>
> > >> - Default Value: (empty)
> > >> - Added In:
> > >>
> > >> The default filesystem and jobtracker for a region.
> > >>
> > >
> > >
> > >
> > > -- Lefty
> > >
> >
>
Re: Nonexistent "region" parameters in the wiki
Posted by Lars Francke <la...@gmail.com>.
Hey Lefty,
take a look at these two issues:
<https://issues.apache.org/jira/browse/HIVE-2965>
<https://issues.apache.org/jira/browse/HIVE-2612>
Means that all related documentation can go. Good find!
On Sun, Aug 3, 2014 at 10:55 PM, Lefty Leverenz <le...@gmail.com>
wrote:
> Carl Steinbach, when you created Configuration Properties
> <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842760>
> two
> years ago the first parameter in the wikidoc was *hive.region.properties*.
> The other two were added in version 7
> <
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842779#ConfigurationProperties-Regions
> >
> the same day. Were they from a jira you were working on at the time?
>
> -- Lefty
>
>
> On Sun, Aug 3, 2014 at 3:36 PM, Lefty Leverenz <le...@gmail.com>
> wrote:
>
> > The wiki has a small section for region configuration parameters
> > <
> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Regions
> >,
> > but none of the parameters exist in any released branch -- not in
> > HiveConf.java, not in the old hive-default.xml file, not in the template
> > file.
> >
> > The word "region" doesn't even exist in any HiveConf or default.xml file.
> >
> > - Does anyone know where these three parameters came from?
> > - Can they be deleted from the wiki?
> >
> > Regions hive.use.input.primary.region
> >>
> >> - Default Value: true
> >> - Added In:
> >>
> >> When creating a table from an input table, create the table in the input
> >> table's primary region.
> >> hive.default.region.name
> >>
> >> - Default Value: default
> >> - Added In:
> >>
> >> The default region name.
> >> hive.region.properties
> >>
> >> - Default Value: (empty)
> >> - Added In:
> >>
> >> The default filesystem and jobtracker for a region.
> >>
> >
> >
> >
> > -- Lefty
> >
>
Re: Nonexistent "region" parameters in the wiki
Posted by Lefty Leverenz <le...@gmail.com>.
Carl Steinbach, when you created Configuration Properties
<https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842760> two
years ago the first parameter in the wikidoc was *hive.region.properties*.
The other two were added in version 7
<https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27842779#ConfigurationProperties-Regions>
the same day. Were they from a jira you were working on at the time?
-- Lefty
On Sun, Aug 3, 2014 at 3:36 PM, Lefty Leverenz <le...@gmail.com>
wrote:
> The wiki has a small section for region configuration parameters
> <https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Regions>,
> but none of the parameters exist in any released branch -- not in
> HiveConf.java, not in the old hive-default.xml file, not in the template
> file.
>
> The word "region" doesn't even exist in any HiveConf or default.xml file.
>
> - Does anyone know where these three parameters came from?
> - Can they be deleted from the wiki?
>
> Regions hive.use.input.primary.region
>>
>> - Default Value: true
>> - Added In:
>>
>> When creating a table from an input table, create the table in the input
>> table's primary region.
>> hive.default.region.name
>>
>> - Default Value: default
>> - Added In:
>>
>> The default region name.
>> hive.region.properties
>>
>> - Default Value: (empty)
>> - Added In:
>>
>> The default filesystem and jobtracker for a region.
>>
>
>
>
> -- Lefty
>