You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by yan liu <li...@hotmail.com> on 2024/08/05 06:05:00 UTC

Access to confluence and updating configuration properties for Hive

to whom it may concern

 I am Yan Liu and currently work at Cloudera,  I have noticed that many configs that exists in the HiveConf.java https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java  did not show up on the hive configuration page https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties

For example: hive.repl.cm.enabled is not documented on the confluent page

I volunteer to constantly updating the hive configuration wiki page to make sure properties are in sync with the actual HiveConf.java
[https://opengraph.githubassets.com/3fa42dfe4c3040430b4083ecf07afaea7505a93896827c05a7f36200fdb16666/apache/hive]<https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
hive/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java at master · apache/hive<https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
Apache Hive. Contribute to apache/hive development by creating an account on GitHub.
github.com

Please let me know how to proceed.

Thank you very much

Best Regards

Yan Liu

Re: Access to confluence and updating configuration properties for Hive

Posted by Stamatis Zampetakis <za...@gmail.com>.
That would be awesome, thanks Kokila! Feel free to create a JIRA ticket and
push this forward.

Best,
Stamatis

On Mon, Aug 5, 2024 at 5:44 PM kokila narayanan <ko...@gmail.com>
wrote:

> Hi Stamatis,
>           Implementing automation for the configuration sync seems like a
> good approach for the long term consistency and ease of management. If it's
> fine, I would like to work on this task.
>
> Thanks,
> Kokila
>
> On Mon, Aug 5, 2024 at 2:37 PM Stamatis Zampetakis <za...@gmail.com>
> wrote:
>
>> Hey everyone,
>>
>> @Yan Liu: Many thanks for volunteering to keep the page up to date. This
>> would definitely be helpful in the short term.
>>
>> @all: In the long term, I feel that this configuration sync could be
>> easily automated. I would suggest moving the configuration page under
>> the main Hive website [1] and add a new entry in the Documentation section.
>> Then we could implement a CI job in the main Apache repo [2] that pushes to
>> the website repo [3] when certain conditions are met. What do you think?
>>
>> Best,
>> Stamatis
>>
>> [1] https://hive.apache.org
>> [2] https://github.com/apache/hive
>> [3] https://github.com/apache/hive-site
>>
>> On Mon, Aug 5, 2024 at 9:13 AM Ayush Saxena <ay...@gmail.com> wrote:
>>
>>> Hi Yan Liu,
>>> Thanx for volunteering, It would require a cwiki user account, I am
>>> creating an INFRA ticket for you,
>>> https://issues.apache.org/jira/browse/INFRA-26016
>>>
>>> Can you drop your preferred userid & email id over there, once your
>>> account is created let me know & I will help with setting up the
>>> permissions for you to update the page
>>>
>>> -Ayush
>>>
>>> On Mon, 5 Aug 2024 at 11:35, yan liu <li...@hotmail.com> wrote:
>>>
>>>> to whom it may concern
>>>>
>>>>  I am Yan Liu and currently work at Cloudera,  I have noticed that many
>>>> configs that exists in the HiveConf.java
>>>> https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java  did
>>>> not show up on the hive configuration page
>>>> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties
>>>>
>>>>
>>>> For example: hive.repl.cm.enabled is not documented on the confluent
>>>> page
>>>>
>>>> I volunteer to constantly updating the hive configuration wiki page to
>>>> make sure properties are in sync with the actual HiveConf.java
>>>>
>>>> <https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
>>>> hive/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java at
>>>> master · apache/hive
>>>> <https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
>>>> Apache Hive. Contribute to apache/hive development by creating an
>>>> account on GitHub.
>>>> github.com
>>>>
>>>> Please let me know how to proceed.
>>>>
>>>> Thank you very much
>>>>
>>>> Best Regards
>>>>
>>>> Yan Liu
>>>>
>>>

Re: Access to confluence and updating configuration properties for Hive

Posted by kokila narayanan <ko...@gmail.com>.
Hi Stamatis,
          Implementing automation for the configuration sync seems like a
good approach for the long term consistency and ease of management. If it's
fine, I would like to work on this task.

Thanks,
Kokila

On Mon, Aug 5, 2024 at 2:37 PM Stamatis Zampetakis <za...@gmail.com>
wrote:

> Hey everyone,
>
> @Yan Liu: Many thanks for volunteering to keep the page up to date. This
> would definitely be helpful in the short term.
>
> @all: In the long term, I feel that this configuration sync could be
> easily automated. I would suggest moving the configuration page under
> the main Hive website [1] and add a new entry in the Documentation section.
> Then we could implement a CI job in the main Apache repo [2] that pushes to
> the website repo [3] when certain conditions are met. What do you think?
>
> Best,
> Stamatis
>
> [1] https://hive.apache.org
> [2] https://github.com/apache/hive
> [3] https://github.com/apache/hive-site
>
> On Mon, Aug 5, 2024 at 9:13 AM Ayush Saxena <ay...@gmail.com> wrote:
>
>> Hi Yan Liu,
>> Thanx for volunteering, It would require a cwiki user account, I am
>> creating an INFRA ticket for you,
>> https://issues.apache.org/jira/browse/INFRA-26016
>>
>> Can you drop your preferred userid & email id over there, once your
>> account is created let me know & I will help with setting up the
>> permissions for you to update the page
>>
>> -Ayush
>>
>> On Mon, 5 Aug 2024 at 11:35, yan liu <li...@hotmail.com> wrote:
>>
>>> to whom it may concern
>>>
>>>  I am Yan Liu and currently work at Cloudera,  I have noticed that many
>>> configs that exists in the HiveConf.java
>>> https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java  did
>>> not show up on the hive configuration page
>>> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties
>>>
>>>
>>> For example: hive.repl.cm.enabled is not documented on the confluent
>>> page
>>>
>>> I volunteer to constantly updating the hive configuration wiki page to
>>> make sure properties are in sync with the actual HiveConf.java
>>>
>>> <https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
>>> hive/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java at master
>>> · apache/hive
>>> <https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
>>> Apache Hive. Contribute to apache/hive development by creating an
>>> account on GitHub.
>>> github.com
>>>
>>> Please let me know how to proceed.
>>>
>>> Thank you very much
>>>
>>> Best Regards
>>>
>>> Yan Liu
>>>
>>

Re: Access to confluence and updating configuration properties for Hive

Posted by Stamatis Zampetakis <za...@gmail.com>.
Hey everyone,

@Yan Liu: Many thanks for volunteering to keep the page up to date. This
would definitely be helpful in the short term.

@all: In the long term, I feel that this configuration sync could be easily
automated. I would suggest moving the configuration page under the main
Hive website [1] and add a new entry in the Documentation section. Then we
could implement a CI job in the main Apache repo [2] that pushes to the
website repo [3] when certain conditions are met. What do you think?

Best,
Stamatis

[1] https://hive.apache.org
[2] https://github.com/apache/hive
[3] https://github.com/apache/hive-site

On Mon, Aug 5, 2024 at 9:13 AM Ayush Saxena <ay...@gmail.com> wrote:

> Hi Yan Liu,
> Thanx for volunteering, It would require a cwiki user account, I am
> creating an INFRA ticket for you,
> https://issues.apache.org/jira/browse/INFRA-26016
>
> Can you drop your preferred userid & email id over there, once your
> account is created let me know & I will help with setting up the
> permissions for you to update the page
>
> -Ayush
>
> On Mon, 5 Aug 2024 at 11:35, yan liu <li...@hotmail.com> wrote:
>
>> to whom it may concern
>>
>>  I am Yan Liu and currently work at Cloudera,  I have noticed that many
>> configs that exists in the HiveConf.java
>> https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java  did
>> not show up on the hive configuration page
>> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties
>>
>>
>> For example: hive.repl.cm.enabled is not documented on the confluent page
>>
>> I volunteer to constantly updating the hive configuration wiki page to
>> make sure properties are in sync with the actual HiveConf.java
>>
>> <https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
>> hive/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java at master
>> · apache/hive
>> <https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
>> Apache Hive. Contribute to apache/hive development by creating an account
>> on GitHub.
>> github.com
>>
>> Please let me know how to proceed.
>>
>> Thank you very much
>>
>> Best Regards
>>
>> Yan Liu
>>
>

Re: Access to confluence and updating configuration properties for Hive

Posted by Ayush Saxena <ay...@gmail.com>.
Hi Yan Liu,
Thanx for volunteering, It would require a cwiki user account, I am
creating an INFRA ticket for you,
https://issues.apache.org/jira/browse/INFRA-26016

Can you drop your preferred userid & email id over there, once your account
is created let me know & I will help with setting up the permissions for
you to update the page

-Ayush

On Mon, 5 Aug 2024 at 11:35, yan liu <li...@hotmail.com> wrote:

> to whom it may concern
>
>  I am Yan Liu and currently work at Cloudera,  I have noticed that many
> configs that exists in the HiveConf.java
> https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java  did
> not show up on the hive configuration page
> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties
>
> For example: hive.repl.cm.enabled is not documented on the confluent page
>
> I volunteer to constantly updating the hive configuration wiki page to
> make sure properties are in sync with the actual HiveConf.java
>
> <https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
> hive/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java at master ·
> apache/hive
> <https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java>
> Apache Hive. Contribute to apache/hive development by creating an account
> on GitHub.
> github.com
>
> Please let me know how to proceed.
>
> Thank you very much
>
> Best Regards
>
> Yan Liu
>