You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by Sergey Edunov <ed...@fb.com> on 2016/06/21 17:42:26 UTC
Releasing Giraph 1.2.0
Hi!
Recently, I talked to Roman and Avery about Giraph release process and we agreed it needs to be revived.
1.1.0 has been released 1.5 years ago and we had a lot of changes since then. Now is a good time to release 1.2.0. I volunteer to be release master this time.
In this release, we will have new implementation of "Out Of Core", multiple performance and reliability improvements and of course bug fixes.
As of today, one test case fails with memory issues, I’ll be working with author to figure out the fix.
We have two open issues marked for 1.2.0-SNAPSHOT, both have patches available:
https://issues.apache.org/jira/browse/GIRAPH-993
https://issues.apache.org/jira/browse/GIRAPH-981
Let's review and close them.
Also, please, by Jun 29, reply in this thread if you have something planed that should go into this release. If there will be no issues by then, I'll cut a branch and start building and testing new Giraph 1.2.0
Regards,
Sergey
Re: Releasing Giraph 1.2.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Tue, Jul 12, 2016 at 5:21 PM, Sergey Edunov <ed...@gmail.com> wrote:
> Hi All,
>
> Sorry for the delay, we don't seem to have any more outstanding issues
> and I finally cut a branch for our new release: release-1.2.0-RC0
Actually, it was great ;-) I was falling behind myself, but since the release is
delayed overall I don't have to feel too bad about it ;-)
But seriously, I'm only now picking up some of these tasks (especially YARN
ones).
Good timing on the branch -- I'll hook it up to Bigtop builds right away.
> Roman, how do we go from here?
The branch is cut and that's the baseline. Lets add CI to the branch
(see bellow)
and also hook it up to Bigtop (see above ;-)). Once that is done, lets
see what's
left for the release:
https://issues.apache.org/jira/browse/GIRAPH/fixforversion/12336955/?selectedTab=com.atlassian.jira.jira-projects-plugin:version-issues-panel
Currently it looks like we don't have any Unresolved issues. If that's
the case -- lets focus on testing and if that goes smoothly we can consider
cutting the first RC next week.
> I don't have permissions on Jenkins to
> add another build configuration or change any existing one. Do you?
> Can you set up continuous build on the new branch?
I'll hook the branch up, but in the meantime go ahead and ask Avery
(as the current Giraph chair) to run the following command on
minotaur.apache.org:
$ modify_appgroups.pl hudson-jobadmin --add=<your ASF ID>
Thanks,
Roman.
Re: Releasing Giraph 1.2.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
I could take a look. Meantime, Sergey, would it be ok for you to
rename the branch
to stay closer to the usual release process?
Thanks,
Roman.
On Wed, Jul 13, 2016 at 6:13 PM, Sergey Edunov <ed...@gmail.com> wrote:
> Thanks Roman,
>
> Maja and I fixed those test cases. However, the build now fails
> because of other two:
>
> https://issues.apache.org/jira/browse/GIRAPH-1093
> https://issues.apache.org/jira/browse/GIRAPH-1094
>
> One is in rexster another one is in hbase. Would be great if someone
> familiar with these could fix them.
>
> Regards,
> Sergey Edunov
>
> On Wed, Jul 13, 2016 at 11:23 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
>> Ok, the job is up and running:
>> https://builds.apache.org/job/Giraph-1.2/
>>
>> At this point we've got 4 test failures blocking future progress.
>>
>> Sergey, any chance you can take a look at those and file
>> JIRAs (either blocking or not) for this release?
>>
>> Thanks,
>> Roman.
>>
>> On Wed, Jul 13, 2016 at 8:08 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
>>> Sergey, forgot to add, could you please rename the branch from release-1.2.0-RC0
>>> to release-1.2 ? The release convention is that the branches are named according
>>> to the release streams (in the semantic version it corresponds to
>>> minor releases).
>>> Then you use tags for everything else. E.g. when it comes to cutting our first
>>> RC that tag will be release-1.2.0-RC0 and so forth.
>>>
>>> Thanks,
>>> Roman.
>>>
>>> On Tue, Jul 12, 2016 at 5:21 PM, Sergey Edunov <ed...@gmail.com> wrote:
>>>> Hi All,
>>>>
>>>> Sorry for the delay, we don't seem to have any more outstanding issues
>>>> and I finally cut a branch for our new release: release-1.2.0-RC0
>>>>
>>>> Roman, how do we go from here? I don't have permissions on Jenkins to
>>>> add another build configuration or change any existing one. Do you?
>>>> Can you set up continuous build on the new branch?
>>>>
>>>> Regards,
>>>> Sergey Edunov
>>>>
>>>>
>>>> On Wed, Jun 29, 2016 at 9:35 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
>>>>> Dongjin,
>>>>>
>>>>> thanks for the update! Personally, I'm slightly behind on my commitments
>>>>> around this release, but I hope to catch up once Hadoop Summit is over.
>>>>>
>>>>> Speaking of which -- if anybody here is at Hadoop Summit -- lets hang out!
>>>>>
>>>>> Thanks,
>>>>> Roman.
>>>>>
>>>>> On Sun, Jun 26, 2016 at 9:45 AM, Dongjin Lee <do...@apache.org> wrote:
>>>>>> Sergey, Roman // Thanks for your works. Add to this, I found a problem
>>>>>> working with GIRAPH-969. As you know, we decided for profile hadoop_yarn
>>>>>> and hadoop_2 to follow the latest Hadoop release. (hadoop_yarn for
>>>>>> GIRAPH-969 and hadoop_2 for GIRAPH-981.) But there are some breaks on unit
>>>>>> tests when I try with Hadoop >= 2.6.0.
>>>>>>
>>>>>> It seems like I have to work with those two issues, to follow up the latest
>>>>>> Hadoop release (=2.7.2). Please check and update the description & assign
>>>>>> them to me. As soon as I finish my job, I will submit my work. It seems
>>>>>> like to take some time.
>>>>>>
>>>>>> Regards,
>>>>>> Dongjin
>>>>>>
>>>>>> On Sun, Jun 26, 2016 at 12:23 AM, Sergey Edunov <ed...@gmail.com> wrote:
>>>>>>
>>>>>>> Dongjin, thank you for bringing this up, and sorry for the delay. I
>>>>>>> will review GIRAPH-882 and land it by the end of next week.
>>>>>>>
>>>>>>> Roman, thank you for your help! I've created a version 1.2.0 in JIRA,
>>>>>>> let's use it to mark tasks we want to land in this release.
>>>>>>> We still have a few important things to land in this release, so let's
>>>>>>> set preliminary ETA for cutting a branch to July 8, let me know if you
>>>>>>> have any objections to this date.
>>>>>>>
>>>>>>> Regards,
>>>>>>> Sergey Edunov
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Dongjin Lee*
>>>>>>
>>>>>>
>>>>>> *Software developer in Line+.So interested in massive-scale machine
>>>>>> learning.facebook: www.facebook.com/dongjin.lee.kr
>>>>>> <http://www.facebook.com/dongjin.lee.kr>linkedin:
>>>>>> kr.linkedin.com/in/dongjinleekr
>>>>>> <http://kr.linkedin.com/in/dongjinleekr>github:
>>>>>> <http://goog_969573159/>github.com/dongjinleekr
>>>>>> <http://github.com/dongjinleekr>twitter: www.twitter.com/dongjinleekr
>>>>>> <http://www.twitter.com/dongjinleekr>*
Re: Releasing Giraph 1.2.0
Posted by Sergey Edunov <ed...@gmail.com>.
Thanks Roman,
Maja and I fixed those test cases. However, the build now fails
because of other two:
https://issues.apache.org/jira/browse/GIRAPH-1093
https://issues.apache.org/jira/browse/GIRAPH-1094
One is in rexster another one is in hbase. Would be great if someone
familiar with these could fix them.
Regards,
Sergey Edunov
On Wed, Jul 13, 2016 at 11:23 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
> Ok, the job is up and running:
> https://builds.apache.org/job/Giraph-1.2/
>
> At this point we've got 4 test failures blocking future progress.
>
> Sergey, any chance you can take a look at those and file
> JIRAs (either blocking or not) for this release?
>
> Thanks,
> Roman.
>
> On Wed, Jul 13, 2016 at 8:08 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
>> Sergey, forgot to add, could you please rename the branch from release-1.2.0-RC0
>> to release-1.2 ? The release convention is that the branches are named according
>> to the release streams (in the semantic version it corresponds to
>> minor releases).
>> Then you use tags for everything else. E.g. when it comes to cutting our first
>> RC that tag will be release-1.2.0-RC0 and so forth.
>>
>> Thanks,
>> Roman.
>>
>> On Tue, Jul 12, 2016 at 5:21 PM, Sergey Edunov <ed...@gmail.com> wrote:
>>> Hi All,
>>>
>>> Sorry for the delay, we don't seem to have any more outstanding issues
>>> and I finally cut a branch for our new release: release-1.2.0-RC0
>>>
>>> Roman, how do we go from here? I don't have permissions on Jenkins to
>>> add another build configuration or change any existing one. Do you?
>>> Can you set up continuous build on the new branch?
>>>
>>> Regards,
>>> Sergey Edunov
>>>
>>>
>>> On Wed, Jun 29, 2016 at 9:35 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
>>>> Dongjin,
>>>>
>>>> thanks for the update! Personally, I'm slightly behind on my commitments
>>>> around this release, but I hope to catch up once Hadoop Summit is over.
>>>>
>>>> Speaking of which -- if anybody here is at Hadoop Summit -- lets hang out!
>>>>
>>>> Thanks,
>>>> Roman.
>>>>
>>>> On Sun, Jun 26, 2016 at 9:45 AM, Dongjin Lee <do...@apache.org> wrote:
>>>>> Sergey, Roman // Thanks for your works. Add to this, I found a problem
>>>>> working with GIRAPH-969. As you know, we decided for profile hadoop_yarn
>>>>> and hadoop_2 to follow the latest Hadoop release. (hadoop_yarn for
>>>>> GIRAPH-969 and hadoop_2 for GIRAPH-981.) But there are some breaks on unit
>>>>> tests when I try with Hadoop >= 2.6.0.
>>>>>
>>>>> It seems like I have to work with those two issues, to follow up the latest
>>>>> Hadoop release (=2.7.2). Please check and update the description & assign
>>>>> them to me. As soon as I finish my job, I will submit my work. It seems
>>>>> like to take some time.
>>>>>
>>>>> Regards,
>>>>> Dongjin
>>>>>
>>>>> On Sun, Jun 26, 2016 at 12:23 AM, Sergey Edunov <ed...@gmail.com> wrote:
>>>>>
>>>>>> Dongjin, thank you for bringing this up, and sorry for the delay. I
>>>>>> will review GIRAPH-882 and land it by the end of next week.
>>>>>>
>>>>>> Roman, thank you for your help! I've created a version 1.2.0 in JIRA,
>>>>>> let's use it to mark tasks we want to land in this release.
>>>>>> We still have a few important things to land in this release, so let's
>>>>>> set preliminary ETA for cutting a branch to July 8, let me know if you
>>>>>> have any objections to this date.
>>>>>>
>>>>>> Regards,
>>>>>> Sergey Edunov
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> *Dongjin Lee*
>>>>>
>>>>>
>>>>> *Software developer in Line+.So interested in massive-scale machine
>>>>> learning.facebook: www.facebook.com/dongjin.lee.kr
>>>>> <http://www.facebook.com/dongjin.lee.kr>linkedin:
>>>>> kr.linkedin.com/in/dongjinleekr
>>>>> <http://kr.linkedin.com/in/dongjinleekr>github:
>>>>> <http://goog_969573159/>github.com/dongjinleekr
>>>>> <http://github.com/dongjinleekr>twitter: www.twitter.com/dongjinleekr
>>>>> <http://www.twitter.com/dongjinleekr>*
Re: Releasing Giraph 1.2.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Ok, the job is up and running:
https://builds.apache.org/job/Giraph-1.2/
At this point we've got 4 test failures blocking future progress.
Sergey, any chance you can take a look at those and file
JIRAs (either blocking or not) for this release?
Thanks,
Roman.
On Wed, Jul 13, 2016 at 8:08 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
> Sergey, forgot to add, could you please rename the branch from release-1.2.0-RC0
> to release-1.2 ? The release convention is that the branches are named according
> to the release streams (in the semantic version it corresponds to
> minor releases).
> Then you use tags for everything else. E.g. when it comes to cutting our first
> RC that tag will be release-1.2.0-RC0 and so forth.
>
> Thanks,
> Roman.
>
> On Tue, Jul 12, 2016 at 5:21 PM, Sergey Edunov <ed...@gmail.com> wrote:
>> Hi All,
>>
>> Sorry for the delay, we don't seem to have any more outstanding issues
>> and I finally cut a branch for our new release: release-1.2.0-RC0
>>
>> Roman, how do we go from here? I don't have permissions on Jenkins to
>> add another build configuration or change any existing one. Do you?
>> Can you set up continuous build on the new branch?
>>
>> Regards,
>> Sergey Edunov
>>
>>
>> On Wed, Jun 29, 2016 at 9:35 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
>>> Dongjin,
>>>
>>> thanks for the update! Personally, I'm slightly behind on my commitments
>>> around this release, but I hope to catch up once Hadoop Summit is over.
>>>
>>> Speaking of which -- if anybody here is at Hadoop Summit -- lets hang out!
>>>
>>> Thanks,
>>> Roman.
>>>
>>> On Sun, Jun 26, 2016 at 9:45 AM, Dongjin Lee <do...@apache.org> wrote:
>>>> Sergey, Roman // Thanks for your works. Add to this, I found a problem
>>>> working with GIRAPH-969. As you know, we decided for profile hadoop_yarn
>>>> and hadoop_2 to follow the latest Hadoop release. (hadoop_yarn for
>>>> GIRAPH-969 and hadoop_2 for GIRAPH-981.) But there are some breaks on unit
>>>> tests when I try with Hadoop >= 2.6.0.
>>>>
>>>> It seems like I have to work with those two issues, to follow up the latest
>>>> Hadoop release (=2.7.2). Please check and update the description & assign
>>>> them to me. As soon as I finish my job, I will submit my work. It seems
>>>> like to take some time.
>>>>
>>>> Regards,
>>>> Dongjin
>>>>
>>>> On Sun, Jun 26, 2016 at 12:23 AM, Sergey Edunov <ed...@gmail.com> wrote:
>>>>
>>>>> Dongjin, thank you for bringing this up, and sorry for the delay. I
>>>>> will review GIRAPH-882 and land it by the end of next week.
>>>>>
>>>>> Roman, thank you for your help! I've created a version 1.2.0 in JIRA,
>>>>> let's use it to mark tasks we want to land in this release.
>>>>> We still have a few important things to land in this release, so let's
>>>>> set preliminary ETA for cutting a branch to July 8, let me know if you
>>>>> have any objections to this date.
>>>>>
>>>>> Regards,
>>>>> Sergey Edunov
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> *Dongjin Lee*
>>>>
>>>>
>>>> *Software developer in Line+.So interested in massive-scale machine
>>>> learning.facebook: www.facebook.com/dongjin.lee.kr
>>>> <http://www.facebook.com/dongjin.lee.kr>linkedin:
>>>> kr.linkedin.com/in/dongjinleekr
>>>> <http://kr.linkedin.com/in/dongjinleekr>github:
>>>> <http://goog_969573159/>github.com/dongjinleekr
>>>> <http://github.com/dongjinleekr>twitter: www.twitter.com/dongjinleekr
>>>> <http://www.twitter.com/dongjinleekr>*
Re: Releasing Giraph 1.2.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Sergey, forgot to add, could you please rename the branch from release-1.2.0-RC0
to release-1.2 ? The release convention is that the branches are named according
to the release streams (in the semantic version it corresponds to
minor releases).
Then you use tags for everything else. E.g. when it comes to cutting our first
RC that tag will be release-1.2.0-RC0 and so forth.
Thanks,
Roman.
On Tue, Jul 12, 2016 at 5:21 PM, Sergey Edunov <ed...@gmail.com> wrote:
> Hi All,
>
> Sorry for the delay, we don't seem to have any more outstanding issues
> and I finally cut a branch for our new release: release-1.2.0-RC0
>
> Roman, how do we go from here? I don't have permissions on Jenkins to
> add another build configuration or change any existing one. Do you?
> Can you set up continuous build on the new branch?
>
> Regards,
> Sergey Edunov
>
>
> On Wed, Jun 29, 2016 at 9:35 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
>> Dongjin,
>>
>> thanks for the update! Personally, I'm slightly behind on my commitments
>> around this release, but I hope to catch up once Hadoop Summit is over.
>>
>> Speaking of which -- if anybody here is at Hadoop Summit -- lets hang out!
>>
>> Thanks,
>> Roman.
>>
>> On Sun, Jun 26, 2016 at 9:45 AM, Dongjin Lee <do...@apache.org> wrote:
>>> Sergey, Roman // Thanks for your works. Add to this, I found a problem
>>> working with GIRAPH-969. As you know, we decided for profile hadoop_yarn
>>> and hadoop_2 to follow the latest Hadoop release. (hadoop_yarn for
>>> GIRAPH-969 and hadoop_2 for GIRAPH-981.) But there are some breaks on unit
>>> tests when I try with Hadoop >= 2.6.0.
>>>
>>> It seems like I have to work with those two issues, to follow up the latest
>>> Hadoop release (=2.7.2). Please check and update the description & assign
>>> them to me. As soon as I finish my job, I will submit my work. It seems
>>> like to take some time.
>>>
>>> Regards,
>>> Dongjin
>>>
>>> On Sun, Jun 26, 2016 at 12:23 AM, Sergey Edunov <ed...@gmail.com> wrote:
>>>
>>>> Dongjin, thank you for bringing this up, and sorry for the delay. I
>>>> will review GIRAPH-882 and land it by the end of next week.
>>>>
>>>> Roman, thank you for your help! I've created a version 1.2.0 in JIRA,
>>>> let's use it to mark tasks we want to land in this release.
>>>> We still have a few important things to land in this release, so let's
>>>> set preliminary ETA for cutting a branch to July 8, let me know if you
>>>> have any objections to this date.
>>>>
>>>> Regards,
>>>> Sergey Edunov
>>>>
>>>
>>>
>>>
>>> --
>>> *Dongjin Lee*
>>>
>>>
>>> *Software developer in Line+.So interested in massive-scale machine
>>> learning.facebook: www.facebook.com/dongjin.lee.kr
>>> <http://www.facebook.com/dongjin.lee.kr>linkedin:
>>> kr.linkedin.com/in/dongjinleekr
>>> <http://kr.linkedin.com/in/dongjinleekr>github:
>>> <http://goog_969573159/>github.com/dongjinleekr
>>> <http://github.com/dongjinleekr>twitter: www.twitter.com/dongjinleekr
>>> <http://www.twitter.com/dongjinleekr>*
Re: Releasing Giraph 1.2.0
Posted by Sergey Edunov <ed...@gmail.com>.
Hi All,
Sorry for the delay, we don't seem to have any more outstanding issues
and I finally cut a branch for our new release: release-1.2.0-RC0
Roman, how do we go from here? I don't have permissions on Jenkins to
add another build configuration or change any existing one. Do you?
Can you set up continuous build on the new branch?
Regards,
Sergey Edunov
On Wed, Jun 29, 2016 at 9:35 AM, Roman Shaposhnik <ro...@shaposhnik.org> wrote:
> Dongjin,
>
> thanks for the update! Personally, I'm slightly behind on my commitments
> around this release, but I hope to catch up once Hadoop Summit is over.
>
> Speaking of which -- if anybody here is at Hadoop Summit -- lets hang out!
>
> Thanks,
> Roman.
>
> On Sun, Jun 26, 2016 at 9:45 AM, Dongjin Lee <do...@apache.org> wrote:
>> Sergey, Roman // Thanks for your works. Add to this, I found a problem
>> working with GIRAPH-969. As you know, we decided for profile hadoop_yarn
>> and hadoop_2 to follow the latest Hadoop release. (hadoop_yarn for
>> GIRAPH-969 and hadoop_2 for GIRAPH-981.) But there are some breaks on unit
>> tests when I try with Hadoop >= 2.6.0.
>>
>> It seems like I have to work with those two issues, to follow up the latest
>> Hadoop release (=2.7.2). Please check and update the description & assign
>> them to me. As soon as I finish my job, I will submit my work. It seems
>> like to take some time.
>>
>> Regards,
>> Dongjin
>>
>> On Sun, Jun 26, 2016 at 12:23 AM, Sergey Edunov <ed...@gmail.com> wrote:
>>
>>> Dongjin, thank you for bringing this up, and sorry for the delay. I
>>> will review GIRAPH-882 and land it by the end of next week.
>>>
>>> Roman, thank you for your help! I've created a version 1.2.0 in JIRA,
>>> let's use it to mark tasks we want to land in this release.
>>> We still have a few important things to land in this release, so let's
>>> set preliminary ETA for cutting a branch to July 8, let me know if you
>>> have any objections to this date.
>>>
>>> Regards,
>>> Sergey Edunov
>>>
>>
>>
>>
>> --
>> *Dongjin Lee*
>>
>>
>> *Software developer in Line+.So interested in massive-scale machine
>> learning.facebook: www.facebook.com/dongjin.lee.kr
>> <http://www.facebook.com/dongjin.lee.kr>linkedin:
>> kr.linkedin.com/in/dongjinleekr
>> <http://kr.linkedin.com/in/dongjinleekr>github:
>> <http://goog_969573159/>github.com/dongjinleekr
>> <http://github.com/dongjinleekr>twitter: www.twitter.com/dongjinleekr
>> <http://www.twitter.com/dongjinleekr>*
Re: Releasing Giraph 1.2.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Dongjin,
thanks for the update! Personally, I'm slightly behind on my commitments
around this release, but I hope to catch up once Hadoop Summit is over.
Speaking of which -- if anybody here is at Hadoop Summit -- lets hang out!
Thanks,
Roman.
On Sun, Jun 26, 2016 at 9:45 AM, Dongjin Lee <do...@apache.org> wrote:
> Sergey, Roman // Thanks for your works. Add to this, I found a problem
> working with GIRAPH-969. As you know, we decided for profile hadoop_yarn
> and hadoop_2 to follow the latest Hadoop release. (hadoop_yarn for
> GIRAPH-969 and hadoop_2 for GIRAPH-981.) But there are some breaks on unit
> tests when I try with Hadoop >= 2.6.0.
>
> It seems like I have to work with those two issues, to follow up the latest
> Hadoop release (=2.7.2). Please check and update the description & assign
> them to me. As soon as I finish my job, I will submit my work. It seems
> like to take some time.
>
> Regards,
> Dongjin
>
> On Sun, Jun 26, 2016 at 12:23 AM, Sergey Edunov <ed...@gmail.com> wrote:
>
>> Dongjin, thank you for bringing this up, and sorry for the delay. I
>> will review GIRAPH-882 and land it by the end of next week.
>>
>> Roman, thank you for your help! I've created a version 1.2.0 in JIRA,
>> let's use it to mark tasks we want to land in this release.
>> We still have a few important things to land in this release, so let's
>> set preliminary ETA for cutting a branch to July 8, let me know if you
>> have any objections to this date.
>>
>> Regards,
>> Sergey Edunov
>>
>
>
>
> --
> *Dongjin Lee*
>
>
> *Software developer in Line+.So interested in massive-scale machine
> learning.facebook: www.facebook.com/dongjin.lee.kr
> <http://www.facebook.com/dongjin.lee.kr>linkedin:
> kr.linkedin.com/in/dongjinleekr
> <http://kr.linkedin.com/in/dongjinleekr>github:
> <http://goog_969573159/>github.com/dongjinleekr
> <http://github.com/dongjinleekr>twitter: www.twitter.com/dongjinleekr
> <http://www.twitter.com/dongjinleekr>*
Re: Releasing Giraph 1.2.0
Posted by Dongjin Lee <do...@apache.org>.
Sergey, Roman // Thanks for your works. Add to this, I found a problem
working with GIRAPH-969. As you know, we decided for profile hadoop_yarn
and hadoop_2 to follow the latest Hadoop release. (hadoop_yarn for
GIRAPH-969 and hadoop_2 for GIRAPH-981.) But there are some breaks on unit
tests when I try with Hadoop >= 2.6.0.
It seems like I have to work with those two issues, to follow up the latest
Hadoop release (=2.7.2). Please check and update the description & assign
them to me. As soon as I finish my job, I will submit my work. It seems
like to take some time.
Regards,
Dongjin
On Sun, Jun 26, 2016 at 12:23 AM, Sergey Edunov <ed...@gmail.com> wrote:
> Dongjin, thank you for bringing this up, and sorry for the delay. I
> will review GIRAPH-882 and land it by the end of next week.
>
> Roman, thank you for your help! I've created a version 1.2.0 in JIRA,
> let's use it to mark tasks we want to land in this release.
> We still have a few important things to land in this release, so let's
> set preliminary ETA for cutting a branch to July 8, let me know if you
> have any objections to this date.
>
> Regards,
> Sergey Edunov
>
--
*Dongjin Lee*
*Software developer in Line+.So interested in massive-scale machine
learning.facebook: www.facebook.com/dongjin.lee.kr
<http://www.facebook.com/dongjin.lee.kr>linkedin:
kr.linkedin.com/in/dongjinleekr
<http://kr.linkedin.com/in/dongjinleekr>github:
<http://goog_969573159/>github.com/dongjinleekr
<http://github.com/dongjinleekr>twitter: www.twitter.com/dongjinleekr
<http://www.twitter.com/dongjinleekr>*
Re: Releasing Giraph 1.2.0
Posted by Sergey Edunov <ed...@gmail.com>.
Dongjin, thank you for bringing this up, and sorry for the delay. I
will review GIRAPH-882 and land it by the end of next week.
Roman, thank you for your help! I've created a version 1.2.0 in JIRA,
let's use it to mark tasks we want to land in this release.
We still have a few important things to land in this release, so let's
set preliminary ETA for cutting a branch to July 8, let me know if you
have any objections to this date.
Regards,
Sergey Edunov
Re: Releasing Giraph 1.2.0
Posted by Dongjin Lee <do...@apache.org>.
No problem. I will work on yarn profile issue (=GIRAPH-969[^1]) with the
assumption that Hadoop 2.7 is the lowest version of YARN we are going to
support. I can finish this work by this saturday[^2].
Thanks,
Dongjin
[^1]: https://issues.apache.org/jira/browse/GIRAPH-969
[^2]: Friday for your timezone - As you know, Seoul is 17 hours ahead of
you. :)
On Thu, Jun 23, 2016 at 1:31 AM, Roman Shaposhnik <ro...@shaposhnik.org>
wrote:
> Really great points, Dongjin!
>
> Sergey, any chance you can help with GIRAPH-882 review? Since this is
> outside
> of my area of expertise.
>
> As for the YARN support, may I suggest the following? We start with an
> assumption
> that Hadoop 2.7 is the lowest version of YARN we are going to support.
> Then we close
> the JIRAs and update POMs as Dongjin is suggesting. This is an area I
> can definitely
> help with. Let me know if there's any disagreement. If not -- I'll
> proceed according to this
> plan on Fri.
>
> Thanks,
> Roman.
>
> On Wed, Jun 22, 2016 at 8:49 AM, Dongjin Lee <do...@apache.org> wrote:
> > Hello. I submitted a patch for GIRAPH-882[^1] but it seems like omitted
> > from the release list. Could you review my patch, please? I updated my
> > first patch applying your comments.
> >
> > Add to this, I have two more issues.
> >
> > The first one is GIRAPH-981[^2], which is one of two still-open issues.
> We
> > have to update hadoop_yarn profile to apply the comments by Martella and
> > Shaposhnik on GIRAPH-981 (see the final three comments). The related Jira
> > issue is GIRAPH-969[^3]. (In the comment Shaposhnik said that he forgot
> the
> > id.) If it's no inconvenience to you, may I submit the patch of
> GIRAPH-969
> > to close GIRAPH-981? I am also the author of the GIRAPH-947 patch which
> was
> > discussed in the comments of GIRAPH-981.
> >
> > The second one is GIRAPH-959[^4]. I think this is intended design so not
> an
> > actual problem. How about close this issue before the release of 1.2.0?
> >
> > Regards,
> > Dongjin
> >
> > [^1]: https://issues.apache.org/jira/browse/GIRAPH-882
> > [^2]: https://issues.apache.org/jira/browse/GIRAPH-981
> > [^3]: https://issues.apache.org/jira/browse/GIRAPH-969
> >
> > On Wed, Jun 22, 2016 at 2:42 AM, Sergey Edunov <ed...@fb.com> wrote:
> >
> >> Hi!
> >>
> >> Recently, I talked to Roman and Avery about Giraph release process and
> we
> >> agreed it needs to be revived.
> >> 1.1.0 has been released 1.5 years ago and we had a lot of changes since
> >> then. Now is a good time to release 1.2.0. I volunteer to be release
> master
> >> this time.
> >>
> >> In this release, we will have new implementation of "Out Of Core",
> >> multiple performance and reliability improvements and of course bug
> fixes.
> >>
> >> As of today, one test case fails with memory issues, I’ll be working
> with
> >> author to figure out the fix.
> >> We have two open issues marked for 1.2.0-SNAPSHOT, both have patches
> >> available:
> >> https://issues.apache.org/jira/browse/GIRAPH-993
> >> https://issues.apache.org/jira/browse/GIRAPH-981
> >> Let's review and close them.
> >>
> >>
> >> Also, please, by Jun 29, reply in this thread if you have something
> planed
> >> that should go into this release. If there will be no issues by then,
> I'll
> >> cut a branch and start building and testing new Giraph 1.2.0
> >>
> >> Regards,
> >> Sergey
> >>
> >>
>
Re: Releasing Giraph 1.2.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Really great points, Dongjin!
Sergey, any chance you can help with GIRAPH-882 review? Since this is outside
of my area of expertise.
As for the YARN support, may I suggest the following? We start with an
assumption
that Hadoop 2.7 is the lowest version of YARN we are going to support.
Then we close
the JIRAs and update POMs as Dongjin is suggesting. This is an area I
can definitely
help with. Let me know if there's any disagreement. If not -- I'll
proceed according to this
plan on Fri.
Thanks,
Roman.
On Wed, Jun 22, 2016 at 8:49 AM, Dongjin Lee <do...@apache.org> wrote:
> Hello. I submitted a patch for GIRAPH-882[^1] but it seems like omitted
> from the release list. Could you review my patch, please? I updated my
> first patch applying your comments.
>
> Add to this, I have two more issues.
>
> The first one is GIRAPH-981[^2], which is one of two still-open issues. We
> have to update hadoop_yarn profile to apply the comments by Martella and
> Shaposhnik on GIRAPH-981 (see the final three comments). The related Jira
> issue is GIRAPH-969[^3]. (In the comment Shaposhnik said that he forgot the
> id.) If it's no inconvenience to you, may I submit the patch of GIRAPH-969
> to close GIRAPH-981? I am also the author of the GIRAPH-947 patch which was
> discussed in the comments of GIRAPH-981.
>
> The second one is GIRAPH-959[^4]. I think this is intended design so not an
> actual problem. How about close this issue before the release of 1.2.0?
>
> Regards,
> Dongjin
>
> [^1]: https://issues.apache.org/jira/browse/GIRAPH-882
> [^2]: https://issues.apache.org/jira/browse/GIRAPH-981
> [^3]: https://issues.apache.org/jira/browse/GIRAPH-969
>
> On Wed, Jun 22, 2016 at 2:42 AM, Sergey Edunov <ed...@fb.com> wrote:
>
>> Hi!
>>
>> Recently, I talked to Roman and Avery about Giraph release process and we
>> agreed it needs to be revived.
>> 1.1.0 has been released 1.5 years ago and we had a lot of changes since
>> then. Now is a good time to release 1.2.0. I volunteer to be release master
>> this time.
>>
>> In this release, we will have new implementation of "Out Of Core",
>> multiple performance and reliability improvements and of course bug fixes.
>>
>> As of today, one test case fails with memory issues, I’ll be working with
>> author to figure out the fix.
>> We have two open issues marked for 1.2.0-SNAPSHOT, both have patches
>> available:
>> https://issues.apache.org/jira/browse/GIRAPH-993
>> https://issues.apache.org/jira/browse/GIRAPH-981
>> Let's review and close them.
>>
>>
>> Also, please, by Jun 29, reply in this thread if you have something planed
>> that should go into this release. If there will be no issues by then, I'll
>> cut a branch and start building and testing new Giraph 1.2.0
>>
>> Regards,
>> Sergey
>>
>>
Re: Releasing Giraph 1.2.0
Posted by Dongjin Lee <do...@apache.org>.
Hello. I submitted a patch for GIRAPH-882[^1] but it seems like omitted
from the release list. Could you review my patch, please? I updated my
first patch applying your comments.
Add to this, I have two more issues.
The first one is GIRAPH-981[^2], which is one of two still-open issues. We
have to update hadoop_yarn profile to apply the comments by Martella and
Shaposhnik on GIRAPH-981 (see the final three comments). The related Jira
issue is GIRAPH-969[^3]. (In the comment Shaposhnik said that he forgot the
id.) If it's no inconvenience to you, may I submit the patch of GIRAPH-969
to close GIRAPH-981? I am also the author of the GIRAPH-947 patch which was
discussed in the comments of GIRAPH-981.
The second one is GIRAPH-959[^4]. I think this is intended design so not an
actual problem. How about close this issue before the release of 1.2.0?
Regards,
Dongjin
[^1]: https://issues.apache.org/jira/browse/GIRAPH-882
[^2]: https://issues.apache.org/jira/browse/GIRAPH-981
[^3]: https://issues.apache.org/jira/browse/GIRAPH-969
On Wed, Jun 22, 2016 at 2:42 AM, Sergey Edunov <ed...@fb.com> wrote:
> Hi!
>
> Recently, I talked to Roman and Avery about Giraph release process and we
> agreed it needs to be revived.
> 1.1.0 has been released 1.5 years ago and we had a lot of changes since
> then. Now is a good time to release 1.2.0. I volunteer to be release master
> this time.
>
> In this release, we will have new implementation of "Out Of Core",
> multiple performance and reliability improvements and of course bug fixes.
>
> As of today, one test case fails with memory issues, I’ll be working with
> author to figure out the fix.
> We have two open issues marked for 1.2.0-SNAPSHOT, both have patches
> available:
> https://issues.apache.org/jira/browse/GIRAPH-993
> https://issues.apache.org/jira/browse/GIRAPH-981
> Let's review and close them.
>
>
> Also, please, by Jun 29, reply in this thread if you have something planed
> that should go into this release. If there will be no issues by then, I'll
> cut a branch and start building and testing new Giraph 1.2.0
>
> Regards,
> Sergey
>
>
Re: Releasing Giraph 1.2.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Tue, Jun 21, 2016 at 10:42 AM, Sergey Edunov <ed...@fb.com> wrote:
> Hi!
>
> Recently, I talked to Roman and Avery about Giraph release process and we agreed it needs to be revived.
> 1.1.0 has been released 1.5 years ago and we had a lot of changes since then. Now is a good time to release 1.2.0. I volunteer to be release master this time.
>
> In this release, we will have new implementation of "Out Of Core", multiple performance and reliability improvements and of course bug fixes.
>
> As of today, one test case fails with memory issues, I’ll be working with author to figure out the fix.
> We have two open issues marked for 1.2.0-SNAPSHOT, both have patches available:
> https://issues.apache.org/jira/browse/GIRAPH-993
> https://issues.apache.org/jira/browse/GIRAPH-981
> Let's review and close them.
>
>
> Also, please, by Jun 29, reply in this thread if you have something planed that should go into this release. If there will be no issues by then, I'll cut a branch and start building and testing new Giraph 1.2.0
Exciting and exactly the right thing to do! Sergey, thank you so much
for volunteering as an RM.
As an RM for 1.1.0 I can definitely offer my help in releasing Giraph
1.2.0 and I can also offer
help in testing it with Bigtop.
First things first, though -- lets make sure we create a version 1.2.0
in our JIRA so that all
of us can track the issues that are going into the release. Sergey,
can you do that please?
Second of all, it would be great if we can cut the release branch at
some point. What's the
ETA for that?
Finally, can somebody please comment on what is the desired level of
YARN support for 1.2.0?
Thanks,
Roman.