You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by Saikat Kanjilal <sx...@gmail.com> on 2017/02/08 19:19:53 UTC
Interested in contributing to reef--newbie
Hello Reef Community,
I am a newbie to Apache Reef and am interested in contributing to the reef
dev efforts, my JIRA id is kanjilal, I can take on dev issues (beginner for
now :) ), would love to hear from the community as to how I can help.
Thanks in advance.
Re: Interested in contributing to reef--newbie
Posted by Markus Weimer <ma...@weimo.de>.
On Thu, Feb 9, 2017 at 8:59 AM, Saikat Kanjilal <sx...@gmail.com> wrote:
> One last question just so I have the same dev environment as everyone else,
> I'm about to spinup a windows vm, does it matter which version of windows
> we use, I was going spin up windows server 2016 DataCenter with containers,
> is that workable with the current reef build?
>
I don't think anyone has tried that version, but I see no reason why it
should not work. Let us know how it goes, and we can update the docs to
reflect that we know that it does or does not work :)
Markus
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Reef Committers et al,
As part of the above discussion I've cleaned up the csharp and the java
build instructions for REEF-1739, please review the pull request here:
https://github.com/apache/reef/pull/1253, once this gets merged I'll clean
up the wiki to just point to these build instructions. Would love to get
this merged soon.
Thanks in advance.
On Wed, Feb 15, 2017 at 11:27 AM, Markus Weimer <ma...@weimo.de> wrote:
> On 2017-02-15 11:24, Saikat Kanjilal wrote:
>
>> should we cleanup/make accurate both tthe build documentation(s)
>> (csharp and java) as part of REEF-1739, I'd really rather not open up
>> another JIRA for the csharp build docs cleanup.
>>
>
> +1. Let's fix both of them in one go.
>
> I think from the wiki perspective we should just refer folks to the
>> build markdown files to remove redundancy.
>>
>
> +1
>
> Markus
>
Re: Interested in contributing to reef--newbie
Posted by Markus Weimer <ma...@weimo.de>.
On 2017-02-15 11:24, Saikat Kanjilal wrote:
> should we cleanup/make accurate both tthe build documentation(s)
> (csharp and java) as part of REEF-1739, I'd really rather not open up
> another JIRA for the csharp build docs cleanup.
+1. Let's fix both of them in one go.
> I think from the wiki perspective we should just refer folks to the
> build markdown files to remove redundancy.
+1
Markus
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
So my question still stands, should we cleanup/make accurate both tthe
build documentation(s) (csharp and java) as part of REEF-1739, I'd really
rather not open up another JIRA for the csharp build docs cleanup. I think
from the wiki perspective we should just refer folks to the build markdown
files to remove redundancy.
On Wed, Feb 15, 2017 at 11:05 AM, Markus Weimer <ma...@weimo.de> wrote:
> On 2017-02-15 10:32, Saikat Kanjilal wrote:
>
>> I was not able to see the MSBuild complete successfully on VS 2015
>> even after I setup all those things that you are describing (namely
>> maven/java/protoc).
>>
>
> OK. Here's what I did on a VS 2015 VM provided on Azure:
>
> * Log into VS 2015 with my account
> * Connect VS 2015 to GitHub
> * Open `lang/cs/Org.Apache.REEF.sln`
> * Hit "CTRL-SHIFT-B" to trigger a build
>
> At this point, I got 46 error messages. Most were not that useful, but
> one read:
>
> $M2_HOME is not set. Please make sure that Maven is installed and
>> configured. See
>> https://cwiki.apache.org/confluence/display/REEF/Compiling+REEF for
>> details.
>>
>
>
> Granted, the link is obsolete and should probably point to
> `lang/cs/BUILD.md` instead.
>
> Next, I installed the JDK from [0]. I accepted the defaults in the
> installer. Side note: I generally use the JDK from Zulu and do not
> install a public JRE on my machines for security reasons. This being a
> throw-away VM, I went ahead with defaults.
>
> I set `JAVA_HOME` to `C:\Program Files\Java\jdk1.8.0_121` in the System
> Properties.
>
> After that, I downloaded Maven from [1]. I downloaded the binary ZIP
> release and unzipped it to `C:\dev\maven` and set `M2_HOME` to point there.
>
> After restarting VS to pickup the new env variables, I did a "rebuild"
> of the solution. At this point, one of the (far too many) errors said:
>
> protoc.exe not found. Please make sure that protoc.exe is on the
>> path. See
>> https://cwiki.apache.org/confluence/display/REEF/Compiling+REEF for
>> details.
>>
>
> Again, the error needs to point to the right documentation. I downloaded
> protoc from [2], copied `protoc.exe` to `C:\dev\bin` and added that
> folder to the PATH.
>
> After restarting VS to pickup the new path, I did another rebuild, which
> succeeded.
>
> This process kinda worked, but wasn't all that intuitive. Some actions
> we can take from this:
>
> * Update the errors to point to the right documentation.
> * Find a way to check for Maven, Java and Protoc at the very
> beginning of the build and fail with a single error if any of those
> are missing. Fishing this information out of the 40+ error messages
> is annoying.
>
> I have no idea how to do that in MSBuild, though. Any experts around
> that could help with that.
>
> Now, about the actual build documentation: I believe the simple link to
> the Java build instructions is misleading. We should just copy the
> prerequisites from `lang/java/BUILD.md` to `lang/cs/Build.md`. If Java,
> Maven and Protoc are installed as per those prerequesites, the build
> seems to work (at least for me on a VM).
>
> Also, I did skip some things in the build instructions that seem redundant:
>
> * I did not add `mvn` to the path for the MSBuild build to succeed.
> * I did not install any NuGet version other than what came with VS.
> * I did not install xunit. That said, I did not run tests.
>
> Markus
>
>
> [0]:
> http://www.oracle.com/technetwork/java/javase/downloads/
> index-jsp-138363.html
>
> [1]: https://maven.apache.org/download.cgi
> [2]:
> https://github.com/google/protobuf/releases/download/v2.5.0/
> protoc-2.5.0-win32.zip
>
Re: Interested in contributing to reef--newbie
Posted by Markus Weimer <ma...@weimo.de>.
On 2017-02-15 10:32, Saikat Kanjilal wrote:
> I was not able to see the MSBuild complete successfully on VS 2015
> even after I setup all those things that you are describing (namely
> maven/java/protoc).
OK. Here's what I did on a VS 2015 VM provided on Azure:
* Log into VS 2015 with my account
* Connect VS 2015 to GitHub
* Open `lang/cs/Org.Apache.REEF.sln`
* Hit "CTRL-SHIFT-B" to trigger a build
At this point, I got 46 error messages. Most were not that useful, but
one read:
> $M2_HOME is not set. Please make sure that Maven is installed and
> configured. See
> https://cwiki.apache.org/confluence/display/REEF/Compiling+REEF for
> details.
Granted, the link is obsolete and should probably point to
`lang/cs/BUILD.md` instead.
Next, I installed the JDK from [0]. I accepted the defaults in the
installer. Side note: I generally use the JDK from Zulu and do not
install a public JRE on my machines for security reasons. This being a
throw-away VM, I went ahead with defaults.
I set `JAVA_HOME` to `C:\Program Files\Java\jdk1.8.0_121` in the System
Properties.
After that, I downloaded Maven from [1]. I downloaded the binary ZIP
release and unzipped it to `C:\dev\maven` and set `M2_HOME` to point there.
After restarting VS to pickup the new env variables, I did a "rebuild"
of the solution. At this point, one of the (far too many) errors said:
> protoc.exe not found. Please make sure that protoc.exe is on the
> path. See
> https://cwiki.apache.org/confluence/display/REEF/Compiling+REEF for
> details.
Again, the error needs to point to the right documentation. I downloaded
protoc from [2], copied `protoc.exe` to `C:\dev\bin` and added that
folder to the PATH.
After restarting VS to pickup the new path, I did another rebuild, which
succeeded.
This process kinda worked, but wasn't all that intuitive. Some actions
we can take from this:
* Update the errors to point to the right documentation.
* Find a way to check for Maven, Java and Protoc at the very
beginning of the build and fail with a single error if any of those
are missing. Fishing this information out of the 40+ error messages
is annoying.
I have no idea how to do that in MSBuild, though. Any experts around
that could help with that.
Now, about the actual build documentation: I believe the simple link to
the Java build instructions is misleading. We should just copy the
prerequisites from `lang/java/BUILD.md` to `lang/cs/Build.md`. If Java,
Maven and Protoc are installed as per those prerequesites, the build
seems to work (at least for me on a VM).
Also, I did skip some things in the build instructions that seem redundant:
* I did not add `mvn` to the path for the MSBuild build to succeed.
* I did not install any NuGet version other than what came with VS.
* I did not install xunit. That said, I did not run tests.
Markus
[0]:
http://www.oracle.com/technetwork/java/javase/downloads/index-jsp-138363.html
[1]: https://maven.apache.org/download.cgi
[2]:
https://github.com/google/protobuf/releases/download/v2.5.0/protoc-2.5.0-win32.zip
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
The IntelliJ IDE is not required at all, my point is that its nice to have
for debugging and visually iterating over code that you are currently
working on. I was not able to see the MSBuild complete successfully on VS
2015 even after I setup all those things that you are describing (namely
maven/java/protoc).
On Wed, Feb 15, 2017 at 10:27 AM, Markus Weimer <ma...@weimo.de> wrote:
> On Wed, Feb 15, 2017 at 9:37 AM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
>
> > Her's a note on the windows build and what I had to do to get things
> > working successfully:
> > 1) I had to install IntelliJ/maven/java
> > 2) I had to build the java build first, used IntelliJ for that, nice IDE
> > btw
> > 3) I built the windows build afterwards and it then built successfully
> >
>
> This is odd. You should not need an IDE to compile the Java code. Maven
> should be sufficient. Also, the MSBuild project should trigger a java build
> if needed, and even produce error messages when the required bits (java,
> maven, protoc) are not on the PATH or the needed environment variables
> aren't set.
>
> I'm getting a VS 2015 VM myself to see whether those "shoulds" are actually
> true :)\
>
>
> > sorry have to give direct feedback so that the next person trying the
> > windows build doesnt scratch their head :)
> >
>
> No, this is very useful. Most of us setup their environments months or
> years ago, so we don't stumble over these issues anymore. Keep it coming.
>
> Markus
>
Re: Interested in contributing to reef--newbie
Posted by Markus Weimer <ma...@weimo.de>.
On Wed, Feb 15, 2017 at 9:37 AM, Saikat Kanjilal <sx...@gmail.com> wrote:
> Her's a note on the windows build and what I had to do to get things
> working successfully:
> 1) I had to install IntelliJ/maven/java
> 2) I had to build the java build first, used IntelliJ for that, nice IDE
> btw
> 3) I built the windows build afterwards and it then built successfully
>
This is odd. You should not need an IDE to compile the Java code. Maven
should be sufficient. Also, the MSBuild project should trigger a java build
if needed, and even produce error messages when the required bits (java,
maven, protoc) are not on the PATH or the needed environment variables
aren't set.
I'm getting a VS 2015 VM myself to see whether those "shoulds" are actually
true :)\
> sorry have to give direct feedback so that the next person trying the
> windows build doesnt scratch their head :)
>
No, this is very useful. Most of us setup their environments months or
years ago, so we don't stumble over these issues anymore. Keep it coming.
Markus
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Her's a note on the windows build and what I had to do to get things
working successfully:
1) I had to install IntelliJ/maven/java
2) I had to build the java build first, used IntelliJ for that, nice IDE btw
3) I built the windows build afterwards and it then built successfully
If I look at these instructions(
https://github.com/apache/reef/blob/master/lang/cs/BUILD.md) the above
steps are not easily decipherable, sorry have to give direct feedback so
that the next person trying the windows build doesnt scratch their head :)
Should we as part of REEF-1739 also improve/make exact the windows build
instructions as well?
On Thu, Feb 9, 2017 at 8:59 AM, Saikat Kanjilal <sx...@gmail.com> wrote:
> One last question just so I have the same dev environment as everyone
> else, I'm about to spinup a windows vm, does it matter which version of
> windows we use, I was going spin up windows server 2016 DataCenter with
> containers, is that workable with the current reef build?
>
> On Thu, Feb 9, 2017 at 8:50 AM, Saikat Kanjilal <sx...@gmail.com> wrote:
>
>> https://issues.apache.org/jira/browse/REEF-1739
>>
>>
>> Also I've assigned myself several subtasks from https://issues.apache.org
>> /jira/browse/REEF-334
>>
>> My next priorities will be:
>> 1) Get reef to build successfully on windows VM
>> 2) Work on REEF-1739
>> 3) Work on subtasks for REEF-334
>>
>> Regards
>>
>> On Thu, Feb 9, 2017 at 8:09 AM, Markus Weimer <ma...@weimo.de> wrote:
>>
>>> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com>
>>> wrote:
>>>
>>> > On to bigger and better things :), we should probably update the docs
>>> to
>>> > reflect the current build process subtleties.
>>> >
>>>
>>> Great idea! Do you feel like filing a JIRA and sending a pull request for
>>> this?
>>>
>>> Markus
>>>
>>
>>
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
One last question just so I have the same dev environment as everyone else,
I'm about to spinup a windows vm, does it matter which version of windows
we use, I was going spin up windows server 2016 DataCenter with containers,
is that workable with the current reef build?
On Thu, Feb 9, 2017 at 8:50 AM, Saikat Kanjilal <sx...@gmail.com> wrote:
> https://issues.apache.org/jira/browse/REEF-1739
>
>
> Also I've assigned myself several subtasks from https://issues.apache.
> org/jira/browse/REEF-334
>
> My next priorities will be:
> 1) Get reef to build successfully on windows VM
> 2) Work on REEF-1739
> 3) Work on subtasks for REEF-334
>
> Regards
>
> On Thu, Feb 9, 2017 at 8:09 AM, Markus Weimer <ma...@weimo.de> wrote:
>
>> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com>
>> wrote:
>>
>> > On to bigger and better things :), we should probably update the docs to
>> > reflect the current build process subtleties.
>> >
>>
>> Great idea! Do you feel like filing a JIRA and sending a pull request for
>> this?
>>
>> Markus
>>
>
>
Re: Interested in contributing to reef--newbie
Posted by Byung-Gon Chun <bg...@gmail.com>.
This's great. Looking forward to your PRs. :-)
On Fri, Feb 10, 2017 at 1:50 AM, Saikat Kanjilal <sx...@gmail.com> wrote:
> https://issues.apache.org/jira/browse/REEF-1739
>
>
> Also I've assigned myself several subtasks from
> https://issues.apache.org/jira/browse/REEF-334
>
> My next priorities will be:
> 1) Get reef to build successfully on windows VM
> 2) Work on REEF-1739
> 3) Work on subtasks for REEF-334
>
> Regards
>
> On Thu, Feb 9, 2017 at 8:09 AM, Markus Weimer <ma...@weimo.de> wrote:
>
> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
> >
> > > On to bigger and better things :), we should probably update the docs
> to
> > > reflect the current build process subtleties.
> > >
> >
> > Great idea! Do you feel like filing a JIRA and sending a pull request for
> > this?
> >
> > Markus
> >
>
--
Byung-Gon Chun
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
https://issues.apache.org/jira/browse/REEF-1739
Also I've assigned myself several subtasks from
https://issues.apache.org/jira/browse/REEF-334
My next priorities will be:
1) Get reef to build successfully on windows VM
2) Work on REEF-1739
3) Work on subtasks for REEF-334
Regards
On Thu, Feb 9, 2017 at 8:09 AM, Markus Weimer <ma...@weimo.de> wrote:
> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
>
> > On to bigger and better things :), we should probably update the docs to
> > reflect the current build process subtleties.
> >
>
> Great idea! Do you feel like filing a JIRA and sending a pull request for
> this?
>
> Markus
>
Re: Interested in contributing to reef--newbie
Posted by Markus Weimer <ma...@weimo.de>.
On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> On to bigger and better things :), we should probably update the docs to
> reflect the current build process subtleties.
>
Great idea! Do you feel like filing a JIRA and sending a pull request for
this?
Markus
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Could be, not sure, the 2 that come to mind are mahout and spark.
On Mon, Feb 13, 2017 at 12:17 PM, Douglas Service <ds...@gmail.com> wrote:
> I wonder if your other open source projects are using a github webhook to
> to trigger the JIRA update?
>
> On Mon, Feb 13, 2017 at 9:39 AM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
>
> > @Doug, In the other open source projects that I'm involved in, the
> comment
> > gets autogenerated into the JIRA ticket once the pull request gets sent
> > across, is there a way to replicate that automation here?
> >
> >
> > @Reef Dev Folks could you all look at this pull request when you get a
> > chance and let me know all the different versions of operating systems
> that
> > have been tested with the current reef build.
> >
> > Thanks in advance.
> >
> >
> >
> > On Fri, Feb 10, 2017 at 6:30 PM, Douglas Service <ds...@gmail.com>
> > wrote:
> >
> > > As per the developer documentation you should add a comment to the JIRA
> > > which gives a link to the pull request on github which triggers an
> email
> > to
> > > the dev list so eveyone knows to take a look. I added the following
> > comment
> > > to the JIRA.
> > >
> > > Pull request is available at
> > > https://github.com/apache/reef/pull/1253#pullrequestreview-21376209.
> > >
> > >
> > > On Fri, Feb 10, 2017 at 5:22 PM, Saikat Kanjilal <sx...@gmail.com>
> > > wrote:
> > >
> > > > Pull request submitted :)))).
> > > > Thanks for all the help, will focus on getting windows build
> > operational.
> > > >
> > > > On Fri, Feb 10, 2017 at 5:06 PM, Saikat Kanjilal <sx...@gmail.com>
> > > > wrote:
> > > >
> > > > > Sure I can try that and that should work, on another note should we
> > > > update
> > > > > the documentation to not say HEAD, I was mimicking the docs to the
> > tee.
> > > > > Will let you know results.
> > > > >
> > > > > Sent from my iPhone
> > > > >
> > > > > > On Feb 10, 2017, at 4:48 PM, Douglas Service <ds...@gmail.com>
> > > > wrote:
> > > > > >
> > > > > > You should have a branched named REEF-1739 on your dev machine
> > where
> > > > your
> > > > > > changes are located. Would you please try
> > > > > >
> > > > > > git push origin REEF-1739
> > > > > >
> > > > > >> On Fri, Feb 10, 2017 at 4:39 PM, Saikat Kanjilal <
> > sxk1969@gmail.com
> > > >
> > > > > wrote:
> > > > > >>
> > > > > >> ok so I fixed the problem of pointing to the wrong repo, namely
> I
> > am
> > > > now
> > > > > >> pointing to my repo for reef, here's what I see now:
> > > > > >>
> > > > > >> saikan@ubuntureef:~/code/localdevreef$ git push origin HEAD
> > > > > >> Username for 'https://github.com': skanjila
> > > > > >> Password for 'https://skanjila@github.com':
> > > > > >> error: unable to push to unqualified destination: HEAD
> > > > > >> The destination refspec neither matches an existing ref on the
> > > remote
> > > > > nor
> > > > > >> begins with refs/, and we are unable to guess a prefix based on
> > the
> > > > > source
> > > > > >> ref.
> > > > > >> error: failed to push some refs to '
> https://github.com/skanjila/
> > > > > reef.git'
> > > > > >>
> > > > > >> Here's what git remote -v yields:
> > > > > >> saikan@ubuntureef:~/code/localdevreef$ git remote -v
> > > > > >> origin https://github.com/skanjila/reef.git (fetch)
> > > > > >> origin https://github.com/skanjila/reef.git (push)
> > > > > >> upstream https://github.com/apache/reef.git (fetch)
> > > > > >> upstream https://github.com/apache/reef.git (push)
> > > > > >>
> > > > > >>
> > > > > >> My github alias is skanjila
> > > > > >>
> > > > > >>
> > > > > >> Here's what git status gives:
> > > > > >> saikan@ubuntureef:~/code/localdevreef$ git status
> > > > > >> interactive rebase in progress; onto e554dd3
> > > > > >> fatal: Could not open file .git/rebase-merge/done for reading:
> No
> > > such
> > > > > file
> > > > > >> or directory
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> Thoughts?
> > > > > >>
> > > > > >>
> > > > > >>> On Fri, Feb 10, 2017 at 2:38 PM, Markus Weimer <
> markus@weimo.de>
> > > > > wrote:
> > > > > >>>
> > > > > >>> Hi,
> > > > > >>>
> > > > > >>> if `origin` refers to the apache/reef repositiory on GitHub OR
> > the
> > > > > >>> repository on apache.org, you won't be able to push, as those
> > > repos
> > > > > are
> > > > > >>> read-only for you. Instead, you need to push to your own fork
> of
> > > REEF
> > > > > on
> > > > > >>> GitHub and then file a PR from that branch to apache/reef from
> > > there.
> > > > > >>>
> > > > > >>> Markus
> > > > > >>>
> > > > > >>> On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <
> > > dsopsrc@gmail.com>
> > > > > >>> wrote:
> > > > > >>>
> > > > > >>>> also what is your GitHub alias?
> > > > > >>>>
> > > > > >>>> On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <
> > > dsopsrc@gmail.com
> > > > >
> > > > > >>>> wrote:
> > > > > >>>>
> > > > > >>>>> and git status from the REEF root directory.
> > > > > >>>>>
> > > > > >>>>> On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <
> > > > dsopsrc@gmail.com>
> > > > > >>>>> wrote:
> > > > > >>>>>
> > > > > >>>>>> Would you please send the output of git remote -v?
> > > > > >>>>>>
> > > > > >>>>>> Doug
> > > > > >>>>>>
> > > > > >>>>>> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <
> > > > sxk1969@gmail.com
> > > > > >>>
> > > > > >>>>>> wrote:
> > > > > >>>>>>
> > > > > >>>>>>> Folks,
> > > > > >>>>>>> I am trying to create/deploy my first pull request, I've
> gone
> > > > > >> through
> > > > > >>>> all
> > > > > >>>>>>> of these steps successfully here:
> > > > > >>>>>>> https://cwiki.apache.org/confluence/display/REEF/
> Contributin
> > > > > >>>>>>> g#Contributing-1.Forkrepository
> > > > > >>>>>>> but I seem to be running into 403 errors when I do a git
> push
> > > > > >> origin
> > > > > >>>>>>> HEAD,
> > > > > >>>>>>> here are my creds, would really appreciate some help:
> > > > > >>>>>>>
> > > > > >>>>>>>
> > > > > >>>>>>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> > > > > >>>>>>> github username: skanjila
> > > > > >>>>>>>
> > > > > >>>>>>>
> > > > > >>>>>>> Please let me know what I am missing here, note that my id
> in
> > > > JIRA
> > > > > >> is
> > > > > >>>>>>> kanjilal but my github userid is skanjila, might this be a
> > > > problem?
> > > > > >>>>>>>
> > > > > >>>>>>> Thanks in advance.
> > > > > >>>>>>>
> > > > > >>>>>>>
> > > > > >>>>>>>
> > > > > >>>>>>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <
> > > > sxk1969@gmail.com
> > > > > >>>
> > > > > >>>>>>> wrote:
> > > > > >>>>>>>
> > > > > >>>>>>>> Well interesting piece of metadata, time for successfully
> > > > > >>> completing
> > > > > >>>>>>>> windows server 2016 build was about half the time for
> linux,
> > > at
> > > > > >>> least
> > > > > >>>>>>> for
> > > > > >>>>>>>> the java build, will try csharp next
> > > > > >>>>>>>>
> > > > > >>>>>>>> Here's what I did:
> > > > > >>>>>>>> 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> > > > > >>>>>>>> 2) mvn clean install -DskipTests=true
> > > > > >>>>>>>>
> > > > > >>>>>>>>
> > > > > >>>>>>>> For posterity's sake I will go back and redo my ubuntu
> linux
> > > > > >> build
> > > > > >>>> and
> > > > > >>>>>>>> then work on the JIRA-1739 to make sure the documentation
> is
> > > up
> > > > > >> to
> > > > > >>>>>>> date as
> > > > > >>>>>>>> needed. I will install java from the repositories this
> > time.
> > > > > >>>>>>>>
> > > > > >>>>>>>>
> > > > > >>>>>>>>
> > > > > >>>>>>>>
> > > > > >>>>>>>> On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <
> > > > > >> sxk1969@gmail.com
> > > > > >>>>
> > > > > >>>>>>> wrote:
> > > > > >>>>>>>>
> > > > > >>>>>>>>> Yes I have gone through that in the past, not sure why I
> > > > decided
> > > > > >>> not
> > > > > >>>>>>> to
> > > > > >>>>>>>>> include that repo and just download the jdk and put it in
> > > > > >> instead
> > > > > >>>> :),
> > > > > >>>>>>>>> regardless I will send a pull request for the build
> cleanup
> > > in
> > > > > >> the
> > > > > >>>>>>> next few
> > > > > >>>>>>>>> days, lets iterate on it as a team and test drive it to
> > prove
> > > > it
> > > > > >>>>>>> wrong or
> > > > > >>>>>>>>> right
> > > > > >>>>>>>>>
> > > > > >>>>>>>>> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <
> > > > > >>> dsopsrc@gmail.com>
> > > > > >>>>>>>>> wrote:
> > > > > >>>>>>>>>
> > > > > >>>>>>>>>> After thinking about all of the changes you had make and
> > the
> > > > > >> fact
> > > > > >>>>>>> that
> > > > > >>>>>>>>>> oracle java does not show up in update-alternatives, you
> > may
> > > > > >> want
> > > > > >>>> to
> > > > > >>>>>>> look
> > > > > >>>>>>>>>> at these instructions which tell how to install oracle
> > java
> > > > via
> > > > > >>>>>>> apt-get
> > > > > >>>>>>>>>> repository which automatically takes care of a lot of
> the
> > > > > >> issues
> > > > > >>>> you
> > > > > >>>>>>> ran
> > > > > >>>>>>>>>> into
> > > > > >>>>>>>>>> https://www.digitalocean.com/
> community/tutorials/how-to-
> > > inst
> > > > > >>>>>>>>>> all-java-on-ubuntu-with-apt-get
> > > > > >>>>>>>>>> .
> > > > > >>>>>>>>>>
> > > > > >>>>>>>>>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
> > > > > >>>> sxk1969@gmail.com>
> > > > > >>>>>>>>>> wrote:
> > > > > >>>>>>>>>>
> > > > > >>>>>>>>>>> I think part of the difference is the way both of us
> > > > > >> installed
> > > > > >>>>>>> java, my
> > > > > >>>>>>>>>>> setup is using the oracle java as opposed to the
> open-jdk
> > > > > >> java
> > > > > >>>>>>>>>> provided by
> > > > > >>>>>>>>>>> update-alternatives, I agree with your instructions
> > > > > >> assessment.
> > > > > >>>>>>>>>>>
> > > > > >>>>>>>>>>>
> > > > > >>>>>>>>>>> On another note I have a question, how did folks
> install
> > > > > >> protoc
> > > > > >>>> on
> > > > > >>>>>>>>>> windows,
> > > > > >>>>>>>>>>> in looking at the wiki it points you to the protoc site
> > > where
> > > > > >>> it
> > > > > >>>>>>> seems
> > > > > >>>>>>>>>> to
> > > > > >>>>>>>>>>> need a whole bunch of supporting tools (cmake/mingw
> > etc), I
> > > > > >> am
> > > > > >>>>>>> using
> > > > > >>>>>>>>>>> gitbash on windows and was wondering if there's an easy
> > way
> > > > > >> to
> > > > > >>>>>>>>>> download the
> > > > > >>>>>>>>>>> protoc binaries and set the path, please forgive me if
> > this
> > > > > >> is
> > > > > >>> in
> > > > > >>>>>>> the
> > > > > >>>>>>>>>>> documentation somewhere, still learning my way around.
> > > > > >>>>>>>>>>>
> > > > > >>>>>>>>>>> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
> > > > > >>>>>>> dsopsrc@gmail.com>
> > > > > >>>>>>>>>>> wrote:
> > > > > >>>>>>>>>>>
> > > > > >>>>>>>>>>>> What I mean is that we should provide instructions to
> > > setup
> > > > > >>> the
> > > > > >>>>>>> least
> > > > > >>>>>>>>>>>> complicated build environment that works, not one that
> > is
> > > > > >>> more
> > > > > >>>>>>>>>>> complicated
> > > > > >>>>>>>>>>>> but also works.
> > > > > >>>>>>>>>>>>
> > > > > >>>>>>>>>>>> On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> > > > > >>>>>>> dsopsrc@gmail.com>
> > > > > >>>>>>>>>>>> wrote:
> > > > > >>>>>>>>>>>>
> > > > > >>>>>>>>>>>>> Do you have update-alternatives installed? Have you
> run
> > > > > >>>>>>>>>>>>> update-alternatives --config java?
> > > > > >>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>> Sorry I made a mistake in may last email, I actually
> > have
> > > > > >>>>>>>>>> JAVA_HOME set
> > > > > >>>>>>>>>>>> to
> > > > > >>>>>>>>>>>>> /usr as listed on the webpage which figured out from
> > > > > >>> Sergiy.
> > > > > >>>>>>>>>> However, I
> > > > > >>>>>>>>>>>> do
> > > > > >>>>>>>>>>>>> not need to set the other ones. It is important that
> > our
> > > > > >>>>>>>>>> contributing
> > > > > >>>>>>>>>>> to
> > > > > >>>>>>>>>>>>> REEF wiki be general and not specific to a single
> > setup.
> > > > > >>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>> Here is my environment for building REEF on Ubuntu
> > 16.04.
> > > > > >>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>> dougse@reefdevlx:/code/reef [master ↑]$$ env
> > > > > >>>>>>>>>>>>> MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > > > > >>>>>>>>>>>>> XDG_SESSION_ID=c2
> > > > > >>>>>>>>>>>>> SHELL=/bin/bash
> > > > > >>>>>>>>>>>>> TERM=xterm
> > > > > >>>>>>>>>>>>> WINDOWID=44144243
> > > > > >>>>>>>>>>>>> USER=dougse
> > > > > >>>>>>>>>>>>> LS_COLORS=rs=0:di=01;34:ln=01;
> > > > > >>> 36:mh=00:pi=40;33:so=01;35:do=
> > > > > >>>>>>>>>>>>> 01;35:bd=40;33;01:cd=40;33;01:
> > > > > >>> or=40;31;01:mi=00:su=37;41:sg=
> > > > > >>>>>>>>>>>>> 30;43:ca=30;41:tw=30;42:ow=34;
> > > > > >>> 42:st=37;44:ex=01;32:*.tar=01;
> > > > > >>>>>>>>>>>>> 31:*.tgz=01;31:*.arc=01;31:*.
> > > > > >> arj=01;31:*.taz=01;31:*.lha=
> > > > > >>>>>>>>>>>>> 01;31:*.lz4=01;31:*.lzh=01;31:
> > > > > >> *.lzma=01;31:*.tlz=01;31:*.
> > > > > >>>>>>>>>>>>> txz=01;31:*.tzo=01;31:*.t7z=
> > > > > >> 01;31:*.zip=01;31:*.z=01;31:*.
> > > > > >>>>>>>>>>>>> Z=01;31:*.dz=01;31:*.gz=01;31:
> > > > > >>> *.lrz=01;31:*.lz=01;31:*.lzo=
> > > > > >>>>>>>>>>>>> 01;31:*.xz=01;31:*.bz2=01;31:*
> > > > > >>> .bz=01;31:*.tbz=01;31:*.tbz2=
> > > > > >>>>>>>>>>>>> 01;31:*.tz=01;31:*.deb=01;31:*
> > > > > >>> .rpm=01;31:*.jar=01;31:*.war=
> > > > > >>>>>>>>>>>>> 01;31:*.ear=01;31:*.sar=01;31:
> > > > > >>> *.rar=01;31:*.alz=01;31:*.ace=
> > > > > >>>>>>>>>>>>> 01;31:*.zoo=01;31:*.cpio=01;
> > 31:*.7z=01;31:*.rz=01;31:*.
> > > > > >>>>>>>>>>>>> cab=01;31:*.jpg=01;35:*.jpeg=
> > > > > >>> 01;35:*.gif=01;35:*.bmp=01;35:
> > > > > >>>>>>>>>>>>> *.pbm=01;35:*.pgm=01;35:*.ppm=
> > > > > >>> 01;35:*.tga=01;35:*.xbm=01;35:
> > > > > >>>>>>>>>>>>> *.xpm=01;35:*.tif=01;35:*.
> > tiff=01;35:*.png=01;35:*.svg=
> > > > > >>>>>>>>>>>>> 01;35:*.svgz=01;35:*.mng=01;
> > > > > >> 35:*.pcx=01;35:*.mov=01;35:*.
> > > > > >>>>>>>>>>>>> mpg=01;35:*.mpeg=01;35:*.m2v=
> > > > > >> 01;35:*.mkv=01;35:*.webm=01;
> > > > > >>>>>>>>>>>>> 35:*.ogm=01;35:*.mp4=01;35:*.
> > > > > >> m4v=01;35:*.mp4v=01;35:*.vob=
> > > > > >>>>>>>>>>>>> 01;35:*.qt=01;35:*.nuv=01;35:*
> > > > > >> .wmv=01;35:*.asf=01;35:*.rm=
> > > > > >>>>>>>>>>>>> 01;35:*.rmvb=01;35:*.flc=01;
> > > > > >> 35:*.avi=01;35:*.fli=01;35:*.
> > > > > >>>>>>>>>>>>> flv=01;35:*.gl=01;35:*.dl=01;
> > > > > >> 35:*.xcf=01;35:*.xwd=01;35:*.
> > > > > >>>>>>>>>>>>> yuv=01;35:*.cgm=01;35:*.emf=
> > > > > >> 01;35:*.ogv=01;35:*.ogx=01;35:
> > > > > >>>>>>>>>>>>> *.aac=00;36:*.au=00;36:*.flac=
> > > > > >>> 00;36:*.m4a=00;36:*.mid=00;36:
> > > > > >>>>>>>>>>>>> *.midi=00;36:*.mka=00;36:*.
> > mp3=00;36:*.mpc=00;36:*.ogg=
> > > > > >>>>>>>>>>>>> 00;36:*.ra=00;36:*.wav=00;36:*
> > > > > >>> .oga=00;36:*.opus=00;36:*.spx=
> > > > > >>>>>>>>>>>>> 00;36:*.xspf=00;36:
> > > > > >>>>>>>>>>>>> SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > > > > >>>>>>>>>>>>> SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > > > > >>>>>>>>>>>>> 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > > > > >>>>>>>>>>>>> PATH=/home/dougse/bin:/bin:/
> > usr/bin:/usr/X11R6/bin:/usr/
> > > > > >>> loca
> > > > > >>>>>>> l/bin
> > > > > >>>>>>>>>>>>> PWD=/code/reef
> > > > > >>>>>>>>>>>>> JAVA_HOME=/usr
> > > > > >>>>>>>>>>>>> LANG=en_US.UTF-8
> > > > > >>>>>>>>>>>>> REEF_HOME=/code/reef
> > > > > >>>>>>>>>>>>> SHLVL=1
> > > > > >>>>>>>>>>>>> HOME=/home/dougse
> > > > > >>>>>>>>>>>>> GTK_OVERLAY_SCROLLING=0
> > > > > >>>>>>>>>>>>> DBUS_SESSION_BUS_ADDRESS=unix:
> > > > > >>> abstract=/tmp/dbus-l06bsMWGy0,
> > > > > >>>>>>> guid=
> > > > > >>>>>>>>>>>>> ae74bbce18102091c11c7bd458939d1c
> > > > > >>>>>>>>>>>>> UID=1000
> > > > > >>>>>>>>>>>>> LESSOPEN=| /bin/lesspipe %s
> > > > > >>>>>>>>>>>>> XDG_RUNTIME_DIR=/run/user/1000
> > > > > >>>>>>>>>>>>> DISPLAY=:10.0
> > > > > >>>>>>>>>>>>> XDG_CURRENT_DESKTOP=MATE
> > > > > >>>>>>>>>>>>> LESSCLOSE=/bin/lesspipe %s %s
> > > > > >>>>>>>>>>>>> COLORTERM=mate-terminal
> > > > > >>>>>>>>>>>>> _=/usr/bin/env
> > > > > >>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>> On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> > > > > >>>>>>> sxk1969@gmail.com
> > > > > >>>>>>>>>>>
> > > > > >>>>>>>>>>>> wrote:
> > > > > >>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>> Weird, yes I did read that pageand yes I had to do
> > those
> > > > > >>>> exact
> > > > > >>>>>>>>>> steps
> > > > > >>>>>>>>>>>> that
> > > > > >>>>>>>>>>>>>> I
> > > > > >>>>>>>>>>>>>> described, I haven't run the tests yet but fully
> > suspect
> > > > > >>>> that
> > > > > >>>>>>> I'll
> > > > > >>>>>>>>>>> need
> > > > > >>>>>>>>>>>> to
> > > > > >>>>>>>>>>>>>> increase the ulimit to enable that. If you do a
> plain
> > > > > >>> maven
> > > > > >>>>>>> build
> > > > > >>>>>>>>>>> after
> > > > > >>>>>>>>>>>>>> checking out the reef code in ubuntu it complains
> that
> > > > > >>>>>>> JAVA_HOME
> > > > > >>>>>>>>>> is
> > > > > >>>>>>>>>>> not
> > > > > >>>>>>>>>>>>>> set, also its a good idea to set the maven oriented
> > > > > >>>>>>> environment
> > > > > >>>>>>>>>>>> variables
> > > > > >>>>>>>>>>>>>> because I highly suspect that in the future we may
> > need
> > > > > >> to
> > > > > >>>>>>> adjust
> > > > > >>>>>>>>>> heap
> > > > > >>>>>>>>>>>>>> space settings, finally the LD_LIBRARY_PATH is
> needed
> > I
> > > > > >>>>>>> suspect
> > > > > >>>>>>>>>>> because
> > > > > >>>>>>>>>>>>>> the
> > > > > >>>>>>>>>>>>>> java code is invoking the protoc compiler at some
> > point
> > > > > >>> and
> > > > > >>>> in
> > > > > >>>>>>>>>> order
> > > > > >>>>>>>>>>> to
> > > > > >>>>>>>>>>>> do
> > > > > >>>>>>>>>>>>>> so it much load some .so files that live in
> > > > > >>> LD_LIBRARY_PATH.
> > > > > >>>>>>> Net
> > > > > >>>>>>>>>> Net
> > > > > >>>>>>>>>>> we
> > > > > >>>>>>>>>>>>>> should definitely figure out the differences between
> > > > > >> your
> > > > > >>>> and
> > > > > >>>>>>>>>> Sergei's
> > > > > >>>>>>>>>>>>>> setup and mine, I believe IIRC I used ubuntu 16.10
> but
> > > > > >> I'm
> > > > > >>>> not
> > > > > >>>>>>>>>>> convinced
> > > > > >>>>>>>>>>>>>> that the version matters if the major version is the
> > > > > >> same.
> > > > > >>>>>>>>>>>>>> Cheers
> > > > > >>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> > > > > >>>>>>>>>> dsopsrc@gmail.com>
> > > > > >>>>>>>>>>>>>> wrote:
> > > > > >>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>> Hello Saikat,
> > > > > >>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>> Did you read the documentation on this page
> > > > > >>>>>>>>>>>>>>> https://cwiki.apache.org/
> > > > > >> confluence/display/REEF/Linux
> > > > > >>> on
> > > > > >>>>>>> the
> > > > > >>>>>>>>>> REEF
> > > > > >>>>>>>>>>>> wiki
> > > > > >>>>>>>>>>>>>>> concerning Java on Ubuntu? I added this page after
> > > > > >>> setting
> > > > > >>>>>>> up a
> > > > > >>>>>>>>>>> Linux
> > > > > >>>>>>>>>>>>>> 16.04
> > > > > >>>>>>>>>>>>>>> to build REEF and trading emails with Sergiy on
> the
> > > > > >> dev
> > > > > >>>>>>> list.
> > > > > >>>>>>>>>> Note
> > > > > >>>>>>>>>>>>>> that I
> > > > > >>>>>>>>>>>>>>> do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH.
> > > > > >> However,
> > > > > >>>>>>> you do
> > > > > >>>>>>>>>> need
> > > > > >>>>>>>>>>>> to
> > > > > >>>>>>>>>>>>>>> change the default for ulimit -n in bash to get the
> > > > > >>> tests
> > > > > >>>>>>> to run
> > > > > >>>>>>>>>>> which
> > > > > >>>>>>>>>>>>>> is
> > > > > >>>>>>>>>>>>>>> also described.
> > > > > >>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>> Doug
> > > > > >>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> > > > > >>>>>>>>>> sxk1969@gmail.com>
> > > > > >>>>>>>>>>>>>> wrote:
> > > > > >>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>> A battle well fought and won, got reef to build
> > > > > >>>>>>> successfully
> > > > > >>>>>>>>>> on
> > > > > >>>>>>>>>>>> ubuntu
> > > > > >>>>>>>>>>>>>>>> linux vm after hours of hacking, fyi here's what I
> > > > > >> had
> > > > > >>>> to
> > > > > >>>>>>> do:
> > > > > >>>>>>>>>>>>>>>> 1) installed the necessary tools (jdk 1.7/maven
> > > > > >>>>>>> 3.3.9/protoc
> > > > > >>>>>>>>>>> version
> > > > > >>>>>>>>>>>>>> 2.5)
> > > > > >>>>>>>>>>>>>>>> 2) added JAVA_HOME and M2_HOME
> > > > > >>>>>>>>>>>>>>>> 3) here's the kicker that's not in the
> documentation
> > > > > >>> :)
> > > > > >>>> (
> > > > > >>>>>>>>>>>>>>>> https://github.com/apache/reef
> > > > > >>>>>>> /blob/master/lang/java/BUILD.md
> > > > > >>>>>>>>>> ),
> > > > > >>>>>>>>>>> had
> > > > > >>>>>>>>>>>>>> to
> > > > > >>>>>>>>>>>>>>> add
> > > > > >>>>>>>>>>>>>>>> LD_LIBRARY_PATH environment variable and have it
> > > > > >> point
> > > > > >>>> to
> > > > > >>>>>>>>>>>>>> /usr/local/lib
> > > > > >>>>>>>>>>>>>>>> where the shared library for protobuf is installed
> > > > > >>>>>>>>>>>>>>>> 4) had to add JAVA_HOME and M2_HOME to path (also
> > > > > >> not
> > > > > >>> in
> > > > > >>>>>>> the
> > > > > >>>>>>>>>>>>>>> documentation
> > > > > >>>>>>>>>>>>>>>> :) )
> > > > > >>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>> [INFO]
> > > > > >>>>>>>>>>>>>>>> ------------------------------
> > > > > >>>>>>> ------------------------------
> > > > > >>>>>>>>>>>>>> ------------
> > > > > >>>>>>>>>>>>>>>> [INFO] Reactor Summary:
> > > > > >>>>>>>>>>>>>>>> [INFO]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF ..............................
> > > > > >>>>>>> .................
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 4.167 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Dot Net ..............................
> > > > > >>>>>>> .........
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 1.628 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Annotations
> > > > > >> ..............................
> > > > > >>>>>>> .....
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 5.509 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Utils ..............................
> > > > > >>>>>>> ...........
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 5.747 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Tang Project
> > > > > >>> ..............................
> > > > > >>>>>>> ....
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 0.492 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar A
> > > > > >> ..............................
> > > > > >>>>>>> ......
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 4.276 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B
> > > > > >> ..............................
> > > > > >>>>>>> ......
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 4.186 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar AB
> > > > > >> ..............................
> > > > > >>>>>>> .....
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 4.376 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B conflict A
> > > > > >>>>>>> .........................
> > > > > >>>>>>>>>>> SUCCESS
> > > > > >>>>>>>>>>>> [
> > > > > >>>>>>>>>>>>>>>> 0.440 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Tang ..............................
> > > > > >>>>>>> ............
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 24.779 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Wake Project
> > > > > >>> ..............................
> > > > > >>>>>>> ....
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 0.487 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Wake ..............................
> > > > > >>>>>>> ............
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 15.587 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Common ..............................
> > > > > >>>>>>> ..........
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 23.343 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime Local
> > > > > >>> ..............................
> > > > > >>>>>>> ...
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 8.375 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Applications
> > > > > >>> ..............................
> > > > > >>>>>>> ....
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 0.416 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Vortex ..............................
> > > > > >>>>>>> ..........
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 11.263 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF HTTP Server
> > > > > >> ..............................
> > > > > >>>>>>> .....
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 9.772 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Utils for Hadoop
> > > > > >>>>>>> ..............................
> > > > > >>>>>>>>>>> SUCCESS
> > > > > >>>>>>>>>>>> [
> > > > > >>>>>>>>>>>>>>>> 5.881 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for YARN
> > > > > >>>>>>> ..............................
> > > > > >>>>>>>>>>> SUCCESS
> > > > > >>>>>>>>>>>> [
> > > > > >>>>>>>>>>>>>>>> 11.041 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for HDInsight
> > > > > >>>>>>> .........................
> > > > > >>>>>>>>>>> SUCCESS
> > > > > >>>>>>>>>>>> [
> > > > > >>>>>>>>>>>>>>>> 9.719 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF IO ..............................
> > > > > >>>>>>> ..............
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 23.729 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Checkpoint
> > > > > >> ..............................
> > > > > >>>>>>> ......
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 5.771 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Bridge Java
> > > > > >> ..............................
> > > > > >>>>>>> .....
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 11.981 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for multiple runtime scenarios
> > > > > >>>>>>> ........
> > > > > >>>>>>>>>>> SUCCESS
> > > > > >>>>>>>>>>>> [
> > > > > >>>>>>>>>>>>>>>> 7.898 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Bridge (Client)
> > > > > >>>> ..............................
> > > > > >>>>>>> .
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 12.242 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime Standalone
> > > > > >>>>>>> ............................
> > > > > >>>>>>>>>>> SUCCESS
> > > > > >>>>>>>>>>>> [
> > > > > >>>>>>>>>>>>>>>> 7.779 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for Mesos
> > > > > >>>>>>> .............................
> > > > > >>>>>>>>>>> SUCCESS
> > > > > >>>>>>>>>>>> [
> > > > > >>>>>>>>>>>>>>>> 11.103 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Poison ..............................
> > > > > >>>>>>> ..........
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 5.384 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Examples
> ..............................
> > > > > >>>>>>> ........
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 14.313 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Examples CLR
> > > > > >>> ..............................
> > > > > >>>>>>> ....
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 7.532 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Examples on HDInsight
> > > > > >>>>>>> .........................
> > > > > >>>>>>>>>>> SUCCESS
> > > > > >>>>>>>>>>>> [
> > > > > >>>>>>>>>>>>>>>> 9.213 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Tang Tint
> ..............................
> > > > > >>>>>>> .......
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 8.546 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Tests ..............................
> > > > > >>>>>>> ...........
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 15.696 s]
> > > > > >>>>>>>>>>>>>>>> [INFO] REEF Website ..............................
> > > > > >>>>>>> .........
> > > > > >>>>>>>>>>>> SUCCESS [
> > > > > >>>>>>>>>>>>>>>> 1.033 s]
> > > > > >>>>>>>>>>>>>>>> [INFO]
> > > > > >>>>>>>>>>>>>>>> ------------------------------
> > > > > >>>>>>> ------------------------------
> > > > > >>>>>>>>>>>>>> ------------
> > > > > >>>>>>>>>>>>>>>> [INFO] BUILD SUCCESS
> > > > > >>>>>>>>>>>>>>>> [INFO]
> > > > > >>>>>>>>>>>>>>>> ------------------------------
> > > > > >>>>>>> ------------------------------
> > > > > >>>>>>>>>>>>>> ------------
> > > > > >>>>>>>>>>>>>>>> [INFO] Total time: 04:54 min
> > > > > >>>>>>>>>>>>>>>> [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > > > > >>>>>>>>>>>>>>>> [INFO] Final Memory: 125M/1238M
> > > > > >>>>>>>>>>>>>>>> [INFO]
> > > > > >>>>>>>>>>>>>>>> ------------------------------
> > > > > >>>>>>> ------------------------------
> > > > > >>>>>>>>>>>>>> ------------
> > > > > >>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>> On to bigger and better things :), we should
> > > > > >> probably
> > > > > >>>>>>> update
> > > > > >>>>>>>>>> the
> > > > > >>>>>>>>>>>> docs
> > > > > >>>>>>>>>>>>>> to
> > > > > >>>>>>>>>>>>>>>> reflect the current build process subtleties.
> Will
> > > > > >>> try
> > > > > >>>>>>>>>> windows
> > > > > >>>>>>>>>>>> next.
> > > > > >>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> > > > > >>>>>>>>>> bgchun@gmail.com
> > > > > >>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>> wrote:
> > > > > >>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>> Welcome, Saikat!
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> > > > > >>>>>>>>>> markus@weimo.de>
> > > > > >>>>>>>>>>>>>> wrote:
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>>> On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > > > > >>>>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>>> I am a newbie to Apache Reef and am interested
> > > > > >> in
> > > > > >>>>>>>>>>> contributing
> > > > > >>>>>>>>>>>> to
> > > > > >>>>>>>>>>>>>>> the
> > > > > >>>>>>>>>>>>>>>>> reef
> > > > > >>>>>>>>>>>>>>>>>>> dev efforts
> > > > > >>>>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>> Welcome!
> > > > > >>>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>> my JIRA id is kanjilal
> > > > > >>>>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>> I have added you to the contributor's list on
> > > > > >>> JIRA.
> > > > > >>>>>>> This
> > > > > >>>>>>>>>>>> basically
> > > > > >>>>>>>>>>>>>>>> means
> > > > > >>>>>>>>>>>>>>>>>> that you can self-assign issues to yourself now
> > > > > >> :)
> > > > > >>>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>> Markus
> > > > > >>>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>> --
> > > > > >>>>>>>>>>>>>>>>> Byung-Gon Chun
> > > > > >>>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>>
> > > > > >>>>>>>>>>>>
> > > > > >>>>>>>>>>>
> > > > > >>>>>>>>>>
> > > > > >>>>>>>>>
> > > > > >>>>>>>>>
> > > > > >>>>>>>>
> > > > > >>>>>>>
> > > > > >>>>>>
> > > > > >>>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>
> > > > >
> > > >
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
I wonder if your other open source projects are using a github webhook to
to trigger the JIRA update?
On Mon, Feb 13, 2017 at 9:39 AM, Saikat Kanjilal <sx...@gmail.com> wrote:
> @Doug, In the other open source projects that I'm involved in, the comment
> gets autogenerated into the JIRA ticket once the pull request gets sent
> across, is there a way to replicate that automation here?
>
>
> @Reef Dev Folks could you all look at this pull request when you get a
> chance and let me know all the different versions of operating systems that
> have been tested with the current reef build.
>
> Thanks in advance.
>
>
>
> On Fri, Feb 10, 2017 at 6:30 PM, Douglas Service <ds...@gmail.com>
> wrote:
>
> > As per the developer documentation you should add a comment to the JIRA
> > which gives a link to the pull request on github which triggers an email
> to
> > the dev list so eveyone knows to take a look. I added the following
> comment
> > to the JIRA.
> >
> > Pull request is available at
> > https://github.com/apache/reef/pull/1253#pullrequestreview-21376209.
> >
> >
> > On Fri, Feb 10, 2017 at 5:22 PM, Saikat Kanjilal <sx...@gmail.com>
> > wrote:
> >
> > > Pull request submitted :)))).
> > > Thanks for all the help, will focus on getting windows build
> operational.
> > >
> > > On Fri, Feb 10, 2017 at 5:06 PM, Saikat Kanjilal <sx...@gmail.com>
> > > wrote:
> > >
> > > > Sure I can try that and that should work, on another note should we
> > > update
> > > > the documentation to not say HEAD, I was mimicking the docs to the
> tee.
> > > > Will let you know results.
> > > >
> > > > Sent from my iPhone
> > > >
> > > > > On Feb 10, 2017, at 4:48 PM, Douglas Service <ds...@gmail.com>
> > > wrote:
> > > > >
> > > > > You should have a branched named REEF-1739 on your dev machine
> where
> > > your
> > > > > changes are located. Would you please try
> > > > >
> > > > > git push origin REEF-1739
> > > > >
> > > > >> On Fri, Feb 10, 2017 at 4:39 PM, Saikat Kanjilal <
> sxk1969@gmail.com
> > >
> > > > wrote:
> > > > >>
> > > > >> ok so I fixed the problem of pointing to the wrong repo, namely I
> am
> > > now
> > > > >> pointing to my repo for reef, here's what I see now:
> > > > >>
> > > > >> saikan@ubuntureef:~/code/localdevreef$ git push origin HEAD
> > > > >> Username for 'https://github.com': skanjila
> > > > >> Password for 'https://skanjila@github.com':
> > > > >> error: unable to push to unqualified destination: HEAD
> > > > >> The destination refspec neither matches an existing ref on the
> > remote
> > > > nor
> > > > >> begins with refs/, and we are unable to guess a prefix based on
> the
> > > > source
> > > > >> ref.
> > > > >> error: failed to push some refs to 'https://github.com/skanjila/
> > > > reef.git'
> > > > >>
> > > > >> Here's what git remote -v yields:
> > > > >> saikan@ubuntureef:~/code/localdevreef$ git remote -v
> > > > >> origin https://github.com/skanjila/reef.git (fetch)
> > > > >> origin https://github.com/skanjila/reef.git (push)
> > > > >> upstream https://github.com/apache/reef.git (fetch)
> > > > >> upstream https://github.com/apache/reef.git (push)
> > > > >>
> > > > >>
> > > > >> My github alias is skanjila
> > > > >>
> > > > >>
> > > > >> Here's what git status gives:
> > > > >> saikan@ubuntureef:~/code/localdevreef$ git status
> > > > >> interactive rebase in progress; onto e554dd3
> > > > >> fatal: Could not open file .git/rebase-merge/done for reading: No
> > such
> > > > file
> > > > >> or directory
> > > > >>
> > > > >>
> > > > >>
> > > > >> Thoughts?
> > > > >>
> > > > >>
> > > > >>> On Fri, Feb 10, 2017 at 2:38 PM, Markus Weimer <ma...@weimo.de>
> > > > wrote:
> > > > >>>
> > > > >>> Hi,
> > > > >>>
> > > > >>> if `origin` refers to the apache/reef repositiory on GitHub OR
> the
> > > > >>> repository on apache.org, you won't be able to push, as those
> > repos
> > > > are
> > > > >>> read-only for you. Instead, you need to push to your own fork of
> > REEF
> > > > on
> > > > >>> GitHub and then file a PR from that branch to apache/reef from
> > there.
> > > > >>>
> > > > >>> Markus
> > > > >>>
> > > > >>> On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <
> > dsopsrc@gmail.com>
> > > > >>> wrote:
> > > > >>>
> > > > >>>> also what is your GitHub alias?
> > > > >>>>
> > > > >>>> On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <
> > dsopsrc@gmail.com
> > > >
> > > > >>>> wrote:
> > > > >>>>
> > > > >>>>> and git status from the REEF root directory.
> > > > >>>>>
> > > > >>>>> On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <
> > > dsopsrc@gmail.com>
> > > > >>>>> wrote:
> > > > >>>>>
> > > > >>>>>> Would you please send the output of git remote -v?
> > > > >>>>>>
> > > > >>>>>> Doug
> > > > >>>>>>
> > > > >>>>>> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <
> > > sxk1969@gmail.com
> > > > >>>
> > > > >>>>>> wrote:
> > > > >>>>>>
> > > > >>>>>>> Folks,
> > > > >>>>>>> I am trying to create/deploy my first pull request, I've gone
> > > > >> through
> > > > >>>> all
> > > > >>>>>>> of these steps successfully here:
> > > > >>>>>>> https://cwiki.apache.org/confluence/display/REEF/Contributin
> > > > >>>>>>> g#Contributing-1.Forkrepository
> > > > >>>>>>> but I seem to be running into 403 errors when I do a git push
> > > > >> origin
> > > > >>>>>>> HEAD,
> > > > >>>>>>> here are my creds, would really appreciate some help:
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> > > > >>>>>>> github username: skanjila
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>> Please let me know what I am missing here, note that my id in
> > > JIRA
> > > > >> is
> > > > >>>>>>> kanjilal but my github userid is skanjila, might this be a
> > > problem?
> > > > >>>>>>>
> > > > >>>>>>> Thanks in advance.
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <
> > > sxk1969@gmail.com
> > > > >>>
> > > > >>>>>>> wrote:
> > > > >>>>>>>
> > > > >>>>>>>> Well interesting piece of metadata, time for successfully
> > > > >>> completing
> > > > >>>>>>>> windows server 2016 build was about half the time for linux,
> > at
> > > > >>> least
> > > > >>>>>>> for
> > > > >>>>>>>> the java build, will try csharp next
> > > > >>>>>>>>
> > > > >>>>>>>> Here's what I did:
> > > > >>>>>>>> 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> > > > >>>>>>>> 2) mvn clean install -DskipTests=true
> > > > >>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>> For posterity's sake I will go back and redo my ubuntu linux
> > > > >> build
> > > > >>>> and
> > > > >>>>>>>> then work on the JIRA-1739 to make sure the documentation is
> > up
> > > > >> to
> > > > >>>>>>> date as
> > > > >>>>>>>> needed. I will install java from the repositories this
> time.
> > > > >>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>> On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <
> > > > >> sxk1969@gmail.com
> > > > >>>>
> > > > >>>>>>> wrote:
> > > > >>>>>>>>
> > > > >>>>>>>>> Yes I have gone through that in the past, not sure why I
> > > decided
> > > > >>> not
> > > > >>>>>>> to
> > > > >>>>>>>>> include that repo and just download the jdk and put it in
> > > > >> instead
> > > > >>>> :),
> > > > >>>>>>>>> regardless I will send a pull request for the build cleanup
> > in
> > > > >> the
> > > > >>>>>>> next few
> > > > >>>>>>>>> days, lets iterate on it as a team and test drive it to
> prove
> > > it
> > > > >>>>>>> wrong or
> > > > >>>>>>>>> right
> > > > >>>>>>>>>
> > > > >>>>>>>>> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <
> > > > >>> dsopsrc@gmail.com>
> > > > >>>>>>>>> wrote:
> > > > >>>>>>>>>
> > > > >>>>>>>>>> After thinking about all of the changes you had make and
> the
> > > > >> fact
> > > > >>>>>>> that
> > > > >>>>>>>>>> oracle java does not show up in update-alternatives, you
> may
> > > > >> want
> > > > >>>> to
> > > > >>>>>>> look
> > > > >>>>>>>>>> at these instructions which tell how to install oracle
> java
> > > via
> > > > >>>>>>> apt-get
> > > > >>>>>>>>>> repository which automatically takes care of a lot of the
> > > > >> issues
> > > > >>>> you
> > > > >>>>>>> ran
> > > > >>>>>>>>>> into
> > > > >>>>>>>>>> https://www.digitalocean.com/community/tutorials/how-to-
> > inst
> > > > >>>>>>>>>> all-java-on-ubuntu-with-apt-get
> > > > >>>>>>>>>> .
> > > > >>>>>>>>>>
> > > > >>>>>>>>>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
> > > > >>>> sxk1969@gmail.com>
> > > > >>>>>>>>>> wrote:
> > > > >>>>>>>>>>
> > > > >>>>>>>>>>> I think part of the difference is the way both of us
> > > > >> installed
> > > > >>>>>>> java, my
> > > > >>>>>>>>>>> setup is using the oracle java as opposed to the open-jdk
> > > > >> java
> > > > >>>>>>>>>> provided by
> > > > >>>>>>>>>>> update-alternatives, I agree with your instructions
> > > > >> assessment.
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>> On another note I have a question, how did folks install
> > > > >> protoc
> > > > >>>> on
> > > > >>>>>>>>>> windows,
> > > > >>>>>>>>>>> in looking at the wiki it points you to the protoc site
> > where
> > > > >>> it
> > > > >>>>>>> seems
> > > > >>>>>>>>>> to
> > > > >>>>>>>>>>> need a whole bunch of supporting tools (cmake/mingw
> etc), I
> > > > >> am
> > > > >>>>>>> using
> > > > >>>>>>>>>>> gitbash on windows and was wondering if there's an easy
> way
> > > > >> to
> > > > >>>>>>>>>> download the
> > > > >>>>>>>>>>> protoc binaries and set the path, please forgive me if
> this
> > > > >> is
> > > > >>> in
> > > > >>>>>>> the
> > > > >>>>>>>>>>> documentation somewhere, still learning my way around.
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
> > > > >>>>>>> dsopsrc@gmail.com>
> > > > >>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>> What I mean is that we should provide instructions to
> > setup
> > > > >>> the
> > > > >>>>>>> least
> > > > >>>>>>>>>>>> complicated build environment that works, not one that
> is
> > > > >>> more
> > > > >>>>>>>>>>> complicated
> > > > >>>>>>>>>>>> but also works.
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>> On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> > > > >>>>>>> dsopsrc@gmail.com>
> > > > >>>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>>> Do you have update-alternatives installed? Have you run
> > > > >>>>>>>>>>>>> update-alternatives --config java?
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>> Sorry I made a mistake in may last email, I actually
> have
> > > > >>>>>>>>>> JAVA_HOME set
> > > > >>>>>>>>>>>> to
> > > > >>>>>>>>>>>>> /usr as listed on the webpage which figured out from
> > > > >>> Sergiy.
> > > > >>>>>>>>>> However, I
> > > > >>>>>>>>>>>> do
> > > > >>>>>>>>>>>>> not need to set the other ones. It is important that
> our
> > > > >>>>>>>>>> contributing
> > > > >>>>>>>>>>> to
> > > > >>>>>>>>>>>>> REEF wiki be general and not specific to a single
> setup.
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>> Here is my environment for building REEF on Ubuntu
> 16.04.
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>> dougse@reefdevlx:/code/reef [master ↑]$$ env
> > > > >>>>>>>>>>>>> MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > > > >>>>>>>>>>>>> XDG_SESSION_ID=c2
> > > > >>>>>>>>>>>>> SHELL=/bin/bash
> > > > >>>>>>>>>>>>> TERM=xterm
> > > > >>>>>>>>>>>>> WINDOWID=44144243
> > > > >>>>>>>>>>>>> USER=dougse
> > > > >>>>>>>>>>>>> LS_COLORS=rs=0:di=01;34:ln=01;
> > > > >>> 36:mh=00:pi=40;33:so=01;35:do=
> > > > >>>>>>>>>>>>> 01;35:bd=40;33;01:cd=40;33;01:
> > > > >>> or=40;31;01:mi=00:su=37;41:sg=
> > > > >>>>>>>>>>>>> 30;43:ca=30;41:tw=30;42:ow=34;
> > > > >>> 42:st=37;44:ex=01;32:*.tar=01;
> > > > >>>>>>>>>>>>> 31:*.tgz=01;31:*.arc=01;31:*.
> > > > >> arj=01;31:*.taz=01;31:*.lha=
> > > > >>>>>>>>>>>>> 01;31:*.lz4=01;31:*.lzh=01;31:
> > > > >> *.lzma=01;31:*.tlz=01;31:*.
> > > > >>>>>>>>>>>>> txz=01;31:*.tzo=01;31:*.t7z=
> > > > >> 01;31:*.zip=01;31:*.z=01;31:*.
> > > > >>>>>>>>>>>>> Z=01;31:*.dz=01;31:*.gz=01;31:
> > > > >>> *.lrz=01;31:*.lz=01;31:*.lzo=
> > > > >>>>>>>>>>>>> 01;31:*.xz=01;31:*.bz2=01;31:*
> > > > >>> .bz=01;31:*.tbz=01;31:*.tbz2=
> > > > >>>>>>>>>>>>> 01;31:*.tz=01;31:*.deb=01;31:*
> > > > >>> .rpm=01;31:*.jar=01;31:*.war=
> > > > >>>>>>>>>>>>> 01;31:*.ear=01;31:*.sar=01;31:
> > > > >>> *.rar=01;31:*.alz=01;31:*.ace=
> > > > >>>>>>>>>>>>> 01;31:*.zoo=01;31:*.cpio=01;
> 31:*.7z=01;31:*.rz=01;31:*.
> > > > >>>>>>>>>>>>> cab=01;31:*.jpg=01;35:*.jpeg=
> > > > >>> 01;35:*.gif=01;35:*.bmp=01;35:
> > > > >>>>>>>>>>>>> *.pbm=01;35:*.pgm=01;35:*.ppm=
> > > > >>> 01;35:*.tga=01;35:*.xbm=01;35:
> > > > >>>>>>>>>>>>> *.xpm=01;35:*.tif=01;35:*.
> tiff=01;35:*.png=01;35:*.svg=
> > > > >>>>>>>>>>>>> 01;35:*.svgz=01;35:*.mng=01;
> > > > >> 35:*.pcx=01;35:*.mov=01;35:*.
> > > > >>>>>>>>>>>>> mpg=01;35:*.mpeg=01;35:*.m2v=
> > > > >> 01;35:*.mkv=01;35:*.webm=01;
> > > > >>>>>>>>>>>>> 35:*.ogm=01;35:*.mp4=01;35:*.
> > > > >> m4v=01;35:*.mp4v=01;35:*.vob=
> > > > >>>>>>>>>>>>> 01;35:*.qt=01;35:*.nuv=01;35:*
> > > > >> .wmv=01;35:*.asf=01;35:*.rm=
> > > > >>>>>>>>>>>>> 01;35:*.rmvb=01;35:*.flc=01;
> > > > >> 35:*.avi=01;35:*.fli=01;35:*.
> > > > >>>>>>>>>>>>> flv=01;35:*.gl=01;35:*.dl=01;
> > > > >> 35:*.xcf=01;35:*.xwd=01;35:*.
> > > > >>>>>>>>>>>>> yuv=01;35:*.cgm=01;35:*.emf=
> > > > >> 01;35:*.ogv=01;35:*.ogx=01;35:
> > > > >>>>>>>>>>>>> *.aac=00;36:*.au=00;36:*.flac=
> > > > >>> 00;36:*.m4a=00;36:*.mid=00;36:
> > > > >>>>>>>>>>>>> *.midi=00;36:*.mka=00;36:*.
> mp3=00;36:*.mpc=00;36:*.ogg=
> > > > >>>>>>>>>>>>> 00;36:*.ra=00;36:*.wav=00;36:*
> > > > >>> .oga=00;36:*.opus=00;36:*.spx=
> > > > >>>>>>>>>>>>> 00;36:*.xspf=00;36:
> > > > >>>>>>>>>>>>> SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > > > >>>>>>>>>>>>> SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > > > >>>>>>>>>>>>> 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > > > >>>>>>>>>>>>> PATH=/home/dougse/bin:/bin:/
> usr/bin:/usr/X11R6/bin:/usr/
> > > > >>> loca
> > > > >>>>>>> l/bin
> > > > >>>>>>>>>>>>> PWD=/code/reef
> > > > >>>>>>>>>>>>> JAVA_HOME=/usr
> > > > >>>>>>>>>>>>> LANG=en_US.UTF-8
> > > > >>>>>>>>>>>>> REEF_HOME=/code/reef
> > > > >>>>>>>>>>>>> SHLVL=1
> > > > >>>>>>>>>>>>> HOME=/home/dougse
> > > > >>>>>>>>>>>>> GTK_OVERLAY_SCROLLING=0
> > > > >>>>>>>>>>>>> DBUS_SESSION_BUS_ADDRESS=unix:
> > > > >>> abstract=/tmp/dbus-l06bsMWGy0,
> > > > >>>>>>> guid=
> > > > >>>>>>>>>>>>> ae74bbce18102091c11c7bd458939d1c
> > > > >>>>>>>>>>>>> UID=1000
> > > > >>>>>>>>>>>>> LESSOPEN=| /bin/lesspipe %s
> > > > >>>>>>>>>>>>> XDG_RUNTIME_DIR=/run/user/1000
> > > > >>>>>>>>>>>>> DISPLAY=:10.0
> > > > >>>>>>>>>>>>> XDG_CURRENT_DESKTOP=MATE
> > > > >>>>>>>>>>>>> LESSCLOSE=/bin/lesspipe %s %s
> > > > >>>>>>>>>>>>> COLORTERM=mate-terminal
> > > > >>>>>>>>>>>>> _=/usr/bin/env
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>> On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> > > > >>>>>>> sxk1969@gmail.com
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>> Weird, yes I did read that pageand yes I had to do
> those
> > > > >>>> exact
> > > > >>>>>>>>>> steps
> > > > >>>>>>>>>>>> that
> > > > >>>>>>>>>>>>>> I
> > > > >>>>>>>>>>>>>> described, I haven't run the tests yet but fully
> suspect
> > > > >>>> that
> > > > >>>>>>> I'll
> > > > >>>>>>>>>>> need
> > > > >>>>>>>>>>>> to
> > > > >>>>>>>>>>>>>> increase the ulimit to enable that. If you do a plain
> > > > >>> maven
> > > > >>>>>>> build
> > > > >>>>>>>>>>> after
> > > > >>>>>>>>>>>>>> checking out the reef code in ubuntu it complains that
> > > > >>>>>>> JAVA_HOME
> > > > >>>>>>>>>> is
> > > > >>>>>>>>>>> not
> > > > >>>>>>>>>>>>>> set, also its a good idea to set the maven oriented
> > > > >>>>>>> environment
> > > > >>>>>>>>>>>> variables
> > > > >>>>>>>>>>>>>> because I highly suspect that in the future we may
> need
> > > > >> to
> > > > >>>>>>> adjust
> > > > >>>>>>>>>> heap
> > > > >>>>>>>>>>>>>> space settings, finally the LD_LIBRARY_PATH is needed
> I
> > > > >>>>>>> suspect
> > > > >>>>>>>>>>> because
> > > > >>>>>>>>>>>>>> the
> > > > >>>>>>>>>>>>>> java code is invoking the protoc compiler at some
> point
> > > > >>> and
> > > > >>>> in
> > > > >>>>>>>>>> order
> > > > >>>>>>>>>>> to
> > > > >>>>>>>>>>>> do
> > > > >>>>>>>>>>>>>> so it much load some .so files that live in
> > > > >>> LD_LIBRARY_PATH.
> > > > >>>>>>> Net
> > > > >>>>>>>>>> Net
> > > > >>>>>>>>>>> we
> > > > >>>>>>>>>>>>>> should definitely figure out the differences between
> > > > >> your
> > > > >>>> and
> > > > >>>>>>>>>> Sergei's
> > > > >>>>>>>>>>>>>> setup and mine, I believe IIRC I used ubuntu 16.10 but
> > > > >> I'm
> > > > >>>> not
> > > > >>>>>>>>>>> convinced
> > > > >>>>>>>>>>>>>> that the version matters if the major version is the
> > > > >> same.
> > > > >>>>>>>>>>>>>> Cheers
> > > > >>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> > > > >>>>>>>>>> dsopsrc@gmail.com>
> > > > >>>>>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>> Hello Saikat,
> > > > >>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>> Did you read the documentation on this page
> > > > >>>>>>>>>>>>>>> https://cwiki.apache.org/
> > > > >> confluence/display/REEF/Linux
> > > > >>> on
> > > > >>>>>>> the
> > > > >>>>>>>>>> REEF
> > > > >>>>>>>>>>>> wiki
> > > > >>>>>>>>>>>>>>> concerning Java on Ubuntu? I added this page after
> > > > >>> setting
> > > > >>>>>>> up a
> > > > >>>>>>>>>>> Linux
> > > > >>>>>>>>>>>>>> 16.04
> > > > >>>>>>>>>>>>>>> to build REEF and trading emails with Sergiy on the
> > > > >> dev
> > > > >>>>>>> list.
> > > > >>>>>>>>>> Note
> > > > >>>>>>>>>>>>>> that I
> > > > >>>>>>>>>>>>>>> do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH.
> > > > >> However,
> > > > >>>>>>> you do
> > > > >>>>>>>>>> need
> > > > >>>>>>>>>>>> to
> > > > >>>>>>>>>>>>>>> change the default for ulimit -n in bash to get the
> > > > >>> tests
> > > > >>>>>>> to run
> > > > >>>>>>>>>>> which
> > > > >>>>>>>>>>>>>> is
> > > > >>>>>>>>>>>>>>> also described.
> > > > >>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>> Doug
> > > > >>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> > > > >>>>>>>>>> sxk1969@gmail.com>
> > > > >>>>>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>> A battle well fought and won, got reef to build
> > > > >>>>>>> successfully
> > > > >>>>>>>>>> on
> > > > >>>>>>>>>>>> ubuntu
> > > > >>>>>>>>>>>>>>>> linux vm after hours of hacking, fyi here's what I
> > > > >> had
> > > > >>>> to
> > > > >>>>>>> do:
> > > > >>>>>>>>>>>>>>>> 1) installed the necessary tools (jdk 1.7/maven
> > > > >>>>>>> 3.3.9/protoc
> > > > >>>>>>>>>>> version
> > > > >>>>>>>>>>>>>> 2.5)
> > > > >>>>>>>>>>>>>>>> 2) added JAVA_HOME and M2_HOME
> > > > >>>>>>>>>>>>>>>> 3) here's the kicker that's not in the documentation
> > > > >>> :)
> > > > >>>> (
> > > > >>>>>>>>>>>>>>>> https://github.com/apache/reef
> > > > >>>>>>> /blob/master/lang/java/BUILD.md
> > > > >>>>>>>>>> ),
> > > > >>>>>>>>>>> had
> > > > >>>>>>>>>>>>>> to
> > > > >>>>>>>>>>>>>>> add
> > > > >>>>>>>>>>>>>>>> LD_LIBRARY_PATH environment variable and have it
> > > > >> point
> > > > >>>> to
> > > > >>>>>>>>>>>>>> /usr/local/lib
> > > > >>>>>>>>>>>>>>>> where the shared library for protobuf is installed
> > > > >>>>>>>>>>>>>>>> 4) had to add JAVA_HOME and M2_HOME to path (also
> > > > >> not
> > > > >>> in
> > > > >>>>>>> the
> > > > >>>>>>>>>>>>>>> documentation
> > > > >>>>>>>>>>>>>>>> :) )
> > > > >>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>> [INFO]
> > > > >>>>>>>>>>>>>>>> ------------------------------
> > > > >>>>>>> ------------------------------
> > > > >>>>>>>>>>>>>> ------------
> > > > >>>>>>>>>>>>>>>> [INFO] Reactor Summary:
> > > > >>>>>>>>>>>>>>>> [INFO]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF ..............................
> > > > >>>>>>> .................
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 4.167 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Dot Net ..............................
> > > > >>>>>>> .........
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 1.628 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Annotations
> > > > >> ..............................
> > > > >>>>>>> .....
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 5.509 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Utils ..............................
> > > > >>>>>>> ...........
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 5.747 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Tang Project
> > > > >>> ..............................
> > > > >>>>>>> ....
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 0.492 s]
> > > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar A
> > > > >> ..............................
> > > > >>>>>>> ......
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 4.276 s]
> > > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B
> > > > >> ..............................
> > > > >>>>>>> ......
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 4.186 s]
> > > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar AB
> > > > >> ..............................
> > > > >>>>>>> .....
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 4.376 s]
> > > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B conflict A
> > > > >>>>>>> .........................
> > > > >>>>>>>>>>> SUCCESS
> > > > >>>>>>>>>>>> [
> > > > >>>>>>>>>>>>>>>> 0.440 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Tang ..............................
> > > > >>>>>>> ............
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 24.779 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Wake Project
> > > > >>> ..............................
> > > > >>>>>>> ....
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 0.487 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Wake ..............................
> > > > >>>>>>> ............
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 15.587 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Common ..............................
> > > > >>>>>>> ..........
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 23.343 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime Local
> > > > >>> ..............................
> > > > >>>>>>> ...
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 8.375 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Applications
> > > > >>> ..............................
> > > > >>>>>>> ....
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 0.416 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Vortex ..............................
> > > > >>>>>>> ..........
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 11.263 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF HTTP Server
> > > > >> ..............................
> > > > >>>>>>> .....
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 9.772 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Utils for Hadoop
> > > > >>>>>>> ..............................
> > > > >>>>>>>>>>> SUCCESS
> > > > >>>>>>>>>>>> [
> > > > >>>>>>>>>>>>>>>> 5.881 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for YARN
> > > > >>>>>>> ..............................
> > > > >>>>>>>>>>> SUCCESS
> > > > >>>>>>>>>>>> [
> > > > >>>>>>>>>>>>>>>> 11.041 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for HDInsight
> > > > >>>>>>> .........................
> > > > >>>>>>>>>>> SUCCESS
> > > > >>>>>>>>>>>> [
> > > > >>>>>>>>>>>>>>>> 9.719 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF IO ..............................
> > > > >>>>>>> ..............
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 23.729 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Checkpoint
> > > > >> ..............................
> > > > >>>>>>> ......
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 5.771 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Bridge Java
> > > > >> ..............................
> > > > >>>>>>> .....
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 11.981 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for multiple runtime scenarios
> > > > >>>>>>> ........
> > > > >>>>>>>>>>> SUCCESS
> > > > >>>>>>>>>>>> [
> > > > >>>>>>>>>>>>>>>> 7.898 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Bridge (Client)
> > > > >>>> ..............................
> > > > >>>>>>> .
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 12.242 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime Standalone
> > > > >>>>>>> ............................
> > > > >>>>>>>>>>> SUCCESS
> > > > >>>>>>>>>>>> [
> > > > >>>>>>>>>>>>>>>> 7.779 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for Mesos
> > > > >>>>>>> .............................
> > > > >>>>>>>>>>> SUCCESS
> > > > >>>>>>>>>>>> [
> > > > >>>>>>>>>>>>>>>> 11.103 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Poison ..............................
> > > > >>>>>>> ..........
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 5.384 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Examples ..............................
> > > > >>>>>>> ........
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 14.313 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Examples CLR
> > > > >>> ..............................
> > > > >>>>>>> ....
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 7.532 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Examples on HDInsight
> > > > >>>>>>> .........................
> > > > >>>>>>>>>>> SUCCESS
> > > > >>>>>>>>>>>> [
> > > > >>>>>>>>>>>>>>>> 9.213 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Tang Tint ..............................
> > > > >>>>>>> .......
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 8.546 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Tests ..............................
> > > > >>>>>>> ...........
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 15.696 s]
> > > > >>>>>>>>>>>>>>>> [INFO] REEF Website ..............................
> > > > >>>>>>> .........
> > > > >>>>>>>>>>>> SUCCESS [
> > > > >>>>>>>>>>>>>>>> 1.033 s]
> > > > >>>>>>>>>>>>>>>> [INFO]
> > > > >>>>>>>>>>>>>>>> ------------------------------
> > > > >>>>>>> ------------------------------
> > > > >>>>>>>>>>>>>> ------------
> > > > >>>>>>>>>>>>>>>> [INFO] BUILD SUCCESS
> > > > >>>>>>>>>>>>>>>> [INFO]
> > > > >>>>>>>>>>>>>>>> ------------------------------
> > > > >>>>>>> ------------------------------
> > > > >>>>>>>>>>>>>> ------------
> > > > >>>>>>>>>>>>>>>> [INFO] Total time: 04:54 min
> > > > >>>>>>>>>>>>>>>> [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > > > >>>>>>>>>>>>>>>> [INFO] Final Memory: 125M/1238M
> > > > >>>>>>>>>>>>>>>> [INFO]
> > > > >>>>>>>>>>>>>>>> ------------------------------
> > > > >>>>>>> ------------------------------
> > > > >>>>>>>>>>>>>> ------------
> > > > >>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>> On to bigger and better things :), we should
> > > > >> probably
> > > > >>>>>>> update
> > > > >>>>>>>>>> the
> > > > >>>>>>>>>>>> docs
> > > > >>>>>>>>>>>>>> to
> > > > >>>>>>>>>>>>>>>> reflect the current build process subtleties. Will
> > > > >>> try
> > > > >>>>>>>>>> windows
> > > > >>>>>>>>>>>> next.
> > > > >>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> > > > >>>>>>>>>> bgchun@gmail.com
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>> Welcome, Saikat!
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> > > > >>>>>>>>>> markus@weimo.de>
> > > > >>>>>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>>> On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > > > >>>>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>>> I am a newbie to Apache Reef and am interested
> > > > >> in
> > > > >>>>>>>>>>> contributing
> > > > >>>>>>>>>>>> to
> > > > >>>>>>>>>>>>>>> the
> > > > >>>>>>>>>>>>>>>>> reef
> > > > >>>>>>>>>>>>>>>>>>> dev efforts
> > > > >>>>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>> Welcome!
> > > > >>>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>> my JIRA id is kanjilal
> > > > >>>>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>> I have added you to the contributor's list on
> > > > >>> JIRA.
> > > > >>>>>>> This
> > > > >>>>>>>>>>>> basically
> > > > >>>>>>>>>>>>>>>> means
> > > > >>>>>>>>>>>>>>>>>> that you can self-assign issues to yourself now
> > > > >> :)
> > > > >>>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>> Markus
> > > > >>>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>> --
> > > > >>>>>>>>>>>>>>>>> Byung-Gon Chun
> > > > >>>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>
> > > > >>>>>>>>>
> > > > >>>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>
> > > > >>>>>>
> > > > >>>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
@Doug, In the other open source projects that I'm involved in, the comment
gets autogenerated into the JIRA ticket once the pull request gets sent
across, is there a way to replicate that automation here?
@Reef Dev Folks could you all look at this pull request when you get a
chance and let me know all the different versions of operating systems that
have been tested with the current reef build.
Thanks in advance.
On Fri, Feb 10, 2017 at 6:30 PM, Douglas Service <ds...@gmail.com> wrote:
> As per the developer documentation you should add a comment to the JIRA
> which gives a link to the pull request on github which triggers an email to
> the dev list so eveyone knows to take a look. I added the following comment
> to the JIRA.
>
> Pull request is available at
> https://github.com/apache/reef/pull/1253#pullrequestreview-21376209.
>
>
> On Fri, Feb 10, 2017 at 5:22 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
>
> > Pull request submitted :)))).
> > Thanks for all the help, will focus on getting windows build operational.
> >
> > On Fri, Feb 10, 2017 at 5:06 PM, Saikat Kanjilal <sx...@gmail.com>
> > wrote:
> >
> > > Sure I can try that and that should work, on another note should we
> > update
> > > the documentation to not say HEAD, I was mimicking the docs to the tee.
> > > Will let you know results.
> > >
> > > Sent from my iPhone
> > >
> > > > On Feb 10, 2017, at 4:48 PM, Douglas Service <ds...@gmail.com>
> > wrote:
> > > >
> > > > You should have a branched named REEF-1739 on your dev machine where
> > your
> > > > changes are located. Would you please try
> > > >
> > > > git push origin REEF-1739
> > > >
> > > >> On Fri, Feb 10, 2017 at 4:39 PM, Saikat Kanjilal <sxk1969@gmail.com
> >
> > > wrote:
> > > >>
> > > >> ok so I fixed the problem of pointing to the wrong repo, namely I am
> > now
> > > >> pointing to my repo for reef, here's what I see now:
> > > >>
> > > >> saikan@ubuntureef:~/code/localdevreef$ git push origin HEAD
> > > >> Username for 'https://github.com': skanjila
> > > >> Password for 'https://skanjila@github.com':
> > > >> error: unable to push to unqualified destination: HEAD
> > > >> The destination refspec neither matches an existing ref on the
> remote
> > > nor
> > > >> begins with refs/, and we are unable to guess a prefix based on the
> > > source
> > > >> ref.
> > > >> error: failed to push some refs to 'https://github.com/skanjila/
> > > reef.git'
> > > >>
> > > >> Here's what git remote -v yields:
> > > >> saikan@ubuntureef:~/code/localdevreef$ git remote -v
> > > >> origin https://github.com/skanjila/reef.git (fetch)
> > > >> origin https://github.com/skanjila/reef.git (push)
> > > >> upstream https://github.com/apache/reef.git (fetch)
> > > >> upstream https://github.com/apache/reef.git (push)
> > > >>
> > > >>
> > > >> My github alias is skanjila
> > > >>
> > > >>
> > > >> Here's what git status gives:
> > > >> saikan@ubuntureef:~/code/localdevreef$ git status
> > > >> interactive rebase in progress; onto e554dd3
> > > >> fatal: Could not open file .git/rebase-merge/done for reading: No
> such
> > > file
> > > >> or directory
> > > >>
> > > >>
> > > >>
> > > >> Thoughts?
> > > >>
> > > >>
> > > >>> On Fri, Feb 10, 2017 at 2:38 PM, Markus Weimer <ma...@weimo.de>
> > > wrote:
> > > >>>
> > > >>> Hi,
> > > >>>
> > > >>> if `origin` refers to the apache/reef repositiory on GitHub OR the
> > > >>> repository on apache.org, you won't be able to push, as those
> repos
> > > are
> > > >>> read-only for you. Instead, you need to push to your own fork of
> REEF
> > > on
> > > >>> GitHub and then file a PR from that branch to apache/reef from
> there.
> > > >>>
> > > >>> Markus
> > > >>>
> > > >>> On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <
> dsopsrc@gmail.com>
> > > >>> wrote:
> > > >>>
> > > >>>> also what is your GitHub alias?
> > > >>>>
> > > >>>> On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <
> dsopsrc@gmail.com
> > >
> > > >>>> wrote:
> > > >>>>
> > > >>>>> and git status from the REEF root directory.
> > > >>>>>
> > > >>>>> On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <
> > dsopsrc@gmail.com>
> > > >>>>> wrote:
> > > >>>>>
> > > >>>>>> Would you please send the output of git remote -v?
> > > >>>>>>
> > > >>>>>> Doug
> > > >>>>>>
> > > >>>>>> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <
> > sxk1969@gmail.com
> > > >>>
> > > >>>>>> wrote:
> > > >>>>>>
> > > >>>>>>> Folks,
> > > >>>>>>> I am trying to create/deploy my first pull request, I've gone
> > > >> through
> > > >>>> all
> > > >>>>>>> of these steps successfully here:
> > > >>>>>>> https://cwiki.apache.org/confluence/display/REEF/Contributin
> > > >>>>>>> g#Contributing-1.Forkrepository
> > > >>>>>>> but I seem to be running into 403 errors when I do a git push
> > > >> origin
> > > >>>>>>> HEAD,
> > > >>>>>>> here are my creds, would really appreciate some help:
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> > > >>>>>>> github username: skanjila
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>> Please let me know what I am missing here, note that my id in
> > JIRA
> > > >> is
> > > >>>>>>> kanjilal but my github userid is skanjila, might this be a
> > problem?
> > > >>>>>>>
> > > >>>>>>> Thanks in advance.
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <
> > sxk1969@gmail.com
> > > >>>
> > > >>>>>>> wrote:
> > > >>>>>>>
> > > >>>>>>>> Well interesting piece of metadata, time for successfully
> > > >>> completing
> > > >>>>>>>> windows server 2016 build was about half the time for linux,
> at
> > > >>> least
> > > >>>>>>> for
> > > >>>>>>>> the java build, will try csharp next
> > > >>>>>>>>
> > > >>>>>>>> Here's what I did:
> > > >>>>>>>> 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> > > >>>>>>>> 2) mvn clean install -DskipTests=true
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>> For posterity's sake I will go back and redo my ubuntu linux
> > > >> build
> > > >>>> and
> > > >>>>>>>> then work on the JIRA-1739 to make sure the documentation is
> up
> > > >> to
> > > >>>>>>> date as
> > > >>>>>>>> needed. I will install java from the repositories this time.
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>> On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <
> > > >> sxk1969@gmail.com
> > > >>>>
> > > >>>>>>> wrote:
> > > >>>>>>>>
> > > >>>>>>>>> Yes I have gone through that in the past, not sure why I
> > decided
> > > >>> not
> > > >>>>>>> to
> > > >>>>>>>>> include that repo and just download the jdk and put it in
> > > >> instead
> > > >>>> :),
> > > >>>>>>>>> regardless I will send a pull request for the build cleanup
> in
> > > >> the
> > > >>>>>>> next few
> > > >>>>>>>>> days, lets iterate on it as a team and test drive it to prove
> > it
> > > >>>>>>> wrong or
> > > >>>>>>>>> right
> > > >>>>>>>>>
> > > >>>>>>>>> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <
> > > >>> dsopsrc@gmail.com>
> > > >>>>>>>>> wrote:
> > > >>>>>>>>>
> > > >>>>>>>>>> After thinking about all of the changes you had make and the
> > > >> fact
> > > >>>>>>> that
> > > >>>>>>>>>> oracle java does not show up in update-alternatives, you may
> > > >> want
> > > >>>> to
> > > >>>>>>> look
> > > >>>>>>>>>> at these instructions which tell how to install oracle java
> > via
> > > >>>>>>> apt-get
> > > >>>>>>>>>> repository which automatically takes care of a lot of the
> > > >> issues
> > > >>>> you
> > > >>>>>>> ran
> > > >>>>>>>>>> into
> > > >>>>>>>>>> https://www.digitalocean.com/community/tutorials/how-to-
> inst
> > > >>>>>>>>>> all-java-on-ubuntu-with-apt-get
> > > >>>>>>>>>> .
> > > >>>>>>>>>>
> > > >>>>>>>>>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
> > > >>>> sxk1969@gmail.com>
> > > >>>>>>>>>> wrote:
> > > >>>>>>>>>>
> > > >>>>>>>>>>> I think part of the difference is the way both of us
> > > >> installed
> > > >>>>>>> java, my
> > > >>>>>>>>>>> setup is using the oracle java as opposed to the open-jdk
> > > >> java
> > > >>>>>>>>>> provided by
> > > >>>>>>>>>>> update-alternatives, I agree with your instructions
> > > >> assessment.
> > > >>>>>>>>>>>
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> On another note I have a question, how did folks install
> > > >> protoc
> > > >>>> on
> > > >>>>>>>>>> windows,
> > > >>>>>>>>>>> in looking at the wiki it points you to the protoc site
> where
> > > >>> it
> > > >>>>>>> seems
> > > >>>>>>>>>> to
> > > >>>>>>>>>>> need a whole bunch of supporting tools (cmake/mingw etc), I
> > > >> am
> > > >>>>>>> using
> > > >>>>>>>>>>> gitbash on windows and was wondering if there's an easy way
> > > >> to
> > > >>>>>>>>>> download the
> > > >>>>>>>>>>> protoc binaries and set the path, please forgive me if this
> > > >> is
> > > >>> in
> > > >>>>>>> the
> > > >>>>>>>>>>> documentation somewhere, still learning my way around.
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
> > > >>>>>>> dsopsrc@gmail.com>
> > > >>>>>>>>>>> wrote:
> > > >>>>>>>>>>>
> > > >>>>>>>>>>>> What I mean is that we should provide instructions to
> setup
> > > >>> the
> > > >>>>>>> least
> > > >>>>>>>>>>>> complicated build environment that works, not one that is
> > > >>> more
> > > >>>>>>>>>>> complicated
> > > >>>>>>>>>>>> but also works.
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>>> On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> > > >>>>>>> dsopsrc@gmail.com>
> > > >>>>>>>>>>>> wrote:
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>>>> Do you have update-alternatives installed? Have you run
> > > >>>>>>>>>>>>> update-alternatives --config java?
> > > >>>>>>>>>>>>>
> > > >>>>>>>>>>>>> Sorry I made a mistake in may last email, I actually have
> > > >>>>>>>>>> JAVA_HOME set
> > > >>>>>>>>>>>> to
> > > >>>>>>>>>>>>> /usr as listed on the webpage which figured out from
> > > >>> Sergiy.
> > > >>>>>>>>>> However, I
> > > >>>>>>>>>>>> do
> > > >>>>>>>>>>>>> not need to set the other ones. It is important that our
> > > >>>>>>>>>> contributing
> > > >>>>>>>>>>> to
> > > >>>>>>>>>>>>> REEF wiki be general and not specific to a single setup.
> > > >>>>>>>>>>>>>
> > > >>>>>>>>>>>>> Here is my environment for building REEF on Ubuntu 16.04.
> > > >>>>>>>>>>>>>
> > > >>>>>>>>>>>>> dougse@reefdevlx:/code/reef [master ↑]$$ env
> > > >>>>>>>>>>>>> MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > > >>>>>>>>>>>>> XDG_SESSION_ID=c2
> > > >>>>>>>>>>>>> SHELL=/bin/bash
> > > >>>>>>>>>>>>> TERM=xterm
> > > >>>>>>>>>>>>> WINDOWID=44144243
> > > >>>>>>>>>>>>> USER=dougse
> > > >>>>>>>>>>>>> LS_COLORS=rs=0:di=01;34:ln=01;
> > > >>> 36:mh=00:pi=40;33:so=01;35:do=
> > > >>>>>>>>>>>>> 01;35:bd=40;33;01:cd=40;33;01:
> > > >>> or=40;31;01:mi=00:su=37;41:sg=
> > > >>>>>>>>>>>>> 30;43:ca=30;41:tw=30;42:ow=34;
> > > >>> 42:st=37;44:ex=01;32:*.tar=01;
> > > >>>>>>>>>>>>> 31:*.tgz=01;31:*.arc=01;31:*.
> > > >> arj=01;31:*.taz=01;31:*.lha=
> > > >>>>>>>>>>>>> 01;31:*.lz4=01;31:*.lzh=01;31:
> > > >> *.lzma=01;31:*.tlz=01;31:*.
> > > >>>>>>>>>>>>> txz=01;31:*.tzo=01;31:*.t7z=
> > > >> 01;31:*.zip=01;31:*.z=01;31:*.
> > > >>>>>>>>>>>>> Z=01;31:*.dz=01;31:*.gz=01;31:
> > > >>> *.lrz=01;31:*.lz=01;31:*.lzo=
> > > >>>>>>>>>>>>> 01;31:*.xz=01;31:*.bz2=01;31:*
> > > >>> .bz=01;31:*.tbz=01;31:*.tbz2=
> > > >>>>>>>>>>>>> 01;31:*.tz=01;31:*.deb=01;31:*
> > > >>> .rpm=01;31:*.jar=01;31:*.war=
> > > >>>>>>>>>>>>> 01;31:*.ear=01;31:*.sar=01;31:
> > > >>> *.rar=01;31:*.alz=01;31:*.ace=
> > > >>>>>>>>>>>>> 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > > >>>>>>>>>>>>> cab=01;31:*.jpg=01;35:*.jpeg=
> > > >>> 01;35:*.gif=01;35:*.bmp=01;35:
> > > >>>>>>>>>>>>> *.pbm=01;35:*.pgm=01;35:*.ppm=
> > > >>> 01;35:*.tga=01;35:*.xbm=01;35:
> > > >>>>>>>>>>>>> *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > > >>>>>>>>>>>>> 01;35:*.svgz=01;35:*.mng=01;
> > > >> 35:*.pcx=01;35:*.mov=01;35:*.
> > > >>>>>>>>>>>>> mpg=01;35:*.mpeg=01;35:*.m2v=
> > > >> 01;35:*.mkv=01;35:*.webm=01;
> > > >>>>>>>>>>>>> 35:*.ogm=01;35:*.mp4=01;35:*.
> > > >> m4v=01;35:*.mp4v=01;35:*.vob=
> > > >>>>>>>>>>>>> 01;35:*.qt=01;35:*.nuv=01;35:*
> > > >> .wmv=01;35:*.asf=01;35:*.rm=
> > > >>>>>>>>>>>>> 01;35:*.rmvb=01;35:*.flc=01;
> > > >> 35:*.avi=01;35:*.fli=01;35:*.
> > > >>>>>>>>>>>>> flv=01;35:*.gl=01;35:*.dl=01;
> > > >> 35:*.xcf=01;35:*.xwd=01;35:*.
> > > >>>>>>>>>>>>> yuv=01;35:*.cgm=01;35:*.emf=
> > > >> 01;35:*.ogv=01;35:*.ogx=01;35:
> > > >>>>>>>>>>>>> *.aac=00;36:*.au=00;36:*.flac=
> > > >>> 00;36:*.m4a=00;36:*.mid=00;36:
> > > >>>>>>>>>>>>> *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > > >>>>>>>>>>>>> 00;36:*.ra=00;36:*.wav=00;36:*
> > > >>> .oga=00;36:*.opus=00;36:*.spx=
> > > >>>>>>>>>>>>> 00;36:*.xspf=00;36:
> > > >>>>>>>>>>>>> SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > > >>>>>>>>>>>>> SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > > >>>>>>>>>>>>> 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > > >>>>>>>>>>>>> PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/
> > > >>> loca
> > > >>>>>>> l/bin
> > > >>>>>>>>>>>>> PWD=/code/reef
> > > >>>>>>>>>>>>> JAVA_HOME=/usr
> > > >>>>>>>>>>>>> LANG=en_US.UTF-8
> > > >>>>>>>>>>>>> REEF_HOME=/code/reef
> > > >>>>>>>>>>>>> SHLVL=1
> > > >>>>>>>>>>>>> HOME=/home/dougse
> > > >>>>>>>>>>>>> GTK_OVERLAY_SCROLLING=0
> > > >>>>>>>>>>>>> DBUS_SESSION_BUS_ADDRESS=unix:
> > > >>> abstract=/tmp/dbus-l06bsMWGy0,
> > > >>>>>>> guid=
> > > >>>>>>>>>>>>> ae74bbce18102091c11c7bd458939d1c
> > > >>>>>>>>>>>>> UID=1000
> > > >>>>>>>>>>>>> LESSOPEN=| /bin/lesspipe %s
> > > >>>>>>>>>>>>> XDG_RUNTIME_DIR=/run/user/1000
> > > >>>>>>>>>>>>> DISPLAY=:10.0
> > > >>>>>>>>>>>>> XDG_CURRENT_DESKTOP=MATE
> > > >>>>>>>>>>>>> LESSCLOSE=/bin/lesspipe %s %s
> > > >>>>>>>>>>>>> COLORTERM=mate-terminal
> > > >>>>>>>>>>>>> _=/usr/bin/env
> > > >>>>>>>>>>>>>
> > > >>>>>>>>>>>>>
> > > >>>>>>>>>>>>> On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> > > >>>>>>> sxk1969@gmail.com
> > > >>>>>>>>>>>
> > > >>>>>>>>>>>> wrote:
> > > >>>>>>>>>>>>>
> > > >>>>>>>>>>>>>> Weird, yes I did read that pageand yes I had to do those
> > > >>>> exact
> > > >>>>>>>>>> steps
> > > >>>>>>>>>>>> that
> > > >>>>>>>>>>>>>> I
> > > >>>>>>>>>>>>>> described, I haven't run the tests yet but fully suspect
> > > >>>> that
> > > >>>>>>> I'll
> > > >>>>>>>>>>> need
> > > >>>>>>>>>>>> to
> > > >>>>>>>>>>>>>> increase the ulimit to enable that. If you do a plain
> > > >>> maven
> > > >>>>>>> build
> > > >>>>>>>>>>> after
> > > >>>>>>>>>>>>>> checking out the reef code in ubuntu it complains that
> > > >>>>>>> JAVA_HOME
> > > >>>>>>>>>> is
> > > >>>>>>>>>>> not
> > > >>>>>>>>>>>>>> set, also its a good idea to set the maven oriented
> > > >>>>>>> environment
> > > >>>>>>>>>>>> variables
> > > >>>>>>>>>>>>>> because I highly suspect that in the future we may need
> > > >> to
> > > >>>>>>> adjust
> > > >>>>>>>>>> heap
> > > >>>>>>>>>>>>>> space settings, finally the LD_LIBRARY_PATH is needed I
> > > >>>>>>> suspect
> > > >>>>>>>>>>> because
> > > >>>>>>>>>>>>>> the
> > > >>>>>>>>>>>>>> java code is invoking the protoc compiler at some point
> > > >>> and
> > > >>>> in
> > > >>>>>>>>>> order
> > > >>>>>>>>>>> to
> > > >>>>>>>>>>>> do
> > > >>>>>>>>>>>>>> so it much load some .so files that live in
> > > >>> LD_LIBRARY_PATH.
> > > >>>>>>> Net
> > > >>>>>>>>>> Net
> > > >>>>>>>>>>> we
> > > >>>>>>>>>>>>>> should definitely figure out the differences between
> > > >> your
> > > >>>> and
> > > >>>>>>>>>> Sergei's
> > > >>>>>>>>>>>>>> setup and mine, I believe IIRC I used ubuntu 16.10 but
> > > >> I'm
> > > >>>> not
> > > >>>>>>>>>>> convinced
> > > >>>>>>>>>>>>>> that the version matters if the major version is the
> > > >> same.
> > > >>>>>>>>>>>>>> Cheers
> > > >>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> > > >>>>>>>>>> dsopsrc@gmail.com>
> > > >>>>>>>>>>>>>> wrote:
> > > >>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>> Hello Saikat,
> > > >>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>> Did you read the documentation on this page
> > > >>>>>>>>>>>>>>> https://cwiki.apache.org/
> > > >> confluence/display/REEF/Linux
> > > >>> on
> > > >>>>>>> the
> > > >>>>>>>>>> REEF
> > > >>>>>>>>>>>> wiki
> > > >>>>>>>>>>>>>>> concerning Java on Ubuntu? I added this page after
> > > >>> setting
> > > >>>>>>> up a
> > > >>>>>>>>>>> Linux
> > > >>>>>>>>>>>>>> 16.04
> > > >>>>>>>>>>>>>>> to build REEF and trading emails with Sergiy on the
> > > >> dev
> > > >>>>>>> list.
> > > >>>>>>>>>> Note
> > > >>>>>>>>>>>>>> that I
> > > >>>>>>>>>>>>>>> do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH.
> > > >> However,
> > > >>>>>>> you do
> > > >>>>>>>>>> need
> > > >>>>>>>>>>>> to
> > > >>>>>>>>>>>>>>> change the default for ulimit -n in bash to get the
> > > >>> tests
> > > >>>>>>> to run
> > > >>>>>>>>>>> which
> > > >>>>>>>>>>>>>> is
> > > >>>>>>>>>>>>>>> also described.
> > > >>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>> Doug
> > > >>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> > > >>>>>>>>>> sxk1969@gmail.com>
> > > >>>>>>>>>>>>>> wrote:
> > > >>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>> A battle well fought and won, got reef to build
> > > >>>>>>> successfully
> > > >>>>>>>>>> on
> > > >>>>>>>>>>>> ubuntu
> > > >>>>>>>>>>>>>>>> linux vm after hours of hacking, fyi here's what I
> > > >> had
> > > >>>> to
> > > >>>>>>> do:
> > > >>>>>>>>>>>>>>>> 1) installed the necessary tools (jdk 1.7/maven
> > > >>>>>>> 3.3.9/protoc
> > > >>>>>>>>>>> version
> > > >>>>>>>>>>>>>> 2.5)
> > > >>>>>>>>>>>>>>>> 2) added JAVA_HOME and M2_HOME
> > > >>>>>>>>>>>>>>>> 3) here's the kicker that's not in the documentation
> > > >>> :)
> > > >>>> (
> > > >>>>>>>>>>>>>>>> https://github.com/apache/reef
> > > >>>>>>> /blob/master/lang/java/BUILD.md
> > > >>>>>>>>>> ),
> > > >>>>>>>>>>> had
> > > >>>>>>>>>>>>>> to
> > > >>>>>>>>>>>>>>> add
> > > >>>>>>>>>>>>>>>> LD_LIBRARY_PATH environment variable and have it
> > > >> point
> > > >>>> to
> > > >>>>>>>>>>>>>> /usr/local/lib
> > > >>>>>>>>>>>>>>>> where the shared library for protobuf is installed
> > > >>>>>>>>>>>>>>>> 4) had to add JAVA_HOME and M2_HOME to path (also
> > > >> not
> > > >>> in
> > > >>>>>>> the
> > > >>>>>>>>>>>>>>> documentation
> > > >>>>>>>>>>>>>>>> :) )
> > > >>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>> [INFO]
> > > >>>>>>>>>>>>>>>> ------------------------------
> > > >>>>>>> ------------------------------
> > > >>>>>>>>>>>>>> ------------
> > > >>>>>>>>>>>>>>>> [INFO] Reactor Summary:
> > > >>>>>>>>>>>>>>>> [INFO]
> > > >>>>>>>>>>>>>>>> [INFO] REEF ..............................
> > > >>>>>>> .................
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 4.167 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Dot Net ..............................
> > > >>>>>>> .........
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 1.628 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Annotations
> > > >> ..............................
> > > >>>>>>> .....
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 5.509 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Utils ..............................
> > > >>>>>>> ...........
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 5.747 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Tang Project
> > > >>> ..............................
> > > >>>>>>> ....
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 0.492 s]
> > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar A
> > > >> ..............................
> > > >>>>>>> ......
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 4.276 s]
> > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B
> > > >> ..............................
> > > >>>>>>> ......
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 4.186 s]
> > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar AB
> > > >> ..............................
> > > >>>>>>> .....
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 4.376 s]
> > > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B conflict A
> > > >>>>>>> .........................
> > > >>>>>>>>>>> SUCCESS
> > > >>>>>>>>>>>> [
> > > >>>>>>>>>>>>>>>> 0.440 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Tang ..............................
> > > >>>>>>> ............
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 24.779 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Wake Project
> > > >>> ..............................
> > > >>>>>>> ....
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 0.487 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Wake ..............................
> > > >>>>>>> ............
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 15.587 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Common ..............................
> > > >>>>>>> ..........
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 23.343 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime Local
> > > >>> ..............................
> > > >>>>>>> ...
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 8.375 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Applications
> > > >>> ..............................
> > > >>>>>>> ....
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 0.416 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Vortex ..............................
> > > >>>>>>> ..........
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 11.263 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF HTTP Server
> > > >> ..............................
> > > >>>>>>> .....
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 9.772 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Utils for Hadoop
> > > >>>>>>> ..............................
> > > >>>>>>>>>>> SUCCESS
> > > >>>>>>>>>>>> [
> > > >>>>>>>>>>>>>>>> 5.881 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for YARN
> > > >>>>>>> ..............................
> > > >>>>>>>>>>> SUCCESS
> > > >>>>>>>>>>>> [
> > > >>>>>>>>>>>>>>>> 11.041 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for HDInsight
> > > >>>>>>> .........................
> > > >>>>>>>>>>> SUCCESS
> > > >>>>>>>>>>>> [
> > > >>>>>>>>>>>>>>>> 9.719 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF IO ..............................
> > > >>>>>>> ..............
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 23.729 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Checkpoint
> > > >> ..............................
> > > >>>>>>> ......
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 5.771 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Bridge Java
> > > >> ..............................
> > > >>>>>>> .....
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 11.981 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for multiple runtime scenarios
> > > >>>>>>> ........
> > > >>>>>>>>>>> SUCCESS
> > > >>>>>>>>>>>> [
> > > >>>>>>>>>>>>>>>> 7.898 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Bridge (Client)
> > > >>>> ..............................
> > > >>>>>>> .
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 12.242 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime Standalone
> > > >>>>>>> ............................
> > > >>>>>>>>>>> SUCCESS
> > > >>>>>>>>>>>> [
> > > >>>>>>>>>>>>>>>> 7.779 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for Mesos
> > > >>>>>>> .............................
> > > >>>>>>>>>>> SUCCESS
> > > >>>>>>>>>>>> [
> > > >>>>>>>>>>>>>>>> 11.103 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Poison ..............................
> > > >>>>>>> ..........
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 5.384 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Examples ..............................
> > > >>>>>>> ........
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 14.313 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Examples CLR
> > > >>> ..............................
> > > >>>>>>> ....
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 7.532 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Examples on HDInsight
> > > >>>>>>> .........................
> > > >>>>>>>>>>> SUCCESS
> > > >>>>>>>>>>>> [
> > > >>>>>>>>>>>>>>>> 9.213 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Tang Tint ..............................
> > > >>>>>>> .......
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 8.546 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Tests ..............................
> > > >>>>>>> ...........
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 15.696 s]
> > > >>>>>>>>>>>>>>>> [INFO] REEF Website ..............................
> > > >>>>>>> .........
> > > >>>>>>>>>>>> SUCCESS [
> > > >>>>>>>>>>>>>>>> 1.033 s]
> > > >>>>>>>>>>>>>>>> [INFO]
> > > >>>>>>>>>>>>>>>> ------------------------------
> > > >>>>>>> ------------------------------
> > > >>>>>>>>>>>>>> ------------
> > > >>>>>>>>>>>>>>>> [INFO] BUILD SUCCESS
> > > >>>>>>>>>>>>>>>> [INFO]
> > > >>>>>>>>>>>>>>>> ------------------------------
> > > >>>>>>> ------------------------------
> > > >>>>>>>>>>>>>> ------------
> > > >>>>>>>>>>>>>>>> [INFO] Total time: 04:54 min
> > > >>>>>>>>>>>>>>>> [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > > >>>>>>>>>>>>>>>> [INFO] Final Memory: 125M/1238M
> > > >>>>>>>>>>>>>>>> [INFO]
> > > >>>>>>>>>>>>>>>> ------------------------------
> > > >>>>>>> ------------------------------
> > > >>>>>>>>>>>>>> ------------
> > > >>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>> On to bigger and better things :), we should
> > > >> probably
> > > >>>>>>> update
> > > >>>>>>>>>> the
> > > >>>>>>>>>>>> docs
> > > >>>>>>>>>>>>>> to
> > > >>>>>>>>>>>>>>>> reflect the current build process subtleties. Will
> > > >>> try
> > > >>>>>>>>>> windows
> > > >>>>>>>>>>>> next.
> > > >>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> > > >>>>>>>>>> bgchun@gmail.com
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>>>>>> wrote:
> > > >>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>> Welcome, Saikat!
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> > > >>>>>>>>>> markus@weimo.de>
> > > >>>>>>>>>>>>>> wrote:
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>>> On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > > >>>>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>>> I am a newbie to Apache Reef and am interested
> > > >> in
> > > >>>>>>>>>>> contributing
> > > >>>>>>>>>>>> to
> > > >>>>>>>>>>>>>>> the
> > > >>>>>>>>>>>>>>>>> reef
> > > >>>>>>>>>>>>>>>>>>> dev efforts
> > > >>>>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>> Welcome!
> > > >>>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>> my JIRA id is kanjilal
> > > >>>>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>> I have added you to the contributor's list on
> > > >>> JIRA.
> > > >>>>>>> This
> > > >>>>>>>>>>>> basically
> > > >>>>>>>>>>>>>>>> means
> > > >>>>>>>>>>>>>>>>>> that you can self-assign issues to yourself now
> > > >> :)
> > > >>>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>> Markus
> > > >>>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>> --
> > > >>>>>>>>>>>>>>>>> Byung-Gon Chun
> > > >>>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>>
> > > >>>>>>>>>>>>>
> > > >>>>>>>>>>>>>
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>
> > > >>>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>
> > > >>>>>>
> > > >>>>>>
> > > >>>>>
> > > >>>>
> > > >>>
> > > >>
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
As per the developer documentation you should add a comment to the JIRA
which gives a link to the pull request on github which triggers an email to
the dev list so eveyone knows to take a look. I added the following comment
to the JIRA.
Pull request is available at
https://github.com/apache/reef/pull/1253#pullrequestreview-21376209.
On Fri, Feb 10, 2017 at 5:22 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> Pull request submitted :)))).
> Thanks for all the help, will focus on getting windows build operational.
>
> On Fri, Feb 10, 2017 at 5:06 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
>
> > Sure I can try that and that should work, on another note should we
> update
> > the documentation to not say HEAD, I was mimicking the docs to the tee.
> > Will let you know results.
> >
> > Sent from my iPhone
> >
> > > On Feb 10, 2017, at 4:48 PM, Douglas Service <ds...@gmail.com>
> wrote:
> > >
> > > You should have a branched named REEF-1739 on your dev machine where
> your
> > > changes are located. Would you please try
> > >
> > > git push origin REEF-1739
> > >
> > >> On Fri, Feb 10, 2017 at 4:39 PM, Saikat Kanjilal <sx...@gmail.com>
> > wrote:
> > >>
> > >> ok so I fixed the problem of pointing to the wrong repo, namely I am
> now
> > >> pointing to my repo for reef, here's what I see now:
> > >>
> > >> saikan@ubuntureef:~/code/localdevreef$ git push origin HEAD
> > >> Username for 'https://github.com': skanjila
> > >> Password for 'https://skanjila@github.com':
> > >> error: unable to push to unqualified destination: HEAD
> > >> The destination refspec neither matches an existing ref on the remote
> > nor
> > >> begins with refs/, and we are unable to guess a prefix based on the
> > source
> > >> ref.
> > >> error: failed to push some refs to 'https://github.com/skanjila/
> > reef.git'
> > >>
> > >> Here's what git remote -v yields:
> > >> saikan@ubuntureef:~/code/localdevreef$ git remote -v
> > >> origin https://github.com/skanjila/reef.git (fetch)
> > >> origin https://github.com/skanjila/reef.git (push)
> > >> upstream https://github.com/apache/reef.git (fetch)
> > >> upstream https://github.com/apache/reef.git (push)
> > >>
> > >>
> > >> My github alias is skanjila
> > >>
> > >>
> > >> Here's what git status gives:
> > >> saikan@ubuntureef:~/code/localdevreef$ git status
> > >> interactive rebase in progress; onto e554dd3
> > >> fatal: Could not open file .git/rebase-merge/done for reading: No such
> > file
> > >> or directory
> > >>
> > >>
> > >>
> > >> Thoughts?
> > >>
> > >>
> > >>> On Fri, Feb 10, 2017 at 2:38 PM, Markus Weimer <ma...@weimo.de>
> > wrote:
> > >>>
> > >>> Hi,
> > >>>
> > >>> if `origin` refers to the apache/reef repositiory on GitHub OR the
> > >>> repository on apache.org, you won't be able to push, as those repos
> > are
> > >>> read-only for you. Instead, you need to push to your own fork of REEF
> > on
> > >>> GitHub and then file a PR from that branch to apache/reef from there.
> > >>>
> > >>> Markus
> > >>>
> > >>> On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <ds...@gmail.com>
> > >>> wrote:
> > >>>
> > >>>> also what is your GitHub alias?
> > >>>>
> > >>>> On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <dsopsrc@gmail.com
> >
> > >>>> wrote:
> > >>>>
> > >>>>> and git status from the REEF root directory.
> > >>>>>
> > >>>>> On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <
> dsopsrc@gmail.com>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Would you please send the output of git remote -v?
> > >>>>>>
> > >>>>>> Doug
> > >>>>>>
> > >>>>>> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <
> sxk1969@gmail.com
> > >>>
> > >>>>>> wrote:
> > >>>>>>
> > >>>>>>> Folks,
> > >>>>>>> I am trying to create/deploy my first pull request, I've gone
> > >> through
> > >>>> all
> > >>>>>>> of these steps successfully here:
> > >>>>>>> https://cwiki.apache.org/confluence/display/REEF/Contributin
> > >>>>>>> g#Contributing-1.Forkrepository
> > >>>>>>> but I seem to be running into 403 errors when I do a git push
> > >> origin
> > >>>>>>> HEAD,
> > >>>>>>> here are my creds, would really appreciate some help:
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> > >>>>>>> github username: skanjila
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> Please let me know what I am missing here, note that my id in
> JIRA
> > >> is
> > >>>>>>> kanjilal but my github userid is skanjila, might this be a
> problem?
> > >>>>>>>
> > >>>>>>> Thanks in advance.
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <
> sxk1969@gmail.com
> > >>>
> > >>>>>>> wrote:
> > >>>>>>>
> > >>>>>>>> Well interesting piece of metadata, time for successfully
> > >>> completing
> > >>>>>>>> windows server 2016 build was about half the time for linux, at
> > >>> least
> > >>>>>>> for
> > >>>>>>>> the java build, will try csharp next
> > >>>>>>>>
> > >>>>>>>> Here's what I did:
> > >>>>>>>> 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> > >>>>>>>> 2) mvn clean install -DskipTests=true
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> For posterity's sake I will go back and redo my ubuntu linux
> > >> build
> > >>>> and
> > >>>>>>>> then work on the JIRA-1739 to make sure the documentation is up
> > >> to
> > >>>>>>> date as
> > >>>>>>>> needed. I will install java from the repositories this time.
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <
> > >> sxk1969@gmail.com
> > >>>>
> > >>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Yes I have gone through that in the past, not sure why I
> decided
> > >>> not
> > >>>>>>> to
> > >>>>>>>>> include that repo and just download the jdk and put it in
> > >> instead
> > >>>> :),
> > >>>>>>>>> regardless I will send a pull request for the build cleanup in
> > >> the
> > >>>>>>> next few
> > >>>>>>>>> days, lets iterate on it as a team and test drive it to prove
> it
> > >>>>>>> wrong or
> > >>>>>>>>> right
> > >>>>>>>>>
> > >>>>>>>>> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <
> > >>> dsopsrc@gmail.com>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> After thinking about all of the changes you had make and the
> > >> fact
> > >>>>>>> that
> > >>>>>>>>>> oracle java does not show up in update-alternatives, you may
> > >> want
> > >>>> to
> > >>>>>>> look
> > >>>>>>>>>> at these instructions which tell how to install oracle java
> via
> > >>>>>>> apt-get
> > >>>>>>>>>> repository which automatically takes care of a lot of the
> > >> issues
> > >>>> you
> > >>>>>>> ran
> > >>>>>>>>>> into
> > >>>>>>>>>> https://www.digitalocean.com/community/tutorials/how-to-inst
> > >>>>>>>>>> all-java-on-ubuntu-with-apt-get
> > >>>>>>>>>> .
> > >>>>>>>>>>
> > >>>>>>>>>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
> > >>>> sxk1969@gmail.com>
> > >>>>>>>>>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>> I think part of the difference is the way both of us
> > >> installed
> > >>>>>>> java, my
> > >>>>>>>>>>> setup is using the oracle java as opposed to the open-jdk
> > >> java
> > >>>>>>>>>> provided by
> > >>>>>>>>>>> update-alternatives, I agree with your instructions
> > >> assessment.
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> On another note I have a question, how did folks install
> > >> protoc
> > >>>> on
> > >>>>>>>>>> windows,
> > >>>>>>>>>>> in looking at the wiki it points you to the protoc site where
> > >>> it
> > >>>>>>> seems
> > >>>>>>>>>> to
> > >>>>>>>>>>> need a whole bunch of supporting tools (cmake/mingw etc), I
> > >> am
> > >>>>>>> using
> > >>>>>>>>>>> gitbash on windows and was wondering if there's an easy way
> > >> to
> > >>>>>>>>>> download the
> > >>>>>>>>>>> protoc binaries and set the path, please forgive me if this
> > >> is
> > >>> in
> > >>>>>>> the
> > >>>>>>>>>>> documentation somewhere, still learning my way around.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
> > >>>>>>> dsopsrc@gmail.com>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>
> > >>>>>>>>>>>> What I mean is that we should provide instructions to setup
> > >>> the
> > >>>>>>> least
> > >>>>>>>>>>>> complicated build environment that works, not one that is
> > >>> more
> > >>>>>>>>>>> complicated
> > >>>>>>>>>>>> but also works.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> > >>>>>>> dsopsrc@gmail.com>
> > >>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> Do you have update-alternatives installed? Have you run
> > >>>>>>>>>>>>> update-alternatives --config java?
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> Sorry I made a mistake in may last email, I actually have
> > >>>>>>>>>> JAVA_HOME set
> > >>>>>>>>>>>> to
> > >>>>>>>>>>>>> /usr as listed on the webpage which figured out from
> > >>> Sergiy.
> > >>>>>>>>>> However, I
> > >>>>>>>>>>>> do
> > >>>>>>>>>>>>> not need to set the other ones. It is important that our
> > >>>>>>>>>> contributing
> > >>>>>>>>>>> to
> > >>>>>>>>>>>>> REEF wiki be general and not specific to a single setup.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> Here is my environment for building REEF on Ubuntu 16.04.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> dougse@reefdevlx:/code/reef [master ↑]$$ env
> > >>>>>>>>>>>>> MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > >>>>>>>>>>>>> XDG_SESSION_ID=c2
> > >>>>>>>>>>>>> SHELL=/bin/bash
> > >>>>>>>>>>>>> TERM=xterm
> > >>>>>>>>>>>>> WINDOWID=44144243
> > >>>>>>>>>>>>> USER=dougse
> > >>>>>>>>>>>>> LS_COLORS=rs=0:di=01;34:ln=01;
> > >>> 36:mh=00:pi=40;33:so=01;35:do=
> > >>>>>>>>>>>>> 01;35:bd=40;33;01:cd=40;33;01:
> > >>> or=40;31;01:mi=00:su=37;41:sg=
> > >>>>>>>>>>>>> 30;43:ca=30;41:tw=30;42:ow=34;
> > >>> 42:st=37;44:ex=01;32:*.tar=01;
> > >>>>>>>>>>>>> 31:*.tgz=01;31:*.arc=01;31:*.
> > >> arj=01;31:*.taz=01;31:*.lha=
> > >>>>>>>>>>>>> 01;31:*.lz4=01;31:*.lzh=01;31:
> > >> *.lzma=01;31:*.tlz=01;31:*.
> > >>>>>>>>>>>>> txz=01;31:*.tzo=01;31:*.t7z=
> > >> 01;31:*.zip=01;31:*.z=01;31:*.
> > >>>>>>>>>>>>> Z=01;31:*.dz=01;31:*.gz=01;31:
> > >>> *.lrz=01;31:*.lz=01;31:*.lzo=
> > >>>>>>>>>>>>> 01;31:*.xz=01;31:*.bz2=01;31:*
> > >>> .bz=01;31:*.tbz=01;31:*.tbz2=
> > >>>>>>>>>>>>> 01;31:*.tz=01;31:*.deb=01;31:*
> > >>> .rpm=01;31:*.jar=01;31:*.war=
> > >>>>>>>>>>>>> 01;31:*.ear=01;31:*.sar=01;31:
> > >>> *.rar=01;31:*.alz=01;31:*.ace=
> > >>>>>>>>>>>>> 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > >>>>>>>>>>>>> cab=01;31:*.jpg=01;35:*.jpeg=
> > >>> 01;35:*.gif=01;35:*.bmp=01;35:
> > >>>>>>>>>>>>> *.pbm=01;35:*.pgm=01;35:*.ppm=
> > >>> 01;35:*.tga=01;35:*.xbm=01;35:
> > >>>>>>>>>>>>> *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > >>>>>>>>>>>>> 01;35:*.svgz=01;35:*.mng=01;
> > >> 35:*.pcx=01;35:*.mov=01;35:*.
> > >>>>>>>>>>>>> mpg=01;35:*.mpeg=01;35:*.m2v=
> > >> 01;35:*.mkv=01;35:*.webm=01;
> > >>>>>>>>>>>>> 35:*.ogm=01;35:*.mp4=01;35:*.
> > >> m4v=01;35:*.mp4v=01;35:*.vob=
> > >>>>>>>>>>>>> 01;35:*.qt=01;35:*.nuv=01;35:*
> > >> .wmv=01;35:*.asf=01;35:*.rm=
> > >>>>>>>>>>>>> 01;35:*.rmvb=01;35:*.flc=01;
> > >> 35:*.avi=01;35:*.fli=01;35:*.
> > >>>>>>>>>>>>> flv=01;35:*.gl=01;35:*.dl=01;
> > >> 35:*.xcf=01;35:*.xwd=01;35:*.
> > >>>>>>>>>>>>> yuv=01;35:*.cgm=01;35:*.emf=
> > >> 01;35:*.ogv=01;35:*.ogx=01;35:
> > >>>>>>>>>>>>> *.aac=00;36:*.au=00;36:*.flac=
> > >>> 00;36:*.m4a=00;36:*.mid=00;36:
> > >>>>>>>>>>>>> *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > >>>>>>>>>>>>> 00;36:*.ra=00;36:*.wav=00;36:*
> > >>> .oga=00;36:*.opus=00;36:*.spx=
> > >>>>>>>>>>>>> 00;36:*.xspf=00;36:
> > >>>>>>>>>>>>> SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > >>>>>>>>>>>>> SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > >>>>>>>>>>>>> 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > >>>>>>>>>>>>> PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/
> > >>> loca
> > >>>>>>> l/bin
> > >>>>>>>>>>>>> PWD=/code/reef
> > >>>>>>>>>>>>> JAVA_HOME=/usr
> > >>>>>>>>>>>>> LANG=en_US.UTF-8
> > >>>>>>>>>>>>> REEF_HOME=/code/reef
> > >>>>>>>>>>>>> SHLVL=1
> > >>>>>>>>>>>>> HOME=/home/dougse
> > >>>>>>>>>>>>> GTK_OVERLAY_SCROLLING=0
> > >>>>>>>>>>>>> DBUS_SESSION_BUS_ADDRESS=unix:
> > >>> abstract=/tmp/dbus-l06bsMWGy0,
> > >>>>>>> guid=
> > >>>>>>>>>>>>> ae74bbce18102091c11c7bd458939d1c
> > >>>>>>>>>>>>> UID=1000
> > >>>>>>>>>>>>> LESSOPEN=| /bin/lesspipe %s
> > >>>>>>>>>>>>> XDG_RUNTIME_DIR=/run/user/1000
> > >>>>>>>>>>>>> DISPLAY=:10.0
> > >>>>>>>>>>>>> XDG_CURRENT_DESKTOP=MATE
> > >>>>>>>>>>>>> LESSCLOSE=/bin/lesspipe %s %s
> > >>>>>>>>>>>>> COLORTERM=mate-terminal
> > >>>>>>>>>>>>> _=/usr/bin/env
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> > >>>>>>> sxk1969@gmail.com
> > >>>>>>>>>>>
> > >>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Weird, yes I did read that pageand yes I had to do those
> > >>>> exact
> > >>>>>>>>>> steps
> > >>>>>>>>>>>> that
> > >>>>>>>>>>>>>> I
> > >>>>>>>>>>>>>> described, I haven't run the tests yet but fully suspect
> > >>>> that
> > >>>>>>> I'll
> > >>>>>>>>>>> need
> > >>>>>>>>>>>> to
> > >>>>>>>>>>>>>> increase the ulimit to enable that. If you do a plain
> > >>> maven
> > >>>>>>> build
> > >>>>>>>>>>> after
> > >>>>>>>>>>>>>> checking out the reef code in ubuntu it complains that
> > >>>>>>> JAVA_HOME
> > >>>>>>>>>> is
> > >>>>>>>>>>> not
> > >>>>>>>>>>>>>> set, also its a good idea to set the maven oriented
> > >>>>>>> environment
> > >>>>>>>>>>>> variables
> > >>>>>>>>>>>>>> because I highly suspect that in the future we may need
> > >> to
> > >>>>>>> adjust
> > >>>>>>>>>> heap
> > >>>>>>>>>>>>>> space settings, finally the LD_LIBRARY_PATH is needed I
> > >>>>>>> suspect
> > >>>>>>>>>>> because
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>> java code is invoking the protoc compiler at some point
> > >>> and
> > >>>> in
> > >>>>>>>>>> order
> > >>>>>>>>>>> to
> > >>>>>>>>>>>> do
> > >>>>>>>>>>>>>> so it much load some .so files that live in
> > >>> LD_LIBRARY_PATH.
> > >>>>>>> Net
> > >>>>>>>>>> Net
> > >>>>>>>>>>> we
> > >>>>>>>>>>>>>> should definitely figure out the differences between
> > >> your
> > >>>> and
> > >>>>>>>>>> Sergei's
> > >>>>>>>>>>>>>> setup and mine, I believe IIRC I used ubuntu 16.10 but
> > >> I'm
> > >>>> not
> > >>>>>>>>>>> convinced
> > >>>>>>>>>>>>>> that the version matters if the major version is the
> > >> same.
> > >>>>>>>>>>>>>> Cheers
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> > >>>>>>>>>> dsopsrc@gmail.com>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Hello Saikat,
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Did you read the documentation on this page
> > >>>>>>>>>>>>>>> https://cwiki.apache.org/
> > >> confluence/display/REEF/Linux
> > >>> on
> > >>>>>>> the
> > >>>>>>>>>> REEF
> > >>>>>>>>>>>> wiki
> > >>>>>>>>>>>>>>> concerning Java on Ubuntu? I added this page after
> > >>> setting
> > >>>>>>> up a
> > >>>>>>>>>>> Linux
> > >>>>>>>>>>>>>> 16.04
> > >>>>>>>>>>>>>>> to build REEF and trading emails with Sergiy on the
> > >> dev
> > >>>>>>> list.
> > >>>>>>>>>> Note
> > >>>>>>>>>>>>>> that I
> > >>>>>>>>>>>>>>> do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH.
> > >> However,
> > >>>>>>> you do
> > >>>>>>>>>> need
> > >>>>>>>>>>>> to
> > >>>>>>>>>>>>>>> change the default for ulimit -n in bash to get the
> > >>> tests
> > >>>>>>> to run
> > >>>>>>>>>>> which
> > >>>>>>>>>>>>>> is
> > >>>>>>>>>>>>>>> also described.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Doug
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> > >>>>>>>>>> sxk1969@gmail.com>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> A battle well fought and won, got reef to build
> > >>>>>>> successfully
> > >>>>>>>>>> on
> > >>>>>>>>>>>> ubuntu
> > >>>>>>>>>>>>>>>> linux vm after hours of hacking, fyi here's what I
> > >> had
> > >>>> to
> > >>>>>>> do:
> > >>>>>>>>>>>>>>>> 1) installed the necessary tools (jdk 1.7/maven
> > >>>>>>> 3.3.9/protoc
> > >>>>>>>>>>> version
> > >>>>>>>>>>>>>> 2.5)
> > >>>>>>>>>>>>>>>> 2) added JAVA_HOME and M2_HOME
> > >>>>>>>>>>>>>>>> 3) here's the kicker that's not in the documentation
> > >>> :)
> > >>>> (
> > >>>>>>>>>>>>>>>> https://github.com/apache/reef
> > >>>>>>> /blob/master/lang/java/BUILD.md
> > >>>>>>>>>> ),
> > >>>>>>>>>>> had
> > >>>>>>>>>>>>>> to
> > >>>>>>>>>>>>>>> add
> > >>>>>>>>>>>>>>>> LD_LIBRARY_PATH environment variable and have it
> > >> point
> > >>>> to
> > >>>>>>>>>>>>>> /usr/local/lib
> > >>>>>>>>>>>>>>>> where the shared library for protobuf is installed
> > >>>>>>>>>>>>>>>> 4) had to add JAVA_HOME and M2_HOME to path (also
> > >> not
> > >>> in
> > >>>>>>> the
> > >>>>>>>>>>>>>>> documentation
> > >>>>>>>>>>>>>>>> :) )
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> [INFO]
> > >>>>>>>>>>>>>>>> ------------------------------
> > >>>>>>> ------------------------------
> > >>>>>>>>>>>>>> ------------
> > >>>>>>>>>>>>>>>> [INFO] Reactor Summary:
> > >>>>>>>>>>>>>>>> [INFO]
> > >>>>>>>>>>>>>>>> [INFO] REEF ..............................
> > >>>>>>> .................
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 4.167 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Dot Net ..............................
> > >>>>>>> .........
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 1.628 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Annotations
> > >> ..............................
> > >>>>>>> .....
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 5.509 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Utils ..............................
> > >>>>>>> ...........
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 5.747 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Tang Project
> > >>> ..............................
> > >>>>>>> ....
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 0.492 s]
> > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar A
> > >> ..............................
> > >>>>>>> ......
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 4.276 s]
> > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B
> > >> ..............................
> > >>>>>>> ......
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 4.186 s]
> > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar AB
> > >> ..............................
> > >>>>>>> .....
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 4.376 s]
> > >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B conflict A
> > >>>>>>> .........................
> > >>>>>>>>>>> SUCCESS
> > >>>>>>>>>>>> [
> > >>>>>>>>>>>>>>>> 0.440 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Tang ..............................
> > >>>>>>> ............
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 24.779 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Wake Project
> > >>> ..............................
> > >>>>>>> ....
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 0.487 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Wake ..............................
> > >>>>>>> ............
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 15.587 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Common ..............................
> > >>>>>>> ..........
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 23.343 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Runtime Local
> > >>> ..............................
> > >>>>>>> ...
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 8.375 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Applications
> > >>> ..............................
> > >>>>>>> ....
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 0.416 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Vortex ..............................
> > >>>>>>> ..........
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 11.263 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF HTTP Server
> > >> ..............................
> > >>>>>>> .....
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 9.772 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Utils for Hadoop
> > >>>>>>> ..............................
> > >>>>>>>>>>> SUCCESS
> > >>>>>>>>>>>> [
> > >>>>>>>>>>>>>>>> 5.881 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for YARN
> > >>>>>>> ..............................
> > >>>>>>>>>>> SUCCESS
> > >>>>>>>>>>>> [
> > >>>>>>>>>>>>>>>> 11.041 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for HDInsight
> > >>>>>>> .........................
> > >>>>>>>>>>> SUCCESS
> > >>>>>>>>>>>> [
> > >>>>>>>>>>>>>>>> 9.719 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF IO ..............................
> > >>>>>>> ..............
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 23.729 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Checkpoint
> > >> ..............................
> > >>>>>>> ......
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 5.771 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Bridge Java
> > >> ..............................
> > >>>>>>> .....
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 11.981 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for multiple runtime scenarios
> > >>>>>>> ........
> > >>>>>>>>>>> SUCCESS
> > >>>>>>>>>>>> [
> > >>>>>>>>>>>>>>>> 7.898 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Bridge (Client)
> > >>>> ..............................
> > >>>>>>> .
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 12.242 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Runtime Standalone
> > >>>>>>> ............................
> > >>>>>>>>>>> SUCCESS
> > >>>>>>>>>>>> [
> > >>>>>>>>>>>>>>>> 7.779 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Runtime for Mesos
> > >>>>>>> .............................
> > >>>>>>>>>>> SUCCESS
> > >>>>>>>>>>>> [
> > >>>>>>>>>>>>>>>> 11.103 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Poison ..............................
> > >>>>>>> ..........
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 5.384 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Examples ..............................
> > >>>>>>> ........
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 14.313 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Examples CLR
> > >>> ..............................
> > >>>>>>> ....
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 7.532 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Examples on HDInsight
> > >>>>>>> .........................
> > >>>>>>>>>>> SUCCESS
> > >>>>>>>>>>>> [
> > >>>>>>>>>>>>>>>> 9.213 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Tang Tint ..............................
> > >>>>>>> .......
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 8.546 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Tests ..............................
> > >>>>>>> ...........
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 15.696 s]
> > >>>>>>>>>>>>>>>> [INFO] REEF Website ..............................
> > >>>>>>> .........
> > >>>>>>>>>>>> SUCCESS [
> > >>>>>>>>>>>>>>>> 1.033 s]
> > >>>>>>>>>>>>>>>> [INFO]
> > >>>>>>>>>>>>>>>> ------------------------------
> > >>>>>>> ------------------------------
> > >>>>>>>>>>>>>> ------------
> > >>>>>>>>>>>>>>>> [INFO] BUILD SUCCESS
> > >>>>>>>>>>>>>>>> [INFO]
> > >>>>>>>>>>>>>>>> ------------------------------
> > >>>>>>> ------------------------------
> > >>>>>>>>>>>>>> ------------
> > >>>>>>>>>>>>>>>> [INFO] Total time: 04:54 min
> > >>>>>>>>>>>>>>>> [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > >>>>>>>>>>>>>>>> [INFO] Final Memory: 125M/1238M
> > >>>>>>>>>>>>>>>> [INFO]
> > >>>>>>>>>>>>>>>> ------------------------------
> > >>>>>>> ------------------------------
> > >>>>>>>>>>>>>> ------------
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> On to bigger and better things :), we should
> > >> probably
> > >>>>>>> update
> > >>>>>>>>>> the
> > >>>>>>>>>>>> docs
> > >>>>>>>>>>>>>> to
> > >>>>>>>>>>>>>>>> reflect the current build process subtleties. Will
> > >>> try
> > >>>>>>>>>> windows
> > >>>>>>>>>>>> next.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> > >>>>>>>>>> bgchun@gmail.com
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>> Welcome, Saikat!
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> > >>>>>>>>>> markus@weimo.de>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>>> On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > >>>>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>>> I am a newbie to Apache Reef and am interested
> > >> in
> > >>>>>>>>>>> contributing
> > >>>>>>>>>>>> to
> > >>>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>>> reef
> > >>>>>>>>>>>>>>>>>>> dev efforts
> > >>>>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>> Welcome!
> > >>>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>> my JIRA id is kanjilal
> > >>>>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>> I have added you to the contributor's list on
> > >>> JIRA.
> > >>>>>>> This
> > >>>>>>>>>>>> basically
> > >>>>>>>>>>>>>>>> means
> > >>>>>>>>>>>>>>>>>> that you can self-assign issues to yourself now
> > >> :)
> > >>>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>> Markus
> > >>>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>> --
> > >>>>>>>>>>>>>>>>> Byung-Gon Chun
> > >>>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Pull request submitted :)))).
Thanks for all the help, will focus on getting windows build operational.
On Fri, Feb 10, 2017 at 5:06 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> Sure I can try that and that should work, on another note should we update
> the documentation to not say HEAD, I was mimicking the docs to the tee.
> Will let you know results.
>
> Sent from my iPhone
>
> > On Feb 10, 2017, at 4:48 PM, Douglas Service <ds...@gmail.com> wrote:
> >
> > You should have a branched named REEF-1739 on your dev machine where your
> > changes are located. Would you please try
> >
> > git push origin REEF-1739
> >
> >> On Fri, Feb 10, 2017 at 4:39 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
> >>
> >> ok so I fixed the problem of pointing to the wrong repo, namely I am now
> >> pointing to my repo for reef, here's what I see now:
> >>
> >> saikan@ubuntureef:~/code/localdevreef$ git push origin HEAD
> >> Username for 'https://github.com': skanjila
> >> Password for 'https://skanjila@github.com':
> >> error: unable to push to unqualified destination: HEAD
> >> The destination refspec neither matches an existing ref on the remote
> nor
> >> begins with refs/, and we are unable to guess a prefix based on the
> source
> >> ref.
> >> error: failed to push some refs to 'https://github.com/skanjila/
> reef.git'
> >>
> >> Here's what git remote -v yields:
> >> saikan@ubuntureef:~/code/localdevreef$ git remote -v
> >> origin https://github.com/skanjila/reef.git (fetch)
> >> origin https://github.com/skanjila/reef.git (push)
> >> upstream https://github.com/apache/reef.git (fetch)
> >> upstream https://github.com/apache/reef.git (push)
> >>
> >>
> >> My github alias is skanjila
> >>
> >>
> >> Here's what git status gives:
> >> saikan@ubuntureef:~/code/localdevreef$ git status
> >> interactive rebase in progress; onto e554dd3
> >> fatal: Could not open file .git/rebase-merge/done for reading: No such
> file
> >> or directory
> >>
> >>
> >>
> >> Thoughts?
> >>
> >>
> >>> On Fri, Feb 10, 2017 at 2:38 PM, Markus Weimer <ma...@weimo.de>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>> if `origin` refers to the apache/reef repositiory on GitHub OR the
> >>> repository on apache.org, you won't be able to push, as those repos
> are
> >>> read-only for you. Instead, you need to push to your own fork of REEF
> on
> >>> GitHub and then file a PR from that branch to apache/reef from there.
> >>>
> >>> Markus
> >>>
> >>> On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <ds...@gmail.com>
> >>> wrote:
> >>>
> >>>> also what is your GitHub alias?
> >>>>
> >>>> On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <ds...@gmail.com>
> >>>> wrote:
> >>>>
> >>>>> and git status from the REEF root directory.
> >>>>>
> >>>>> On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <ds...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> Would you please send the output of git remote -v?
> >>>>>>
> >>>>>> Doug
> >>>>>>
> >>>>>> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <sxk1969@gmail.com
> >>>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Folks,
> >>>>>>> I am trying to create/deploy my first pull request, I've gone
> >> through
> >>>> all
> >>>>>>> of these steps successfully here:
> >>>>>>> https://cwiki.apache.org/confluence/display/REEF/Contributin
> >>>>>>> g#Contributing-1.Forkrepository
> >>>>>>> but I seem to be running into 403 errors when I do a git push
> >> origin
> >>>>>>> HEAD,
> >>>>>>> here are my creds, would really appreciate some help:
> >>>>>>>
> >>>>>>>
> >>>>>>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> >>>>>>> github username: skanjila
> >>>>>>>
> >>>>>>>
> >>>>>>> Please let me know what I am missing here, note that my id in JIRA
> >> is
> >>>>>>> kanjilal but my github userid is skanjila, might this be a problem?
> >>>>>>>
> >>>>>>> Thanks in advance.
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sxk1969@gmail.com
> >>>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> Well interesting piece of metadata, time for successfully
> >>> completing
> >>>>>>>> windows server 2016 build was about half the time for linux, at
> >>> least
> >>>>>>> for
> >>>>>>>> the java build, will try csharp next
> >>>>>>>>
> >>>>>>>> Here's what I did:
> >>>>>>>> 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> >>>>>>>> 2) mvn clean install -DskipTests=true
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> For posterity's sake I will go back and redo my ubuntu linux
> >> build
> >>>> and
> >>>>>>>> then work on the JIRA-1739 to make sure the documentation is up
> >> to
> >>>>>>> date as
> >>>>>>>> needed. I will install java from the repositories this time.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <
> >> sxk1969@gmail.com
> >>>>
> >>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Yes I have gone through that in the past, not sure why I decided
> >>> not
> >>>>>>> to
> >>>>>>>>> include that repo and just download the jdk and put it in
> >> instead
> >>>> :),
> >>>>>>>>> regardless I will send a pull request for the build cleanup in
> >> the
> >>>>>>> next few
> >>>>>>>>> days, lets iterate on it as a team and test drive it to prove it
> >>>>>>> wrong or
> >>>>>>>>> right
> >>>>>>>>>
> >>>>>>>>> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <
> >>> dsopsrc@gmail.com>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> After thinking about all of the changes you had make and the
> >> fact
> >>>>>>> that
> >>>>>>>>>> oracle java does not show up in update-alternatives, you may
> >> want
> >>>> to
> >>>>>>> look
> >>>>>>>>>> at these instructions which tell how to install oracle java via
> >>>>>>> apt-get
> >>>>>>>>>> repository which automatically takes care of a lot of the
> >> issues
> >>>> you
> >>>>>>> ran
> >>>>>>>>>> into
> >>>>>>>>>> https://www.digitalocean.com/community/tutorials/how-to-inst
> >>>>>>>>>> all-java-on-ubuntu-with-apt-get
> >>>>>>>>>> .
> >>>>>>>>>>
> >>>>>>>>>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
> >>>> sxk1969@gmail.com>
> >>>>>>>>>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>> I think part of the difference is the way both of us
> >> installed
> >>>>>>> java, my
> >>>>>>>>>>> setup is using the oracle java as opposed to the open-jdk
> >> java
> >>>>>>>>>> provided by
> >>>>>>>>>>> update-alternatives, I agree with your instructions
> >> assessment.
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> On another note I have a question, how did folks install
> >> protoc
> >>>> on
> >>>>>>>>>> windows,
> >>>>>>>>>>> in looking at the wiki it points you to the protoc site where
> >>> it
> >>>>>>> seems
> >>>>>>>>>> to
> >>>>>>>>>>> need a whole bunch of supporting tools (cmake/mingw etc), I
> >> am
> >>>>>>> using
> >>>>>>>>>>> gitbash on windows and was wondering if there's an easy way
> >> to
> >>>>>>>>>> download the
> >>>>>>>>>>> protoc binaries and set the path, please forgive me if this
> >> is
> >>> in
> >>>>>>> the
> >>>>>>>>>>> documentation somewhere, still learning my way around.
> >>>>>>>>>>>
> >>>>>>>>>>> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
> >>>>>>> dsopsrc@gmail.com>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> What I mean is that we should provide instructions to setup
> >>> the
> >>>>>>> least
> >>>>>>>>>>>> complicated build environment that works, not one that is
> >>> more
> >>>>>>>>>>> complicated
> >>>>>>>>>>>> but also works.
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> >>>>>>> dsopsrc@gmail.com>
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> Do you have update-alternatives installed? Have you run
> >>>>>>>>>>>>> update-alternatives --config java?
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Sorry I made a mistake in may last email, I actually have
> >>>>>>>>>> JAVA_HOME set
> >>>>>>>>>>>> to
> >>>>>>>>>>>>> /usr as listed on the webpage which figured out from
> >>> Sergiy.
> >>>>>>>>>> However, I
> >>>>>>>>>>>> do
> >>>>>>>>>>>>> not need to set the other ones. It is important that our
> >>>>>>>>>> contributing
> >>>>>>>>>>> to
> >>>>>>>>>>>>> REEF wiki be general and not specific to a single setup.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Here is my environment for building REEF on Ubuntu 16.04.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> dougse@reefdevlx:/code/reef [master ↑]$$ env
> >>>>>>>>>>>>> MATE_DESKTOP_SESSION_ID=this-is-deprecated
> >>>>>>>>>>>>> XDG_SESSION_ID=c2
> >>>>>>>>>>>>> SHELL=/bin/bash
> >>>>>>>>>>>>> TERM=xterm
> >>>>>>>>>>>>> WINDOWID=44144243
> >>>>>>>>>>>>> USER=dougse
> >>>>>>>>>>>>> LS_COLORS=rs=0:di=01;34:ln=01;
> >>> 36:mh=00:pi=40;33:so=01;35:do=
> >>>>>>>>>>>>> 01;35:bd=40;33;01:cd=40;33;01:
> >>> or=40;31;01:mi=00:su=37;41:sg=
> >>>>>>>>>>>>> 30;43:ca=30;41:tw=30;42:ow=34;
> >>> 42:st=37;44:ex=01;32:*.tar=01;
> >>>>>>>>>>>>> 31:*.tgz=01;31:*.arc=01;31:*.
> >> arj=01;31:*.taz=01;31:*.lha=
> >>>>>>>>>>>>> 01;31:*.lz4=01;31:*.lzh=01;31:
> >> *.lzma=01;31:*.tlz=01;31:*.
> >>>>>>>>>>>>> txz=01;31:*.tzo=01;31:*.t7z=
> >> 01;31:*.zip=01;31:*.z=01;31:*.
> >>>>>>>>>>>>> Z=01;31:*.dz=01;31:*.gz=01;31:
> >>> *.lrz=01;31:*.lz=01;31:*.lzo=
> >>>>>>>>>>>>> 01;31:*.xz=01;31:*.bz2=01;31:*
> >>> .bz=01;31:*.tbz=01;31:*.tbz2=
> >>>>>>>>>>>>> 01;31:*.tz=01;31:*.deb=01;31:*
> >>> .rpm=01;31:*.jar=01;31:*.war=
> >>>>>>>>>>>>> 01;31:*.ear=01;31:*.sar=01;31:
> >>> *.rar=01;31:*.alz=01;31:*.ace=
> >>>>>>>>>>>>> 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> >>>>>>>>>>>>> cab=01;31:*.jpg=01;35:*.jpeg=
> >>> 01;35:*.gif=01;35:*.bmp=01;35:
> >>>>>>>>>>>>> *.pbm=01;35:*.pgm=01;35:*.ppm=
> >>> 01;35:*.tga=01;35:*.xbm=01;35:
> >>>>>>>>>>>>> *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> >>>>>>>>>>>>> 01;35:*.svgz=01;35:*.mng=01;
> >> 35:*.pcx=01;35:*.mov=01;35:*.
> >>>>>>>>>>>>> mpg=01;35:*.mpeg=01;35:*.m2v=
> >> 01;35:*.mkv=01;35:*.webm=01;
> >>>>>>>>>>>>> 35:*.ogm=01;35:*.mp4=01;35:*.
> >> m4v=01;35:*.mp4v=01;35:*.vob=
> >>>>>>>>>>>>> 01;35:*.qt=01;35:*.nuv=01;35:*
> >> .wmv=01;35:*.asf=01;35:*.rm=
> >>>>>>>>>>>>> 01;35:*.rmvb=01;35:*.flc=01;
> >> 35:*.avi=01;35:*.fli=01;35:*.
> >>>>>>>>>>>>> flv=01;35:*.gl=01;35:*.dl=01;
> >> 35:*.xcf=01;35:*.xwd=01;35:*.
> >>>>>>>>>>>>> yuv=01;35:*.cgm=01;35:*.emf=
> >> 01;35:*.ogv=01;35:*.ogx=01;35:
> >>>>>>>>>>>>> *.aac=00;36:*.au=00;36:*.flac=
> >>> 00;36:*.m4a=00;36:*.mid=00;36:
> >>>>>>>>>>>>> *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> >>>>>>>>>>>>> 00;36:*.ra=00;36:*.wav=00;36:*
> >>> .oga=00;36:*.opus=00;36:*.spx=
> >>>>>>>>>>>>> 00;36:*.xspf=00;36:
> >>>>>>>>>>>>> SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> >>>>>>>>>>>>> SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> >>>>>>>>>>>>> 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> >>>>>>>>>>>>> PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/
> >>> loca
> >>>>>>> l/bin
> >>>>>>>>>>>>> PWD=/code/reef
> >>>>>>>>>>>>> JAVA_HOME=/usr
> >>>>>>>>>>>>> LANG=en_US.UTF-8
> >>>>>>>>>>>>> REEF_HOME=/code/reef
> >>>>>>>>>>>>> SHLVL=1
> >>>>>>>>>>>>> HOME=/home/dougse
> >>>>>>>>>>>>> GTK_OVERLAY_SCROLLING=0
> >>>>>>>>>>>>> DBUS_SESSION_BUS_ADDRESS=unix:
> >>> abstract=/tmp/dbus-l06bsMWGy0,
> >>>>>>> guid=
> >>>>>>>>>>>>> ae74bbce18102091c11c7bd458939d1c
> >>>>>>>>>>>>> UID=1000
> >>>>>>>>>>>>> LESSOPEN=| /bin/lesspipe %s
> >>>>>>>>>>>>> XDG_RUNTIME_DIR=/run/user/1000
> >>>>>>>>>>>>> DISPLAY=:10.0
> >>>>>>>>>>>>> XDG_CURRENT_DESKTOP=MATE
> >>>>>>>>>>>>> LESSCLOSE=/bin/lesspipe %s %s
> >>>>>>>>>>>>> COLORTERM=mate-terminal
> >>>>>>>>>>>>> _=/usr/bin/env
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> >>>>>>> sxk1969@gmail.com
> >>>>>>>>>>>
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Weird, yes I did read that pageand yes I had to do those
> >>>> exact
> >>>>>>>>>> steps
> >>>>>>>>>>>> that
> >>>>>>>>>>>>>> I
> >>>>>>>>>>>>>> described, I haven't run the tests yet but fully suspect
> >>>> that
> >>>>>>> I'll
> >>>>>>>>>>> need
> >>>>>>>>>>>> to
> >>>>>>>>>>>>>> increase the ulimit to enable that. If you do a plain
> >>> maven
> >>>>>>> build
> >>>>>>>>>>> after
> >>>>>>>>>>>>>> checking out the reef code in ubuntu it complains that
> >>>>>>> JAVA_HOME
> >>>>>>>>>> is
> >>>>>>>>>>> not
> >>>>>>>>>>>>>> set, also its a good idea to set the maven oriented
> >>>>>>> environment
> >>>>>>>>>>>> variables
> >>>>>>>>>>>>>> because I highly suspect that in the future we may need
> >> to
> >>>>>>> adjust
> >>>>>>>>>> heap
> >>>>>>>>>>>>>> space settings, finally the LD_LIBRARY_PATH is needed I
> >>>>>>> suspect
> >>>>>>>>>>> because
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>> java code is invoking the protoc compiler at some point
> >>> and
> >>>> in
> >>>>>>>>>> order
> >>>>>>>>>>> to
> >>>>>>>>>>>> do
> >>>>>>>>>>>>>> so it much load some .so files that live in
> >>> LD_LIBRARY_PATH.
> >>>>>>> Net
> >>>>>>>>>> Net
> >>>>>>>>>>> we
> >>>>>>>>>>>>>> should definitely figure out the differences between
> >> your
> >>>> and
> >>>>>>>>>> Sergei's
> >>>>>>>>>>>>>> setup and mine, I believe IIRC I used ubuntu 16.10 but
> >> I'm
> >>>> not
> >>>>>>>>>>> convinced
> >>>>>>>>>>>>>> that the version matters if the major version is the
> >> same.
> >>>>>>>>>>>>>> Cheers
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> >>>>>>>>>> dsopsrc@gmail.com>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Hello Saikat,
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Did you read the documentation on this page
> >>>>>>>>>>>>>>> https://cwiki.apache.org/
> >> confluence/display/REEF/Linux
> >>> on
> >>>>>>> the
> >>>>>>>>>> REEF
> >>>>>>>>>>>> wiki
> >>>>>>>>>>>>>>> concerning Java on Ubuntu? I added this page after
> >>> setting
> >>>>>>> up a
> >>>>>>>>>>> Linux
> >>>>>>>>>>>>>> 16.04
> >>>>>>>>>>>>>>> to build REEF and trading emails with Sergiy on the
> >> dev
> >>>>>>> list.
> >>>>>>>>>> Note
> >>>>>>>>>>>>>> that I
> >>>>>>>>>>>>>>> do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH.
> >> However,
> >>>>>>> you do
> >>>>>>>>>> need
> >>>>>>>>>>>> to
> >>>>>>>>>>>>>>> change the default for ulimit -n in bash to get the
> >>> tests
> >>>>>>> to run
> >>>>>>>>>>> which
> >>>>>>>>>>>>>> is
> >>>>>>>>>>>>>>> also described.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Doug
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> >>>>>>>>>> sxk1969@gmail.com>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> A battle well fought and won, got reef to build
> >>>>>>> successfully
> >>>>>>>>>> on
> >>>>>>>>>>>> ubuntu
> >>>>>>>>>>>>>>>> linux vm after hours of hacking, fyi here's what I
> >> had
> >>>> to
> >>>>>>> do:
> >>>>>>>>>>>>>>>> 1) installed the necessary tools (jdk 1.7/maven
> >>>>>>> 3.3.9/protoc
> >>>>>>>>>>> version
> >>>>>>>>>>>>>> 2.5)
> >>>>>>>>>>>>>>>> 2) added JAVA_HOME and M2_HOME
> >>>>>>>>>>>>>>>> 3) here's the kicker that's not in the documentation
> >>> :)
> >>>> (
> >>>>>>>>>>>>>>>> https://github.com/apache/reef
> >>>>>>> /blob/master/lang/java/BUILD.md
> >>>>>>>>>> ),
> >>>>>>>>>>> had
> >>>>>>>>>>>>>> to
> >>>>>>>>>>>>>>> add
> >>>>>>>>>>>>>>>> LD_LIBRARY_PATH environment variable and have it
> >> point
> >>>> to
> >>>>>>>>>>>>>> /usr/local/lib
> >>>>>>>>>>>>>>>> where the shared library for protobuf is installed
> >>>>>>>>>>>>>>>> 4) had to add JAVA_HOME and M2_HOME to path (also
> >> not
> >>> in
> >>>>>>> the
> >>>>>>>>>>>>>>> documentation
> >>>>>>>>>>>>>>>> :) )
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> [INFO]
> >>>>>>>>>>>>>>>> ------------------------------
> >>>>>>> ------------------------------
> >>>>>>>>>>>>>> ------------
> >>>>>>>>>>>>>>>> [INFO] Reactor Summary:
> >>>>>>>>>>>>>>>> [INFO]
> >>>>>>>>>>>>>>>> [INFO] REEF ..............................
> >>>>>>> .................
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 4.167 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Dot Net ..............................
> >>>>>>> .........
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 1.628 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Annotations
> >> ..............................
> >>>>>>> .....
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 5.509 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Utils ..............................
> >>>>>>> ...........
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 5.747 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Tang Project
> >>> ..............................
> >>>>>>> ....
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 0.492 s]
> >>>>>>>>>>>>>>>> [INFO] Tang Test Jar A
> >> ..............................
> >>>>>>> ......
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 4.276 s]
> >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B
> >> ..............................
> >>>>>>> ......
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 4.186 s]
> >>>>>>>>>>>>>>>> [INFO] Tang Test Jar AB
> >> ..............................
> >>>>>>> .....
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 4.376 s]
> >>>>>>>>>>>>>>>> [INFO] Tang Test Jar B conflict A
> >>>>>>> .........................
> >>>>>>>>>>> SUCCESS
> >>>>>>>>>>>> [
> >>>>>>>>>>>>>>>> 0.440 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Tang ..............................
> >>>>>>> ............
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 24.779 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Wake Project
> >>> ..............................
> >>>>>>> ....
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 0.487 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Wake ..............................
> >>>>>>> ............
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 15.587 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Common ..............................
> >>>>>>> ..........
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 23.343 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Runtime Local
> >>> ..............................
> >>>>>>> ...
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 8.375 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Applications
> >>> ..............................
> >>>>>>> ....
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 0.416 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Vortex ..............................
> >>>>>>> ..........
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 11.263 s]
> >>>>>>>>>>>>>>>> [INFO] REEF HTTP Server
> >> ..............................
> >>>>>>> .....
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 9.772 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Utils for Hadoop
> >>>>>>> ..............................
> >>>>>>>>>>> SUCCESS
> >>>>>>>>>>>> [
> >>>>>>>>>>>>>>>> 5.881 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Runtime for YARN
> >>>>>>> ..............................
> >>>>>>>>>>> SUCCESS
> >>>>>>>>>>>> [
> >>>>>>>>>>>>>>>> 11.041 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Runtime for HDInsight
> >>>>>>> .........................
> >>>>>>>>>>> SUCCESS
> >>>>>>>>>>>> [
> >>>>>>>>>>>>>>>> 9.719 s]
> >>>>>>>>>>>>>>>> [INFO] REEF IO ..............................
> >>>>>>> ..............
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 23.729 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Checkpoint
> >> ..............................
> >>>>>>> ......
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 5.771 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Bridge Java
> >> ..............................
> >>>>>>> .....
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 11.981 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Runtime for multiple runtime scenarios
> >>>>>>> ........
> >>>>>>>>>>> SUCCESS
> >>>>>>>>>>>> [
> >>>>>>>>>>>>>>>> 7.898 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Bridge (Client)
> >>>> ..............................
> >>>>>>> .
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 12.242 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Runtime Standalone
> >>>>>>> ............................
> >>>>>>>>>>> SUCCESS
> >>>>>>>>>>>> [
> >>>>>>>>>>>>>>>> 7.779 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Runtime for Mesos
> >>>>>>> .............................
> >>>>>>>>>>> SUCCESS
> >>>>>>>>>>>> [
> >>>>>>>>>>>>>>>> 11.103 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Poison ..............................
> >>>>>>> ..........
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 5.384 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Examples ..............................
> >>>>>>> ........
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 14.313 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Examples CLR
> >>> ..............................
> >>>>>>> ....
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 7.532 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Examples on HDInsight
> >>>>>>> .........................
> >>>>>>>>>>> SUCCESS
> >>>>>>>>>>>> [
> >>>>>>>>>>>>>>>> 9.213 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Tang Tint ..............................
> >>>>>>> .......
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 8.546 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Tests ..............................
> >>>>>>> ...........
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 15.696 s]
> >>>>>>>>>>>>>>>> [INFO] REEF Website ..............................
> >>>>>>> .........
> >>>>>>>>>>>> SUCCESS [
> >>>>>>>>>>>>>>>> 1.033 s]
> >>>>>>>>>>>>>>>> [INFO]
> >>>>>>>>>>>>>>>> ------------------------------
> >>>>>>> ------------------------------
> >>>>>>>>>>>>>> ------------
> >>>>>>>>>>>>>>>> [INFO] BUILD SUCCESS
> >>>>>>>>>>>>>>>> [INFO]
> >>>>>>>>>>>>>>>> ------------------------------
> >>>>>>> ------------------------------
> >>>>>>>>>>>>>> ------------
> >>>>>>>>>>>>>>>> [INFO] Total time: 04:54 min
> >>>>>>>>>>>>>>>> [INFO] Finished at: 2017-02-09T01:21:17+00:00
> >>>>>>>>>>>>>>>> [INFO] Final Memory: 125M/1238M
> >>>>>>>>>>>>>>>> [INFO]
> >>>>>>>>>>>>>>>> ------------------------------
> >>>>>>> ------------------------------
> >>>>>>>>>>>>>> ------------
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> On to bigger and better things :), we should
> >> probably
> >>>>>>> update
> >>>>>>>>>> the
> >>>>>>>>>>>> docs
> >>>>>>>>>>>>>> to
> >>>>>>>>>>>>>>>> reflect the current build process subtleties. Will
> >>> try
> >>>>>>>>>> windows
> >>>>>>>>>>>> next.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> >>>>>>>>>> bgchun@gmail.com
> >>>>>>>>>>>>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Welcome, Saikat!
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> >>>>>>>>>> markus@weimo.de>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> On 2017-02-08 11:19, Saikat Kanjilal wrote:
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> I am a newbie to Apache Reef and am interested
> >> in
> >>>>>>>>>>> contributing
> >>>>>>>>>>>> to
> >>>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>>> reef
> >>>>>>>>>>>>>>>>>>> dev efforts
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Welcome!
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> my JIRA id is kanjilal
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> I have added you to the contributor's list on
> >>> JIRA.
> >>>>>>> This
> >>>>>>>>>>>> basically
> >>>>>>>>>>>>>>>> means
> >>>>>>>>>>>>>>>>>> that you can self-assign issues to yourself now
> >> :)
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Markus
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> --
> >>>>>>>>>>>>>>>>> Byung-Gon Chun
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Sure I can try that and that should work, on another note should we update the documentation to not say HEAD, I was mimicking the docs to the tee. Will let you know results.
Sent from my iPhone
> On Feb 10, 2017, at 4:48 PM, Douglas Service <ds...@gmail.com> wrote:
>
> You should have a branched named REEF-1739 on your dev machine where your
> changes are located. Would you please try
>
> git push origin REEF-1739
>
>> On Fri, Feb 10, 2017 at 4:39 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
>>
>> ok so I fixed the problem of pointing to the wrong repo, namely I am now
>> pointing to my repo for reef, here's what I see now:
>>
>> saikan@ubuntureef:~/code/localdevreef$ git push origin HEAD
>> Username for 'https://github.com': skanjila
>> Password for 'https://skanjila@github.com':
>> error: unable to push to unqualified destination: HEAD
>> The destination refspec neither matches an existing ref on the remote nor
>> begins with refs/, and we are unable to guess a prefix based on the source
>> ref.
>> error: failed to push some refs to 'https://github.com/skanjila/reef.git'
>>
>> Here's what git remote -v yields:
>> saikan@ubuntureef:~/code/localdevreef$ git remote -v
>> origin https://github.com/skanjila/reef.git (fetch)
>> origin https://github.com/skanjila/reef.git (push)
>> upstream https://github.com/apache/reef.git (fetch)
>> upstream https://github.com/apache/reef.git (push)
>>
>>
>> My github alias is skanjila
>>
>>
>> Here's what git status gives:
>> saikan@ubuntureef:~/code/localdevreef$ git status
>> interactive rebase in progress; onto e554dd3
>> fatal: Could not open file .git/rebase-merge/done for reading: No such file
>> or directory
>>
>>
>>
>> Thoughts?
>>
>>
>>> On Fri, Feb 10, 2017 at 2:38 PM, Markus Weimer <ma...@weimo.de> wrote:
>>>
>>> Hi,
>>>
>>> if `origin` refers to the apache/reef repositiory on GitHub OR the
>>> repository on apache.org, you won't be able to push, as those repos are
>>> read-only for you. Instead, you need to push to your own fork of REEF on
>>> GitHub and then file a PR from that branch to apache/reef from there.
>>>
>>> Markus
>>>
>>> On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <ds...@gmail.com>
>>> wrote:
>>>
>>>> also what is your GitHub alias?
>>>>
>>>> On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <ds...@gmail.com>
>>>> wrote:
>>>>
>>>>> and git status from the REEF root directory.
>>>>>
>>>>> On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <ds...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Would you please send the output of git remote -v?
>>>>>>
>>>>>> Doug
>>>>>>
>>>>>> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <sxk1969@gmail.com
>>>
>>>>>> wrote:
>>>>>>
>>>>>>> Folks,
>>>>>>> I am trying to create/deploy my first pull request, I've gone
>> through
>>>> all
>>>>>>> of these steps successfully here:
>>>>>>> https://cwiki.apache.org/confluence/display/REEF/Contributin
>>>>>>> g#Contributing-1.Forkrepository
>>>>>>> but I seem to be running into 403 errors when I do a git push
>> origin
>>>>>>> HEAD,
>>>>>>> here are my creds, would really appreciate some help:
>>>>>>>
>>>>>>>
>>>>>>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
>>>>>>> github username: skanjila
>>>>>>>
>>>>>>>
>>>>>>> Please let me know what I am missing here, note that my id in JIRA
>> is
>>>>>>> kanjilal but my github userid is skanjila, might this be a problem?
>>>>>>>
>>>>>>> Thanks in advance.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sxk1969@gmail.com
>>>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Well interesting piece of metadata, time for successfully
>>> completing
>>>>>>>> windows server 2016 build was about half the time for linux, at
>>> least
>>>>>>> for
>>>>>>>> the java build, will try csharp next
>>>>>>>>
>>>>>>>> Here's what I did:
>>>>>>>> 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
>>>>>>>> 2) mvn clean install -DskipTests=true
>>>>>>>>
>>>>>>>>
>>>>>>>> For posterity's sake I will go back and redo my ubuntu linux
>> build
>>>> and
>>>>>>>> then work on the JIRA-1739 to make sure the documentation is up
>> to
>>>>>>> date as
>>>>>>>> needed. I will install java from the repositories this time.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <
>> sxk1969@gmail.com
>>>>
>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Yes I have gone through that in the past, not sure why I decided
>>> not
>>>>>>> to
>>>>>>>>> include that repo and just download the jdk and put it in
>> instead
>>>> :),
>>>>>>>>> regardless I will send a pull request for the build cleanup in
>> the
>>>>>>> next few
>>>>>>>>> days, lets iterate on it as a team and test drive it to prove it
>>>>>>> wrong or
>>>>>>>>> right
>>>>>>>>>
>>>>>>>>> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <
>>> dsopsrc@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> After thinking about all of the changes you had make and the
>> fact
>>>>>>> that
>>>>>>>>>> oracle java does not show up in update-alternatives, you may
>> want
>>>> to
>>>>>>> look
>>>>>>>>>> at these instructions which tell how to install oracle java via
>>>>>>> apt-get
>>>>>>>>>> repository which automatically takes care of a lot of the
>> issues
>>>> you
>>>>>>> ran
>>>>>>>>>> into
>>>>>>>>>> https://www.digitalocean.com/community/tutorials/how-to-inst
>>>>>>>>>> all-java-on-ubuntu-with-apt-get
>>>>>>>>>> .
>>>>>>>>>>
>>>>>>>>>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
>>>> sxk1969@gmail.com>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> I think part of the difference is the way both of us
>> installed
>>>>>>> java, my
>>>>>>>>>>> setup is using the oracle java as opposed to the open-jdk
>> java
>>>>>>>>>> provided by
>>>>>>>>>>> update-alternatives, I agree with your instructions
>> assessment.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On another note I have a question, how did folks install
>> protoc
>>>> on
>>>>>>>>>> windows,
>>>>>>>>>>> in looking at the wiki it points you to the protoc site where
>>> it
>>>>>>> seems
>>>>>>>>>> to
>>>>>>>>>>> need a whole bunch of supporting tools (cmake/mingw etc), I
>> am
>>>>>>> using
>>>>>>>>>>> gitbash on windows and was wondering if there's an easy way
>> to
>>>>>>>>>> download the
>>>>>>>>>>> protoc binaries and set the path, please forgive me if this
>> is
>>> in
>>>>>>> the
>>>>>>>>>>> documentation somewhere, still learning my way around.
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
>>>>>>> dsopsrc@gmail.com>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> What I mean is that we should provide instructions to setup
>>> the
>>>>>>> least
>>>>>>>>>>>> complicated build environment that works, not one that is
>>> more
>>>>>>>>>>> complicated
>>>>>>>>>>>> but also works.
>>>>>>>>>>>>
>>>>>>>>>>>> On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
>>>>>>> dsopsrc@gmail.com>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Do you have update-alternatives installed? Have you run
>>>>>>>>>>>>> update-alternatives --config java?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Sorry I made a mistake in may last email, I actually have
>>>>>>>>>> JAVA_HOME set
>>>>>>>>>>>> to
>>>>>>>>>>>>> /usr as listed on the webpage which figured out from
>>> Sergiy.
>>>>>>>>>> However, I
>>>>>>>>>>>> do
>>>>>>>>>>>>> not need to set the other ones. It is important that our
>>>>>>>>>> contributing
>>>>>>>>>>> to
>>>>>>>>>>>>> REEF wiki be general and not specific to a single setup.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Here is my environment for building REEF on Ubuntu 16.04.
>>>>>>>>>>>>>
>>>>>>>>>>>>> dougse@reefdevlx:/code/reef [master ↑]$$ env
>>>>>>>>>>>>> MATE_DESKTOP_SESSION_ID=this-is-deprecated
>>>>>>>>>>>>> XDG_SESSION_ID=c2
>>>>>>>>>>>>> SHELL=/bin/bash
>>>>>>>>>>>>> TERM=xterm
>>>>>>>>>>>>> WINDOWID=44144243
>>>>>>>>>>>>> USER=dougse
>>>>>>>>>>>>> LS_COLORS=rs=0:di=01;34:ln=01;
>>> 36:mh=00:pi=40;33:so=01;35:do=
>>>>>>>>>>>>> 01;35:bd=40;33;01:cd=40;33;01:
>>> or=40;31;01:mi=00:su=37;41:sg=
>>>>>>>>>>>>> 30;43:ca=30;41:tw=30;42:ow=34;
>>> 42:st=37;44:ex=01;32:*.tar=01;
>>>>>>>>>>>>> 31:*.tgz=01;31:*.arc=01;31:*.
>> arj=01;31:*.taz=01;31:*.lha=
>>>>>>>>>>>>> 01;31:*.lz4=01;31:*.lzh=01;31:
>> *.lzma=01;31:*.tlz=01;31:*.
>>>>>>>>>>>>> txz=01;31:*.tzo=01;31:*.t7z=
>> 01;31:*.zip=01;31:*.z=01;31:*.
>>>>>>>>>>>>> Z=01;31:*.dz=01;31:*.gz=01;31:
>>> *.lrz=01;31:*.lz=01;31:*.lzo=
>>>>>>>>>>>>> 01;31:*.xz=01;31:*.bz2=01;31:*
>>> .bz=01;31:*.tbz=01;31:*.tbz2=
>>>>>>>>>>>>> 01;31:*.tz=01;31:*.deb=01;31:*
>>> .rpm=01;31:*.jar=01;31:*.war=
>>>>>>>>>>>>> 01;31:*.ear=01;31:*.sar=01;31:
>>> *.rar=01;31:*.alz=01;31:*.ace=
>>>>>>>>>>>>> 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
>>>>>>>>>>>>> cab=01;31:*.jpg=01;35:*.jpeg=
>>> 01;35:*.gif=01;35:*.bmp=01;35:
>>>>>>>>>>>>> *.pbm=01;35:*.pgm=01;35:*.ppm=
>>> 01;35:*.tga=01;35:*.xbm=01;35:
>>>>>>>>>>>>> *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
>>>>>>>>>>>>> 01;35:*.svgz=01;35:*.mng=01;
>> 35:*.pcx=01;35:*.mov=01;35:*.
>>>>>>>>>>>>> mpg=01;35:*.mpeg=01;35:*.m2v=
>> 01;35:*.mkv=01;35:*.webm=01;
>>>>>>>>>>>>> 35:*.ogm=01;35:*.mp4=01;35:*.
>> m4v=01;35:*.mp4v=01;35:*.vob=
>>>>>>>>>>>>> 01;35:*.qt=01;35:*.nuv=01;35:*
>> .wmv=01;35:*.asf=01;35:*.rm=
>>>>>>>>>>>>> 01;35:*.rmvb=01;35:*.flc=01;
>> 35:*.avi=01;35:*.fli=01;35:*.
>>>>>>>>>>>>> flv=01;35:*.gl=01;35:*.dl=01;
>> 35:*.xcf=01;35:*.xwd=01;35:*.
>>>>>>>>>>>>> yuv=01;35:*.cgm=01;35:*.emf=
>> 01;35:*.ogv=01;35:*.ogx=01;35:
>>>>>>>>>>>>> *.aac=00;36:*.au=00;36:*.flac=
>>> 00;36:*.m4a=00;36:*.mid=00;36:
>>>>>>>>>>>>> *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
>>>>>>>>>>>>> 00;36:*.ra=00;36:*.wav=00;36:*
>>> .oga=00;36:*.opus=00;36:*.spx=
>>>>>>>>>>>>> 00;36:*.xspf=00;36:
>>>>>>>>>>>>> SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
>>>>>>>>>>>>> SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
>>>>>>>>>>>>> 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
>>>>>>>>>>>>> PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/
>>> loca
>>>>>>> l/bin
>>>>>>>>>>>>> PWD=/code/reef
>>>>>>>>>>>>> JAVA_HOME=/usr
>>>>>>>>>>>>> LANG=en_US.UTF-8
>>>>>>>>>>>>> REEF_HOME=/code/reef
>>>>>>>>>>>>> SHLVL=1
>>>>>>>>>>>>> HOME=/home/dougse
>>>>>>>>>>>>> GTK_OVERLAY_SCROLLING=0
>>>>>>>>>>>>> DBUS_SESSION_BUS_ADDRESS=unix:
>>> abstract=/tmp/dbus-l06bsMWGy0,
>>>>>>> guid=
>>>>>>>>>>>>> ae74bbce18102091c11c7bd458939d1c
>>>>>>>>>>>>> UID=1000
>>>>>>>>>>>>> LESSOPEN=| /bin/lesspipe %s
>>>>>>>>>>>>> XDG_RUNTIME_DIR=/run/user/1000
>>>>>>>>>>>>> DISPLAY=:10.0
>>>>>>>>>>>>> XDG_CURRENT_DESKTOP=MATE
>>>>>>>>>>>>> LESSCLOSE=/bin/lesspipe %s %s
>>>>>>>>>>>>> COLORTERM=mate-terminal
>>>>>>>>>>>>> _=/usr/bin/env
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
>>>>>>> sxk1969@gmail.com
>>>>>>>>>>>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Weird, yes I did read that pageand yes I had to do those
>>>> exact
>>>>>>>>>> steps
>>>>>>>>>>>> that
>>>>>>>>>>>>>> I
>>>>>>>>>>>>>> described, I haven't run the tests yet but fully suspect
>>>> that
>>>>>>> I'll
>>>>>>>>>>> need
>>>>>>>>>>>> to
>>>>>>>>>>>>>> increase the ulimit to enable that. If you do a plain
>>> maven
>>>>>>> build
>>>>>>>>>>> after
>>>>>>>>>>>>>> checking out the reef code in ubuntu it complains that
>>>>>>> JAVA_HOME
>>>>>>>>>> is
>>>>>>>>>>> not
>>>>>>>>>>>>>> set, also its a good idea to set the maven oriented
>>>>>>> environment
>>>>>>>>>>>> variables
>>>>>>>>>>>>>> because I highly suspect that in the future we may need
>> to
>>>>>>> adjust
>>>>>>>>>> heap
>>>>>>>>>>>>>> space settings, finally the LD_LIBRARY_PATH is needed I
>>>>>>> suspect
>>>>>>>>>>> because
>>>>>>>>>>>>>> the
>>>>>>>>>>>>>> java code is invoking the protoc compiler at some point
>>> and
>>>> in
>>>>>>>>>> order
>>>>>>>>>>> to
>>>>>>>>>>>> do
>>>>>>>>>>>>>> so it much load some .so files that live in
>>> LD_LIBRARY_PATH.
>>>>>>> Net
>>>>>>>>>> Net
>>>>>>>>>>> we
>>>>>>>>>>>>>> should definitely figure out the differences between
>> your
>>>> and
>>>>>>>>>> Sergei's
>>>>>>>>>>>>>> setup and mine, I believe IIRC I used ubuntu 16.10 but
>> I'm
>>>> not
>>>>>>>>>>> convinced
>>>>>>>>>>>>>> that the version matters if the major version is the
>> same.
>>>>>>>>>>>>>> Cheers
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
>>>>>>>>>> dsopsrc@gmail.com>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hello Saikat,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Did you read the documentation on this page
>>>>>>>>>>>>>>> https://cwiki.apache.org/
>> confluence/display/REEF/Linux
>>> on
>>>>>>> the
>>>>>>>>>> REEF
>>>>>>>>>>>> wiki
>>>>>>>>>>>>>>> concerning Java on Ubuntu? I added this page after
>>> setting
>>>>>>> up a
>>>>>>>>>>> Linux
>>>>>>>>>>>>>> 16.04
>>>>>>>>>>>>>>> to build REEF and trading emails with Sergiy on the
>> dev
>>>>>>> list.
>>>>>>>>>> Note
>>>>>>>>>>>>>> that I
>>>>>>>>>>>>>>> do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH.
>> However,
>>>>>>> you do
>>>>>>>>>> need
>>>>>>>>>>>> to
>>>>>>>>>>>>>>> change the default for ulimit -n in bash to get the
>>> tests
>>>>>>> to run
>>>>>>>>>>> which
>>>>>>>>>>>>>> is
>>>>>>>>>>>>>>> also described.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Doug
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
>>>>>>>>>> sxk1969@gmail.com>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> A battle well fought and won, got reef to build
>>>>>>> successfully
>>>>>>>>>> on
>>>>>>>>>>>> ubuntu
>>>>>>>>>>>>>>>> linux vm after hours of hacking, fyi here's what I
>> had
>>>> to
>>>>>>> do:
>>>>>>>>>>>>>>>> 1) installed the necessary tools (jdk 1.7/maven
>>>>>>> 3.3.9/protoc
>>>>>>>>>>> version
>>>>>>>>>>>>>> 2.5)
>>>>>>>>>>>>>>>> 2) added JAVA_HOME and M2_HOME
>>>>>>>>>>>>>>>> 3) here's the kicker that's not in the documentation
>>> :)
>>>> (
>>>>>>>>>>>>>>>> https://github.com/apache/reef
>>>>>>> /blob/master/lang/java/BUILD.md
>>>>>>>>>> ),
>>>>>>>>>>> had
>>>>>>>>>>>>>> to
>>>>>>>>>>>>>>> add
>>>>>>>>>>>>>>>> LD_LIBRARY_PATH environment variable and have it
>> point
>>>> to
>>>>>>>>>>>>>> /usr/local/lib
>>>>>>>>>>>>>>>> where the shared library for protobuf is installed
>>>>>>>>>>>>>>>> 4) had to add JAVA_HOME and M2_HOME to path (also
>> not
>>> in
>>>>>>> the
>>>>>>>>>>>>>>> documentation
>>>>>>>>>>>>>>>> :) )
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> [INFO]
>>>>>>>>>>>>>>>> ------------------------------
>>>>>>> ------------------------------
>>>>>>>>>>>>>> ------------
>>>>>>>>>>>>>>>> [INFO] Reactor Summary:
>>>>>>>>>>>>>>>> [INFO]
>>>>>>>>>>>>>>>> [INFO] REEF ..............................
>>>>>>> .................
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 4.167 s]
>>>>>>>>>>>>>>>> [INFO] REEF Dot Net ..............................
>>>>>>> .........
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 1.628 s]
>>>>>>>>>>>>>>>> [INFO] REEF Annotations
>> ..............................
>>>>>>> .....
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 5.509 s]
>>>>>>>>>>>>>>>> [INFO] REEF Utils ..............................
>>>>>>> ...........
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 5.747 s]
>>>>>>>>>>>>>>>> [INFO] REEF Tang Project
>>> ..............................
>>>>>>> ....
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 0.492 s]
>>>>>>>>>>>>>>>> [INFO] Tang Test Jar A
>> ..............................
>>>>>>> ......
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 4.276 s]
>>>>>>>>>>>>>>>> [INFO] Tang Test Jar B
>> ..............................
>>>>>>> ......
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 4.186 s]
>>>>>>>>>>>>>>>> [INFO] Tang Test Jar AB
>> ..............................
>>>>>>> .....
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 4.376 s]
>>>>>>>>>>>>>>>> [INFO] Tang Test Jar B conflict A
>>>>>>> .........................
>>>>>>>>>>> SUCCESS
>>>>>>>>>>>> [
>>>>>>>>>>>>>>>> 0.440 s]
>>>>>>>>>>>>>>>> [INFO] REEF Tang ..............................
>>>>>>> ............
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 24.779 s]
>>>>>>>>>>>>>>>> [INFO] REEF Wake Project
>>> ..............................
>>>>>>> ....
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 0.487 s]
>>>>>>>>>>>>>>>> [INFO] REEF Wake ..............................
>>>>>>> ............
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 15.587 s]
>>>>>>>>>>>>>>>> [INFO] REEF Common ..............................
>>>>>>> ..........
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 23.343 s]
>>>>>>>>>>>>>>>> [INFO] REEF Runtime Local
>>> ..............................
>>>>>>> ...
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 8.375 s]
>>>>>>>>>>>>>>>> [INFO] REEF Applications
>>> ..............................
>>>>>>> ....
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 0.416 s]
>>>>>>>>>>>>>>>> [INFO] REEF Vortex ..............................
>>>>>>> ..........
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 11.263 s]
>>>>>>>>>>>>>>>> [INFO] REEF HTTP Server
>> ..............................
>>>>>>> .....
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 9.772 s]
>>>>>>>>>>>>>>>> [INFO] REEF Utils for Hadoop
>>>>>>> ..............................
>>>>>>>>>>> SUCCESS
>>>>>>>>>>>> [
>>>>>>>>>>>>>>>> 5.881 s]
>>>>>>>>>>>>>>>> [INFO] REEF Runtime for YARN
>>>>>>> ..............................
>>>>>>>>>>> SUCCESS
>>>>>>>>>>>> [
>>>>>>>>>>>>>>>> 11.041 s]
>>>>>>>>>>>>>>>> [INFO] REEF Runtime for HDInsight
>>>>>>> .........................
>>>>>>>>>>> SUCCESS
>>>>>>>>>>>> [
>>>>>>>>>>>>>>>> 9.719 s]
>>>>>>>>>>>>>>>> [INFO] REEF IO ..............................
>>>>>>> ..............
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 23.729 s]
>>>>>>>>>>>>>>>> [INFO] REEF Checkpoint
>> ..............................
>>>>>>> ......
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 5.771 s]
>>>>>>>>>>>>>>>> [INFO] REEF Bridge Java
>> ..............................
>>>>>>> .....
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 11.981 s]
>>>>>>>>>>>>>>>> [INFO] REEF Runtime for multiple runtime scenarios
>>>>>>> ........
>>>>>>>>>>> SUCCESS
>>>>>>>>>>>> [
>>>>>>>>>>>>>>>> 7.898 s]
>>>>>>>>>>>>>>>> [INFO] REEF Bridge (Client)
>>>> ..............................
>>>>>>> .
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 12.242 s]
>>>>>>>>>>>>>>>> [INFO] REEF Runtime Standalone
>>>>>>> ............................
>>>>>>>>>>> SUCCESS
>>>>>>>>>>>> [
>>>>>>>>>>>>>>>> 7.779 s]
>>>>>>>>>>>>>>>> [INFO] REEF Runtime for Mesos
>>>>>>> .............................
>>>>>>>>>>> SUCCESS
>>>>>>>>>>>> [
>>>>>>>>>>>>>>>> 11.103 s]
>>>>>>>>>>>>>>>> [INFO] REEF Poison ..............................
>>>>>>> ..........
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 5.384 s]
>>>>>>>>>>>>>>>> [INFO] REEF Examples ..............................
>>>>>>> ........
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 14.313 s]
>>>>>>>>>>>>>>>> [INFO] REEF Examples CLR
>>> ..............................
>>>>>>> ....
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 7.532 s]
>>>>>>>>>>>>>>>> [INFO] REEF Examples on HDInsight
>>>>>>> .........................
>>>>>>>>>>> SUCCESS
>>>>>>>>>>>> [
>>>>>>>>>>>>>>>> 9.213 s]
>>>>>>>>>>>>>>>> [INFO] REEF Tang Tint ..............................
>>>>>>> .......
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 8.546 s]
>>>>>>>>>>>>>>>> [INFO] REEF Tests ..............................
>>>>>>> ...........
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 15.696 s]
>>>>>>>>>>>>>>>> [INFO] REEF Website ..............................
>>>>>>> .........
>>>>>>>>>>>> SUCCESS [
>>>>>>>>>>>>>>>> 1.033 s]
>>>>>>>>>>>>>>>> [INFO]
>>>>>>>>>>>>>>>> ------------------------------
>>>>>>> ------------------------------
>>>>>>>>>>>>>> ------------
>>>>>>>>>>>>>>>> [INFO] BUILD SUCCESS
>>>>>>>>>>>>>>>> [INFO]
>>>>>>>>>>>>>>>> ------------------------------
>>>>>>> ------------------------------
>>>>>>>>>>>>>> ------------
>>>>>>>>>>>>>>>> [INFO] Total time: 04:54 min
>>>>>>>>>>>>>>>> [INFO] Finished at: 2017-02-09T01:21:17+00:00
>>>>>>>>>>>>>>>> [INFO] Final Memory: 125M/1238M
>>>>>>>>>>>>>>>> [INFO]
>>>>>>>>>>>>>>>> ------------------------------
>>>>>>> ------------------------------
>>>>>>>>>>>>>> ------------
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On to bigger and better things :), we should
>> probably
>>>>>>> update
>>>>>>>>>> the
>>>>>>>>>>>> docs
>>>>>>>>>>>>>> to
>>>>>>>>>>>>>>>> reflect the current build process subtleties. Will
>>> try
>>>>>>>>>> windows
>>>>>>>>>>>> next.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
>>>>>>>>>> bgchun@gmail.com
>>>>>>>>>>>>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Welcome, Saikat!
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
>>>>>>>>>> markus@weimo.de>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> On 2017-02-08 11:19, Saikat Kanjilal wrote:
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> I am a newbie to Apache Reef and am interested
>> in
>>>>>>>>>>> contributing
>>>>>>>>>>>> to
>>>>>>>>>>>>>>> the
>>>>>>>>>>>>>>>>> reef
>>>>>>>>>>>>>>>>>>> dev efforts
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Welcome!
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> my JIRA id is kanjilal
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> I have added you to the contributor's list on
>>> JIRA.
>>>>>>> This
>>>>>>>>>>>> basically
>>>>>>>>>>>>>>>> means
>>>>>>>>>>>>>>>>>> that you can self-assign issues to yourself now
>> :)
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Markus
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>> Byung-Gon Chun
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
You should have a branched named REEF-1739 on your dev machine where your
changes are located. Would you please try
git push origin REEF-1739
On Fri, Feb 10, 2017 at 4:39 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> ok so I fixed the problem of pointing to the wrong repo, namely I am now
> pointing to my repo for reef, here's what I see now:
>
> saikan@ubuntureef:~/code/localdevreef$ git push origin HEAD
> Username for 'https://github.com': skanjila
> Password for 'https://skanjila@github.com':
> error: unable to push to unqualified destination: HEAD
> The destination refspec neither matches an existing ref on the remote nor
> begins with refs/, and we are unable to guess a prefix based on the source
> ref.
> error: failed to push some refs to 'https://github.com/skanjila/reef.git'
>
> Here's what git remote -v yields:
> saikan@ubuntureef:~/code/localdevreef$ git remote -v
> origin https://github.com/skanjila/reef.git (fetch)
> origin https://github.com/skanjila/reef.git (push)
> upstream https://github.com/apache/reef.git (fetch)
> upstream https://github.com/apache/reef.git (push)
>
>
> My github alias is skanjila
>
>
> Here's what git status gives:
> saikan@ubuntureef:~/code/localdevreef$ git status
> interactive rebase in progress; onto e554dd3
> fatal: Could not open file .git/rebase-merge/done for reading: No such file
> or directory
>
>
>
> Thoughts?
>
>
> On Fri, Feb 10, 2017 at 2:38 PM, Markus Weimer <ma...@weimo.de> wrote:
>
> > Hi,
> >
> > if `origin` refers to the apache/reef repositiory on GitHub OR the
> > repository on apache.org, you won't be able to push, as those repos are
> > read-only for you. Instead, you need to push to your own fork of REEF on
> > GitHub and then file a PR from that branch to apache/reef from there.
> >
> > Markus
> >
> > On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <ds...@gmail.com>
> > wrote:
> >
> > > also what is your GitHub alias?
> > >
> > > On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <ds...@gmail.com>
> > > wrote:
> > >
> > > > and git status from the REEF root directory.
> > > >
> > > > On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <ds...@gmail.com>
> > > > wrote:
> > > >
> > > >> Would you please send the output of git remote -v?
> > > >>
> > > >> Doug
> > > >>
> > > >> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <sxk1969@gmail.com
> >
> > > >> wrote:
> > > >>
> > > >>> Folks,
> > > >>> I am trying to create/deploy my first pull request, I've gone
> through
> > > all
> > > >>> of these steps successfully here:
> > > >>> https://cwiki.apache.org/confluence/display/REEF/Contributin
> > > >>> g#Contributing-1.Forkrepository
> > > >>> but I seem to be running into 403 errors when I do a git push
> origin
> > > >>> HEAD,
> > > >>> here are my creds, would really appreciate some help:
> > > >>>
> > > >>>
> > > >>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> > > >>> github username: skanjila
> > > >>>
> > > >>>
> > > >>> Please let me know what I am missing here, note that my id in JIRA
> is
> > > >>> kanjilal but my github userid is skanjila, might this be a problem?
> > > >>>
> > > >>> Thanks in advance.
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sxk1969@gmail.com
> >
> > > >>> wrote:
> > > >>>
> > > >>> > Well interesting piece of metadata, time for successfully
> > completing
> > > >>> > windows server 2016 build was about half the time for linux, at
> > least
> > > >>> for
> > > >>> > the java build, will try csharp next
> > > >>> >
> > > >>> > Here's what I did:
> > > >>> > 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> > > >>> > 2) mvn clean install -DskipTests=true
> > > >>> >
> > > >>> >
> > > >>> > For posterity's sake I will go back and redo my ubuntu linux
> build
> > > and
> > > >>> > then work on the JIRA-1739 to make sure the documentation is up
> to
> > > >>> date as
> > > >>> > needed. I will install java from the repositories this time.
> > > >>> >
> > > >>> >
> > > >>> >
> > > >>> >
> > > >>> > On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <
> sxk1969@gmail.com
> > >
> > > >>> wrote:
> > > >>> >
> > > >>> >> Yes I have gone through that in the past, not sure why I decided
> > not
> > > >>> to
> > > >>> >> include that repo and just download the jdk and put it in
> instead
> > > :),
> > > >>> >> regardless I will send a pull request for the build cleanup in
> the
> > > >>> next few
> > > >>> >> days, lets iterate on it as a team and test drive it to prove it
> > > >>> wrong or
> > > >>> >> right
> > > >>> >>
> > > >>> >> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <
> > dsopsrc@gmail.com>
> > > >>> >> wrote:
> > > >>> >>
> > > >>> >>> After thinking about all of the changes you had make and the
> fact
> > > >>> that
> > > >>> >>> oracle java does not show up in update-alternatives, you may
> want
> > > to
> > > >>> look
> > > >>> >>> at these instructions which tell how to install oracle java via
> > > >>> apt-get
> > > >>> >>> repository which automatically takes care of a lot of the
> issues
> > > you
> > > >>> ran
> > > >>> >>> into
> > > >>> >>> https://www.digitalocean.com/community/tutorials/how-to-inst
> > > >>> >>> all-java-on-ubuntu-with-apt-get
> > > >>> >>> .
> > > >>> >>>
> > > >>> >>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
> > > sxk1969@gmail.com>
> > > >>> >>> wrote:
> > > >>> >>>
> > > >>> >>> > I think part of the difference is the way both of us
> installed
> > > >>> java, my
> > > >>> >>> > setup is using the oracle java as opposed to the open-jdk
> java
> > > >>> >>> provided by
> > > >>> >>> > update-alternatives, I agree with your instructions
> assessment.
> > > >>> >>> >
> > > >>> >>> >
> > > >>> >>> > On another note I have a question, how did folks install
> protoc
> > > on
> > > >>> >>> windows,
> > > >>> >>> > in looking at the wiki it points you to the protoc site where
> > it
> > > >>> seems
> > > >>> >>> to
> > > >>> >>> > need a whole bunch of supporting tools (cmake/mingw etc), I
> am
> > > >>> using
> > > >>> >>> > gitbash on windows and was wondering if there's an easy way
> to
> > > >>> >>> download the
> > > >>> >>> > protoc binaries and set the path, please forgive me if this
> is
> > in
> > > >>> the
> > > >>> >>> > documentation somewhere, still learning my way around.
> > > >>> >>> >
> > > >>> >>> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
> > > >>> dsopsrc@gmail.com>
> > > >>> >>> > wrote:
> > > >>> >>> >
> > > >>> >>> > > What I mean is that we should provide instructions to setup
> > the
> > > >>> least
> > > >>> >>> > > complicated build environment that works, not one that is
> > more
> > > >>> >>> > complicated
> > > >>> >>> > > but also works.
> > > >>> >>> > >
> > > >>> >>> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> > > >>> dsopsrc@gmail.com>
> > > >>> >>> > > wrote:
> > > >>> >>> > >
> > > >>> >>> > > > Do you have update-alternatives installed? Have you run
> > > >>> >>> > > > update-alternatives --config java?
> > > >>> >>> > > >
> > > >>> >>> > > > Sorry I made a mistake in may last email, I actually have
> > > >>> >>> JAVA_HOME set
> > > >>> >>> > > to
> > > >>> >>> > > > /usr as listed on the webpage which figured out from
> > Sergiy.
> > > >>> >>> However, I
> > > >>> >>> > > do
> > > >>> >>> > > > not need to set the other ones. It is important that our
> > > >>> >>> contributing
> > > >>> >>> > to
> > > >>> >>> > > > REEF wiki be general and not specific to a single setup.
> > > >>> >>> > > >
> > > >>> >>> > > > Here is my environment for building REEF on Ubuntu 16.04.
> > > >>> >>> > > >
> > > >>> >>> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> > > >>> >>> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > > >>> >>> > > > XDG_SESSION_ID=c2
> > > >>> >>> > > > SHELL=/bin/bash
> > > >>> >>> > > > TERM=xterm
> > > >>> >>> > > > WINDOWID=44144243
> > > >>> >>> > > > USER=dougse
> > > >>> >>> > > > LS_COLORS=rs=0:di=01;34:ln=01;
> > 36:mh=00:pi=40;33:so=01;35:do=
> > > >>> >>> > > > 01;35:bd=40;33;01:cd=40;33;01:
> > or=40;31;01:mi=00:su=37;41:sg=
> > > >>> >>> > > > 30;43:ca=30;41:tw=30;42:ow=34;
> > 42:st=37;44:ex=01;32:*.tar=01;
> > > >>> >>> > > > 31:*.tgz=01;31:*.arc=01;31:*.
> arj=01;31:*.taz=01;31:*.lha=
> > > >>> >>> > > > 01;31:*.lz4=01;31:*.lzh=01;31:
> *.lzma=01;31:*.tlz=01;31:*.
> > > >>> >>> > > > txz=01;31:*.tzo=01;31:*.t7z=
> 01;31:*.zip=01;31:*.z=01;31:*.
> > > >>> >>> > > > Z=01;31:*.dz=01;31:*.gz=01;31:
> > *.lrz=01;31:*.lz=01;31:*.lzo=
> > > >>> >>> > > > 01;31:*.xz=01;31:*.bz2=01;31:*
> > .bz=01;31:*.tbz=01;31:*.tbz2=
> > > >>> >>> > > > 01;31:*.tz=01;31:*.deb=01;31:*
> > .rpm=01;31:*.jar=01;31:*.war=
> > > >>> >>> > > > 01;31:*.ear=01;31:*.sar=01;31:
> > *.rar=01;31:*.alz=01;31:*.ace=
> > > >>> >>> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > > >>> >>> > > > cab=01;31:*.jpg=01;35:*.jpeg=
> > 01;35:*.gif=01;35:*.bmp=01;35:
> > > >>> >>> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=
> > 01;35:*.tga=01;35:*.xbm=01;35:
> > > >>> >>> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > > >>> >>> > > > 01;35:*.svgz=01;35:*.mng=01;
> 35:*.pcx=01;35:*.mov=01;35:*.
> > > >>> >>> > > > mpg=01;35:*.mpeg=01;35:*.m2v=
> 01;35:*.mkv=01;35:*.webm=01;
> > > >>> >>> > > > 35:*.ogm=01;35:*.mp4=01;35:*.
> m4v=01;35:*.mp4v=01;35:*.vob=
> > > >>> >>> > > > 01;35:*.qt=01;35:*.nuv=01;35:*
> .wmv=01;35:*.asf=01;35:*.rm=
> > > >>> >>> > > > 01;35:*.rmvb=01;35:*.flc=01;
> 35:*.avi=01;35:*.fli=01;35:*.
> > > >>> >>> > > > flv=01;35:*.gl=01;35:*.dl=01;
> 35:*.xcf=01;35:*.xwd=01;35:*.
> > > >>> >>> > > > yuv=01;35:*.cgm=01;35:*.emf=
> 01;35:*.ogv=01;35:*.ogx=01;35:
> > > >>> >>> > > > *.aac=00;36:*.au=00;36:*.flac=
> > 00;36:*.m4a=00;36:*.mid=00;36:
> > > >>> >>> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > > >>> >>> > > > 00;36:*.ra=00;36:*.wav=00;36:*
> > .oga=00;36:*.opus=00;36:*.spx=
> > > >>> >>> > > > 00;36:*.xspf=00;36:
> > > >>> >>> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > > >>> >>> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > > >>> >>> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > > >>> >>> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/
> > loca
> > > >>> l/bin
> > > >>> >>> > > > PWD=/code/reef
> > > >>> >>> > > > JAVA_HOME=/usr
> > > >>> >>> > > > LANG=en_US.UTF-8
> > > >>> >>> > > > REEF_HOME=/code/reef
> > > >>> >>> > > > SHLVL=1
> > > >>> >>> > > > HOME=/home/dougse
> > > >>> >>> > > > GTK_OVERLAY_SCROLLING=0
> > > >>> >>> > > > DBUS_SESSION_BUS_ADDRESS=unix:
> > abstract=/tmp/dbus-l06bsMWGy0,
> > > >>> guid=
> > > >>> >>> > > > ae74bbce18102091c11c7bd458939d1c
> > > >>> >>> > > > UID=1000
> > > >>> >>> > > > LESSOPEN=| /bin/lesspipe %s
> > > >>> >>> > > > XDG_RUNTIME_DIR=/run/user/1000
> > > >>> >>> > > > DISPLAY=:10.0
> > > >>> >>> > > > XDG_CURRENT_DESKTOP=MATE
> > > >>> >>> > > > LESSCLOSE=/bin/lesspipe %s %s
> > > >>> >>> > > > COLORTERM=mate-terminal
> > > >>> >>> > > > _=/usr/bin/env
> > > >>> >>> > > >
> > > >>> >>> > > >
> > > >>> >>> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> > > >>> sxk1969@gmail.com
> > > >>> >>> >
> > > >>> >>> > > wrote:
> > > >>> >>> > > >
> > > >>> >>> > > >> Weird, yes I did read that pageand yes I had to do those
> > > exact
> > > >>> >>> steps
> > > >>> >>> > > that
> > > >>> >>> > > >> I
> > > >>> >>> > > >> described, I haven't run the tests yet but fully suspect
> > > that
> > > >>> I'll
> > > >>> >>> > need
> > > >>> >>> > > to
> > > >>> >>> > > >> increase the ulimit to enable that. If you do a plain
> > maven
> > > >>> build
> > > >>> >>> > after
> > > >>> >>> > > >> checking out the reef code in ubuntu it complains that
> > > >>> JAVA_HOME
> > > >>> >>> is
> > > >>> >>> > not
> > > >>> >>> > > >> set, also its a good idea to set the maven oriented
> > > >>> environment
> > > >>> >>> > > variables
> > > >>> >>> > > >> because I highly suspect that in the future we may need
> to
> > > >>> adjust
> > > >>> >>> heap
> > > >>> >>> > > >> space settings, finally the LD_LIBRARY_PATH is needed I
> > > >>> suspect
> > > >>> >>> > because
> > > >>> >>> > > >> the
> > > >>> >>> > > >> java code is invoking the protoc compiler at some point
> > and
> > > in
> > > >>> >>> order
> > > >>> >>> > to
> > > >>> >>> > > do
> > > >>> >>> > > >> so it much load some .so files that live in
> > LD_LIBRARY_PATH.
> > > >>> Net
> > > >>> >>> Net
> > > >>> >>> > we
> > > >>> >>> > > >> should definitely figure out the differences between
> your
> > > and
> > > >>> >>> Sergei's
> > > >>> >>> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but
> I'm
> > > not
> > > >>> >>> > convinced
> > > >>> >>> > > >> that the version matters if the major version is the
> same.
> > > >>> >>> > > >> Cheers
> > > >>> >>> > > >>
> > > >>> >>> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> > > >>> >>> dsopsrc@gmail.com>
> > > >>> >>> > > >> wrote:
> > > >>> >>> > > >>
> > > >>> >>> > > >> > Hello Saikat,
> > > >>> >>> > > >> >
> > > >>> >>> > > >> > Did you read the documentation on this page
> > > >>> >>> > > >> > https://cwiki.apache.org/
> confluence/display/REEF/Linux
> > on
> > > >>> the
> > > >>> >>> REEF
> > > >>> >>> > > wiki
> > > >>> >>> > > >> > concerning Java on Ubuntu? I added this page after
> > setting
> > > >>> up a
> > > >>> >>> > Linux
> > > >>> >>> > > >> 16.04
> > > >>> >>> > > >> > to build REEF and trading emails with Sergiy on the
> dev
> > > >>> list.
> > > >>> >>> Note
> > > >>> >>> > > >> that I
> > > >>> >>> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH.
> However,
> > > >>> you do
> > > >>> >>> need
> > > >>> >>> > > to
> > > >>> >>> > > >> > change the default for ulimit -n in bash to get the
> > tests
> > > >>> to run
> > > >>> >>> > which
> > > >>> >>> > > >> is
> > > >>> >>> > > >> > also described.
> > > >>> >>> > > >> >
> > > >>> >>> > > >> > Doug
> > > >>> >>> > > >> >
> > > >>> >>> > > >> >
> > > >>> >>> > > >> >
> > > >>> >>> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> > > >>> >>> sxk1969@gmail.com>
> > > >>> >>> > > >> wrote:
> > > >>> >>> > > >> >
> > > >>> >>> > > >> > > A battle well fought and won, got reef to build
> > > >>> successfully
> > > >>> >>> on
> > > >>> >>> > > ubuntu
> > > >>> >>> > > >> > > linux vm after hours of hacking, fyi here's what I
> had
> > > to
> > > >>> do:
> > > >>> >>> > > >> > > 1) installed the necessary tools (jdk 1.7/maven
> > > >>> 3.3.9/protoc
> > > >>> >>> > version
> > > >>> >>> > > >> 2.5)
> > > >>> >>> > > >> > > 2) added JAVA_HOME and M2_HOME
> > > >>> >>> > > >> > > 3) here's the kicker that's not in the documentation
> > :)
> > > (
> > > >>> >>> > > >> > > https://github.com/apache/reef
> > > >>> /blob/master/lang/java/BUILD.md
> > > >>> >>> ),
> > > >>> >>> > had
> > > >>> >>> > > >> to
> > > >>> >>> > > >> > add
> > > >>> >>> > > >> > > LD_LIBRARY_PATH environment variable and have it
> point
> > > to
> > > >>> >>> > > >> /usr/local/lib
> > > >>> >>> > > >> > > where the shared library for protobuf is installed
> > > >>> >>> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also
> not
> > in
> > > >>> the
> > > >>> >>> > > >> > documentation
> > > >>> >>> > > >> > > :) )
> > > >>> >>> > > >> > >
> > > >>> >>> > > >> > >
> > > >>> >>> > > >> > > [INFO]
> > > >>> >>> > > >> > > ------------------------------
> > > >>> ------------------------------
> > > >>> >>> > > >> ------------
> > > >>> >>> > > >> > > [INFO] Reactor Summary:
> > > >>> >>> > > >> > > [INFO]
> > > >>> >>> > > >> > > [INFO] REEF ..............................
> > > >>> .................
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 4.167 s]
> > > >>> >>> > > >> > > [INFO] REEF Dot Net ..............................
> > > >>> .........
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 1.628 s]
> > > >>> >>> > > >> > > [INFO] REEF Annotations
> ..............................
> > > >>> .....
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 5.509 s]
> > > >>> >>> > > >> > > [INFO] REEF Utils ..............................
> > > >>> ...........
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 5.747 s]
> > > >>> >>> > > >> > > [INFO] REEF Tang Project
> > ..............................
> > > >>> ....
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 0.492 s]
> > > >>> >>> > > >> > > [INFO] Tang Test Jar A
> ..............................
> > > >>> ......
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 4.276 s]
> > > >>> >>> > > >> > > [INFO] Tang Test Jar B
> ..............................
> > > >>> ......
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 4.186 s]
> > > >>> >>> > > >> > > [INFO] Tang Test Jar AB
> ..............................
> > > >>> .....
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 4.376 s]
> > > >>> >>> > > >> > > [INFO] Tang Test Jar B conflict A
> > > >>> .........................
> > > >>> >>> > SUCCESS
> > > >>> >>> > > [
> > > >>> >>> > > >> > > 0.440 s]
> > > >>> >>> > > >> > > [INFO] REEF Tang ..............................
> > > >>> ............
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 24.779 s]
> > > >>> >>> > > >> > > [INFO] REEF Wake Project
> > ..............................
> > > >>> ....
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 0.487 s]
> > > >>> >>> > > >> > > [INFO] REEF Wake ..............................
> > > >>> ............
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 15.587 s]
> > > >>> >>> > > >> > > [INFO] REEF Common ..............................
> > > >>> ..........
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 23.343 s]
> > > >>> >>> > > >> > > [INFO] REEF Runtime Local
> > ..............................
> > > >>> ...
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 8.375 s]
> > > >>> >>> > > >> > > [INFO] REEF Applications
> > ..............................
> > > >>> ....
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 0.416 s]
> > > >>> >>> > > >> > > [INFO] REEF Vortex ..............................
> > > >>> ..........
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 11.263 s]
> > > >>> >>> > > >> > > [INFO] REEF HTTP Server
> ..............................
> > > >>> .....
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 9.772 s]
> > > >>> >>> > > >> > > [INFO] REEF Utils for Hadoop
> > > >>> ..............................
> > > >>> >>> > SUCCESS
> > > >>> >>> > > [
> > > >>> >>> > > >> > > 5.881 s]
> > > >>> >>> > > >> > > [INFO] REEF Runtime for YARN
> > > >>> ..............................
> > > >>> >>> > SUCCESS
> > > >>> >>> > > [
> > > >>> >>> > > >> > > 11.041 s]
> > > >>> >>> > > >> > > [INFO] REEF Runtime for HDInsight
> > > >>> .........................
> > > >>> >>> > SUCCESS
> > > >>> >>> > > [
> > > >>> >>> > > >> > > 9.719 s]
> > > >>> >>> > > >> > > [INFO] REEF IO ..............................
> > > >>> ..............
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 23.729 s]
> > > >>> >>> > > >> > > [INFO] REEF Checkpoint
> ..............................
> > > >>> ......
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 5.771 s]
> > > >>> >>> > > >> > > [INFO] REEF Bridge Java
> ..............................
> > > >>> .....
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 11.981 s]
> > > >>> >>> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios
> > > >>> ........
> > > >>> >>> > SUCCESS
> > > >>> >>> > > [
> > > >>> >>> > > >> > > 7.898 s]
> > > >>> >>> > > >> > > [INFO] REEF Bridge (Client)
> > > ..............................
> > > >>> .
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 12.242 s]
> > > >>> >>> > > >> > > [INFO] REEF Runtime Standalone
> > > >>> ............................
> > > >>> >>> > SUCCESS
> > > >>> >>> > > [
> > > >>> >>> > > >> > > 7.779 s]
> > > >>> >>> > > >> > > [INFO] REEF Runtime for Mesos
> > > >>> .............................
> > > >>> >>> > SUCCESS
> > > >>> >>> > > [
> > > >>> >>> > > >> > > 11.103 s]
> > > >>> >>> > > >> > > [INFO] REEF Poison ..............................
> > > >>> ..........
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 5.384 s]
> > > >>> >>> > > >> > > [INFO] REEF Examples ..............................
> > > >>> ........
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 14.313 s]
> > > >>> >>> > > >> > > [INFO] REEF Examples CLR
> > ..............................
> > > >>> ....
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 7.532 s]
> > > >>> >>> > > >> > > [INFO] REEF Examples on HDInsight
> > > >>> .........................
> > > >>> >>> > SUCCESS
> > > >>> >>> > > [
> > > >>> >>> > > >> > > 9.213 s]
> > > >>> >>> > > >> > > [INFO] REEF Tang Tint ..............................
> > > >>> .......
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 8.546 s]
> > > >>> >>> > > >> > > [INFO] REEF Tests ..............................
> > > >>> ...........
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 15.696 s]
> > > >>> >>> > > >> > > [INFO] REEF Website ..............................
> > > >>> .........
> > > >>> >>> > > SUCCESS [
> > > >>> >>> > > >> > > 1.033 s]
> > > >>> >>> > > >> > > [INFO]
> > > >>> >>> > > >> > > ------------------------------
> > > >>> ------------------------------
> > > >>> >>> > > >> ------------
> > > >>> >>> > > >> > > [INFO] BUILD SUCCESS
> > > >>> >>> > > >> > > [INFO]
> > > >>> >>> > > >> > > ------------------------------
> > > >>> ------------------------------
> > > >>> >>> > > >> ------------
> > > >>> >>> > > >> > > [INFO] Total time: 04:54 min
> > > >>> >>> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > > >>> >>> > > >> > > [INFO] Final Memory: 125M/1238M
> > > >>> >>> > > >> > > [INFO]
> > > >>> >>> > > >> > > ------------------------------
> > > >>> ------------------------------
> > > >>> >>> > > >> ------------
> > > >>> >>> > > >> > >
> > > >>> >>> > > >> > >
> > > >>> >>> > > >> > > On to bigger and better things :), we should
> probably
> > > >>> update
> > > >>> >>> the
> > > >>> >>> > > docs
> > > >>> >>> > > >> to
> > > >>> >>> > > >> > > reflect the current build process subtleties. Will
> > try
> > > >>> >>> windows
> > > >>> >>> > > next.
> > > >>> >>> > > >> > >
> > > >>> >>> > > >> > >
> > > >>> >>> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> > > >>> >>> bgchun@gmail.com
> > > >>> >>> > >
> > > >>> >>> > > >> > wrote:
> > > >>> >>> > > >> > >
> > > >>> >>> > > >> > > > Welcome, Saikat!
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> > > >>> >>> markus@weimo.de>
> > > >>> >>> > > >> wrote:
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > > >>> >>> > > >> > > > >
> > > >>> >>> > > >> > > > >> I am a newbie to Apache Reef and am interested
> in
> > > >>> >>> > contributing
> > > >>> >>> > > to
> > > >>> >>> > > >> > the
> > > >>> >>> > > >> > > > reef
> > > >>> >>> > > >> > > > >> dev efforts
> > > >>> >>> > > >> > > > >>
> > > >>> >>> > > >> > > > >
> > > >>> >>> > > >> > > > > Welcome!
> > > >>> >>> > > >> > > > >
> > > >>> >>> > > >> > > > > my JIRA id is kanjilal
> > > >>> >>> > > >> > > > >>
> > > >>> >>> > > >> > > > >
> > > >>> >>> > > >> > > > > I have added you to the contributor's list on
> > JIRA.
> > > >>> This
> > > >>> >>> > > basically
> > > >>> >>> > > >> > > means
> > > >>> >>> > > >> > > > > that you can self-assign issues to yourself now
> :)
> > > >>> >>> > > >> > > > >
> > > >>> >>> > > >> > > > > Markus
> > > >>> >>> > > >> > > > >
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > > > --
> > > >>> >>> > > >> > > > Byung-Gon Chun
> > > >>> >>> > > >> > > >
> > > >>> >>> > > >> > >
> > > >>> >>> > > >> >
> > > >>> >>> > > >>
> > > >>> >>> > > >
> > > >>> >>> > > >
> > > >>> >>> > >
> > > >>> >>> >
> > > >>> >>>
> > > >>> >>
> > > >>> >>
> > > >>> >
> > > >>>
> > > >>
> > > >>
> > > >
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
ok so I fixed the problem of pointing to the wrong repo, namely I am now
pointing to my repo for reef, here's what I see now:
saikan@ubuntureef:~/code/localdevreef$ git push origin HEAD
Username for 'https://github.com': skanjila
Password for 'https://skanjila@github.com':
error: unable to push to unqualified destination: HEAD
The destination refspec neither matches an existing ref on the remote nor
begins with refs/, and we are unable to guess a prefix based on the source
ref.
error: failed to push some refs to 'https://github.com/skanjila/reef.git'
Here's what git remote -v yields:
saikan@ubuntureef:~/code/localdevreef$ git remote -v
origin https://github.com/skanjila/reef.git (fetch)
origin https://github.com/skanjila/reef.git (push)
upstream https://github.com/apache/reef.git (fetch)
upstream https://github.com/apache/reef.git (push)
My github alias is skanjila
Here's what git status gives:
saikan@ubuntureef:~/code/localdevreef$ git status
interactive rebase in progress; onto e554dd3
fatal: Could not open file .git/rebase-merge/done for reading: No such file
or directory
Thoughts?
On Fri, Feb 10, 2017 at 2:38 PM, Markus Weimer <ma...@weimo.de> wrote:
> Hi,
>
> if `origin` refers to the apache/reef repositiory on GitHub OR the
> repository on apache.org, you won't be able to push, as those repos are
> read-only for you. Instead, you need to push to your own fork of REEF on
> GitHub and then file a PR from that branch to apache/reef from there.
>
> Markus
>
> On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <ds...@gmail.com>
> wrote:
>
> > also what is your GitHub alias?
> >
> > On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <ds...@gmail.com>
> > wrote:
> >
> > > and git status from the REEF root directory.
> > >
> > > On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <ds...@gmail.com>
> > > wrote:
> > >
> > >> Would you please send the output of git remote -v?
> > >>
> > >> Doug
> > >>
> > >> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <sx...@gmail.com>
> > >> wrote:
> > >>
> > >>> Folks,
> > >>> I am trying to create/deploy my first pull request, I've gone through
> > all
> > >>> of these steps successfully here:
> > >>> https://cwiki.apache.org/confluence/display/REEF/Contributin
> > >>> g#Contributing-1.Forkrepository
> > >>> but I seem to be running into 403 errors when I do a git push origin
> > >>> HEAD,
> > >>> here are my creds, would really appreciate some help:
> > >>>
> > >>>
> > >>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> > >>> github username: skanjila
> > >>>
> > >>>
> > >>> Please let me know what I am missing here, note that my id in JIRA is
> > >>> kanjilal but my github userid is skanjila, might this be a problem?
> > >>>
> > >>> Thanks in advance.
> > >>>
> > >>>
> > >>>
> > >>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sx...@gmail.com>
> > >>> wrote:
> > >>>
> > >>> > Well interesting piece of metadata, time for successfully
> completing
> > >>> > windows server 2016 build was about half the time for linux, at
> least
> > >>> for
> > >>> > the java build, will try csharp next
> > >>> >
> > >>> > Here's what I did:
> > >>> > 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> > >>> > 2) mvn clean install -DskipTests=true
> > >>> >
> > >>> >
> > >>> > For posterity's sake I will go back and redo my ubuntu linux build
> > and
> > >>> > then work on the JIRA-1739 to make sure the documentation is up to
> > >>> date as
> > >>> > needed. I will install java from the repositories this time.
> > >>> >
> > >>> >
> > >>> >
> > >>> >
> > >>> > On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <sxk1969@gmail.com
> >
> > >>> wrote:
> > >>> >
> > >>> >> Yes I have gone through that in the past, not sure why I decided
> not
> > >>> to
> > >>> >> include that repo and just download the jdk and put it in instead
> > :),
> > >>> >> regardless I will send a pull request for the build cleanup in the
> > >>> next few
> > >>> >> days, lets iterate on it as a team and test drive it to prove it
> > >>> wrong or
> > >>> >> right
> > >>> >>
> > >>> >> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <
> dsopsrc@gmail.com>
> > >>> >> wrote:
> > >>> >>
> > >>> >>> After thinking about all of the changes you had make and the fact
> > >>> that
> > >>> >>> oracle java does not show up in update-alternatives, you may want
> > to
> > >>> look
> > >>> >>> at these instructions which tell how to install oracle java via
> > >>> apt-get
> > >>> >>> repository which automatically takes care of a lot of the issues
> > you
> > >>> ran
> > >>> >>> into
> > >>> >>> https://www.digitalocean.com/community/tutorials/how-to-inst
> > >>> >>> all-java-on-ubuntu-with-apt-get
> > >>> >>> .
> > >>> >>>
> > >>> >>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
> > sxk1969@gmail.com>
> > >>> >>> wrote:
> > >>> >>>
> > >>> >>> > I think part of the difference is the way both of us installed
> > >>> java, my
> > >>> >>> > setup is using the oracle java as opposed to the open-jdk java
> > >>> >>> provided by
> > >>> >>> > update-alternatives, I agree with your instructions assessment.
> > >>> >>> >
> > >>> >>> >
> > >>> >>> > On another note I have a question, how did folks install protoc
> > on
> > >>> >>> windows,
> > >>> >>> > in looking at the wiki it points you to the protoc site where
> it
> > >>> seems
> > >>> >>> to
> > >>> >>> > need a whole bunch of supporting tools (cmake/mingw etc), I am
> > >>> using
> > >>> >>> > gitbash on windows and was wondering if there's an easy way to
> > >>> >>> download the
> > >>> >>> > protoc binaries and set the path, please forgive me if this is
> in
> > >>> the
> > >>> >>> > documentation somewhere, still learning my way around.
> > >>> >>> >
> > >>> >>> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
> > >>> dsopsrc@gmail.com>
> > >>> >>> > wrote:
> > >>> >>> >
> > >>> >>> > > What I mean is that we should provide instructions to setup
> the
> > >>> least
> > >>> >>> > > complicated build environment that works, not one that is
> more
> > >>> >>> > complicated
> > >>> >>> > > but also works.
> > >>> >>> > >
> > >>> >>> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> > >>> dsopsrc@gmail.com>
> > >>> >>> > > wrote:
> > >>> >>> > >
> > >>> >>> > > > Do you have update-alternatives installed? Have you run
> > >>> >>> > > > update-alternatives --config java?
> > >>> >>> > > >
> > >>> >>> > > > Sorry I made a mistake in may last email, I actually have
> > >>> >>> JAVA_HOME set
> > >>> >>> > > to
> > >>> >>> > > > /usr as listed on the webpage which figured out from
> Sergiy.
> > >>> >>> However, I
> > >>> >>> > > do
> > >>> >>> > > > not need to set the other ones. It is important that our
> > >>> >>> contributing
> > >>> >>> > to
> > >>> >>> > > > REEF wiki be general and not specific to a single setup.
> > >>> >>> > > >
> > >>> >>> > > > Here is my environment for building REEF on Ubuntu 16.04.
> > >>> >>> > > >
> > >>> >>> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> > >>> >>> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > >>> >>> > > > XDG_SESSION_ID=c2
> > >>> >>> > > > SHELL=/bin/bash
> > >>> >>> > > > TERM=xterm
> > >>> >>> > > > WINDOWID=44144243
> > >>> >>> > > > USER=dougse
> > >>> >>> > > > LS_COLORS=rs=0:di=01;34:ln=01;
> 36:mh=00:pi=40;33:so=01;35:do=
> > >>> >>> > > > 01;35:bd=40;33;01:cd=40;33;01:
> or=40;31;01:mi=00:su=37;41:sg=
> > >>> >>> > > > 30;43:ca=30;41:tw=30;42:ow=34;
> 42:st=37;44:ex=01;32:*.tar=01;
> > >>> >>> > > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> > >>> >>> > > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> > >>> >>> > > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> > >>> >>> > > > Z=01;31:*.dz=01;31:*.gz=01;31:
> *.lrz=01;31:*.lz=01;31:*.lzo=
> > >>> >>> > > > 01;31:*.xz=01;31:*.bz2=01;31:*
> .bz=01;31:*.tbz=01;31:*.tbz2=
> > >>> >>> > > > 01;31:*.tz=01;31:*.deb=01;31:*
> .rpm=01;31:*.jar=01;31:*.war=
> > >>> >>> > > > 01;31:*.ear=01;31:*.sar=01;31:
> *.rar=01;31:*.alz=01;31:*.ace=
> > >>> >>> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > >>> >>> > > > cab=01;31:*.jpg=01;35:*.jpeg=
> 01;35:*.gif=01;35:*.bmp=01;35:
> > >>> >>> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=
> 01;35:*.tga=01;35:*.xbm=01;35:
> > >>> >>> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > >>> >>> > > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> > >>> >>> > > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> > >>> >>> > > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> > >>> >>> > > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> > >>> >>> > > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> > >>> >>> > > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> > >>> >>> > > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> > >>> >>> > > > *.aac=00;36:*.au=00;36:*.flac=
> 00;36:*.m4a=00;36:*.mid=00;36:
> > >>> >>> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > >>> >>> > > > 00;36:*.ra=00;36:*.wav=00;36:*
> .oga=00;36:*.opus=00;36:*.spx=
> > >>> >>> > > > 00;36:*.xspf=00;36:
> > >>> >>> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > >>> >>> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > >>> >>> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > >>> >>> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/
> loca
> > >>> l/bin
> > >>> >>> > > > PWD=/code/reef
> > >>> >>> > > > JAVA_HOME=/usr
> > >>> >>> > > > LANG=en_US.UTF-8
> > >>> >>> > > > REEF_HOME=/code/reef
> > >>> >>> > > > SHLVL=1
> > >>> >>> > > > HOME=/home/dougse
> > >>> >>> > > > GTK_OVERLAY_SCROLLING=0
> > >>> >>> > > > DBUS_SESSION_BUS_ADDRESS=unix:
> abstract=/tmp/dbus-l06bsMWGy0,
> > >>> guid=
> > >>> >>> > > > ae74bbce18102091c11c7bd458939d1c
> > >>> >>> > > > UID=1000
> > >>> >>> > > > LESSOPEN=| /bin/lesspipe %s
> > >>> >>> > > > XDG_RUNTIME_DIR=/run/user/1000
> > >>> >>> > > > DISPLAY=:10.0
> > >>> >>> > > > XDG_CURRENT_DESKTOP=MATE
> > >>> >>> > > > LESSCLOSE=/bin/lesspipe %s %s
> > >>> >>> > > > COLORTERM=mate-terminal
> > >>> >>> > > > _=/usr/bin/env
> > >>> >>> > > >
> > >>> >>> > > >
> > >>> >>> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> > >>> sxk1969@gmail.com
> > >>> >>> >
> > >>> >>> > > wrote:
> > >>> >>> > > >
> > >>> >>> > > >> Weird, yes I did read that pageand yes I had to do those
> > exact
> > >>> >>> steps
> > >>> >>> > > that
> > >>> >>> > > >> I
> > >>> >>> > > >> described, I haven't run the tests yet but fully suspect
> > that
> > >>> I'll
> > >>> >>> > need
> > >>> >>> > > to
> > >>> >>> > > >> increase the ulimit to enable that. If you do a plain
> maven
> > >>> build
> > >>> >>> > after
> > >>> >>> > > >> checking out the reef code in ubuntu it complains that
> > >>> JAVA_HOME
> > >>> >>> is
> > >>> >>> > not
> > >>> >>> > > >> set, also its a good idea to set the maven oriented
> > >>> environment
> > >>> >>> > > variables
> > >>> >>> > > >> because I highly suspect that in the future we may need to
> > >>> adjust
> > >>> >>> heap
> > >>> >>> > > >> space settings, finally the LD_LIBRARY_PATH is needed I
> > >>> suspect
> > >>> >>> > because
> > >>> >>> > > >> the
> > >>> >>> > > >> java code is invoking the protoc compiler at some point
> and
> > in
> > >>> >>> order
> > >>> >>> > to
> > >>> >>> > > do
> > >>> >>> > > >> so it much load some .so files that live in
> LD_LIBRARY_PATH.
> > >>> Net
> > >>> >>> Net
> > >>> >>> > we
> > >>> >>> > > >> should definitely figure out the differences between your
> > and
> > >>> >>> Sergei's
> > >>> >>> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm
> > not
> > >>> >>> > convinced
> > >>> >>> > > >> that the version matters if the major version is the same.
> > >>> >>> > > >> Cheers
> > >>> >>> > > >>
> > >>> >>> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> > >>> >>> dsopsrc@gmail.com>
> > >>> >>> > > >> wrote:
> > >>> >>> > > >>
> > >>> >>> > > >> > Hello Saikat,
> > >>> >>> > > >> >
> > >>> >>> > > >> > Did you read the documentation on this page
> > >>> >>> > > >> > https://cwiki.apache.org/confluence/display/REEF/Linux
> on
> > >>> the
> > >>> >>> REEF
> > >>> >>> > > wiki
> > >>> >>> > > >> > concerning Java on Ubuntu? I added this page after
> setting
> > >>> up a
> > >>> >>> > Linux
> > >>> >>> > > >> 16.04
> > >>> >>> > > >> > to build REEF and trading emails with Sergiy on the dev
> > >>> list.
> > >>> >>> Note
> > >>> >>> > > >> that I
> > >>> >>> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However,
> > >>> you do
> > >>> >>> need
> > >>> >>> > > to
> > >>> >>> > > >> > change the default for ulimit -n in bash to get the
> tests
> > >>> to run
> > >>> >>> > which
> > >>> >>> > > >> is
> > >>> >>> > > >> > also described.
> > >>> >>> > > >> >
> > >>> >>> > > >> > Doug
> > >>> >>> > > >> >
> > >>> >>> > > >> >
> > >>> >>> > > >> >
> > >>> >>> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> > >>> >>> sxk1969@gmail.com>
> > >>> >>> > > >> wrote:
> > >>> >>> > > >> >
> > >>> >>> > > >> > > A battle well fought and won, got reef to build
> > >>> successfully
> > >>> >>> on
> > >>> >>> > > ubuntu
> > >>> >>> > > >> > > linux vm after hours of hacking, fyi here's what I had
> > to
> > >>> do:
> > >>> >>> > > >> > > 1) installed the necessary tools (jdk 1.7/maven
> > >>> 3.3.9/protoc
> > >>> >>> > version
> > >>> >>> > > >> 2.5)
> > >>> >>> > > >> > > 2) added JAVA_HOME and M2_HOME
> > >>> >>> > > >> > > 3) here's the kicker that's not in the documentation
> :)
> > (
> > >>> >>> > > >> > > https://github.com/apache/reef
> > >>> /blob/master/lang/java/BUILD.md
> > >>> >>> ),
> > >>> >>> > had
> > >>> >>> > > >> to
> > >>> >>> > > >> > add
> > >>> >>> > > >> > > LD_LIBRARY_PATH environment variable and have it point
> > to
> > >>> >>> > > >> /usr/local/lib
> > >>> >>> > > >> > > where the shared library for protobuf is installed
> > >>> >>> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not
> in
> > >>> the
> > >>> >>> > > >> > documentation
> > >>> >>> > > >> > > :) )
> > >>> >>> > > >> > >
> > >>> >>> > > >> > >
> > >>> >>> > > >> > > [INFO]
> > >>> >>> > > >> > > ------------------------------
> > >>> ------------------------------
> > >>> >>> > > >> ------------
> > >>> >>> > > >> > > [INFO] Reactor Summary:
> > >>> >>> > > >> > > [INFO]
> > >>> >>> > > >> > > [INFO] REEF ..............................
> > >>> .................
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 4.167 s]
> > >>> >>> > > >> > > [INFO] REEF Dot Net ..............................
> > >>> .........
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 1.628 s]
> > >>> >>> > > >> > > [INFO] REEF Annotations ..............................
> > >>> .....
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 5.509 s]
> > >>> >>> > > >> > > [INFO] REEF Utils ..............................
> > >>> ...........
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 5.747 s]
> > >>> >>> > > >> > > [INFO] REEF Tang Project
> ..............................
> > >>> ....
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 0.492 s]
> > >>> >>> > > >> > > [INFO] Tang Test Jar A ..............................
> > >>> ......
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 4.276 s]
> > >>> >>> > > >> > > [INFO] Tang Test Jar B ..............................
> > >>> ......
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 4.186 s]
> > >>> >>> > > >> > > [INFO] Tang Test Jar AB ..............................
> > >>> .....
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 4.376 s]
> > >>> >>> > > >> > > [INFO] Tang Test Jar B conflict A
> > >>> .........................
> > >>> >>> > SUCCESS
> > >>> >>> > > [
> > >>> >>> > > >> > > 0.440 s]
> > >>> >>> > > >> > > [INFO] REEF Tang ..............................
> > >>> ............
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 24.779 s]
> > >>> >>> > > >> > > [INFO] REEF Wake Project
> ..............................
> > >>> ....
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 0.487 s]
> > >>> >>> > > >> > > [INFO] REEF Wake ..............................
> > >>> ............
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 15.587 s]
> > >>> >>> > > >> > > [INFO] REEF Common ..............................
> > >>> ..........
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 23.343 s]
> > >>> >>> > > >> > > [INFO] REEF Runtime Local
> ..............................
> > >>> ...
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 8.375 s]
> > >>> >>> > > >> > > [INFO] REEF Applications
> ..............................
> > >>> ....
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 0.416 s]
> > >>> >>> > > >> > > [INFO] REEF Vortex ..............................
> > >>> ..........
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 11.263 s]
> > >>> >>> > > >> > > [INFO] REEF HTTP Server ..............................
> > >>> .....
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 9.772 s]
> > >>> >>> > > >> > > [INFO] REEF Utils for Hadoop
> > >>> ..............................
> > >>> >>> > SUCCESS
> > >>> >>> > > [
> > >>> >>> > > >> > > 5.881 s]
> > >>> >>> > > >> > > [INFO] REEF Runtime for YARN
> > >>> ..............................
> > >>> >>> > SUCCESS
> > >>> >>> > > [
> > >>> >>> > > >> > > 11.041 s]
> > >>> >>> > > >> > > [INFO] REEF Runtime for HDInsight
> > >>> .........................
> > >>> >>> > SUCCESS
> > >>> >>> > > [
> > >>> >>> > > >> > > 9.719 s]
> > >>> >>> > > >> > > [INFO] REEF IO ..............................
> > >>> ..............
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 23.729 s]
> > >>> >>> > > >> > > [INFO] REEF Checkpoint ..............................
> > >>> ......
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 5.771 s]
> > >>> >>> > > >> > > [INFO] REEF Bridge Java ..............................
> > >>> .....
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 11.981 s]
> > >>> >>> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios
> > >>> ........
> > >>> >>> > SUCCESS
> > >>> >>> > > [
> > >>> >>> > > >> > > 7.898 s]
> > >>> >>> > > >> > > [INFO] REEF Bridge (Client)
> > ..............................
> > >>> .
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 12.242 s]
> > >>> >>> > > >> > > [INFO] REEF Runtime Standalone
> > >>> ............................
> > >>> >>> > SUCCESS
> > >>> >>> > > [
> > >>> >>> > > >> > > 7.779 s]
> > >>> >>> > > >> > > [INFO] REEF Runtime for Mesos
> > >>> .............................
> > >>> >>> > SUCCESS
> > >>> >>> > > [
> > >>> >>> > > >> > > 11.103 s]
> > >>> >>> > > >> > > [INFO] REEF Poison ..............................
> > >>> ..........
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 5.384 s]
> > >>> >>> > > >> > > [INFO] REEF Examples ..............................
> > >>> ........
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 14.313 s]
> > >>> >>> > > >> > > [INFO] REEF Examples CLR
> ..............................
> > >>> ....
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 7.532 s]
> > >>> >>> > > >> > > [INFO] REEF Examples on HDInsight
> > >>> .........................
> > >>> >>> > SUCCESS
> > >>> >>> > > [
> > >>> >>> > > >> > > 9.213 s]
> > >>> >>> > > >> > > [INFO] REEF Tang Tint ..............................
> > >>> .......
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 8.546 s]
> > >>> >>> > > >> > > [INFO] REEF Tests ..............................
> > >>> ...........
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 15.696 s]
> > >>> >>> > > >> > > [INFO] REEF Website ..............................
> > >>> .........
> > >>> >>> > > SUCCESS [
> > >>> >>> > > >> > > 1.033 s]
> > >>> >>> > > >> > > [INFO]
> > >>> >>> > > >> > > ------------------------------
> > >>> ------------------------------
> > >>> >>> > > >> ------------
> > >>> >>> > > >> > > [INFO] BUILD SUCCESS
> > >>> >>> > > >> > > [INFO]
> > >>> >>> > > >> > > ------------------------------
> > >>> ------------------------------
> > >>> >>> > > >> ------------
> > >>> >>> > > >> > > [INFO] Total time: 04:54 min
> > >>> >>> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > >>> >>> > > >> > > [INFO] Final Memory: 125M/1238M
> > >>> >>> > > >> > > [INFO]
> > >>> >>> > > >> > > ------------------------------
> > >>> ------------------------------
> > >>> >>> > > >> ------------
> > >>> >>> > > >> > >
> > >>> >>> > > >> > >
> > >>> >>> > > >> > > On to bigger and better things :), we should probably
> > >>> update
> > >>> >>> the
> > >>> >>> > > docs
> > >>> >>> > > >> to
> > >>> >>> > > >> > > reflect the current build process subtleties. Will
> try
> > >>> >>> windows
> > >>> >>> > > next.
> > >>> >>> > > >> > >
> > >>> >>> > > >> > >
> > >>> >>> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> > >>> >>> bgchun@gmail.com
> > >>> >>> > >
> > >>> >>> > > >> > wrote:
> > >>> >>> > > >> > >
> > >>> >>> > > >> > > > Welcome, Saikat!
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> > >>> >>> markus@weimo.de>
> > >>> >>> > > >> wrote:
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > >>> >>> > > >> > > > >
> > >>> >>> > > >> > > > >> I am a newbie to Apache Reef and am interested in
> > >>> >>> > contributing
> > >>> >>> > > to
> > >>> >>> > > >> > the
> > >>> >>> > > >> > > > reef
> > >>> >>> > > >> > > > >> dev efforts
> > >>> >>> > > >> > > > >>
> > >>> >>> > > >> > > > >
> > >>> >>> > > >> > > > > Welcome!
> > >>> >>> > > >> > > > >
> > >>> >>> > > >> > > > > my JIRA id is kanjilal
> > >>> >>> > > >> > > > >>
> > >>> >>> > > >> > > > >
> > >>> >>> > > >> > > > > I have added you to the contributor's list on
> JIRA.
> > >>> This
> > >>> >>> > > basically
> > >>> >>> > > >> > > means
> > >>> >>> > > >> > > > > that you can self-assign issues to yourself now :)
> > >>> >>> > > >> > > > >
> > >>> >>> > > >> > > > > Markus
> > >>> >>> > > >> > > > >
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > > > --
> > >>> >>> > > >> > > > Byung-Gon Chun
> > >>> >>> > > >> > > >
> > >>> >>> > > >> > >
> > >>> >>> > > >> >
> > >>> >>> > > >>
> > >>> >>> > > >
> > >>> >>> > > >
> > >>> >>> > >
> > >>> >>> >
> > >>> >>>
> > >>> >>
> > >>> >>
> > >>> >
> > >>>
> > >>
> > >>
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Markus Weimer <ma...@weimo.de>.
Hi,
if `origin` refers to the apache/reef repositiory on GitHub OR the
repository on apache.org, you won't be able to push, as those repos are
read-only for you. Instead, you need to push to your own fork of REEF on
GitHub and then file a PR from that branch to apache/reef from there.
Markus
On Fri, Feb 10, 2017 at 2:09 PM, Douglas Service <ds...@gmail.com> wrote:
> also what is your GitHub alias?
>
> On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <ds...@gmail.com>
> wrote:
>
> > and git status from the REEF root directory.
> >
> > On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <ds...@gmail.com>
> > wrote:
> >
> >> Would you please send the output of git remote -v?
> >>
> >> Doug
> >>
> >> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <sx...@gmail.com>
> >> wrote:
> >>
> >>> Folks,
> >>> I am trying to create/deploy my first pull request, I've gone through
> all
> >>> of these steps successfully here:
> >>> https://cwiki.apache.org/confluence/display/REEF/Contributin
> >>> g#Contributing-1.Forkrepository
> >>> but I seem to be running into 403 errors when I do a git push origin
> >>> HEAD,
> >>> here are my creds, would really appreciate some help:
> >>>
> >>>
> >>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> >>> github username: skanjila
> >>>
> >>>
> >>> Please let me know what I am missing here, note that my id in JIRA is
> >>> kanjilal but my github userid is skanjila, might this be a problem?
> >>>
> >>> Thanks in advance.
> >>>
> >>>
> >>>
> >>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sx...@gmail.com>
> >>> wrote:
> >>>
> >>> > Well interesting piece of metadata, time for successfully completing
> >>> > windows server 2016 build was about half the time for linux, at least
> >>> for
> >>> > the java build, will try csharp next
> >>> >
> >>> > Here's what I did:
> >>> > 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> >>> > 2) mvn clean install -DskipTests=true
> >>> >
> >>> >
> >>> > For posterity's sake I will go back and redo my ubuntu linux build
> and
> >>> > then work on the JIRA-1739 to make sure the documentation is up to
> >>> date as
> >>> > needed. I will install java from the repositories this time.
> >>> >
> >>> >
> >>> >
> >>> >
> >>> > On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <sx...@gmail.com>
> >>> wrote:
> >>> >
> >>> >> Yes I have gone through that in the past, not sure why I decided not
> >>> to
> >>> >> include that repo and just download the jdk and put it in instead
> :),
> >>> >> regardless I will send a pull request for the build cleanup in the
> >>> next few
> >>> >> days, lets iterate on it as a team and test drive it to prove it
> >>> wrong or
> >>> >> right
> >>> >>
> >>> >> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <ds...@gmail.com>
> >>> >> wrote:
> >>> >>
> >>> >>> After thinking about all of the changes you had make and the fact
> >>> that
> >>> >>> oracle java does not show up in update-alternatives, you may want
> to
> >>> look
> >>> >>> at these instructions which tell how to install oracle java via
> >>> apt-get
> >>> >>> repository which automatically takes care of a lot of the issues
> you
> >>> ran
> >>> >>> into
> >>> >>> https://www.digitalocean.com/community/tutorials/how-to-inst
> >>> >>> all-java-on-ubuntu-with-apt-get
> >>> >>> .
> >>> >>>
> >>> >>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <
> sxk1969@gmail.com>
> >>> >>> wrote:
> >>> >>>
> >>> >>> > I think part of the difference is the way both of us installed
> >>> java, my
> >>> >>> > setup is using the oracle java as opposed to the open-jdk java
> >>> >>> provided by
> >>> >>> > update-alternatives, I agree with your instructions assessment.
> >>> >>> >
> >>> >>> >
> >>> >>> > On another note I have a question, how did folks install protoc
> on
> >>> >>> windows,
> >>> >>> > in looking at the wiki it points you to the protoc site where it
> >>> seems
> >>> >>> to
> >>> >>> > need a whole bunch of supporting tools (cmake/mingw etc), I am
> >>> using
> >>> >>> > gitbash on windows and was wondering if there's an easy way to
> >>> >>> download the
> >>> >>> > protoc binaries and set the path, please forgive me if this is in
> >>> the
> >>> >>> > documentation somewhere, still learning my way around.
> >>> >>> >
> >>> >>> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
> >>> dsopsrc@gmail.com>
> >>> >>> > wrote:
> >>> >>> >
> >>> >>> > > What I mean is that we should provide instructions to setup the
> >>> least
> >>> >>> > > complicated build environment that works, not one that is more
> >>> >>> > complicated
> >>> >>> > > but also works.
> >>> >>> > >
> >>> >>> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> >>> dsopsrc@gmail.com>
> >>> >>> > > wrote:
> >>> >>> > >
> >>> >>> > > > Do you have update-alternatives installed? Have you run
> >>> >>> > > > update-alternatives --config java?
> >>> >>> > > >
> >>> >>> > > > Sorry I made a mistake in may last email, I actually have
> >>> >>> JAVA_HOME set
> >>> >>> > > to
> >>> >>> > > > /usr as listed on the webpage which figured out from Sergiy.
> >>> >>> However, I
> >>> >>> > > do
> >>> >>> > > > not need to set the other ones. It is important that our
> >>> >>> contributing
> >>> >>> > to
> >>> >>> > > > REEF wiki be general and not specific to a single setup.
> >>> >>> > > >
> >>> >>> > > > Here is my environment for building REEF on Ubuntu 16.04.
> >>> >>> > > >
> >>> >>> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> >>> >>> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> >>> >>> > > > XDG_SESSION_ID=c2
> >>> >>> > > > SHELL=/bin/bash
> >>> >>> > > > TERM=xterm
> >>> >>> > > > WINDOWID=44144243
> >>> >>> > > > USER=dougse
> >>> >>> > > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> >>> >>> > > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> >>> >>> > > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> >>> >>> > > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> >>> >>> > > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> >>> >>> > > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> >>> >>> > > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> >>> >>> > > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> >>> >>> > > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> >>> >>> > > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> >>> >>> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> >>> >>> > > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> >>> >>> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> >>> >>> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> >>> >>> > > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> >>> >>> > > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> >>> >>> > > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> >>> >>> > > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> >>> >>> > > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> >>> >>> > > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> >>> >>> > > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> >>> >>> > > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> >>> >>> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> >>> >>> > > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> >>> >>> > > > 00;36:*.xspf=00;36:
> >>> >>> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> >>> >>> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> >>> >>> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> >>> >>> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/loca
> >>> l/bin
> >>> >>> > > > PWD=/code/reef
> >>> >>> > > > JAVA_HOME=/usr
> >>> >>> > > > LANG=en_US.UTF-8
> >>> >>> > > > REEF_HOME=/code/reef
> >>> >>> > > > SHLVL=1
> >>> >>> > > > HOME=/home/dougse
> >>> >>> > > > GTK_OVERLAY_SCROLLING=0
> >>> >>> > > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,
> >>> guid=
> >>> >>> > > > ae74bbce18102091c11c7bd458939d1c
> >>> >>> > > > UID=1000
> >>> >>> > > > LESSOPEN=| /bin/lesspipe %s
> >>> >>> > > > XDG_RUNTIME_DIR=/run/user/1000
> >>> >>> > > > DISPLAY=:10.0
> >>> >>> > > > XDG_CURRENT_DESKTOP=MATE
> >>> >>> > > > LESSCLOSE=/bin/lesspipe %s %s
> >>> >>> > > > COLORTERM=mate-terminal
> >>> >>> > > > _=/usr/bin/env
> >>> >>> > > >
> >>> >>> > > >
> >>> >>> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> >>> sxk1969@gmail.com
> >>> >>> >
> >>> >>> > > wrote:
> >>> >>> > > >
> >>> >>> > > >> Weird, yes I did read that pageand yes I had to do those
> exact
> >>> >>> steps
> >>> >>> > > that
> >>> >>> > > >> I
> >>> >>> > > >> described, I haven't run the tests yet but fully suspect
> that
> >>> I'll
> >>> >>> > need
> >>> >>> > > to
> >>> >>> > > >> increase the ulimit to enable that. If you do a plain maven
> >>> build
> >>> >>> > after
> >>> >>> > > >> checking out the reef code in ubuntu it complains that
> >>> JAVA_HOME
> >>> >>> is
> >>> >>> > not
> >>> >>> > > >> set, also its a good idea to set the maven oriented
> >>> environment
> >>> >>> > > variables
> >>> >>> > > >> because I highly suspect that in the future we may need to
> >>> adjust
> >>> >>> heap
> >>> >>> > > >> space settings, finally the LD_LIBRARY_PATH is needed I
> >>> suspect
> >>> >>> > because
> >>> >>> > > >> the
> >>> >>> > > >> java code is invoking the protoc compiler at some point and
> in
> >>> >>> order
> >>> >>> > to
> >>> >>> > > do
> >>> >>> > > >> so it much load some .so files that live in LD_LIBRARY_PATH.
> >>> Net
> >>> >>> Net
> >>> >>> > we
> >>> >>> > > >> should definitely figure out the differences between your
> and
> >>> >>> Sergei's
> >>> >>> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm
> not
> >>> >>> > convinced
> >>> >>> > > >> that the version matters if the major version is the same.
> >>> >>> > > >> Cheers
> >>> >>> > > >>
> >>> >>> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> >>> >>> dsopsrc@gmail.com>
> >>> >>> > > >> wrote:
> >>> >>> > > >>
> >>> >>> > > >> > Hello Saikat,
> >>> >>> > > >> >
> >>> >>> > > >> > Did you read the documentation on this page
> >>> >>> > > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on
> >>> the
> >>> >>> REEF
> >>> >>> > > wiki
> >>> >>> > > >> > concerning Java on Ubuntu? I added this page after setting
> >>> up a
> >>> >>> > Linux
> >>> >>> > > >> 16.04
> >>> >>> > > >> > to build REEF and trading emails with Sergiy on the dev
> >>> list.
> >>> >>> Note
> >>> >>> > > >> that I
> >>> >>> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However,
> >>> you do
> >>> >>> need
> >>> >>> > > to
> >>> >>> > > >> > change the default for ulimit -n in bash to get the tests
> >>> to run
> >>> >>> > which
> >>> >>> > > >> is
> >>> >>> > > >> > also described.
> >>> >>> > > >> >
> >>> >>> > > >> > Doug
> >>> >>> > > >> >
> >>> >>> > > >> >
> >>> >>> > > >> >
> >>> >>> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> >>> >>> sxk1969@gmail.com>
> >>> >>> > > >> wrote:
> >>> >>> > > >> >
> >>> >>> > > >> > > A battle well fought and won, got reef to build
> >>> successfully
> >>> >>> on
> >>> >>> > > ubuntu
> >>> >>> > > >> > > linux vm after hours of hacking, fyi here's what I had
> to
> >>> do:
> >>> >>> > > >> > > 1) installed the necessary tools (jdk 1.7/maven
> >>> 3.3.9/protoc
> >>> >>> > version
> >>> >>> > > >> 2.5)
> >>> >>> > > >> > > 2) added JAVA_HOME and M2_HOME
> >>> >>> > > >> > > 3) here's the kicker that's not in the documentation :)
> (
> >>> >>> > > >> > > https://github.com/apache/reef
> >>> /blob/master/lang/java/BUILD.md
> >>> >>> ),
> >>> >>> > had
> >>> >>> > > >> to
> >>> >>> > > >> > add
> >>> >>> > > >> > > LD_LIBRARY_PATH environment variable and have it point
> to
> >>> >>> > > >> /usr/local/lib
> >>> >>> > > >> > > where the shared library for protobuf is installed
> >>> >>> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in
> >>> the
> >>> >>> > > >> > documentation
> >>> >>> > > >> > > :) )
> >>> >>> > > >> > >
> >>> >>> > > >> > >
> >>> >>> > > >> > > [INFO]
> >>> >>> > > >> > > ------------------------------
> >>> ------------------------------
> >>> >>> > > >> ------------
> >>> >>> > > >> > > [INFO] Reactor Summary:
> >>> >>> > > >> > > [INFO]
> >>> >>> > > >> > > [INFO] REEF ..............................
> >>> .................
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 4.167 s]
> >>> >>> > > >> > > [INFO] REEF Dot Net ..............................
> >>> .........
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 1.628 s]
> >>> >>> > > >> > > [INFO] REEF Annotations ..............................
> >>> .....
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 5.509 s]
> >>> >>> > > >> > > [INFO] REEF Utils ..............................
> >>> ...........
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 5.747 s]
> >>> >>> > > >> > > [INFO] REEF Tang Project ..............................
> >>> ....
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 0.492 s]
> >>> >>> > > >> > > [INFO] Tang Test Jar A ..............................
> >>> ......
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 4.276 s]
> >>> >>> > > >> > > [INFO] Tang Test Jar B ..............................
> >>> ......
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 4.186 s]
> >>> >>> > > >> > > [INFO] Tang Test Jar AB ..............................
> >>> .....
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 4.376 s]
> >>> >>> > > >> > > [INFO] Tang Test Jar B conflict A
> >>> .........................
> >>> >>> > SUCCESS
> >>> >>> > > [
> >>> >>> > > >> > > 0.440 s]
> >>> >>> > > >> > > [INFO] REEF Tang ..............................
> >>> ............
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 24.779 s]
> >>> >>> > > >> > > [INFO] REEF Wake Project ..............................
> >>> ....
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 0.487 s]
> >>> >>> > > >> > > [INFO] REEF Wake ..............................
> >>> ............
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 15.587 s]
> >>> >>> > > >> > > [INFO] REEF Common ..............................
> >>> ..........
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 23.343 s]
> >>> >>> > > >> > > [INFO] REEF Runtime Local ..............................
> >>> ...
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 8.375 s]
> >>> >>> > > >> > > [INFO] REEF Applications ..............................
> >>> ....
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 0.416 s]
> >>> >>> > > >> > > [INFO] REEF Vortex ..............................
> >>> ..........
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 11.263 s]
> >>> >>> > > >> > > [INFO] REEF HTTP Server ..............................
> >>> .....
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 9.772 s]
> >>> >>> > > >> > > [INFO] REEF Utils for Hadoop
> >>> ..............................
> >>> >>> > SUCCESS
> >>> >>> > > [
> >>> >>> > > >> > > 5.881 s]
> >>> >>> > > >> > > [INFO] REEF Runtime for YARN
> >>> ..............................
> >>> >>> > SUCCESS
> >>> >>> > > [
> >>> >>> > > >> > > 11.041 s]
> >>> >>> > > >> > > [INFO] REEF Runtime for HDInsight
> >>> .........................
> >>> >>> > SUCCESS
> >>> >>> > > [
> >>> >>> > > >> > > 9.719 s]
> >>> >>> > > >> > > [INFO] REEF IO ..............................
> >>> ..............
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 23.729 s]
> >>> >>> > > >> > > [INFO] REEF Checkpoint ..............................
> >>> ......
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 5.771 s]
> >>> >>> > > >> > > [INFO] REEF Bridge Java ..............................
> >>> .....
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 11.981 s]
> >>> >>> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios
> >>> ........
> >>> >>> > SUCCESS
> >>> >>> > > [
> >>> >>> > > >> > > 7.898 s]
> >>> >>> > > >> > > [INFO] REEF Bridge (Client)
> ..............................
> >>> .
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 12.242 s]
> >>> >>> > > >> > > [INFO] REEF Runtime Standalone
> >>> ............................
> >>> >>> > SUCCESS
> >>> >>> > > [
> >>> >>> > > >> > > 7.779 s]
> >>> >>> > > >> > > [INFO] REEF Runtime for Mesos
> >>> .............................
> >>> >>> > SUCCESS
> >>> >>> > > [
> >>> >>> > > >> > > 11.103 s]
> >>> >>> > > >> > > [INFO] REEF Poison ..............................
> >>> ..........
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 5.384 s]
> >>> >>> > > >> > > [INFO] REEF Examples ..............................
> >>> ........
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 14.313 s]
> >>> >>> > > >> > > [INFO] REEF Examples CLR ..............................
> >>> ....
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 7.532 s]
> >>> >>> > > >> > > [INFO] REEF Examples on HDInsight
> >>> .........................
> >>> >>> > SUCCESS
> >>> >>> > > [
> >>> >>> > > >> > > 9.213 s]
> >>> >>> > > >> > > [INFO] REEF Tang Tint ..............................
> >>> .......
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 8.546 s]
> >>> >>> > > >> > > [INFO] REEF Tests ..............................
> >>> ...........
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 15.696 s]
> >>> >>> > > >> > > [INFO] REEF Website ..............................
> >>> .........
> >>> >>> > > SUCCESS [
> >>> >>> > > >> > > 1.033 s]
> >>> >>> > > >> > > [INFO]
> >>> >>> > > >> > > ------------------------------
> >>> ------------------------------
> >>> >>> > > >> ------------
> >>> >>> > > >> > > [INFO] BUILD SUCCESS
> >>> >>> > > >> > > [INFO]
> >>> >>> > > >> > > ------------------------------
> >>> ------------------------------
> >>> >>> > > >> ------------
> >>> >>> > > >> > > [INFO] Total time: 04:54 min
> >>> >>> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> >>> >>> > > >> > > [INFO] Final Memory: 125M/1238M
> >>> >>> > > >> > > [INFO]
> >>> >>> > > >> > > ------------------------------
> >>> ------------------------------
> >>> >>> > > >> ------------
> >>> >>> > > >> > >
> >>> >>> > > >> > >
> >>> >>> > > >> > > On to bigger and better things :), we should probably
> >>> update
> >>> >>> the
> >>> >>> > > docs
> >>> >>> > > >> to
> >>> >>> > > >> > > reflect the current build process subtleties. Will try
> >>> >>> windows
> >>> >>> > > next.
> >>> >>> > > >> > >
> >>> >>> > > >> > >
> >>> >>> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> >>> >>> bgchun@gmail.com
> >>> >>> > >
> >>> >>> > > >> > wrote:
> >>> >>> > > >> > >
> >>> >>> > > >> > > > Welcome, Saikat!
> >>> >>> > > >> > > >
> >>> >>> > > >> > > >
> >>> >>> > > >> > > >
> >>> >>> > > >> > > >
> >>> >>> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> >>> >>> markus@weimo.de>
> >>> >>> > > >> wrote:
> >>> >>> > > >> > > >
> >>> >>> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> >>> >>> > > >> > > > >
> >>> >>> > > >> > > > >> I am a newbie to Apache Reef and am interested in
> >>> >>> > contributing
> >>> >>> > > to
> >>> >>> > > >> > the
> >>> >>> > > >> > > > reef
> >>> >>> > > >> > > > >> dev efforts
> >>> >>> > > >> > > > >>
> >>> >>> > > >> > > > >
> >>> >>> > > >> > > > > Welcome!
> >>> >>> > > >> > > > >
> >>> >>> > > >> > > > > my JIRA id is kanjilal
> >>> >>> > > >> > > > >>
> >>> >>> > > >> > > > >
> >>> >>> > > >> > > > > I have added you to the contributor's list on JIRA.
> >>> This
> >>> >>> > > basically
> >>> >>> > > >> > > means
> >>> >>> > > >> > > > > that you can self-assign issues to yourself now :)
> >>> >>> > > >> > > > >
> >>> >>> > > >> > > > > Markus
> >>> >>> > > >> > > > >
> >>> >>> > > >> > > >
> >>> >>> > > >> > > >
> >>> >>> > > >> > > >
> >>> >>> > > >> > > > --
> >>> >>> > > >> > > > Byung-Gon Chun
> >>> >>> > > >> > > >
> >>> >>> > > >> > >
> >>> >>> > > >> >
> >>> >>> > > >>
> >>> >>> > > >
> >>> >>> > > >
> >>> >>> > >
> >>> >>> >
> >>> >>>
> >>> >>
> >>> >>
> >>> >
> >>>
> >>
> >>
> >
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
also what is your GitHub alias?
On Fri, Feb 10, 2017 at 2:07 PM, Douglas Service <ds...@gmail.com> wrote:
> and git status from the REEF root directory.
>
> On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <ds...@gmail.com>
> wrote:
>
>> Would you please send the output of git remote -v?
>>
>> Doug
>>
>> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <sx...@gmail.com>
>> wrote:
>>
>>> Folks,
>>> I am trying to create/deploy my first pull request, I've gone through all
>>> of these steps successfully here:
>>> https://cwiki.apache.org/confluence/display/REEF/Contributin
>>> g#Contributing-1.Forkrepository
>>> but I seem to be running into 403 errors when I do a git push origin
>>> HEAD,
>>> here are my creds, would really appreciate some help:
>>>
>>>
>>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
>>> github username: skanjila
>>>
>>>
>>> Please let me know what I am missing here, note that my id in JIRA is
>>> kanjilal but my github userid is skanjila, might this be a problem?
>>>
>>> Thanks in advance.
>>>
>>>
>>>
>>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sx...@gmail.com>
>>> wrote:
>>>
>>> > Well interesting piece of metadata, time for successfully completing
>>> > windows server 2016 build was about half the time for linux, at least
>>> for
>>> > the java build, will try csharp next
>>> >
>>> > Here's what I did:
>>> > 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
>>> > 2) mvn clean install -DskipTests=true
>>> >
>>> >
>>> > For posterity's sake I will go back and redo my ubuntu linux build and
>>> > then work on the JIRA-1739 to make sure the documentation is up to
>>> date as
>>> > needed. I will install java from the repositories this time.
>>> >
>>> >
>>> >
>>> >
>>> > On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <sx...@gmail.com>
>>> wrote:
>>> >
>>> >> Yes I have gone through that in the past, not sure why I decided not
>>> to
>>> >> include that repo and just download the jdk and put it in instead :),
>>> >> regardless I will send a pull request for the build cleanup in the
>>> next few
>>> >> days, lets iterate on it as a team and test drive it to prove it
>>> wrong or
>>> >> right
>>> >>
>>> >> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <ds...@gmail.com>
>>> >> wrote:
>>> >>
>>> >>> After thinking about all of the changes you had make and the fact
>>> that
>>> >>> oracle java does not show up in update-alternatives, you may want to
>>> look
>>> >>> at these instructions which tell how to install oracle java via
>>> apt-get
>>> >>> repository which automatically takes care of a lot of the issues you
>>> ran
>>> >>> into
>>> >>> https://www.digitalocean.com/community/tutorials/how-to-inst
>>> >>> all-java-on-ubuntu-with-apt-get
>>> >>> .
>>> >>>
>>> >>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <sx...@gmail.com>
>>> >>> wrote:
>>> >>>
>>> >>> > I think part of the difference is the way both of us installed
>>> java, my
>>> >>> > setup is using the oracle java as opposed to the open-jdk java
>>> >>> provided by
>>> >>> > update-alternatives, I agree with your instructions assessment.
>>> >>> >
>>> >>> >
>>> >>> > On another note I have a question, how did folks install protoc on
>>> >>> windows,
>>> >>> > in looking at the wiki it points you to the protoc site where it
>>> seems
>>> >>> to
>>> >>> > need a whole bunch of supporting tools (cmake/mingw etc), I am
>>> using
>>> >>> > gitbash on windows and was wondering if there's an easy way to
>>> >>> download the
>>> >>> > protoc binaries and set the path, please forgive me if this is in
>>> the
>>> >>> > documentation somewhere, still learning my way around.
>>> >>> >
>>> >>> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <
>>> dsopsrc@gmail.com>
>>> >>> > wrote:
>>> >>> >
>>> >>> > > What I mean is that we should provide instructions to setup the
>>> least
>>> >>> > > complicated build environment that works, not one that is more
>>> >>> > complicated
>>> >>> > > but also works.
>>> >>> > >
>>> >>> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
>>> dsopsrc@gmail.com>
>>> >>> > > wrote:
>>> >>> > >
>>> >>> > > > Do you have update-alternatives installed? Have you run
>>> >>> > > > update-alternatives --config java?
>>> >>> > > >
>>> >>> > > > Sorry I made a mistake in may last email, I actually have
>>> >>> JAVA_HOME set
>>> >>> > > to
>>> >>> > > > /usr as listed on the webpage which figured out from Sergiy.
>>> >>> However, I
>>> >>> > > do
>>> >>> > > > not need to set the other ones. It is important that our
>>> >>> contributing
>>> >>> > to
>>> >>> > > > REEF wiki be general and not specific to a single setup.
>>> >>> > > >
>>> >>> > > > Here is my environment for building REEF on Ubuntu 16.04.
>>> >>> > > >
>>> >>> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
>>> >>> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
>>> >>> > > > XDG_SESSION_ID=c2
>>> >>> > > > SHELL=/bin/bash
>>> >>> > > > TERM=xterm
>>> >>> > > > WINDOWID=44144243
>>> >>> > > > USER=dougse
>>> >>> > > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
>>> >>> > > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
>>> >>> > > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
>>> >>> > > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
>>> >>> > > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
>>> >>> > > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
>>> >>> > > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
>>> >>> > > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
>>> >>> > > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
>>> >>> > > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
>>> >>> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
>>> >>> > > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
>>> >>> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
>>> >>> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
>>> >>> > > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
>>> >>> > > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
>>> >>> > > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
>>> >>> > > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
>>> >>> > > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
>>> >>> > > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
>>> >>> > > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
>>> >>> > > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
>>> >>> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
>>> >>> > > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
>>> >>> > > > 00;36:*.xspf=00;36:
>>> >>> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
>>> >>> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
>>> >>> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
>>> >>> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/loca
>>> l/bin
>>> >>> > > > PWD=/code/reef
>>> >>> > > > JAVA_HOME=/usr
>>> >>> > > > LANG=en_US.UTF-8
>>> >>> > > > REEF_HOME=/code/reef
>>> >>> > > > SHLVL=1
>>> >>> > > > HOME=/home/dougse
>>> >>> > > > GTK_OVERLAY_SCROLLING=0
>>> >>> > > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,
>>> guid=
>>> >>> > > > ae74bbce18102091c11c7bd458939d1c
>>> >>> > > > UID=1000
>>> >>> > > > LESSOPEN=| /bin/lesspipe %s
>>> >>> > > > XDG_RUNTIME_DIR=/run/user/1000
>>> >>> > > > DISPLAY=:10.0
>>> >>> > > > XDG_CURRENT_DESKTOP=MATE
>>> >>> > > > LESSCLOSE=/bin/lesspipe %s %s
>>> >>> > > > COLORTERM=mate-terminal
>>> >>> > > > _=/usr/bin/env
>>> >>> > > >
>>> >>> > > >
>>> >>> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
>>> sxk1969@gmail.com
>>> >>> >
>>> >>> > > wrote:
>>> >>> > > >
>>> >>> > > >> Weird, yes I did read that pageand yes I had to do those exact
>>> >>> steps
>>> >>> > > that
>>> >>> > > >> I
>>> >>> > > >> described, I haven't run the tests yet but fully suspect that
>>> I'll
>>> >>> > need
>>> >>> > > to
>>> >>> > > >> increase the ulimit to enable that. If you do a plain maven
>>> build
>>> >>> > after
>>> >>> > > >> checking out the reef code in ubuntu it complains that
>>> JAVA_HOME
>>> >>> is
>>> >>> > not
>>> >>> > > >> set, also its a good idea to set the maven oriented
>>> environment
>>> >>> > > variables
>>> >>> > > >> because I highly suspect that in the future we may need to
>>> adjust
>>> >>> heap
>>> >>> > > >> space settings, finally the LD_LIBRARY_PATH is needed I
>>> suspect
>>> >>> > because
>>> >>> > > >> the
>>> >>> > > >> java code is invoking the protoc compiler at some point and in
>>> >>> order
>>> >>> > to
>>> >>> > > do
>>> >>> > > >> so it much load some .so files that live in LD_LIBRARY_PATH.
>>> Net
>>> >>> Net
>>> >>> > we
>>> >>> > > >> should definitely figure out the differences between your and
>>> >>> Sergei's
>>> >>> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
>>> >>> > convinced
>>> >>> > > >> that the version matters if the major version is the same.
>>> >>> > > >> Cheers
>>> >>> > > >>
>>> >>> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
>>> >>> dsopsrc@gmail.com>
>>> >>> > > >> wrote:
>>> >>> > > >>
>>> >>> > > >> > Hello Saikat,
>>> >>> > > >> >
>>> >>> > > >> > Did you read the documentation on this page
>>> >>> > > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on
>>> the
>>> >>> REEF
>>> >>> > > wiki
>>> >>> > > >> > concerning Java on Ubuntu? I added this page after setting
>>> up a
>>> >>> > Linux
>>> >>> > > >> 16.04
>>> >>> > > >> > to build REEF and trading emails with Sergiy on the dev
>>> list.
>>> >>> Note
>>> >>> > > >> that I
>>> >>> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However,
>>> you do
>>> >>> need
>>> >>> > > to
>>> >>> > > >> > change the default for ulimit -n in bash to get the tests
>>> to run
>>> >>> > which
>>> >>> > > >> is
>>> >>> > > >> > also described.
>>> >>> > > >> >
>>> >>> > > >> > Doug
>>> >>> > > >> >
>>> >>> > > >> >
>>> >>> > > >> >
>>> >>> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
>>> >>> sxk1969@gmail.com>
>>> >>> > > >> wrote:
>>> >>> > > >> >
>>> >>> > > >> > > A battle well fought and won, got reef to build
>>> successfully
>>> >>> on
>>> >>> > > ubuntu
>>> >>> > > >> > > linux vm after hours of hacking, fyi here's what I had to
>>> do:
>>> >>> > > >> > > 1) installed the necessary tools (jdk 1.7/maven
>>> 3.3.9/protoc
>>> >>> > version
>>> >>> > > >> 2.5)
>>> >>> > > >> > > 2) added JAVA_HOME and M2_HOME
>>> >>> > > >> > > 3) here's the kicker that's not in the documentation :) (
>>> >>> > > >> > > https://github.com/apache/reef
>>> /blob/master/lang/java/BUILD.md
>>> >>> ),
>>> >>> > had
>>> >>> > > >> to
>>> >>> > > >> > add
>>> >>> > > >> > > LD_LIBRARY_PATH environment variable and have it point to
>>> >>> > > >> /usr/local/lib
>>> >>> > > >> > > where the shared library for protobuf is installed
>>> >>> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in
>>> the
>>> >>> > > >> > documentation
>>> >>> > > >> > > :) )
>>> >>> > > >> > >
>>> >>> > > >> > >
>>> >>> > > >> > > [INFO]
>>> >>> > > >> > > ------------------------------
>>> ------------------------------
>>> >>> > > >> ------------
>>> >>> > > >> > > [INFO] Reactor Summary:
>>> >>> > > >> > > [INFO]
>>> >>> > > >> > > [INFO] REEF ..............................
>>> .................
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 4.167 s]
>>> >>> > > >> > > [INFO] REEF Dot Net ..............................
>>> .........
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 1.628 s]
>>> >>> > > >> > > [INFO] REEF Annotations ..............................
>>> .....
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 5.509 s]
>>> >>> > > >> > > [INFO] REEF Utils ..............................
>>> ...........
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 5.747 s]
>>> >>> > > >> > > [INFO] REEF Tang Project ..............................
>>> ....
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 0.492 s]
>>> >>> > > >> > > [INFO] Tang Test Jar A ..............................
>>> ......
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 4.276 s]
>>> >>> > > >> > > [INFO] Tang Test Jar B ..............................
>>> ......
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 4.186 s]
>>> >>> > > >> > > [INFO] Tang Test Jar AB ..............................
>>> .....
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 4.376 s]
>>> >>> > > >> > > [INFO] Tang Test Jar B conflict A
>>> .........................
>>> >>> > SUCCESS
>>> >>> > > [
>>> >>> > > >> > > 0.440 s]
>>> >>> > > >> > > [INFO] REEF Tang ..............................
>>> ............
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 24.779 s]
>>> >>> > > >> > > [INFO] REEF Wake Project ..............................
>>> ....
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 0.487 s]
>>> >>> > > >> > > [INFO] REEF Wake ..............................
>>> ............
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 15.587 s]
>>> >>> > > >> > > [INFO] REEF Common ..............................
>>> ..........
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 23.343 s]
>>> >>> > > >> > > [INFO] REEF Runtime Local ..............................
>>> ...
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 8.375 s]
>>> >>> > > >> > > [INFO] REEF Applications ..............................
>>> ....
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 0.416 s]
>>> >>> > > >> > > [INFO] REEF Vortex ..............................
>>> ..........
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 11.263 s]
>>> >>> > > >> > > [INFO] REEF HTTP Server ..............................
>>> .....
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 9.772 s]
>>> >>> > > >> > > [INFO] REEF Utils for Hadoop
>>> ..............................
>>> >>> > SUCCESS
>>> >>> > > [
>>> >>> > > >> > > 5.881 s]
>>> >>> > > >> > > [INFO] REEF Runtime for YARN
>>> ..............................
>>> >>> > SUCCESS
>>> >>> > > [
>>> >>> > > >> > > 11.041 s]
>>> >>> > > >> > > [INFO] REEF Runtime for HDInsight
>>> .........................
>>> >>> > SUCCESS
>>> >>> > > [
>>> >>> > > >> > > 9.719 s]
>>> >>> > > >> > > [INFO] REEF IO ..............................
>>> ..............
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 23.729 s]
>>> >>> > > >> > > [INFO] REEF Checkpoint ..............................
>>> ......
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 5.771 s]
>>> >>> > > >> > > [INFO] REEF Bridge Java ..............................
>>> .....
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 11.981 s]
>>> >>> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios
>>> ........
>>> >>> > SUCCESS
>>> >>> > > [
>>> >>> > > >> > > 7.898 s]
>>> >>> > > >> > > [INFO] REEF Bridge (Client) ..............................
>>> .
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 12.242 s]
>>> >>> > > >> > > [INFO] REEF Runtime Standalone
>>> ............................
>>> >>> > SUCCESS
>>> >>> > > [
>>> >>> > > >> > > 7.779 s]
>>> >>> > > >> > > [INFO] REEF Runtime for Mesos
>>> .............................
>>> >>> > SUCCESS
>>> >>> > > [
>>> >>> > > >> > > 11.103 s]
>>> >>> > > >> > > [INFO] REEF Poison ..............................
>>> ..........
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 5.384 s]
>>> >>> > > >> > > [INFO] REEF Examples ..............................
>>> ........
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 14.313 s]
>>> >>> > > >> > > [INFO] REEF Examples CLR ..............................
>>> ....
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 7.532 s]
>>> >>> > > >> > > [INFO] REEF Examples on HDInsight
>>> .........................
>>> >>> > SUCCESS
>>> >>> > > [
>>> >>> > > >> > > 9.213 s]
>>> >>> > > >> > > [INFO] REEF Tang Tint ..............................
>>> .......
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 8.546 s]
>>> >>> > > >> > > [INFO] REEF Tests ..............................
>>> ...........
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 15.696 s]
>>> >>> > > >> > > [INFO] REEF Website ..............................
>>> .........
>>> >>> > > SUCCESS [
>>> >>> > > >> > > 1.033 s]
>>> >>> > > >> > > [INFO]
>>> >>> > > >> > > ------------------------------
>>> ------------------------------
>>> >>> > > >> ------------
>>> >>> > > >> > > [INFO] BUILD SUCCESS
>>> >>> > > >> > > [INFO]
>>> >>> > > >> > > ------------------------------
>>> ------------------------------
>>> >>> > > >> ------------
>>> >>> > > >> > > [INFO] Total time: 04:54 min
>>> >>> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
>>> >>> > > >> > > [INFO] Final Memory: 125M/1238M
>>> >>> > > >> > > [INFO]
>>> >>> > > >> > > ------------------------------
>>> ------------------------------
>>> >>> > > >> ------------
>>> >>> > > >> > >
>>> >>> > > >> > >
>>> >>> > > >> > > On to bigger and better things :), we should probably
>>> update
>>> >>> the
>>> >>> > > docs
>>> >>> > > >> to
>>> >>> > > >> > > reflect the current build process subtleties. Will try
>>> >>> windows
>>> >>> > > next.
>>> >>> > > >> > >
>>> >>> > > >> > >
>>> >>> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
>>> >>> bgchun@gmail.com
>>> >>> > >
>>> >>> > > >> > wrote:
>>> >>> > > >> > >
>>> >>> > > >> > > > Welcome, Saikat!
>>> >>> > > >> > > >
>>> >>> > > >> > > >
>>> >>> > > >> > > >
>>> >>> > > >> > > >
>>> >>> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
>>> >>> markus@weimo.de>
>>> >>> > > >> wrote:
>>> >>> > > >> > > >
>>> >>> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
>>> >>> > > >> > > > >
>>> >>> > > >> > > > >> I am a newbie to Apache Reef and am interested in
>>> >>> > contributing
>>> >>> > > to
>>> >>> > > >> > the
>>> >>> > > >> > > > reef
>>> >>> > > >> > > > >> dev efforts
>>> >>> > > >> > > > >>
>>> >>> > > >> > > > >
>>> >>> > > >> > > > > Welcome!
>>> >>> > > >> > > > >
>>> >>> > > >> > > > > my JIRA id is kanjilal
>>> >>> > > >> > > > >>
>>> >>> > > >> > > > >
>>> >>> > > >> > > > > I have added you to the contributor's list on JIRA.
>>> This
>>> >>> > > basically
>>> >>> > > >> > > means
>>> >>> > > >> > > > > that you can self-assign issues to yourself now :)
>>> >>> > > >> > > > >
>>> >>> > > >> > > > > Markus
>>> >>> > > >> > > > >
>>> >>> > > >> > > >
>>> >>> > > >> > > >
>>> >>> > > >> > > >
>>> >>> > > >> > > > --
>>> >>> > > >> > > > Byung-Gon Chun
>>> >>> > > >> > > >
>>> >>> > > >> > >
>>> >>> > > >> >
>>> >>> > > >>
>>> >>> > > >
>>> >>> > > >
>>> >>> > >
>>> >>> >
>>> >>>
>>> >>
>>> >>
>>> >
>>>
>>
>>
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
and git status from the REEF root directory.
On Fri, Feb 10, 2017 at 2:06 PM, Douglas Service <ds...@gmail.com> wrote:
> Would you please send the output of git remote -v?
>
> Doug
>
> On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
>
>> Folks,
>> I am trying to create/deploy my first pull request, I've gone through all
>> of these steps successfully here:
>> https://cwiki.apache.org/confluence/display/REEF/Contributin
>> g#Contributing-1.Forkrepository
>> but I seem to be running into 403 errors when I do a git push origin HEAD,
>> here are my creds, would really appreciate some help:
>>
>>
>> JIRA: https://issues.apache.org/jira/browse/REEF-1739
>> github username: skanjila
>>
>>
>> Please let me know what I am missing here, note that my id in JIRA is
>> kanjilal but my github userid is skanjila, might this be a problem?
>>
>> Thanks in advance.
>>
>>
>>
>> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sx...@gmail.com>
>> wrote:
>>
>> > Well interesting piece of metadata, time for successfully completing
>> > windows server 2016 build was about half the time for linux, at least
>> for
>> > the java build, will try csharp next
>> >
>> > Here's what I did:
>> > 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
>> > 2) mvn clean install -DskipTests=true
>> >
>> >
>> > For posterity's sake I will go back and redo my ubuntu linux build and
>> > then work on the JIRA-1739 to make sure the documentation is up to date
>> as
>> > needed. I will install java from the repositories this time.
>> >
>> >
>> >
>> >
>> > On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <sx...@gmail.com>
>> wrote:
>> >
>> >> Yes I have gone through that in the past, not sure why I decided not to
>> >> include that repo and just download the jdk and put it in instead :),
>> >> regardless I will send a pull request for the build cleanup in the
>> next few
>> >> days, lets iterate on it as a team and test drive it to prove it wrong
>> or
>> >> right
>> >>
>> >> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <ds...@gmail.com>
>> >> wrote:
>> >>
>> >>> After thinking about all of the changes you had make and the fact that
>> >>> oracle java does not show up in update-alternatives, you may want to
>> look
>> >>> at these instructions which tell how to install oracle java via
>> apt-get
>> >>> repository which automatically takes care of a lot of the issues you
>> ran
>> >>> into
>> >>> https://www.digitalocean.com/community/tutorials/how-to-inst
>> >>> all-java-on-ubuntu-with-apt-get
>> >>> .
>> >>>
>> >>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <sx...@gmail.com>
>> >>> wrote:
>> >>>
>> >>> > I think part of the difference is the way both of us installed
>> java, my
>> >>> > setup is using the oracle java as opposed to the open-jdk java
>> >>> provided by
>> >>> > update-alternatives, I agree with your instructions assessment.
>> >>> >
>> >>> >
>> >>> > On another note I have a question, how did folks install protoc on
>> >>> windows,
>> >>> > in looking at the wiki it points you to the protoc site where it
>> seems
>> >>> to
>> >>> > need a whole bunch of supporting tools (cmake/mingw etc), I am using
>> >>> > gitbash on windows and was wondering if there's an easy way to
>> >>> download the
>> >>> > protoc binaries and set the path, please forgive me if this is in
>> the
>> >>> > documentation somewhere, still learning my way around.
>> >>> >
>> >>> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <dsopsrc@gmail.com
>> >
>> >>> > wrote:
>> >>> >
>> >>> > > What I mean is that we should provide instructions to setup the
>> least
>> >>> > > complicated build environment that works, not one that is more
>> >>> > complicated
>> >>> > > but also works.
>> >>> > >
>> >>> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
>> dsopsrc@gmail.com>
>> >>> > > wrote:
>> >>> > >
>> >>> > > > Do you have update-alternatives installed? Have you run
>> >>> > > > update-alternatives --config java?
>> >>> > > >
>> >>> > > > Sorry I made a mistake in may last email, I actually have
>> >>> JAVA_HOME set
>> >>> > > to
>> >>> > > > /usr as listed on the webpage which figured out from Sergiy.
>> >>> However, I
>> >>> > > do
>> >>> > > > not need to set the other ones. It is important that our
>> >>> contributing
>> >>> > to
>> >>> > > > REEF wiki be general and not specific to a single setup.
>> >>> > > >
>> >>> > > > Here is my environment for building REEF on Ubuntu 16.04.
>> >>> > > >
>> >>> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
>> >>> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
>> >>> > > > XDG_SESSION_ID=c2
>> >>> > > > SHELL=/bin/bash
>> >>> > > > TERM=xterm
>> >>> > > > WINDOWID=44144243
>> >>> > > > USER=dougse
>> >>> > > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
>> >>> > > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
>> >>> > > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
>> >>> > > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
>> >>> > > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
>> >>> > > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
>> >>> > > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
>> >>> > > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
>> >>> > > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
>> >>> > > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
>> >>> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
>> >>> > > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
>> >>> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
>> >>> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
>> >>> > > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
>> >>> > > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
>> >>> > > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
>> >>> > > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
>> >>> > > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
>> >>> > > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
>> >>> > > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
>> >>> > > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
>> >>> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
>> >>> > > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
>> >>> > > > 00;36:*.xspf=00;36:
>> >>> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
>> >>> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
>> >>> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
>> >>> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/loca
>> l/bin
>> >>> > > > PWD=/code/reef
>> >>> > > > JAVA_HOME=/usr
>> >>> > > > LANG=en_US.UTF-8
>> >>> > > > REEF_HOME=/code/reef
>> >>> > > > SHLVL=1
>> >>> > > > HOME=/home/dougse
>> >>> > > > GTK_OVERLAY_SCROLLING=0
>> >>> > > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,
>> guid=
>> >>> > > > ae74bbce18102091c11c7bd458939d1c
>> >>> > > > UID=1000
>> >>> > > > LESSOPEN=| /bin/lesspipe %s
>> >>> > > > XDG_RUNTIME_DIR=/run/user/1000
>> >>> > > > DISPLAY=:10.0
>> >>> > > > XDG_CURRENT_DESKTOP=MATE
>> >>> > > > LESSCLOSE=/bin/lesspipe %s %s
>> >>> > > > COLORTERM=mate-terminal
>> >>> > > > _=/usr/bin/env
>> >>> > > >
>> >>> > > >
>> >>> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
>> sxk1969@gmail.com
>> >>> >
>> >>> > > wrote:
>> >>> > > >
>> >>> > > >> Weird, yes I did read that pageand yes I had to do those exact
>> >>> steps
>> >>> > > that
>> >>> > > >> I
>> >>> > > >> described, I haven't run the tests yet but fully suspect that
>> I'll
>> >>> > need
>> >>> > > to
>> >>> > > >> increase the ulimit to enable that. If you do a plain maven
>> build
>> >>> > after
>> >>> > > >> checking out the reef code in ubuntu it complains that
>> JAVA_HOME
>> >>> is
>> >>> > not
>> >>> > > >> set, also its a good idea to set the maven oriented environment
>> >>> > > variables
>> >>> > > >> because I highly suspect that in the future we may need to
>> adjust
>> >>> heap
>> >>> > > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
>> >>> > because
>> >>> > > >> the
>> >>> > > >> java code is invoking the protoc compiler at some point and in
>> >>> order
>> >>> > to
>> >>> > > do
>> >>> > > >> so it much load some .so files that live in LD_LIBRARY_PATH.
>> Net
>> >>> Net
>> >>> > we
>> >>> > > >> should definitely figure out the differences between your and
>> >>> Sergei's
>> >>> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
>> >>> > convinced
>> >>> > > >> that the version matters if the major version is the same.
>> >>> > > >> Cheers
>> >>> > > >>
>> >>> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
>> >>> dsopsrc@gmail.com>
>> >>> > > >> wrote:
>> >>> > > >>
>> >>> > > >> > Hello Saikat,
>> >>> > > >> >
>> >>> > > >> > Did you read the documentation on this page
>> >>> > > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on
>> the
>> >>> REEF
>> >>> > > wiki
>> >>> > > >> > concerning Java on Ubuntu? I added this page after setting
>> up a
>> >>> > Linux
>> >>> > > >> 16.04
>> >>> > > >> > to build REEF and trading emails with Sergiy on the dev
>> list.
>> >>> Note
>> >>> > > >> that I
>> >>> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you
>> do
>> >>> need
>> >>> > > to
>> >>> > > >> > change the default for ulimit -n in bash to get the tests to
>> run
>> >>> > which
>> >>> > > >> is
>> >>> > > >> > also described.
>> >>> > > >> >
>> >>> > > >> > Doug
>> >>> > > >> >
>> >>> > > >> >
>> >>> > > >> >
>> >>> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
>> >>> sxk1969@gmail.com>
>> >>> > > >> wrote:
>> >>> > > >> >
>> >>> > > >> > > A battle well fought and won, got reef to build
>> successfully
>> >>> on
>> >>> > > ubuntu
>> >>> > > >> > > linux vm after hours of hacking, fyi here's what I had to
>> do:
>> >>> > > >> > > 1) installed the necessary tools (jdk 1.7/maven
>> 3.3.9/protoc
>> >>> > version
>> >>> > > >> 2.5)
>> >>> > > >> > > 2) added JAVA_HOME and M2_HOME
>> >>> > > >> > > 3) here's the kicker that's not in the documentation :) (
>> >>> > > >> > > https://github.com/apache/reef
>> /blob/master/lang/java/BUILD.md
>> >>> ),
>> >>> > had
>> >>> > > >> to
>> >>> > > >> > add
>> >>> > > >> > > LD_LIBRARY_PATH environment variable and have it point to
>> >>> > > >> /usr/local/lib
>> >>> > > >> > > where the shared library for protobuf is installed
>> >>> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in
>> the
>> >>> > > >> > documentation
>> >>> > > >> > > :) )
>> >>> > > >> > >
>> >>> > > >> > >
>> >>> > > >> > > [INFO]
>> >>> > > >> > > ------------------------------
>> ------------------------------
>> >>> > > >> ------------
>> >>> > > >> > > [INFO] Reactor Summary:
>> >>> > > >> > > [INFO]
>> >>> > > >> > > [INFO] REEF ..............................
>> .................
>> >>> > > SUCCESS [
>> >>> > > >> > > 4.167 s]
>> >>> > > >> > > [INFO] REEF Dot Net ..............................
>> .........
>> >>> > > SUCCESS [
>> >>> > > >> > > 1.628 s]
>> >>> > > >> > > [INFO] REEF Annotations ..............................
>> .....
>> >>> > > SUCCESS [
>> >>> > > >> > > 5.509 s]
>> >>> > > >> > > [INFO] REEF Utils ..............................
>> ...........
>> >>> > > SUCCESS [
>> >>> > > >> > > 5.747 s]
>> >>> > > >> > > [INFO] REEF Tang Project ..............................
>> ....
>> >>> > > SUCCESS [
>> >>> > > >> > > 0.492 s]
>> >>> > > >> > > [INFO] Tang Test Jar A ..............................
>> ......
>> >>> > > SUCCESS [
>> >>> > > >> > > 4.276 s]
>> >>> > > >> > > [INFO] Tang Test Jar B ..............................
>> ......
>> >>> > > SUCCESS [
>> >>> > > >> > > 4.186 s]
>> >>> > > >> > > [INFO] Tang Test Jar AB ..............................
>> .....
>> >>> > > SUCCESS [
>> >>> > > >> > > 4.376 s]
>> >>> > > >> > > [INFO] Tang Test Jar B conflict A .........................
>> >>> > SUCCESS
>> >>> > > [
>> >>> > > >> > > 0.440 s]
>> >>> > > >> > > [INFO] REEF Tang ..............................
>> ............
>> >>> > > SUCCESS [
>> >>> > > >> > > 24.779 s]
>> >>> > > >> > > [INFO] REEF Wake Project ..............................
>> ....
>> >>> > > SUCCESS [
>> >>> > > >> > > 0.487 s]
>> >>> > > >> > > [INFO] REEF Wake ..............................
>> ............
>> >>> > > SUCCESS [
>> >>> > > >> > > 15.587 s]
>> >>> > > >> > > [INFO] REEF Common ..............................
>> ..........
>> >>> > > SUCCESS [
>> >>> > > >> > > 23.343 s]
>> >>> > > >> > > [INFO] REEF Runtime Local ..............................
>> ...
>> >>> > > SUCCESS [
>> >>> > > >> > > 8.375 s]
>> >>> > > >> > > [INFO] REEF Applications ..............................
>> ....
>> >>> > > SUCCESS [
>> >>> > > >> > > 0.416 s]
>> >>> > > >> > > [INFO] REEF Vortex ..............................
>> ..........
>> >>> > > SUCCESS [
>> >>> > > >> > > 11.263 s]
>> >>> > > >> > > [INFO] REEF HTTP Server ..............................
>> .....
>> >>> > > SUCCESS [
>> >>> > > >> > > 9.772 s]
>> >>> > > >> > > [INFO] REEF Utils for Hadoop ..............................
>> >>> > SUCCESS
>> >>> > > [
>> >>> > > >> > > 5.881 s]
>> >>> > > >> > > [INFO] REEF Runtime for YARN ..............................
>> >>> > SUCCESS
>> >>> > > [
>> >>> > > >> > > 11.041 s]
>> >>> > > >> > > [INFO] REEF Runtime for HDInsight .........................
>> >>> > SUCCESS
>> >>> > > [
>> >>> > > >> > > 9.719 s]
>> >>> > > >> > > [INFO] REEF IO ..............................
>> ..............
>> >>> > > SUCCESS [
>> >>> > > >> > > 23.729 s]
>> >>> > > >> > > [INFO] REEF Checkpoint ..............................
>> ......
>> >>> > > SUCCESS [
>> >>> > > >> > > 5.771 s]
>> >>> > > >> > > [INFO] REEF Bridge Java ..............................
>> .....
>> >>> > > SUCCESS [
>> >>> > > >> > > 11.981 s]
>> >>> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
>> >>> > SUCCESS
>> >>> > > [
>> >>> > > >> > > 7.898 s]
>> >>> > > >> > > [INFO] REEF Bridge (Client) ..............................
>> .
>> >>> > > SUCCESS [
>> >>> > > >> > > 12.242 s]
>> >>> > > >> > > [INFO] REEF Runtime Standalone ............................
>> >>> > SUCCESS
>> >>> > > [
>> >>> > > >> > > 7.779 s]
>> >>> > > >> > > [INFO] REEF Runtime for Mesos .............................
>> >>> > SUCCESS
>> >>> > > [
>> >>> > > >> > > 11.103 s]
>> >>> > > >> > > [INFO] REEF Poison ..............................
>> ..........
>> >>> > > SUCCESS [
>> >>> > > >> > > 5.384 s]
>> >>> > > >> > > [INFO] REEF Examples ..............................
>> ........
>> >>> > > SUCCESS [
>> >>> > > >> > > 14.313 s]
>> >>> > > >> > > [INFO] REEF Examples CLR ..............................
>> ....
>> >>> > > SUCCESS [
>> >>> > > >> > > 7.532 s]
>> >>> > > >> > > [INFO] REEF Examples on HDInsight .........................
>> >>> > SUCCESS
>> >>> > > [
>> >>> > > >> > > 9.213 s]
>> >>> > > >> > > [INFO] REEF Tang Tint ..............................
>> .......
>> >>> > > SUCCESS [
>> >>> > > >> > > 8.546 s]
>> >>> > > >> > > [INFO] REEF Tests ..............................
>> ...........
>> >>> > > SUCCESS [
>> >>> > > >> > > 15.696 s]
>> >>> > > >> > > [INFO] REEF Website ..............................
>> .........
>> >>> > > SUCCESS [
>> >>> > > >> > > 1.033 s]
>> >>> > > >> > > [INFO]
>> >>> > > >> > > ------------------------------
>> ------------------------------
>> >>> > > >> ------------
>> >>> > > >> > > [INFO] BUILD SUCCESS
>> >>> > > >> > > [INFO]
>> >>> > > >> > > ------------------------------
>> ------------------------------
>> >>> > > >> ------------
>> >>> > > >> > > [INFO] Total time: 04:54 min
>> >>> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
>> >>> > > >> > > [INFO] Final Memory: 125M/1238M
>> >>> > > >> > > [INFO]
>> >>> > > >> > > ------------------------------
>> ------------------------------
>> >>> > > >> ------------
>> >>> > > >> > >
>> >>> > > >> > >
>> >>> > > >> > > On to bigger and better things :), we should probably
>> update
>> >>> the
>> >>> > > docs
>> >>> > > >> to
>> >>> > > >> > > reflect the current build process subtleties. Will try
>> >>> windows
>> >>> > > next.
>> >>> > > >> > >
>> >>> > > >> > >
>> >>> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
>> >>> bgchun@gmail.com
>> >>> > >
>> >>> > > >> > wrote:
>> >>> > > >> > >
>> >>> > > >> > > > Welcome, Saikat!
>> >>> > > >> > > >
>> >>> > > >> > > >
>> >>> > > >> > > >
>> >>> > > >> > > >
>> >>> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
>> >>> markus@weimo.de>
>> >>> > > >> wrote:
>> >>> > > >> > > >
>> >>> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
>> >>> > > >> > > > >
>> >>> > > >> > > > >> I am a newbie to Apache Reef and am interested in
>> >>> > contributing
>> >>> > > to
>> >>> > > >> > the
>> >>> > > >> > > > reef
>> >>> > > >> > > > >> dev efforts
>> >>> > > >> > > > >>
>> >>> > > >> > > > >
>> >>> > > >> > > > > Welcome!
>> >>> > > >> > > > >
>> >>> > > >> > > > > my JIRA id is kanjilal
>> >>> > > >> > > > >>
>> >>> > > >> > > > >
>> >>> > > >> > > > > I have added you to the contributor's list on JIRA.
>> This
>> >>> > > basically
>> >>> > > >> > > means
>> >>> > > >> > > > > that you can self-assign issues to yourself now :)
>> >>> > > >> > > > >
>> >>> > > >> > > > > Markus
>> >>> > > >> > > > >
>> >>> > > >> > > >
>> >>> > > >> > > >
>> >>> > > >> > > >
>> >>> > > >> > > > --
>> >>> > > >> > > > Byung-Gon Chun
>> >>> > > >> > > >
>> >>> > > >> > >
>> >>> > > >> >
>> >>> > > >>
>> >>> > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> >>
>> >>
>> >
>>
>
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
Would you please send the output of git remote -v?
Doug
On Fri, Feb 10, 2017 at 1:17 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> Folks,
> I am trying to create/deploy my first pull request, I've gone through all
> of these steps successfully here:
> https://cwiki.apache.org/confluence/display/REEF/
> Contributing#Contributing-1.Forkrepository
> but I seem to be running into 403 errors when I do a git push origin HEAD,
> here are my creds, would really appreciate some help:
>
>
> JIRA: https://issues.apache.org/jira/browse/REEF-1739
> github username: skanjila
>
>
> Please let me know what I am missing here, note that my id in JIRA is
> kanjilal but my github userid is skanjila, might this be a problem?
>
> Thanks in advance.
>
>
>
> On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
>
> > Well interesting piece of metadata, time for successfully completing
> > windows server 2016 build was about half the time for linux, at least for
> > the java build, will try csharp next
> >
> > Here's what I did:
> > 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> > 2) mvn clean install -DskipTests=true
> >
> >
> > For posterity's sake I will go back and redo my ubuntu linux build and
> > then work on the JIRA-1739 to make sure the documentation is up to date
> as
> > needed. I will install java from the repositories this time.
> >
> >
> >
> >
> > On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
> >
> >> Yes I have gone through that in the past, not sure why I decided not to
> >> include that repo and just download the jdk and put it in instead :),
> >> regardless I will send a pull request for the build cleanup in the next
> few
> >> days, lets iterate on it as a team and test drive it to prove it wrong
> or
> >> right
> >>
> >> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <ds...@gmail.com>
> >> wrote:
> >>
> >>> After thinking about all of the changes you had make and the fact that
> >>> oracle java does not show up in update-alternatives, you may want to
> look
> >>> at these instructions which tell how to install oracle java via apt-get
> >>> repository which automatically takes care of a lot of the issues you
> ran
> >>> into
> >>> https://www.digitalocean.com/community/tutorials/how-to-inst
> >>> all-java-on-ubuntu-with-apt-get
> >>> .
> >>>
> >>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <sx...@gmail.com>
> >>> wrote:
> >>>
> >>> > I think part of the difference is the way both of us installed java,
> my
> >>> > setup is using the oracle java as opposed to the open-jdk java
> >>> provided by
> >>> > update-alternatives, I agree with your instructions assessment.
> >>> >
> >>> >
> >>> > On another note I have a question, how did folks install protoc on
> >>> windows,
> >>> > in looking at the wiki it points you to the protoc site where it
> seems
> >>> to
> >>> > need a whole bunch of supporting tools (cmake/mingw etc), I am using
> >>> > gitbash on windows and was wondering if there's an easy way to
> >>> download the
> >>> > protoc binaries and set the path, please forgive me if this is in the
> >>> > documentation somewhere, still learning my way around.
> >>> >
> >>> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
> >>> > wrote:
> >>> >
> >>> > > What I mean is that we should provide instructions to setup the
> least
> >>> > > complicated build environment that works, not one that is more
> >>> > complicated
> >>> > > but also works.
> >>> > >
> >>> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <
> dsopsrc@gmail.com>
> >>> > > wrote:
> >>> > >
> >>> > > > Do you have update-alternatives installed? Have you run
> >>> > > > update-alternatives --config java?
> >>> > > >
> >>> > > > Sorry I made a mistake in may last email, I actually have
> >>> JAVA_HOME set
> >>> > > to
> >>> > > > /usr as listed on the webpage which figured out from Sergiy.
> >>> However, I
> >>> > > do
> >>> > > > not need to set the other ones. It is important that our
> >>> contributing
> >>> > to
> >>> > > > REEF wiki be general and not specific to a single setup.
> >>> > > >
> >>> > > > Here is my environment for building REEF on Ubuntu 16.04.
> >>> > > >
> >>> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> >>> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> >>> > > > XDG_SESSION_ID=c2
> >>> > > > SHELL=/bin/bash
> >>> > > > TERM=xterm
> >>> > > > WINDOWID=44144243
> >>> > > > USER=dougse
> >>> > > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> >>> > > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> >>> > > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> >>> > > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> >>> > > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> >>> > > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> >>> > > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> >>> > > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> >>> > > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> >>> > > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> >>> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> >>> > > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> >>> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> >>> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> >>> > > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> >>> > > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> >>> > > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> >>> > > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> >>> > > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> >>> > > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> >>> > > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> >>> > > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> >>> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> >>> > > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> >>> > > > 00;36:*.xspf=00;36:
> >>> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> >>> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> >>> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> >>> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/
> local/bin
> >>> > > > PWD=/code/reef
> >>> > > > JAVA_HOME=/usr
> >>> > > > LANG=en_US.UTF-8
> >>> > > > REEF_HOME=/code/reef
> >>> > > > SHLVL=1
> >>> > > > HOME=/home/dougse
> >>> > > > GTK_OVERLAY_SCROLLING=0
> >>> > > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,
> guid=
> >>> > > > ae74bbce18102091c11c7bd458939d1c
> >>> > > > UID=1000
> >>> > > > LESSOPEN=| /bin/lesspipe %s
> >>> > > > XDG_RUNTIME_DIR=/run/user/1000
> >>> > > > DISPLAY=:10.0
> >>> > > > XDG_CURRENT_DESKTOP=MATE
> >>> > > > LESSCLOSE=/bin/lesspipe %s %s
> >>> > > > COLORTERM=mate-terminal
> >>> > > > _=/usr/bin/env
> >>> > > >
> >>> > > >
> >>> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> sxk1969@gmail.com
> >>> >
> >>> > > wrote:
> >>> > > >
> >>> > > >> Weird, yes I did read that pageand yes I had to do those exact
> >>> steps
> >>> > > that
> >>> > > >> I
> >>> > > >> described, I haven't run the tests yet but fully suspect that
> I'll
> >>> > need
> >>> > > to
> >>> > > >> increase the ulimit to enable that. If you do a plain maven
> build
> >>> > after
> >>> > > >> checking out the reef code in ubuntu it complains that JAVA_HOME
> >>> is
> >>> > not
> >>> > > >> set, also its a good idea to set the maven oriented environment
> >>> > > variables
> >>> > > >> because I highly suspect that in the future we may need to
> adjust
> >>> heap
> >>> > > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
> >>> > because
> >>> > > >> the
> >>> > > >> java code is invoking the protoc compiler at some point and in
> >>> order
> >>> > to
> >>> > > do
> >>> > > >> so it much load some .so files that live in LD_LIBRARY_PATH.
> Net
> >>> Net
> >>> > we
> >>> > > >> should definitely figure out the differences between your and
> >>> Sergei's
> >>> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
> >>> > convinced
> >>> > > >> that the version matters if the major version is the same.
> >>> > > >> Cheers
> >>> > > >>
> >>> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> >>> dsopsrc@gmail.com>
> >>> > > >> wrote:
> >>> > > >>
> >>> > > >> > Hello Saikat,
> >>> > > >> >
> >>> > > >> > Did you read the documentation on this page
> >>> > > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the
> >>> REEF
> >>> > > wiki
> >>> > > >> > concerning Java on Ubuntu? I added this page after setting up
> a
> >>> > Linux
> >>> > > >> 16.04
> >>> > > >> > to build REEF and trading emails with Sergiy on the dev list.
> >>> Note
> >>> > > >> that I
> >>> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you
> do
> >>> need
> >>> > > to
> >>> > > >> > change the default for ulimit -n in bash to get the tests to
> run
> >>> > which
> >>> > > >> is
> >>> > > >> > also described.
> >>> > > >> >
> >>> > > >> > Doug
> >>> > > >> >
> >>> > > >> >
> >>> > > >> >
> >>> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> >>> sxk1969@gmail.com>
> >>> > > >> wrote:
> >>> > > >> >
> >>> > > >> > > A battle well fought and won, got reef to build successfully
> >>> on
> >>> > > ubuntu
> >>> > > >> > > linux vm after hours of hacking, fyi here's what I had to
> do:
> >>> > > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
> >>> > version
> >>> > > >> 2.5)
> >>> > > >> > > 2) added JAVA_HOME and M2_HOME
> >>> > > >> > > 3) here's the kicker that's not in the documentation :) (
> >>> > > >> > > https://github.com/apache/reef/blob/master/lang/java/
> BUILD.md
> >>> ),
> >>> > had
> >>> > > >> to
> >>> > > >> > add
> >>> > > >> > > LD_LIBRARY_PATH environment variable and have it point to
> >>> > > >> /usr/local/lib
> >>> > > >> > > where the shared library for protobuf is installed
> >>> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> >>> > > >> > documentation
> >>> > > >> > > :) )
> >>> > > >> > >
> >>> > > >> > >
> >>> > > >> > > [INFO]
> >>> > > >> > > ------------------------------
> ------------------------------
> >>> > > >> ------------
> >>> > > >> > > [INFO] Reactor Summary:
> >>> > > >> > > [INFO]
> >>> > > >> > > [INFO] REEF ...............................................
> >>> > > SUCCESS [
> >>> > > >> > > 4.167 s]
> >>> > > >> > > [INFO] REEF Dot Net .......................................
> >>> > > SUCCESS [
> >>> > > >> > > 1.628 s]
> >>> > > >> > > [INFO] REEF Annotations ...................................
> >>> > > SUCCESS [
> >>> > > >> > > 5.509 s]
> >>> > > >> > > [INFO] REEF Utils .........................................
> >>> > > SUCCESS [
> >>> > > >> > > 5.747 s]
> >>> > > >> > > [INFO] REEF Tang Project ..................................
> >>> > > SUCCESS [
> >>> > > >> > > 0.492 s]
> >>> > > >> > > [INFO] Tang Test Jar A ....................................
> >>> > > SUCCESS [
> >>> > > >> > > 4.276 s]
> >>> > > >> > > [INFO] Tang Test Jar B ....................................
> >>> > > SUCCESS [
> >>> > > >> > > 4.186 s]
> >>> > > >> > > [INFO] Tang Test Jar AB ...................................
> >>> > > SUCCESS [
> >>> > > >> > > 4.376 s]
> >>> > > >> > > [INFO] Tang Test Jar B conflict A .........................
> >>> > SUCCESS
> >>> > > [
> >>> > > >> > > 0.440 s]
> >>> > > >> > > [INFO] REEF Tang ..........................................
> >>> > > SUCCESS [
> >>> > > >> > > 24.779 s]
> >>> > > >> > > [INFO] REEF Wake Project ..................................
> >>> > > SUCCESS [
> >>> > > >> > > 0.487 s]
> >>> > > >> > > [INFO] REEF Wake ..........................................
> >>> > > SUCCESS [
> >>> > > >> > > 15.587 s]
> >>> > > >> > > [INFO] REEF Common ........................................
> >>> > > SUCCESS [
> >>> > > >> > > 23.343 s]
> >>> > > >> > > [INFO] REEF Runtime Local .................................
> >>> > > SUCCESS [
> >>> > > >> > > 8.375 s]
> >>> > > >> > > [INFO] REEF Applications ..................................
> >>> > > SUCCESS [
> >>> > > >> > > 0.416 s]
> >>> > > >> > > [INFO] REEF Vortex ........................................
> >>> > > SUCCESS [
> >>> > > >> > > 11.263 s]
> >>> > > >> > > [INFO] REEF HTTP Server ...................................
> >>> > > SUCCESS [
> >>> > > >> > > 9.772 s]
> >>> > > >> > > [INFO] REEF Utils for Hadoop ..............................
> >>> > SUCCESS
> >>> > > [
> >>> > > >> > > 5.881 s]
> >>> > > >> > > [INFO] REEF Runtime for YARN ..............................
> >>> > SUCCESS
> >>> > > [
> >>> > > >> > > 11.041 s]
> >>> > > >> > > [INFO] REEF Runtime for HDInsight .........................
> >>> > SUCCESS
> >>> > > [
> >>> > > >> > > 9.719 s]
> >>> > > >> > > [INFO] REEF IO ............................................
> >>> > > SUCCESS [
> >>> > > >> > > 23.729 s]
> >>> > > >> > > [INFO] REEF Checkpoint ....................................
> >>> > > SUCCESS [
> >>> > > >> > > 5.771 s]
> >>> > > >> > > [INFO] REEF Bridge Java ...................................
> >>> > > SUCCESS [
> >>> > > >> > > 11.981 s]
> >>> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
> >>> > SUCCESS
> >>> > > [
> >>> > > >> > > 7.898 s]
> >>> > > >> > > [INFO] REEF Bridge (Client) ...............................
> >>> > > SUCCESS [
> >>> > > >> > > 12.242 s]
> >>> > > >> > > [INFO] REEF Runtime Standalone ............................
> >>> > SUCCESS
> >>> > > [
> >>> > > >> > > 7.779 s]
> >>> > > >> > > [INFO] REEF Runtime for Mesos .............................
> >>> > SUCCESS
> >>> > > [
> >>> > > >> > > 11.103 s]
> >>> > > >> > > [INFO] REEF Poison ........................................
> >>> > > SUCCESS [
> >>> > > >> > > 5.384 s]
> >>> > > >> > > [INFO] REEF Examples ......................................
> >>> > > SUCCESS [
> >>> > > >> > > 14.313 s]
> >>> > > >> > > [INFO] REEF Examples CLR ..................................
> >>> > > SUCCESS [
> >>> > > >> > > 7.532 s]
> >>> > > >> > > [INFO] REEF Examples on HDInsight .........................
> >>> > SUCCESS
> >>> > > [
> >>> > > >> > > 9.213 s]
> >>> > > >> > > [INFO] REEF Tang Tint .....................................
> >>> > > SUCCESS [
> >>> > > >> > > 8.546 s]
> >>> > > >> > > [INFO] REEF Tests .........................................
> >>> > > SUCCESS [
> >>> > > >> > > 15.696 s]
> >>> > > >> > > [INFO] REEF Website .......................................
> >>> > > SUCCESS [
> >>> > > >> > > 1.033 s]
> >>> > > >> > > [INFO]
> >>> > > >> > > ------------------------------
> ------------------------------
> >>> > > >> ------------
> >>> > > >> > > [INFO] BUILD SUCCESS
> >>> > > >> > > [INFO]
> >>> > > >> > > ------------------------------
> ------------------------------
> >>> > > >> ------------
> >>> > > >> > > [INFO] Total time: 04:54 min
> >>> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> >>> > > >> > > [INFO] Final Memory: 125M/1238M
> >>> > > >> > > [INFO]
> >>> > > >> > > ------------------------------
> ------------------------------
> >>> > > >> ------------
> >>> > > >> > >
> >>> > > >> > >
> >>> > > >> > > On to bigger and better things :), we should probably update
> >>> the
> >>> > > docs
> >>> > > >> to
> >>> > > >> > > reflect the current build process subtleties. Will try
> >>> windows
> >>> > > next.
> >>> > > >> > >
> >>> > > >> > >
> >>> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> >>> bgchun@gmail.com
> >>> > >
> >>> > > >> > wrote:
> >>> > > >> > >
> >>> > > >> > > > Welcome, Saikat!
> >>> > > >> > > >
> >>> > > >> > > >
> >>> > > >> > > >
> >>> > > >> > > >
> >>> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> >>> markus@weimo.de>
> >>> > > >> wrote:
> >>> > > >> > > >
> >>> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> >>> > > >> > > > >
> >>> > > >> > > > >> I am a newbie to Apache Reef and am interested in
> >>> > contributing
> >>> > > to
> >>> > > >> > the
> >>> > > >> > > > reef
> >>> > > >> > > > >> dev efforts
> >>> > > >> > > > >>
> >>> > > >> > > > >
> >>> > > >> > > > > Welcome!
> >>> > > >> > > > >
> >>> > > >> > > > > my JIRA id is kanjilal
> >>> > > >> > > > >>
> >>> > > >> > > > >
> >>> > > >> > > > > I have added you to the contributor's list on JIRA. This
> >>> > > basically
> >>> > > >> > > means
> >>> > > >> > > > > that you can self-assign issues to yourself now :)
> >>> > > >> > > > >
> >>> > > >> > > > > Markus
> >>> > > >> > > > >
> >>> > > >> > > >
> >>> > > >> > > >
> >>> > > >> > > >
> >>> > > >> > > > --
> >>> > > >> > > > Byung-Gon Chun
> >>> > > >> > > >
> >>> > > >> > >
> >>> > > >> >
> >>> > > >>
> >>> > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> >>
> >>
> >
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Folks,
I am trying to create/deploy my first pull request, I've gone through all
of these steps successfully here:
https://cwiki.apache.org/confluence/display/REEF/Contributing#Contributing-1.Forkrepository
but I seem to be running into 403 errors when I do a git push origin HEAD,
here are my creds, would really appreciate some help:
JIRA: https://issues.apache.org/jira/browse/REEF-1739
github username: skanjila
Please let me know what I am missing here, note that my id in JIRA is
kanjilal but my github userid is skanjila, might this be a problem?
Thanks in advance.
On Thu, Feb 9, 2017 at 2:56 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> Well interesting piece of metadata, time for successfully completing
> windows server 2016 build was about half the time for linux, at least for
> the java build, will try csharp next
>
> Here's what I did:
> 1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
> 2) mvn clean install -DskipTests=true
>
>
> For posterity's sake I will go back and redo my ubuntu linux build and
> then work on the JIRA-1739 to make sure the documentation is up to date as
> needed. I will install java from the repositories this time.
>
>
>
>
> On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
>
>> Yes I have gone through that in the past, not sure why I decided not to
>> include that repo and just download the jdk and put it in instead :),
>> regardless I will send a pull request for the build cleanup in the next few
>> days, lets iterate on it as a team and test drive it to prove it wrong or
>> right
>>
>> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <ds...@gmail.com>
>> wrote:
>>
>>> After thinking about all of the changes you had make and the fact that
>>> oracle java does not show up in update-alternatives, you may want to look
>>> at these instructions which tell how to install oracle java via apt-get
>>> repository which automatically takes care of a lot of the issues you ran
>>> into
>>> https://www.digitalocean.com/community/tutorials/how-to-inst
>>> all-java-on-ubuntu-with-apt-get
>>> .
>>>
>>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <sx...@gmail.com>
>>> wrote:
>>>
>>> > I think part of the difference is the way both of us installed java, my
>>> > setup is using the oracle java as opposed to the open-jdk java
>>> provided by
>>> > update-alternatives, I agree with your instructions assessment.
>>> >
>>> >
>>> > On another note I have a question, how did folks install protoc on
>>> windows,
>>> > in looking at the wiki it points you to the protoc site where it seems
>>> to
>>> > need a whole bunch of supporting tools (cmake/mingw etc), I am using
>>> > gitbash on windows and was wondering if there's an easy way to
>>> download the
>>> > protoc binaries and set the path, please forgive me if this is in the
>>> > documentation somewhere, still learning my way around.
>>> >
>>> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
>>> > wrote:
>>> >
>>> > > What I mean is that we should provide instructions to setup the least
>>> > > complicated build environment that works, not one that is more
>>> > complicated
>>> > > but also works.
>>> > >
>>> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com>
>>> > > wrote:
>>> > >
>>> > > > Do you have update-alternatives installed? Have you run
>>> > > > update-alternatives --config java?
>>> > > >
>>> > > > Sorry I made a mistake in may last email, I actually have
>>> JAVA_HOME set
>>> > > to
>>> > > > /usr as listed on the webpage which figured out from Sergiy.
>>> However, I
>>> > > do
>>> > > > not need to set the other ones. It is important that our
>>> contributing
>>> > to
>>> > > > REEF wiki be general and not specific to a single setup.
>>> > > >
>>> > > > Here is my environment for building REEF on Ubuntu 16.04.
>>> > > >
>>> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
>>> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
>>> > > > XDG_SESSION_ID=c2
>>> > > > SHELL=/bin/bash
>>> > > > TERM=xterm
>>> > > > WINDOWID=44144243
>>> > > > USER=dougse
>>> > > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
>>> > > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
>>> > > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
>>> > > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
>>> > > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
>>> > > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
>>> > > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
>>> > > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
>>> > > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
>>> > > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
>>> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
>>> > > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
>>> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
>>> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
>>> > > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
>>> > > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
>>> > > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
>>> > > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
>>> > > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
>>> > > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
>>> > > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
>>> > > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
>>> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
>>> > > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
>>> > > > 00;36:*.xspf=00;36:
>>> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
>>> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
>>> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
>>> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
>>> > > > PWD=/code/reef
>>> > > > JAVA_HOME=/usr
>>> > > > LANG=en_US.UTF-8
>>> > > > REEF_HOME=/code/reef
>>> > > > SHLVL=1
>>> > > > HOME=/home/dougse
>>> > > > GTK_OVERLAY_SCROLLING=0
>>> > > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
>>> > > > ae74bbce18102091c11c7bd458939d1c
>>> > > > UID=1000
>>> > > > LESSOPEN=| /bin/lesspipe %s
>>> > > > XDG_RUNTIME_DIR=/run/user/1000
>>> > > > DISPLAY=:10.0
>>> > > > XDG_CURRENT_DESKTOP=MATE
>>> > > > LESSCLOSE=/bin/lesspipe %s %s
>>> > > > COLORTERM=mate-terminal
>>> > > > _=/usr/bin/env
>>> > > >
>>> > > >
>>> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sxk1969@gmail.com
>>> >
>>> > > wrote:
>>> > > >
>>> > > >> Weird, yes I did read that pageand yes I had to do those exact
>>> steps
>>> > > that
>>> > > >> I
>>> > > >> described, I haven't run the tests yet but fully suspect that I'll
>>> > need
>>> > > to
>>> > > >> increase the ulimit to enable that. If you do a plain maven build
>>> > after
>>> > > >> checking out the reef code in ubuntu it complains that JAVA_HOME
>>> is
>>> > not
>>> > > >> set, also its a good idea to set the maven oriented environment
>>> > > variables
>>> > > >> because I highly suspect that in the future we may need to adjust
>>> heap
>>> > > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
>>> > because
>>> > > >> the
>>> > > >> java code is invoking the protoc compiler at some point and in
>>> order
>>> > to
>>> > > do
>>> > > >> so it much load some .so files that live in LD_LIBRARY_PATH. Net
>>> Net
>>> > we
>>> > > >> should definitely figure out the differences between your and
>>> Sergei's
>>> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
>>> > convinced
>>> > > >> that the version matters if the major version is the same.
>>> > > >> Cheers
>>> > > >>
>>> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
>>> dsopsrc@gmail.com>
>>> > > >> wrote:
>>> > > >>
>>> > > >> > Hello Saikat,
>>> > > >> >
>>> > > >> > Did you read the documentation on this page
>>> > > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the
>>> REEF
>>> > > wiki
>>> > > >> > concerning Java on Ubuntu? I added this page after setting up a
>>> > Linux
>>> > > >> 16.04
>>> > > >> > to build REEF and trading emails with Sergiy on the dev list.
>>> Note
>>> > > >> that I
>>> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do
>>> need
>>> > > to
>>> > > >> > change the default for ulimit -n in bash to get the tests to run
>>> > which
>>> > > >> is
>>> > > >> > also described.
>>> > > >> >
>>> > > >> > Doug
>>> > > >> >
>>> > > >> >
>>> > > >> >
>>> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
>>> sxk1969@gmail.com>
>>> > > >> wrote:
>>> > > >> >
>>> > > >> > > A battle well fought and won, got reef to build successfully
>>> on
>>> > > ubuntu
>>> > > >> > > linux vm after hours of hacking, fyi here's what I had to do:
>>> > > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
>>> > version
>>> > > >> 2.5)
>>> > > >> > > 2) added JAVA_HOME and M2_HOME
>>> > > >> > > 3) here's the kicker that's not in the documentation :) (
>>> > > >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md
>>> ),
>>> > had
>>> > > >> to
>>> > > >> > add
>>> > > >> > > LD_LIBRARY_PATH environment variable and have it point to
>>> > > >> /usr/local/lib
>>> > > >> > > where the shared library for protobuf is installed
>>> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
>>> > > >> > documentation
>>> > > >> > > :) )
>>> > > >> > >
>>> > > >> > >
>>> > > >> > > [INFO]
>>> > > >> > > ------------------------------------------------------------
>>> > > >> ------------
>>> > > >> > > [INFO] Reactor Summary:
>>> > > >> > > [INFO]
>>> > > >> > > [INFO] REEF ...............................................
>>> > > SUCCESS [
>>> > > >> > > 4.167 s]
>>> > > >> > > [INFO] REEF Dot Net .......................................
>>> > > SUCCESS [
>>> > > >> > > 1.628 s]
>>> > > >> > > [INFO] REEF Annotations ...................................
>>> > > SUCCESS [
>>> > > >> > > 5.509 s]
>>> > > >> > > [INFO] REEF Utils .........................................
>>> > > SUCCESS [
>>> > > >> > > 5.747 s]
>>> > > >> > > [INFO] REEF Tang Project ..................................
>>> > > SUCCESS [
>>> > > >> > > 0.492 s]
>>> > > >> > > [INFO] Tang Test Jar A ....................................
>>> > > SUCCESS [
>>> > > >> > > 4.276 s]
>>> > > >> > > [INFO] Tang Test Jar B ....................................
>>> > > SUCCESS [
>>> > > >> > > 4.186 s]
>>> > > >> > > [INFO] Tang Test Jar AB ...................................
>>> > > SUCCESS [
>>> > > >> > > 4.376 s]
>>> > > >> > > [INFO] Tang Test Jar B conflict A .........................
>>> > SUCCESS
>>> > > [
>>> > > >> > > 0.440 s]
>>> > > >> > > [INFO] REEF Tang ..........................................
>>> > > SUCCESS [
>>> > > >> > > 24.779 s]
>>> > > >> > > [INFO] REEF Wake Project ..................................
>>> > > SUCCESS [
>>> > > >> > > 0.487 s]
>>> > > >> > > [INFO] REEF Wake ..........................................
>>> > > SUCCESS [
>>> > > >> > > 15.587 s]
>>> > > >> > > [INFO] REEF Common ........................................
>>> > > SUCCESS [
>>> > > >> > > 23.343 s]
>>> > > >> > > [INFO] REEF Runtime Local .................................
>>> > > SUCCESS [
>>> > > >> > > 8.375 s]
>>> > > >> > > [INFO] REEF Applications ..................................
>>> > > SUCCESS [
>>> > > >> > > 0.416 s]
>>> > > >> > > [INFO] REEF Vortex ........................................
>>> > > SUCCESS [
>>> > > >> > > 11.263 s]
>>> > > >> > > [INFO] REEF HTTP Server ...................................
>>> > > SUCCESS [
>>> > > >> > > 9.772 s]
>>> > > >> > > [INFO] REEF Utils for Hadoop ..............................
>>> > SUCCESS
>>> > > [
>>> > > >> > > 5.881 s]
>>> > > >> > > [INFO] REEF Runtime for YARN ..............................
>>> > SUCCESS
>>> > > [
>>> > > >> > > 11.041 s]
>>> > > >> > > [INFO] REEF Runtime for HDInsight .........................
>>> > SUCCESS
>>> > > [
>>> > > >> > > 9.719 s]
>>> > > >> > > [INFO] REEF IO ............................................
>>> > > SUCCESS [
>>> > > >> > > 23.729 s]
>>> > > >> > > [INFO] REEF Checkpoint ....................................
>>> > > SUCCESS [
>>> > > >> > > 5.771 s]
>>> > > >> > > [INFO] REEF Bridge Java ...................................
>>> > > SUCCESS [
>>> > > >> > > 11.981 s]
>>> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
>>> > SUCCESS
>>> > > [
>>> > > >> > > 7.898 s]
>>> > > >> > > [INFO] REEF Bridge (Client) ...............................
>>> > > SUCCESS [
>>> > > >> > > 12.242 s]
>>> > > >> > > [INFO] REEF Runtime Standalone ............................
>>> > SUCCESS
>>> > > [
>>> > > >> > > 7.779 s]
>>> > > >> > > [INFO] REEF Runtime for Mesos .............................
>>> > SUCCESS
>>> > > [
>>> > > >> > > 11.103 s]
>>> > > >> > > [INFO] REEF Poison ........................................
>>> > > SUCCESS [
>>> > > >> > > 5.384 s]
>>> > > >> > > [INFO] REEF Examples ......................................
>>> > > SUCCESS [
>>> > > >> > > 14.313 s]
>>> > > >> > > [INFO] REEF Examples CLR ..................................
>>> > > SUCCESS [
>>> > > >> > > 7.532 s]
>>> > > >> > > [INFO] REEF Examples on HDInsight .........................
>>> > SUCCESS
>>> > > [
>>> > > >> > > 9.213 s]
>>> > > >> > > [INFO] REEF Tang Tint .....................................
>>> > > SUCCESS [
>>> > > >> > > 8.546 s]
>>> > > >> > > [INFO] REEF Tests .........................................
>>> > > SUCCESS [
>>> > > >> > > 15.696 s]
>>> > > >> > > [INFO] REEF Website .......................................
>>> > > SUCCESS [
>>> > > >> > > 1.033 s]
>>> > > >> > > [INFO]
>>> > > >> > > ------------------------------------------------------------
>>> > > >> ------------
>>> > > >> > > [INFO] BUILD SUCCESS
>>> > > >> > > [INFO]
>>> > > >> > > ------------------------------------------------------------
>>> > > >> ------------
>>> > > >> > > [INFO] Total time: 04:54 min
>>> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
>>> > > >> > > [INFO] Final Memory: 125M/1238M
>>> > > >> > > [INFO]
>>> > > >> > > ------------------------------------------------------------
>>> > > >> ------------
>>> > > >> > >
>>> > > >> > >
>>> > > >> > > On to bigger and better things :), we should probably update
>>> the
>>> > > docs
>>> > > >> to
>>> > > >> > > reflect the current build process subtleties. Will try
>>> windows
>>> > > next.
>>> > > >> > >
>>> > > >> > >
>>> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
>>> bgchun@gmail.com
>>> > >
>>> > > >> > wrote:
>>> > > >> > >
>>> > > >> > > > Welcome, Saikat!
>>> > > >> > > >
>>> > > >> > > >
>>> > > >> > > >
>>> > > >> > > >
>>> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
>>> markus@weimo.de>
>>> > > >> wrote:
>>> > > >> > > >
>>> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
>>> > > >> > > > >
>>> > > >> > > > >> I am a newbie to Apache Reef and am interested in
>>> > contributing
>>> > > to
>>> > > >> > the
>>> > > >> > > > reef
>>> > > >> > > > >> dev efforts
>>> > > >> > > > >>
>>> > > >> > > > >
>>> > > >> > > > > Welcome!
>>> > > >> > > > >
>>> > > >> > > > > my JIRA id is kanjilal
>>> > > >> > > > >>
>>> > > >> > > > >
>>> > > >> > > > > I have added you to the contributor's list on JIRA. This
>>> > > basically
>>> > > >> > > means
>>> > > >> > > > > that you can self-assign issues to yourself now :)
>>> > > >> > > > >
>>> > > >> > > > > Markus
>>> > > >> > > > >
>>> > > >> > > >
>>> > > >> > > >
>>> > > >> > > >
>>> > > >> > > > --
>>> > > >> > > > Byung-Gon Chun
>>> > > >> > > >
>>> > > >> > >
>>> > > >> >
>>> > > >>
>>> > > >
>>> > > >
>>> > >
>>> >
>>>
>>
>>
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Well interesting piece of metadata, time for successfully completing
windows server 2016 build was about half the time for linux, at least for
the java build, will try csharp next
Here's what I did:
1) Installed IntelliJ/jdk1.7/protoc 32 bit/maven
2) mvn clean install -DskipTests=true
For posterity's sake I will go back and redo my ubuntu linux build and then
work on the JIRA-1739 to make sure the documentation is up to date as
needed. I will install java from the repositories this time.
On Thu, Feb 9, 2017 at 1:57 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> Yes I have gone through that in the past, not sure why I decided not to
> include that repo and just download the jdk and put it in instead :),
> regardless I will send a pull request for the build cleanup in the next few
> days, lets iterate on it as a team and test drive it to prove it wrong or
> right
>
> On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <ds...@gmail.com> wrote:
>
>> After thinking about all of the changes you had make and the fact that
>> oracle java does not show up in update-alternatives, you may want to look
>> at these instructions which tell how to install oracle java via apt-get
>> repository which automatically takes care of a lot of the issues you ran
>> into
>> https://www.digitalocean.com/community/tutorials/how-to-inst
>> all-java-on-ubuntu-with-apt-get
>> .
>>
>> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <sx...@gmail.com>
>> wrote:
>>
>> > I think part of the difference is the way both of us installed java, my
>> > setup is using the oracle java as opposed to the open-jdk java provided
>> by
>> > update-alternatives, I agree with your instructions assessment.
>> >
>> >
>> > On another note I have a question, how did folks install protoc on
>> windows,
>> > in looking at the wiki it points you to the protoc site where it seems
>> to
>> > need a whole bunch of supporting tools (cmake/mingw etc), I am using
>> > gitbash on windows and was wondering if there's an easy way to download
>> the
>> > protoc binaries and set the path, please forgive me if this is in the
>> > documentation somewhere, still learning my way around.
>> >
>> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
>> > wrote:
>> >
>> > > What I mean is that we should provide instructions to setup the least
>> > > complicated build environment that works, not one that is more
>> > complicated
>> > > but also works.
>> > >
>> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com>
>> > > wrote:
>> > >
>> > > > Do you have update-alternatives installed? Have you run
>> > > > update-alternatives --config java?
>> > > >
>> > > > Sorry I made a mistake in may last email, I actually have JAVA_HOME
>> set
>> > > to
>> > > > /usr as listed on the webpage which figured out from Sergiy.
>> However, I
>> > > do
>> > > > not need to set the other ones. It is important that our
>> contributing
>> > to
>> > > > REEF wiki be general and not specific to a single setup.
>> > > >
>> > > > Here is my environment for building REEF on Ubuntu 16.04.
>> > > >
>> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
>> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
>> > > > XDG_SESSION_ID=c2
>> > > > SHELL=/bin/bash
>> > > > TERM=xterm
>> > > > WINDOWID=44144243
>> > > > USER=dougse
>> > > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
>> > > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
>> > > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
>> > > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
>> > > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
>> > > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
>> > > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
>> > > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
>> > > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
>> > > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
>> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
>> > > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
>> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
>> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
>> > > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
>> > > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
>> > > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
>> > > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
>> > > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
>> > > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
>> > > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
>> > > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
>> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
>> > > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
>> > > > 00;36:*.xspf=00;36:
>> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
>> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
>> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
>> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
>> > > > PWD=/code/reef
>> > > > JAVA_HOME=/usr
>> > > > LANG=en_US.UTF-8
>> > > > REEF_HOME=/code/reef
>> > > > SHLVL=1
>> > > > HOME=/home/dougse
>> > > > GTK_OVERLAY_SCROLLING=0
>> > > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
>> > > > ae74bbce18102091c11c7bd458939d1c
>> > > > UID=1000
>> > > > LESSOPEN=| /bin/lesspipe %s
>> > > > XDG_RUNTIME_DIR=/run/user/1000
>> > > > DISPLAY=:10.0
>> > > > XDG_CURRENT_DESKTOP=MATE
>> > > > LESSCLOSE=/bin/lesspipe %s %s
>> > > > COLORTERM=mate-terminal
>> > > > _=/usr/bin/env
>> > > >
>> > > >
>> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com>
>> > > wrote:
>> > > >
>> > > >> Weird, yes I did read that pageand yes I had to do those exact
>> steps
>> > > that
>> > > >> I
>> > > >> described, I haven't run the tests yet but fully suspect that I'll
>> > need
>> > > to
>> > > >> increase the ulimit to enable that. If you do a plain maven build
>> > after
>> > > >> checking out the reef code in ubuntu it complains that JAVA_HOME is
>> > not
>> > > >> set, also its a good idea to set the maven oriented environment
>> > > variables
>> > > >> because I highly suspect that in the future we may need to adjust
>> heap
>> > > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
>> > because
>> > > >> the
>> > > >> java code is invoking the protoc compiler at some point and in
>> order
>> > to
>> > > do
>> > > >> so it much load some .so files that live in LD_LIBRARY_PATH. Net
>> Net
>> > we
>> > > >> should definitely figure out the differences between your and
>> Sergei's
>> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
>> > convinced
>> > > >> that the version matters if the major version is the same.
>> > > >> Cheers
>> > > >>
>> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
>> dsopsrc@gmail.com>
>> > > >> wrote:
>> > > >>
>> > > >> > Hello Saikat,
>> > > >> >
>> > > >> > Did you read the documentation on this page
>> > > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the
>> REEF
>> > > wiki
>> > > >> > concerning Java on Ubuntu? I added this page after setting up a
>> > Linux
>> > > >> 16.04
>> > > >> > to build REEF and trading emails with Sergiy on the dev list.
>> Note
>> > > >> that I
>> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do
>> need
>> > > to
>> > > >> > change the default for ulimit -n in bash to get the tests to run
>> > which
>> > > >> is
>> > > >> > also described.
>> > > >> >
>> > > >> > Doug
>> > > >> >
>> > > >> >
>> > > >> >
>> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
>> sxk1969@gmail.com>
>> > > >> wrote:
>> > > >> >
>> > > >> > > A battle well fought and won, got reef to build successfully on
>> > > ubuntu
>> > > >> > > linux vm after hours of hacking, fyi here's what I had to do:
>> > > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
>> > version
>> > > >> 2.5)
>> > > >> > > 2) added JAVA_HOME and M2_HOME
>> > > >> > > 3) here's the kicker that's not in the documentation :) (
>> > > >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md
>> ),
>> > had
>> > > >> to
>> > > >> > add
>> > > >> > > LD_LIBRARY_PATH environment variable and have it point to
>> > > >> /usr/local/lib
>> > > >> > > where the shared library for protobuf is installed
>> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
>> > > >> > documentation
>> > > >> > > :) )
>> > > >> > >
>> > > >> > >
>> > > >> > > [INFO]
>> > > >> > > ------------------------------------------------------------
>> > > >> ------------
>> > > >> > > [INFO] Reactor Summary:
>> > > >> > > [INFO]
>> > > >> > > [INFO] REEF ...............................................
>> > > SUCCESS [
>> > > >> > > 4.167 s]
>> > > >> > > [INFO] REEF Dot Net .......................................
>> > > SUCCESS [
>> > > >> > > 1.628 s]
>> > > >> > > [INFO] REEF Annotations ...................................
>> > > SUCCESS [
>> > > >> > > 5.509 s]
>> > > >> > > [INFO] REEF Utils .........................................
>> > > SUCCESS [
>> > > >> > > 5.747 s]
>> > > >> > > [INFO] REEF Tang Project ..................................
>> > > SUCCESS [
>> > > >> > > 0.492 s]
>> > > >> > > [INFO] Tang Test Jar A ....................................
>> > > SUCCESS [
>> > > >> > > 4.276 s]
>> > > >> > > [INFO] Tang Test Jar B ....................................
>> > > SUCCESS [
>> > > >> > > 4.186 s]
>> > > >> > > [INFO] Tang Test Jar AB ...................................
>> > > SUCCESS [
>> > > >> > > 4.376 s]
>> > > >> > > [INFO] Tang Test Jar B conflict A .........................
>> > SUCCESS
>> > > [
>> > > >> > > 0.440 s]
>> > > >> > > [INFO] REEF Tang ..........................................
>> > > SUCCESS [
>> > > >> > > 24.779 s]
>> > > >> > > [INFO] REEF Wake Project ..................................
>> > > SUCCESS [
>> > > >> > > 0.487 s]
>> > > >> > > [INFO] REEF Wake ..........................................
>> > > SUCCESS [
>> > > >> > > 15.587 s]
>> > > >> > > [INFO] REEF Common ........................................
>> > > SUCCESS [
>> > > >> > > 23.343 s]
>> > > >> > > [INFO] REEF Runtime Local .................................
>> > > SUCCESS [
>> > > >> > > 8.375 s]
>> > > >> > > [INFO] REEF Applications ..................................
>> > > SUCCESS [
>> > > >> > > 0.416 s]
>> > > >> > > [INFO] REEF Vortex ........................................
>> > > SUCCESS [
>> > > >> > > 11.263 s]
>> > > >> > > [INFO] REEF HTTP Server ...................................
>> > > SUCCESS [
>> > > >> > > 9.772 s]
>> > > >> > > [INFO] REEF Utils for Hadoop ..............................
>> > SUCCESS
>> > > [
>> > > >> > > 5.881 s]
>> > > >> > > [INFO] REEF Runtime for YARN ..............................
>> > SUCCESS
>> > > [
>> > > >> > > 11.041 s]
>> > > >> > > [INFO] REEF Runtime for HDInsight .........................
>> > SUCCESS
>> > > [
>> > > >> > > 9.719 s]
>> > > >> > > [INFO] REEF IO ............................................
>> > > SUCCESS [
>> > > >> > > 23.729 s]
>> > > >> > > [INFO] REEF Checkpoint ....................................
>> > > SUCCESS [
>> > > >> > > 5.771 s]
>> > > >> > > [INFO] REEF Bridge Java ...................................
>> > > SUCCESS [
>> > > >> > > 11.981 s]
>> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
>> > SUCCESS
>> > > [
>> > > >> > > 7.898 s]
>> > > >> > > [INFO] REEF Bridge (Client) ...............................
>> > > SUCCESS [
>> > > >> > > 12.242 s]
>> > > >> > > [INFO] REEF Runtime Standalone ............................
>> > SUCCESS
>> > > [
>> > > >> > > 7.779 s]
>> > > >> > > [INFO] REEF Runtime for Mesos .............................
>> > SUCCESS
>> > > [
>> > > >> > > 11.103 s]
>> > > >> > > [INFO] REEF Poison ........................................
>> > > SUCCESS [
>> > > >> > > 5.384 s]
>> > > >> > > [INFO] REEF Examples ......................................
>> > > SUCCESS [
>> > > >> > > 14.313 s]
>> > > >> > > [INFO] REEF Examples CLR ..................................
>> > > SUCCESS [
>> > > >> > > 7.532 s]
>> > > >> > > [INFO] REEF Examples on HDInsight .........................
>> > SUCCESS
>> > > [
>> > > >> > > 9.213 s]
>> > > >> > > [INFO] REEF Tang Tint .....................................
>> > > SUCCESS [
>> > > >> > > 8.546 s]
>> > > >> > > [INFO] REEF Tests .........................................
>> > > SUCCESS [
>> > > >> > > 15.696 s]
>> > > >> > > [INFO] REEF Website .......................................
>> > > SUCCESS [
>> > > >> > > 1.033 s]
>> > > >> > > [INFO]
>> > > >> > > ------------------------------------------------------------
>> > > >> ------------
>> > > >> > > [INFO] BUILD SUCCESS
>> > > >> > > [INFO]
>> > > >> > > ------------------------------------------------------------
>> > > >> ------------
>> > > >> > > [INFO] Total time: 04:54 min
>> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
>> > > >> > > [INFO] Final Memory: 125M/1238M
>> > > >> > > [INFO]
>> > > >> > > ------------------------------------------------------------
>> > > >> ------------
>> > > >> > >
>> > > >> > >
>> > > >> > > On to bigger and better things :), we should probably update
>> the
>> > > docs
>> > > >> to
>> > > >> > > reflect the current build process subtleties. Will try windows
>> > > next.
>> > > >> > >
>> > > >> > >
>> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
>> bgchun@gmail.com
>> > >
>> > > >> > wrote:
>> > > >> > >
>> > > >> > > > Welcome, Saikat!
>> > > >> > > >
>> > > >> > > >
>> > > >> > > >
>> > > >> > > >
>> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
>> markus@weimo.de>
>> > > >> wrote:
>> > > >> > > >
>> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
>> > > >> > > > >
>> > > >> > > > >> I am a newbie to Apache Reef and am interested in
>> > contributing
>> > > to
>> > > >> > the
>> > > >> > > > reef
>> > > >> > > > >> dev efforts
>> > > >> > > > >>
>> > > >> > > > >
>> > > >> > > > > Welcome!
>> > > >> > > > >
>> > > >> > > > > my JIRA id is kanjilal
>> > > >> > > > >>
>> > > >> > > > >
>> > > >> > > > > I have added you to the contributor's list on JIRA. This
>> > > basically
>> > > >> > > means
>> > > >> > > > > that you can self-assign issues to yourself now :)
>> > > >> > > > >
>> > > >> > > > > Markus
>> > > >> > > > >
>> > > >> > > >
>> > > >> > > >
>> > > >> > > >
>> > > >> > > > --
>> > > >> > > > Byung-Gon Chun
>> > > >> > > >
>> > > >> > >
>> > > >> >
>> > > >>
>> > > >
>> > > >
>> > >
>> >
>>
>
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Yes I have gone through that in the past, not sure why I decided not to
include that repo and just download the jdk and put it in instead :),
regardless I will send a pull request for the build cleanup in the next few
days, lets iterate on it as a team and test drive it to prove it wrong or
right
On Thu, Feb 9, 2017 at 1:41 PM, Douglas Service <ds...@gmail.com> wrote:
> After thinking about all of the changes you had make and the fact that
> oracle java does not show up in update-alternatives, you may want to look
> at these instructions which tell how to install oracle java via apt-get
> repository which automatically takes care of a lot of the issues you ran
> into
> https://www.digitalocean.com/community/tutorials/how-to-
> install-java-on-ubuntu-with-apt-get
> .
>
> On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
>
> > I think part of the difference is the way both of us installed java, my
> > setup is using the oracle java as opposed to the open-jdk java provided
> by
> > update-alternatives, I agree with your instructions assessment.
> >
> >
> > On another note I have a question, how did folks install protoc on
> windows,
> > in looking at the wiki it points you to the protoc site where it seems to
> > need a whole bunch of supporting tools (cmake/mingw etc), I am using
> > gitbash on windows and was wondering if there's an easy way to download
> the
> > protoc binaries and set the path, please forgive me if this is in the
> > documentation somewhere, still learning my way around.
> >
> > On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
> > wrote:
> >
> > > What I mean is that we should provide instructions to setup the least
> > > complicated build environment that works, not one that is more
> > complicated
> > > but also works.
> > >
> > > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com>
> > > wrote:
> > >
> > > > Do you have update-alternatives installed? Have you run
> > > > update-alternatives --config java?
> > > >
> > > > Sorry I made a mistake in may last email, I actually have JAVA_HOME
> set
> > > to
> > > > /usr as listed on the webpage which figured out from Sergiy.
> However, I
> > > do
> > > > not need to set the other ones. It is important that our contributing
> > to
> > > > REEF wiki be general and not specific to a single setup.
> > > >
> > > > Here is my environment for building REEF on Ubuntu 16.04.
> > > >
> > > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> > > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > > > XDG_SESSION_ID=c2
> > > > SHELL=/bin/bash
> > > > TERM=xterm
> > > > WINDOWID=44144243
> > > > USER=dougse
> > > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> > > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> > > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> > > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> > > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> > > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> > > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> > > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> > > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> > > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> > > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> > > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> > > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> > > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> > > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> > > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> > > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> > > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> > > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> > > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> > > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> > > > 00;36:*.xspf=00;36:
> > > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
> > > > PWD=/code/reef
> > > > JAVA_HOME=/usr
> > > > LANG=en_US.UTF-8
> > > > REEF_HOME=/code/reef
> > > > SHLVL=1
> > > > HOME=/home/dougse
> > > > GTK_OVERLAY_SCROLLING=0
> > > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
> > > > ae74bbce18102091c11c7bd458939d1c
> > > > UID=1000
> > > > LESSOPEN=| /bin/lesspipe %s
> > > > XDG_RUNTIME_DIR=/run/user/1000
> > > > DISPLAY=:10.0
> > > > XDG_CURRENT_DESKTOP=MATE
> > > > LESSCLOSE=/bin/lesspipe %s %s
> > > > COLORTERM=mate-terminal
> > > > _=/usr/bin/env
> > > >
> > > >
> > > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com>
> > > wrote:
> > > >
> > > >> Weird, yes I did read that pageand yes I had to do those exact steps
> > > that
> > > >> I
> > > >> described, I haven't run the tests yet but fully suspect that I'll
> > need
> > > to
> > > >> increase the ulimit to enable that. If you do a plain maven build
> > after
> > > >> checking out the reef code in ubuntu it complains that JAVA_HOME is
> > not
> > > >> set, also its a good idea to set the maven oriented environment
> > > variables
> > > >> because I highly suspect that in the future we may need to adjust
> heap
> > > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
> > because
> > > >> the
> > > >> java code is invoking the protoc compiler at some point and in order
> > to
> > > do
> > > >> so it much load some .so files that live in LD_LIBRARY_PATH. Net
> Net
> > we
> > > >> should definitely figure out the differences between your and
> Sergei's
> > > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
> > convinced
> > > >> that the version matters if the major version is the same.
> > > >> Cheers
> > > >>
> > > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <dsopsrc@gmail.com
> >
> > > >> wrote:
> > > >>
> > > >> > Hello Saikat,
> > > >> >
> > > >> > Did you read the documentation on this page
> > > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the
> REEF
> > > wiki
> > > >> > concerning Java on Ubuntu? I added this page after setting up a
> > Linux
> > > >> 16.04
> > > >> > to build REEF and trading emails with Sergiy on the dev list.
> Note
> > > >> that I
> > > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do
> need
> > > to
> > > >> > change the default for ulimit -n in bash to get the tests to run
> > which
> > > >> is
> > > >> > also described.
> > > >> >
> > > >> > Doug
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> sxk1969@gmail.com>
> > > >> wrote:
> > > >> >
> > > >> > > A battle well fought and won, got reef to build successfully on
> > > ubuntu
> > > >> > > linux vm after hours of hacking, fyi here's what I had to do:
> > > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
> > version
> > > >> 2.5)
> > > >> > > 2) added JAVA_HOME and M2_HOME
> > > >> > > 3) here's the kicker that's not in the documentation :) (
> > > >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md),
> > had
> > > >> to
> > > >> > add
> > > >> > > LD_LIBRARY_PATH environment variable and have it point to
> > > >> /usr/local/lib
> > > >> > > where the shared library for protobuf is installed
> > > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> > > >> > documentation
> > > >> > > :) )
> > > >> > >
> > > >> > >
> > > >> > > [INFO]
> > > >> > > ------------------------------------------------------------
> > > >> ------------
> > > >> > > [INFO] Reactor Summary:
> > > >> > > [INFO]
> > > >> > > [INFO] REEF ...............................................
> > > SUCCESS [
> > > >> > > 4.167 s]
> > > >> > > [INFO] REEF Dot Net .......................................
> > > SUCCESS [
> > > >> > > 1.628 s]
> > > >> > > [INFO] REEF Annotations ...................................
> > > SUCCESS [
> > > >> > > 5.509 s]
> > > >> > > [INFO] REEF Utils .........................................
> > > SUCCESS [
> > > >> > > 5.747 s]
> > > >> > > [INFO] REEF Tang Project ..................................
> > > SUCCESS [
> > > >> > > 0.492 s]
> > > >> > > [INFO] Tang Test Jar A ....................................
> > > SUCCESS [
> > > >> > > 4.276 s]
> > > >> > > [INFO] Tang Test Jar B ....................................
> > > SUCCESS [
> > > >> > > 4.186 s]
> > > >> > > [INFO] Tang Test Jar AB ...................................
> > > SUCCESS [
> > > >> > > 4.376 s]
> > > >> > > [INFO] Tang Test Jar B conflict A .........................
> > SUCCESS
> > > [
> > > >> > > 0.440 s]
> > > >> > > [INFO] REEF Tang ..........................................
> > > SUCCESS [
> > > >> > > 24.779 s]
> > > >> > > [INFO] REEF Wake Project ..................................
> > > SUCCESS [
> > > >> > > 0.487 s]
> > > >> > > [INFO] REEF Wake ..........................................
> > > SUCCESS [
> > > >> > > 15.587 s]
> > > >> > > [INFO] REEF Common ........................................
> > > SUCCESS [
> > > >> > > 23.343 s]
> > > >> > > [INFO] REEF Runtime Local .................................
> > > SUCCESS [
> > > >> > > 8.375 s]
> > > >> > > [INFO] REEF Applications ..................................
> > > SUCCESS [
> > > >> > > 0.416 s]
> > > >> > > [INFO] REEF Vortex ........................................
> > > SUCCESS [
> > > >> > > 11.263 s]
> > > >> > > [INFO] REEF HTTP Server ...................................
> > > SUCCESS [
> > > >> > > 9.772 s]
> > > >> > > [INFO] REEF Utils for Hadoop ..............................
> > SUCCESS
> > > [
> > > >> > > 5.881 s]
> > > >> > > [INFO] REEF Runtime for YARN ..............................
> > SUCCESS
> > > [
> > > >> > > 11.041 s]
> > > >> > > [INFO] REEF Runtime for HDInsight .........................
> > SUCCESS
> > > [
> > > >> > > 9.719 s]
> > > >> > > [INFO] REEF IO ............................................
> > > SUCCESS [
> > > >> > > 23.729 s]
> > > >> > > [INFO] REEF Checkpoint ....................................
> > > SUCCESS [
> > > >> > > 5.771 s]
> > > >> > > [INFO] REEF Bridge Java ...................................
> > > SUCCESS [
> > > >> > > 11.981 s]
> > > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
> > SUCCESS
> > > [
> > > >> > > 7.898 s]
> > > >> > > [INFO] REEF Bridge (Client) ...............................
> > > SUCCESS [
> > > >> > > 12.242 s]
> > > >> > > [INFO] REEF Runtime Standalone ............................
> > SUCCESS
> > > [
> > > >> > > 7.779 s]
> > > >> > > [INFO] REEF Runtime for Mesos .............................
> > SUCCESS
> > > [
> > > >> > > 11.103 s]
> > > >> > > [INFO] REEF Poison ........................................
> > > SUCCESS [
> > > >> > > 5.384 s]
> > > >> > > [INFO] REEF Examples ......................................
> > > SUCCESS [
> > > >> > > 14.313 s]
> > > >> > > [INFO] REEF Examples CLR ..................................
> > > SUCCESS [
> > > >> > > 7.532 s]
> > > >> > > [INFO] REEF Examples on HDInsight .........................
> > SUCCESS
> > > [
> > > >> > > 9.213 s]
> > > >> > > [INFO] REEF Tang Tint .....................................
> > > SUCCESS [
> > > >> > > 8.546 s]
> > > >> > > [INFO] REEF Tests .........................................
> > > SUCCESS [
> > > >> > > 15.696 s]
> > > >> > > [INFO] REEF Website .......................................
> > > SUCCESS [
> > > >> > > 1.033 s]
> > > >> > > [INFO]
> > > >> > > ------------------------------------------------------------
> > > >> ------------
> > > >> > > [INFO] BUILD SUCCESS
> > > >> > > [INFO]
> > > >> > > ------------------------------------------------------------
> > > >> ------------
> > > >> > > [INFO] Total time: 04:54 min
> > > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > > >> > > [INFO] Final Memory: 125M/1238M
> > > >> > > [INFO]
> > > >> > > ------------------------------------------------------------
> > > >> ------------
> > > >> > >
> > > >> > >
> > > >> > > On to bigger and better things :), we should probably update the
> > > docs
> > > >> to
> > > >> > > reflect the current build process subtleties. Will try windows
> > > next.
> > > >> > >
> > > >> > >
> > > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> bgchun@gmail.com
> > >
> > > >> > wrote:
> > > >> > >
> > > >> > > > Welcome, Saikat!
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> markus@weimo.de>
> > > >> wrote:
> > > >> > > >
> > > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > > >> > > > >
> > > >> > > > >> I am a newbie to Apache Reef and am interested in
> > contributing
> > > to
> > > >> > the
> > > >> > > > reef
> > > >> > > > >> dev efforts
> > > >> > > > >>
> > > >> > > > >
> > > >> > > > > Welcome!
> > > >> > > > >
> > > >> > > > > my JIRA id is kanjilal
> > > >> > > > >>
> > > >> > > > >
> > > >> > > > > I have added you to the contributor's list on JIRA. This
> > > basically
> > > >> > > means
> > > >> > > > > that you can self-assign issues to yourself now :)
> > > >> > > > >
> > > >> > > > > Markus
> > > >> > > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > --
> > > >> > > > Byung-Gon Chun
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
After thinking about all of the changes you had make and the fact that
oracle java does not show up in update-alternatives, you may want to look
at these instructions which tell how to install oracle java via apt-get
repository which automatically takes care of a lot of the issues you ran
into
https://www.digitalocean.com/community/tutorials/how-to-install-java-on-ubuntu-with-apt-get
.
On Thu, Feb 9, 2017 at 12:52 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> I think part of the difference is the way both of us installed java, my
> setup is using the oracle java as opposed to the open-jdk java provided by
> update-alternatives, I agree with your instructions assessment.
>
>
> On another note I have a question, how did folks install protoc on windows,
> in looking at the wiki it points you to the protoc site where it seems to
> need a whole bunch of supporting tools (cmake/mingw etc), I am using
> gitbash on windows and was wondering if there's an easy way to download the
> protoc binaries and set the path, please forgive me if this is in the
> documentation somewhere, still learning my way around.
>
> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
> wrote:
>
> > What I mean is that we should provide instructions to setup the least
> > complicated build environment that works, not one that is more
> complicated
> > but also works.
> >
> > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com>
> > wrote:
> >
> > > Do you have update-alternatives installed? Have you run
> > > update-alternatives --config java?
> > >
> > > Sorry I made a mistake in may last email, I actually have JAVA_HOME set
> > to
> > > /usr as listed on the webpage which figured out from Sergiy. However, I
> > do
> > > not need to set the other ones. It is important that our contributing
> to
> > > REEF wiki be general and not specific to a single setup.
> > >
> > > Here is my environment for building REEF on Ubuntu 16.04.
> > >
> > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > > XDG_SESSION_ID=c2
> > > SHELL=/bin/bash
> > > TERM=xterm
> > > WINDOWID=44144243
> > > USER=dougse
> > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> > > 00;36:*.xspf=00;36:
> > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
> > > PWD=/code/reef
> > > JAVA_HOME=/usr
> > > LANG=en_US.UTF-8
> > > REEF_HOME=/code/reef
> > > SHLVL=1
> > > HOME=/home/dougse
> > > GTK_OVERLAY_SCROLLING=0
> > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
> > > ae74bbce18102091c11c7bd458939d1c
> > > UID=1000
> > > LESSOPEN=| /bin/lesspipe %s
> > > XDG_RUNTIME_DIR=/run/user/1000
> > > DISPLAY=:10.0
> > > XDG_CURRENT_DESKTOP=MATE
> > > LESSCLOSE=/bin/lesspipe %s %s
> > > COLORTERM=mate-terminal
> > > _=/usr/bin/env
> > >
> > >
> > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com>
> > wrote:
> > >
> > >> Weird, yes I did read that pageand yes I had to do those exact steps
> > that
> > >> I
> > >> described, I haven't run the tests yet but fully suspect that I'll
> need
> > to
> > >> increase the ulimit to enable that. If you do a plain maven build
> after
> > >> checking out the reef code in ubuntu it complains that JAVA_HOME is
> not
> > >> set, also its a good idea to set the maven oriented environment
> > variables
> > >> because I highly suspect that in the future we may need to adjust heap
> > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
> because
> > >> the
> > >> java code is invoking the protoc compiler at some point and in order
> to
> > do
> > >> so it much load some .so files that live in LD_LIBRARY_PATH. Net Net
> we
> > >> should definitely figure out the differences between your and Sergei's
> > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
> convinced
> > >> that the version matters if the major version is the same.
> > >> Cheers
> > >>
> > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <ds...@gmail.com>
> > >> wrote:
> > >>
> > >> > Hello Saikat,
> > >> >
> > >> > Did you read the documentation on this page
> > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF
> > wiki
> > >> > concerning Java on Ubuntu? I added this page after setting up a
> Linux
> > >> 16.04
> > >> > to build REEF and trading emails with Sergiy on the dev list. Note
> > >> that I
> > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need
> > to
> > >> > change the default for ulimit -n in bash to get the tests to run
> which
> > >> is
> > >> > also described.
> > >> >
> > >> > Doug
> > >> >
> > >> >
> > >> >
> > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com>
> > >> wrote:
> > >> >
> > >> > > A battle well fought and won, got reef to build successfully on
> > ubuntu
> > >> > > linux vm after hours of hacking, fyi here's what I had to do:
> > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
> version
> > >> 2.5)
> > >> > > 2) added JAVA_HOME and M2_HOME
> > >> > > 3) here's the kicker that's not in the documentation :) (
> > >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md),
> had
> > >> to
> > >> > add
> > >> > > LD_LIBRARY_PATH environment variable and have it point to
> > >> /usr/local/lib
> > >> > > where the shared library for protobuf is installed
> > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> > >> > documentation
> > >> > > :) )
> > >> > >
> > >> > >
> > >> > > [INFO]
> > >> > > ------------------------------------------------------------
> > >> ------------
> > >> > > [INFO] Reactor Summary:
> > >> > > [INFO]
> > >> > > [INFO] REEF ...............................................
> > SUCCESS [
> > >> > > 4.167 s]
> > >> > > [INFO] REEF Dot Net .......................................
> > SUCCESS [
> > >> > > 1.628 s]
> > >> > > [INFO] REEF Annotations ...................................
> > SUCCESS [
> > >> > > 5.509 s]
> > >> > > [INFO] REEF Utils .........................................
> > SUCCESS [
> > >> > > 5.747 s]
> > >> > > [INFO] REEF Tang Project ..................................
> > SUCCESS [
> > >> > > 0.492 s]
> > >> > > [INFO] Tang Test Jar A ....................................
> > SUCCESS [
> > >> > > 4.276 s]
> > >> > > [INFO] Tang Test Jar B ....................................
> > SUCCESS [
> > >> > > 4.186 s]
> > >> > > [INFO] Tang Test Jar AB ...................................
> > SUCCESS [
> > >> > > 4.376 s]
> > >> > > [INFO] Tang Test Jar B conflict A .........................
> SUCCESS
> > [
> > >> > > 0.440 s]
> > >> > > [INFO] REEF Tang ..........................................
> > SUCCESS [
> > >> > > 24.779 s]
> > >> > > [INFO] REEF Wake Project ..................................
> > SUCCESS [
> > >> > > 0.487 s]
> > >> > > [INFO] REEF Wake ..........................................
> > SUCCESS [
> > >> > > 15.587 s]
> > >> > > [INFO] REEF Common ........................................
> > SUCCESS [
> > >> > > 23.343 s]
> > >> > > [INFO] REEF Runtime Local .................................
> > SUCCESS [
> > >> > > 8.375 s]
> > >> > > [INFO] REEF Applications ..................................
> > SUCCESS [
> > >> > > 0.416 s]
> > >> > > [INFO] REEF Vortex ........................................
> > SUCCESS [
> > >> > > 11.263 s]
> > >> > > [INFO] REEF HTTP Server ...................................
> > SUCCESS [
> > >> > > 9.772 s]
> > >> > > [INFO] REEF Utils for Hadoop ..............................
> SUCCESS
> > [
> > >> > > 5.881 s]
> > >> > > [INFO] REEF Runtime for YARN ..............................
> SUCCESS
> > [
> > >> > > 11.041 s]
> > >> > > [INFO] REEF Runtime for HDInsight .........................
> SUCCESS
> > [
> > >> > > 9.719 s]
> > >> > > [INFO] REEF IO ............................................
> > SUCCESS [
> > >> > > 23.729 s]
> > >> > > [INFO] REEF Checkpoint ....................................
> > SUCCESS [
> > >> > > 5.771 s]
> > >> > > [INFO] REEF Bridge Java ...................................
> > SUCCESS [
> > >> > > 11.981 s]
> > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
> SUCCESS
> > [
> > >> > > 7.898 s]
> > >> > > [INFO] REEF Bridge (Client) ...............................
> > SUCCESS [
> > >> > > 12.242 s]
> > >> > > [INFO] REEF Runtime Standalone ............................
> SUCCESS
> > [
> > >> > > 7.779 s]
> > >> > > [INFO] REEF Runtime for Mesos .............................
> SUCCESS
> > [
> > >> > > 11.103 s]
> > >> > > [INFO] REEF Poison ........................................
> > SUCCESS [
> > >> > > 5.384 s]
> > >> > > [INFO] REEF Examples ......................................
> > SUCCESS [
> > >> > > 14.313 s]
> > >> > > [INFO] REEF Examples CLR ..................................
> > SUCCESS [
> > >> > > 7.532 s]
> > >> > > [INFO] REEF Examples on HDInsight .........................
> SUCCESS
> > [
> > >> > > 9.213 s]
> > >> > > [INFO] REEF Tang Tint .....................................
> > SUCCESS [
> > >> > > 8.546 s]
> > >> > > [INFO] REEF Tests .........................................
> > SUCCESS [
> > >> > > 15.696 s]
> > >> > > [INFO] REEF Website .......................................
> > SUCCESS [
> > >> > > 1.033 s]
> > >> > > [INFO]
> > >> > > ------------------------------------------------------------
> > >> ------------
> > >> > > [INFO] BUILD SUCCESS
> > >> > > [INFO]
> > >> > > ------------------------------------------------------------
> > >> ------------
> > >> > > [INFO] Total time: 04:54 min
> > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > >> > > [INFO] Final Memory: 125M/1238M
> > >> > > [INFO]
> > >> > > ------------------------------------------------------------
> > >> ------------
> > >> > >
> > >> > >
> > >> > > On to bigger and better things :), we should probably update the
> > docs
> > >> to
> > >> > > reflect the current build process subtleties. Will try windows
> > next.
> > >> > >
> > >> > >
> > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bgchun@gmail.com
> >
> > >> > wrote:
> > >> > >
> > >> > > > Welcome, Saikat!
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de>
> > >> wrote:
> > >> > > >
> > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > >> > > > >
> > >> > > > >> I am a newbie to Apache Reef and am interested in
> contributing
> > to
> > >> > the
> > >> > > > reef
> > >> > > > >> dev efforts
> > >> > > > >>
> > >> > > > >
> > >> > > > > Welcome!
> > >> > > > >
> > >> > > > > my JIRA id is kanjilal
> > >> > > > >>
> > >> > > > >
> > >> > > > > I have added you to the contributor's list on JIRA. This
> > basically
> > >> > > means
> > >> > > > > that you can self-assign issues to yourself now :)
> > >> > > > >
> > >> > > > > Markus
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > --
> > >> > > > Byung-Gon Chun
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Markus Weimer <ma...@weimo.de>.
> I am actually using 64 bit version of windows server, I tried the other protoc
but it has source code in it, are most people using 32 bit windows vm's or
64 bit vm's?
64Bit windows can run 32Bit binaries. Many well-used apps are still 32Bit
(ahem, Visual Studio, ahem).
Markus
On Thu, Feb 9, 2017 at 1:17 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> I am actually using 64 bit version of windows server, I tried the other
> protoc but it has source code in it, are most people using 32 bit windows
> vm's or 64 bit vm's?
>
> On Thu, Feb 9, 2017 at 1:12 PM, Douglas Service <ds...@gmail.com> wrote:
>
> > You can download this zip file from GitHub
> > https://github.com/google/protobuf/releases/download/v2.
> > 5.0/protoc-2.5.0-win32.zip
> > and extract the protoc.exe into a directory in your windows path.
> >
> > Doug
> >
> > On Thu, Feb 9, 2017 at 1:02 PM, Douglas Service <ds...@gmail.com>
> wrote:
> >
> > > No I am actually running two versions of the Oracle java using
> > > update-alternatives and do not have the open-jdk installed as I apt-get
> > > purged it. Take the time to understand all of the configuration issues
> on
> > > Linux as you update the documentation. I learned about this the hard
> way
> > > and ended up changing the wiki many times as figured out how to
> simplify
> > my
> > > build setup and realized my initial understanding of the environment
> was
> > > not very clear.
> > >
> > > Doug
> > >
> > > On Thu, Feb 9, 2017 at 8:52 PM, Saikat Kanjilal <sx...@gmail.com>
> > wrote:
> > >
> > >> I think part of the difference is the way both of us installed java,
> my
> > >> setup is using the oracle java as opposed to the open-jdk java
> provided
> > by
> > >> update-alternatives, I agree with your instructions assessment.
> > >>
> > >>
> > >> On another note I have a question, how did folks install protoc on
> > >> windows,
> > >> in looking at the wiki it points you to the protoc site where it seems
> > to
> > >> need a whole bunch of supporting tools (cmake/mingw etc), I am using
> > >> gitbash on windows and was wondering if there's an easy way to
> download
> > >> the
> > >> protoc binaries and set the path, please forgive me if this is in the
> > >> documentation somewhere, still learning my way around.
> > >>
> > >> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
> > >> wrote:
> > >>
> > >> > What I mean is that we should provide instructions to setup the
> least
> > >> > complicated build environment that works, not one that is more
> > >> complicated
> > >> > but also works.
> > >> >
> > >> > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <dsopsrc@gmail.com
> >
> > >> > wrote:
> > >> >
> > >> > > Do you have update-alternatives installed? Have you run
> > >> > > update-alternatives --config java?
> > >> > >
> > >> > > Sorry I made a mistake in may last email, I actually have
> JAVA_HOME
> > >> set
> > >> > to
> > >> > > /usr as listed on the webpage which figured out from Sergiy.
> > However,
> > >> I
> > >> > do
> > >> > > not need to set the other ones. It is important that our
> > contributing
> > >> to
> > >> > > REEF wiki be general and not specific to a single setup.
> > >> > >
> > >> > > Here is my environment for building REEF on Ubuntu 16.04.
> > >> > >
> > >> > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> > >> > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > >> > > XDG_SESSION_ID=c2
> > >> > > SHELL=/bin/bash
> > >> > > TERM=xterm
> > >> > > WINDOWID=44144243
> > >> > > USER=dougse
> > >> > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> > >> > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> > >> > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> > >> > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> > >> > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> > >> > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> > >> > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> > >> > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> > >> > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> > >> > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> > >> > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > >> > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> > >> > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> > >> > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > >> > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> > >> > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> > >> > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> > >> > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> > >> > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> > >> > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> > >> > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> > >> > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> > >> > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > >> > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> > >> > > 00;36:*.xspf=00;36:
> > >> > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > >> > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > >> > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > >> > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
> > >> > > PWD=/code/reef
> > >> > > JAVA_HOME=/usr
> > >> > > LANG=en_US.UTF-8
> > >> > > REEF_HOME=/code/reef
> > >> > > SHLVL=1
> > >> > > HOME=/home/dougse
> > >> > > GTK_OVERLAY_SCROLLING=0
> > >> > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
> > >> > > ae74bbce18102091c11c7bd458939d1c
> > >> > > UID=1000
> > >> > > LESSOPEN=| /bin/lesspipe %s
> > >> > > XDG_RUNTIME_DIR=/run/user/1000
> > >> > > DISPLAY=:10.0
> > >> > > XDG_CURRENT_DESKTOP=MATE
> > >> > > LESSCLOSE=/bin/lesspipe %s %s
> > >> > > COLORTERM=mate-terminal
> > >> > > _=/usr/bin/env
> > >> > >
> > >> > >
> > >> > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <
> sxk1969@gmail.com>
> > >> > wrote:
> > >> > >
> > >> > >> Weird, yes I did read that pageand yes I had to do those exact
> > steps
> > >> > that
> > >> > >> I
> > >> > >> described, I haven't run the tests yet but fully suspect that
> I'll
> > >> need
> > >> > to
> > >> > >> increase the ulimit to enable that. If you do a plain maven
> build
> > >> after
> > >> > >> checking out the reef code in ubuntu it complains that JAVA_HOME
> is
> > >> not
> > >> > >> set, also its a good idea to set the maven oriented environment
> > >> > variables
> > >> > >> because I highly suspect that in the future we may need to adjust
> > >> heap
> > >> > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
> > >> because
> > >> > >> the
> > >> > >> java code is invoking the protoc compiler at some point and in
> > order
> > >> to
> > >> > do
> > >> > >> so it much load some .so files that live in LD_LIBRARY_PATH. Net
> > >> Net we
> > >> > >> should definitely figure out the differences between your and
> > >> Sergei's
> > >> > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
> > >> convinced
> > >> > >> that the version matters if the major version is the same.
> > >> > >> Cheers
> > >> > >>
> > >> > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> > dsopsrc@gmail.com>
> > >> > >> wrote:
> > >> > >>
> > >> > >> > Hello Saikat,
> > >> > >> >
> > >> > >> > Did you read the documentation on this page
> > >> > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the
> > REEF
> > >> > wiki
> > >> > >> > concerning Java on Ubuntu? I added this page after setting up a
> > >> Linux
> > >> > >> 16.04
> > >> > >> > to build REEF and trading emails with Sergiy on the dev list.
> > Note
> > >> > >> that I
> > >> > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do
> > >> need
> > >> > to
> > >> > >> > change the default for ulimit -n in bash to get the tests to
> run
> > >> which
> > >> > >> is
> > >> > >> > also described.
> > >> > >> >
> > >> > >> > Doug
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> > sxk1969@gmail.com
> > >> >
> > >> > >> wrote:
> > >> > >> >
> > >> > >> > > A battle well fought and won, got reef to build successfully
> on
> > >> > ubuntu
> > >> > >> > > linux vm after hours of hacking, fyi here's what I had to do:
> > >> > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
> > >> version
> > >> > >> 2.5)
> > >> > >> > > 2) added JAVA_HOME and M2_HOME
> > >> > >> > > 3) here's the kicker that's not in the documentation :) (
> > >> > >> > > https://github.com/apache/reef/blob/master/lang/java/
> BUILD.md
> > ),
> > >> had
> > >> > >> to
> > >> > >> > add
> > >> > >> > > LD_LIBRARY_PATH environment variable and have it point to
> > >> > >> /usr/local/lib
> > >> > >> > > where the shared library for protobuf is installed
> > >> > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> > >> > >> > documentation
> > >> > >> > > :) )
> > >> > >> > >
> > >> > >> > >
> > >> > >> > > [INFO]
> > >> > >> > > ------------------------------------------------------------
> > >> > >> ------------
> > >> > >> > > [INFO] Reactor Summary:
> > >> > >> > > [INFO]
> > >> > >> > > [INFO] REEF ...............................................
> > >> > SUCCESS [
> > >> > >> > > 4.167 s]
> > >> > >> > > [INFO] REEF Dot Net .......................................
> > >> > SUCCESS [
> > >> > >> > > 1.628 s]
> > >> > >> > > [INFO] REEF Annotations ...................................
> > >> > SUCCESS [
> > >> > >> > > 5.509 s]
> > >> > >> > > [INFO] REEF Utils .........................................
> > >> > SUCCESS [
> > >> > >> > > 5.747 s]
> > >> > >> > > [INFO] REEF Tang Project ..................................
> > >> > SUCCESS [
> > >> > >> > > 0.492 s]
> > >> > >> > > [INFO] Tang Test Jar A ....................................
> > >> > SUCCESS [
> > >> > >> > > 4.276 s]
> > >> > >> > > [INFO] Tang Test Jar B ....................................
> > >> > SUCCESS [
> > >> > >> > > 4.186 s]
> > >> > >> > > [INFO] Tang Test Jar AB ...................................
> > >> > SUCCESS [
> > >> > >> > > 4.376 s]
> > >> > >> > > [INFO] Tang Test Jar B conflict A .........................
> > >> SUCCESS
> > >> > [
> > >> > >> > > 0.440 s]
> > >> > >> > > [INFO] REEF Tang ..........................................
> > >> > SUCCESS [
> > >> > >> > > 24.779 s]
> > >> > >> > > [INFO] REEF Wake Project ..................................
> > >> > SUCCESS [
> > >> > >> > > 0.487 s]
> > >> > >> > > [INFO] REEF Wake ..........................................
> > >> > SUCCESS [
> > >> > >> > > 15.587 s]
> > >> > >> > > [INFO] REEF Common ........................................
> > >> > SUCCESS [
> > >> > >> > > 23.343 s]
> > >> > >> > > [INFO] REEF Runtime Local .................................
> > >> > SUCCESS [
> > >> > >> > > 8.375 s]
> > >> > >> > > [INFO] REEF Applications ..................................
> > >> > SUCCESS [
> > >> > >> > > 0.416 s]
> > >> > >> > > [INFO] REEF Vortex ........................................
> > >> > SUCCESS [
> > >> > >> > > 11.263 s]
> > >> > >> > > [INFO] REEF HTTP Server ...................................
> > >> > SUCCESS [
> > >> > >> > > 9.772 s]
> > >> > >> > > [INFO] REEF Utils for Hadoop ..............................
> > >> SUCCESS
> > >> > [
> > >> > >> > > 5.881 s]
> > >> > >> > > [INFO] REEF Runtime for YARN ..............................
> > >> SUCCESS
> > >> > [
> > >> > >> > > 11.041 s]
> > >> > >> > > [INFO] REEF Runtime for HDInsight .........................
> > >> SUCCESS
> > >> > [
> > >> > >> > > 9.719 s]
> > >> > >> > > [INFO] REEF IO ............................................
> > >> > SUCCESS [
> > >> > >> > > 23.729 s]
> > >> > >> > > [INFO] REEF Checkpoint ....................................
> > >> > SUCCESS [
> > >> > >> > > 5.771 s]
> > >> > >> > > [INFO] REEF Bridge Java ...................................
> > >> > SUCCESS [
> > >> > >> > > 11.981 s]
> > >> > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
> > >> SUCCESS
> > >> > [
> > >> > >> > > 7.898 s]
> > >> > >> > > [INFO] REEF Bridge (Client) ...............................
> > >> > SUCCESS [
> > >> > >> > > 12.242 s]
> > >> > >> > > [INFO] REEF Runtime Standalone ............................
> > >> SUCCESS
> > >> > [
> > >> > >> > > 7.779 s]
> > >> > >> > > [INFO] REEF Runtime for Mesos .............................
> > >> SUCCESS
> > >> > [
> > >> > >> > > 11.103 s]
> > >> > >> > > [INFO] REEF Poison ........................................
> > >> > SUCCESS [
> > >> > >> > > 5.384 s]
> > >> > >> > > [INFO] REEF Examples ......................................
> > >> > SUCCESS [
> > >> > >> > > 14.313 s]
> > >> > >> > > [INFO] REEF Examples CLR ..................................
> > >> > SUCCESS [
> > >> > >> > > 7.532 s]
> > >> > >> > > [INFO] REEF Examples on HDInsight .........................
> > >> SUCCESS
> > >> > [
> > >> > >> > > 9.213 s]
> > >> > >> > > [INFO] REEF Tang Tint .....................................
> > >> > SUCCESS [
> > >> > >> > > 8.546 s]
> > >> > >> > > [INFO] REEF Tests .........................................
> > >> > SUCCESS [
> > >> > >> > > 15.696 s]
> > >> > >> > > [INFO] REEF Website .......................................
> > >> > SUCCESS [
> > >> > >> > > 1.033 s]
> > >> > >> > > [INFO]
> > >> > >> > > ------------------------------------------------------------
> > >> > >> ------------
> > >> > >> > > [INFO] BUILD SUCCESS
> > >> > >> > > [INFO]
> > >> > >> > > ------------------------------------------------------------
> > >> > >> ------------
> > >> > >> > > [INFO] Total time: 04:54 min
> > >> > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > >> > >> > > [INFO] Final Memory: 125M/1238M
> > >> > >> > > [INFO]
> > >> > >> > > ------------------------------------------------------------
> > >> > >> ------------
> > >> > >> > >
> > >> > >> > >
> > >> > >> > > On to bigger and better things :), we should probably update
> > the
> > >> > docs
> > >> > >> to
> > >> > >> > > reflect the current build process subtleties. Will try
> windows
> > >> > next.
> > >> > >> > >
> > >> > >> > >
> > >> > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> > >> bgchun@gmail.com>
> > >> > >> > wrote:
> > >> > >> > >
> > >> > >> > > > Welcome, Saikat!
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> > markus@weimo.de
> > >> >
> > >> > >> wrote:
> > >> > >> > > >
> > >> > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > >> > >> > > > >
> > >> > >> > > > >> I am a newbie to Apache Reef and am interested in
> > >> contributing
> > >> > to
> > >> > >> > the
> > >> > >> > > > reef
> > >> > >> > > > >> dev efforts
> > >> > >> > > > >>
> > >> > >> > > > >
> > >> > >> > > > > Welcome!
> > >> > >> > > > >
> > >> > >> > > > > my JIRA id is kanjilal
> > >> > >> > > > >>
> > >> > >> > > > >
> > >> > >> > > > > I have added you to the contributor's list on JIRA. This
> > >> > basically
> > >> > >> > > means
> > >> > >> > > > > that you can self-assign issues to yourself now :)
> > >> > >> > > > >
> > >> > >> > > > > Markus
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > > --
> > >> > >> > > > Byung-Gon Chun
> > >> > >> > > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
I am actually using 64 bit version of windows server, I tried the other
protoc but it has source code in it, are most people using 32 bit windows
vm's or 64 bit vm's?
On Thu, Feb 9, 2017 at 1:12 PM, Douglas Service <ds...@gmail.com> wrote:
> You can download this zip file from GitHub
> https://github.com/google/protobuf/releases/download/v2.
> 5.0/protoc-2.5.0-win32.zip
> and extract the protoc.exe into a directory in your windows path.
>
> Doug
>
> On Thu, Feb 9, 2017 at 1:02 PM, Douglas Service <ds...@gmail.com> wrote:
>
> > No I am actually running two versions of the Oracle java using
> > update-alternatives and do not have the open-jdk installed as I apt-get
> > purged it. Take the time to understand all of the configuration issues on
> > Linux as you update the documentation. I learned about this the hard way
> > and ended up changing the wiki many times as figured out how to simplify
> my
> > build setup and realized my initial understanding of the environment was
> > not very clear.
> >
> > Doug
> >
> > On Thu, Feb 9, 2017 at 8:52 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
> >
> >> I think part of the difference is the way both of us installed java, my
> >> setup is using the oracle java as opposed to the open-jdk java provided
> by
> >> update-alternatives, I agree with your instructions assessment.
> >>
> >>
> >> On another note I have a question, how did folks install protoc on
> >> windows,
> >> in looking at the wiki it points you to the protoc site where it seems
> to
> >> need a whole bunch of supporting tools (cmake/mingw etc), I am using
> >> gitbash on windows and was wondering if there's an easy way to download
> >> the
> >> protoc binaries and set the path, please forgive me if this is in the
> >> documentation somewhere, still learning my way around.
> >>
> >> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
> >> wrote:
> >>
> >> > What I mean is that we should provide instructions to setup the least
> >> > complicated build environment that works, not one that is more
> >> complicated
> >> > but also works.
> >> >
> >> > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com>
> >> > wrote:
> >> >
> >> > > Do you have update-alternatives installed? Have you run
> >> > > update-alternatives --config java?
> >> > >
> >> > > Sorry I made a mistake in may last email, I actually have JAVA_HOME
> >> set
> >> > to
> >> > > /usr as listed on the webpage which figured out from Sergiy.
> However,
> >> I
> >> > do
> >> > > not need to set the other ones. It is important that our
> contributing
> >> to
> >> > > REEF wiki be general and not specific to a single setup.
> >> > >
> >> > > Here is my environment for building REEF on Ubuntu 16.04.
> >> > >
> >> > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> >> > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> >> > > XDG_SESSION_ID=c2
> >> > > SHELL=/bin/bash
> >> > > TERM=xterm
> >> > > WINDOWID=44144243
> >> > > USER=dougse
> >> > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> >> > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> >> > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> >> > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> >> > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> >> > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> >> > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> >> > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> >> > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> >> > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> >> > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> >> > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> >> > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> >> > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> >> > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> >> > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> >> > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> >> > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> >> > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> >> > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> >> > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> >> > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> >> > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> >> > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> >> > > 00;36:*.xspf=00;36:
> >> > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> >> > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> >> > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> >> > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
> >> > > PWD=/code/reef
> >> > > JAVA_HOME=/usr
> >> > > LANG=en_US.UTF-8
> >> > > REEF_HOME=/code/reef
> >> > > SHLVL=1
> >> > > HOME=/home/dougse
> >> > > GTK_OVERLAY_SCROLLING=0
> >> > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
> >> > > ae74bbce18102091c11c7bd458939d1c
> >> > > UID=1000
> >> > > LESSOPEN=| /bin/lesspipe %s
> >> > > XDG_RUNTIME_DIR=/run/user/1000
> >> > > DISPLAY=:10.0
> >> > > XDG_CURRENT_DESKTOP=MATE
> >> > > LESSCLOSE=/bin/lesspipe %s %s
> >> > > COLORTERM=mate-terminal
> >> > > _=/usr/bin/env
> >> > >
> >> > >
> >> > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com>
> >> > wrote:
> >> > >
> >> > >> Weird, yes I did read that pageand yes I had to do those exact
> steps
> >> > that
> >> > >> I
> >> > >> described, I haven't run the tests yet but fully suspect that I'll
> >> need
> >> > to
> >> > >> increase the ulimit to enable that. If you do a plain maven build
> >> after
> >> > >> checking out the reef code in ubuntu it complains that JAVA_HOME is
> >> not
> >> > >> set, also its a good idea to set the maven oriented environment
> >> > variables
> >> > >> because I highly suspect that in the future we may need to adjust
> >> heap
> >> > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
> >> because
> >> > >> the
> >> > >> java code is invoking the protoc compiler at some point and in
> order
> >> to
> >> > do
> >> > >> so it much load some .so files that live in LD_LIBRARY_PATH. Net
> >> Net we
> >> > >> should definitely figure out the differences between your and
> >> Sergei's
> >> > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
> >> convinced
> >> > >> that the version matters if the major version is the same.
> >> > >> Cheers
> >> > >>
> >> > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <
> dsopsrc@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > Hello Saikat,
> >> > >> >
> >> > >> > Did you read the documentation on this page
> >> > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the
> REEF
> >> > wiki
> >> > >> > concerning Java on Ubuntu? I added this page after setting up a
> >> Linux
> >> > >> 16.04
> >> > >> > to build REEF and trading emails with Sergiy on the dev list.
> Note
> >> > >> that I
> >> > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do
> >> need
> >> > to
> >> > >> > change the default for ulimit -n in bash to get the tests to run
> >> which
> >> > >> is
> >> > >> > also described.
> >> > >> >
> >> > >> > Doug
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <
> sxk1969@gmail.com
> >> >
> >> > >> wrote:
> >> > >> >
> >> > >> > > A battle well fought and won, got reef to build successfully on
> >> > ubuntu
> >> > >> > > linux vm after hours of hacking, fyi here's what I had to do:
> >> > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
> >> version
> >> > >> 2.5)
> >> > >> > > 2) added JAVA_HOME and M2_HOME
> >> > >> > > 3) here's the kicker that's not in the documentation :) (
> >> > >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md
> ),
> >> had
> >> > >> to
> >> > >> > add
> >> > >> > > LD_LIBRARY_PATH environment variable and have it point to
> >> > >> /usr/local/lib
> >> > >> > > where the shared library for protobuf is installed
> >> > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> >> > >> > documentation
> >> > >> > > :) )
> >> > >> > >
> >> > >> > >
> >> > >> > > [INFO]
> >> > >> > > ------------------------------------------------------------
> >> > >> ------------
> >> > >> > > [INFO] Reactor Summary:
> >> > >> > > [INFO]
> >> > >> > > [INFO] REEF ...............................................
> >> > SUCCESS [
> >> > >> > > 4.167 s]
> >> > >> > > [INFO] REEF Dot Net .......................................
> >> > SUCCESS [
> >> > >> > > 1.628 s]
> >> > >> > > [INFO] REEF Annotations ...................................
> >> > SUCCESS [
> >> > >> > > 5.509 s]
> >> > >> > > [INFO] REEF Utils .........................................
> >> > SUCCESS [
> >> > >> > > 5.747 s]
> >> > >> > > [INFO] REEF Tang Project ..................................
> >> > SUCCESS [
> >> > >> > > 0.492 s]
> >> > >> > > [INFO] Tang Test Jar A ....................................
> >> > SUCCESS [
> >> > >> > > 4.276 s]
> >> > >> > > [INFO] Tang Test Jar B ....................................
> >> > SUCCESS [
> >> > >> > > 4.186 s]
> >> > >> > > [INFO] Tang Test Jar AB ...................................
> >> > SUCCESS [
> >> > >> > > 4.376 s]
> >> > >> > > [INFO] Tang Test Jar B conflict A .........................
> >> SUCCESS
> >> > [
> >> > >> > > 0.440 s]
> >> > >> > > [INFO] REEF Tang ..........................................
> >> > SUCCESS [
> >> > >> > > 24.779 s]
> >> > >> > > [INFO] REEF Wake Project ..................................
> >> > SUCCESS [
> >> > >> > > 0.487 s]
> >> > >> > > [INFO] REEF Wake ..........................................
> >> > SUCCESS [
> >> > >> > > 15.587 s]
> >> > >> > > [INFO] REEF Common ........................................
> >> > SUCCESS [
> >> > >> > > 23.343 s]
> >> > >> > > [INFO] REEF Runtime Local .................................
> >> > SUCCESS [
> >> > >> > > 8.375 s]
> >> > >> > > [INFO] REEF Applications ..................................
> >> > SUCCESS [
> >> > >> > > 0.416 s]
> >> > >> > > [INFO] REEF Vortex ........................................
> >> > SUCCESS [
> >> > >> > > 11.263 s]
> >> > >> > > [INFO] REEF HTTP Server ...................................
> >> > SUCCESS [
> >> > >> > > 9.772 s]
> >> > >> > > [INFO] REEF Utils for Hadoop ..............................
> >> SUCCESS
> >> > [
> >> > >> > > 5.881 s]
> >> > >> > > [INFO] REEF Runtime for YARN ..............................
> >> SUCCESS
> >> > [
> >> > >> > > 11.041 s]
> >> > >> > > [INFO] REEF Runtime for HDInsight .........................
> >> SUCCESS
> >> > [
> >> > >> > > 9.719 s]
> >> > >> > > [INFO] REEF IO ............................................
> >> > SUCCESS [
> >> > >> > > 23.729 s]
> >> > >> > > [INFO] REEF Checkpoint ....................................
> >> > SUCCESS [
> >> > >> > > 5.771 s]
> >> > >> > > [INFO] REEF Bridge Java ...................................
> >> > SUCCESS [
> >> > >> > > 11.981 s]
> >> > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
> >> SUCCESS
> >> > [
> >> > >> > > 7.898 s]
> >> > >> > > [INFO] REEF Bridge (Client) ...............................
> >> > SUCCESS [
> >> > >> > > 12.242 s]
> >> > >> > > [INFO] REEF Runtime Standalone ............................
> >> SUCCESS
> >> > [
> >> > >> > > 7.779 s]
> >> > >> > > [INFO] REEF Runtime for Mesos .............................
> >> SUCCESS
> >> > [
> >> > >> > > 11.103 s]
> >> > >> > > [INFO] REEF Poison ........................................
> >> > SUCCESS [
> >> > >> > > 5.384 s]
> >> > >> > > [INFO] REEF Examples ......................................
> >> > SUCCESS [
> >> > >> > > 14.313 s]
> >> > >> > > [INFO] REEF Examples CLR ..................................
> >> > SUCCESS [
> >> > >> > > 7.532 s]
> >> > >> > > [INFO] REEF Examples on HDInsight .........................
> >> SUCCESS
> >> > [
> >> > >> > > 9.213 s]
> >> > >> > > [INFO] REEF Tang Tint .....................................
> >> > SUCCESS [
> >> > >> > > 8.546 s]
> >> > >> > > [INFO] REEF Tests .........................................
> >> > SUCCESS [
> >> > >> > > 15.696 s]
> >> > >> > > [INFO] REEF Website .......................................
> >> > SUCCESS [
> >> > >> > > 1.033 s]
> >> > >> > > [INFO]
> >> > >> > > ------------------------------------------------------------
> >> > >> ------------
> >> > >> > > [INFO] BUILD SUCCESS
> >> > >> > > [INFO]
> >> > >> > > ------------------------------------------------------------
> >> > >> ------------
> >> > >> > > [INFO] Total time: 04:54 min
> >> > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> >> > >> > > [INFO] Final Memory: 125M/1238M
> >> > >> > > [INFO]
> >> > >> > > ------------------------------------------------------------
> >> > >> ------------
> >> > >> > >
> >> > >> > >
> >> > >> > > On to bigger and better things :), we should probably update
> the
> >> > docs
> >> > >> to
> >> > >> > > reflect the current build process subtleties. Will try windows
> >> > next.
> >> > >> > >
> >> > >> > >
> >> > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
> >> bgchun@gmail.com>
> >> > >> > wrote:
> >> > >> > >
> >> > >> > > > Welcome, Saikat!
> >> > >> > > >
> >> > >> > > >
> >> > >> > > >
> >> > >> > > >
> >> > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <
> markus@weimo.de
> >> >
> >> > >> wrote:
> >> > >> > > >
> >> > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> >> > >> > > > >
> >> > >> > > > >> I am a newbie to Apache Reef and am interested in
> >> contributing
> >> > to
> >> > >> > the
> >> > >> > > > reef
> >> > >> > > > >> dev efforts
> >> > >> > > > >>
> >> > >> > > > >
> >> > >> > > > > Welcome!
> >> > >> > > > >
> >> > >> > > > > my JIRA id is kanjilal
> >> > >> > > > >>
> >> > >> > > > >
> >> > >> > > > > I have added you to the contributor's list on JIRA. This
> >> > basically
> >> > >> > > means
> >> > >> > > > > that you can self-assign issues to yourself now :)
> >> > >> > > > >
> >> > >> > > > > Markus
> >> > >> > > > >
> >> > >> > > >
> >> > >> > > >
> >> > >> > > >
> >> > >> > > > --
> >> > >> > > > Byung-Gon Chun
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> > >
> >> > >
> >> >
> >>
> >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
You can download this zip file from GitHub
https://github.com/google/protobuf/releases/download/v2.5.0/protoc-2.5.0-win32.zip
and extract the protoc.exe into a directory in your windows path.
Doug
On Thu, Feb 9, 2017 at 1:02 PM, Douglas Service <ds...@gmail.com> wrote:
> No I am actually running two versions of the Oracle java using
> update-alternatives and do not have the open-jdk installed as I apt-get
> purged it. Take the time to understand all of the configuration issues on
> Linux as you update the documentation. I learned about this the hard way
> and ended up changing the wiki many times as figured out how to simplify my
> build setup and realized my initial understanding of the environment was
> not very clear.
>
> Doug
>
> On Thu, Feb 9, 2017 at 8:52 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
>
>> I think part of the difference is the way both of us installed java, my
>> setup is using the oracle java as opposed to the open-jdk java provided by
>> update-alternatives, I agree with your instructions assessment.
>>
>>
>> On another note I have a question, how did folks install protoc on
>> windows,
>> in looking at the wiki it points you to the protoc site where it seems to
>> need a whole bunch of supporting tools (cmake/mingw etc), I am using
>> gitbash on windows and was wondering if there's an easy way to download
>> the
>> protoc binaries and set the path, please forgive me if this is in the
>> documentation somewhere, still learning my way around.
>>
>> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
>> wrote:
>>
>> > What I mean is that we should provide instructions to setup the least
>> > complicated build environment that works, not one that is more
>> complicated
>> > but also works.
>> >
>> > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com>
>> > wrote:
>> >
>> > > Do you have update-alternatives installed? Have you run
>> > > update-alternatives --config java?
>> > >
>> > > Sorry I made a mistake in may last email, I actually have JAVA_HOME
>> set
>> > to
>> > > /usr as listed on the webpage which figured out from Sergiy. However,
>> I
>> > do
>> > > not need to set the other ones. It is important that our contributing
>> to
>> > > REEF wiki be general and not specific to a single setup.
>> > >
>> > > Here is my environment for building REEF on Ubuntu 16.04.
>> > >
>> > > dougse@reefdevlx:/code/reef [master ↑]$$ env
>> > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
>> > > XDG_SESSION_ID=c2
>> > > SHELL=/bin/bash
>> > > TERM=xterm
>> > > WINDOWID=44144243
>> > > USER=dougse
>> > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
>> > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
>> > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
>> > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
>> > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
>> > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
>> > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
>> > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
>> > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
>> > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
>> > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
>> > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
>> > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
>> > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
>> > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
>> > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
>> > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
>> > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
>> > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
>> > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
>> > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
>> > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
>> > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
>> > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
>> > > 00;36:*.xspf=00;36:
>> > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
>> > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
>> > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
>> > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
>> > > PWD=/code/reef
>> > > JAVA_HOME=/usr
>> > > LANG=en_US.UTF-8
>> > > REEF_HOME=/code/reef
>> > > SHLVL=1
>> > > HOME=/home/dougse
>> > > GTK_OVERLAY_SCROLLING=0
>> > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
>> > > ae74bbce18102091c11c7bd458939d1c
>> > > UID=1000
>> > > LESSOPEN=| /bin/lesspipe %s
>> > > XDG_RUNTIME_DIR=/run/user/1000
>> > > DISPLAY=:10.0
>> > > XDG_CURRENT_DESKTOP=MATE
>> > > LESSCLOSE=/bin/lesspipe %s %s
>> > > COLORTERM=mate-terminal
>> > > _=/usr/bin/env
>> > >
>> > >
>> > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com>
>> > wrote:
>> > >
>> > >> Weird, yes I did read that pageand yes I had to do those exact steps
>> > that
>> > >> I
>> > >> described, I haven't run the tests yet but fully suspect that I'll
>> need
>> > to
>> > >> increase the ulimit to enable that. If you do a plain maven build
>> after
>> > >> checking out the reef code in ubuntu it complains that JAVA_HOME is
>> not
>> > >> set, also its a good idea to set the maven oriented environment
>> > variables
>> > >> because I highly suspect that in the future we may need to adjust
>> heap
>> > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
>> because
>> > >> the
>> > >> java code is invoking the protoc compiler at some point and in order
>> to
>> > do
>> > >> so it much load some .so files that live in LD_LIBRARY_PATH. Net
>> Net we
>> > >> should definitely figure out the differences between your and
>> Sergei's
>> > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
>> convinced
>> > >> that the version matters if the major version is the same.
>> > >> Cheers
>> > >>
>> > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <ds...@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > Hello Saikat,
>> > >> >
>> > >> > Did you read the documentation on this page
>> > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF
>> > wiki
>> > >> > concerning Java on Ubuntu? I added this page after setting up a
>> Linux
>> > >> 16.04
>> > >> > to build REEF and trading emails with Sergiy on the dev list. Note
>> > >> that I
>> > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do
>> need
>> > to
>> > >> > change the default for ulimit -n in bash to get the tests to run
>> which
>> > >> is
>> > >> > also described.
>> > >> >
>> > >> > Doug
>> > >> >
>> > >> >
>> > >> >
>> > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sxk1969@gmail.com
>> >
>> > >> wrote:
>> > >> >
>> > >> > > A battle well fought and won, got reef to build successfully on
>> > ubuntu
>> > >> > > linux vm after hours of hacking, fyi here's what I had to do:
>> > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
>> version
>> > >> 2.5)
>> > >> > > 2) added JAVA_HOME and M2_HOME
>> > >> > > 3) here's the kicker that's not in the documentation :) (
>> > >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md),
>> had
>> > >> to
>> > >> > add
>> > >> > > LD_LIBRARY_PATH environment variable and have it point to
>> > >> /usr/local/lib
>> > >> > > where the shared library for protobuf is installed
>> > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
>> > >> > documentation
>> > >> > > :) )
>> > >> > >
>> > >> > >
>> > >> > > [INFO]
>> > >> > > ------------------------------------------------------------
>> > >> ------------
>> > >> > > [INFO] Reactor Summary:
>> > >> > > [INFO]
>> > >> > > [INFO] REEF ...............................................
>> > SUCCESS [
>> > >> > > 4.167 s]
>> > >> > > [INFO] REEF Dot Net .......................................
>> > SUCCESS [
>> > >> > > 1.628 s]
>> > >> > > [INFO] REEF Annotations ...................................
>> > SUCCESS [
>> > >> > > 5.509 s]
>> > >> > > [INFO] REEF Utils .........................................
>> > SUCCESS [
>> > >> > > 5.747 s]
>> > >> > > [INFO] REEF Tang Project ..................................
>> > SUCCESS [
>> > >> > > 0.492 s]
>> > >> > > [INFO] Tang Test Jar A ....................................
>> > SUCCESS [
>> > >> > > 4.276 s]
>> > >> > > [INFO] Tang Test Jar B ....................................
>> > SUCCESS [
>> > >> > > 4.186 s]
>> > >> > > [INFO] Tang Test Jar AB ...................................
>> > SUCCESS [
>> > >> > > 4.376 s]
>> > >> > > [INFO] Tang Test Jar B conflict A .........................
>> SUCCESS
>> > [
>> > >> > > 0.440 s]
>> > >> > > [INFO] REEF Tang ..........................................
>> > SUCCESS [
>> > >> > > 24.779 s]
>> > >> > > [INFO] REEF Wake Project ..................................
>> > SUCCESS [
>> > >> > > 0.487 s]
>> > >> > > [INFO] REEF Wake ..........................................
>> > SUCCESS [
>> > >> > > 15.587 s]
>> > >> > > [INFO] REEF Common ........................................
>> > SUCCESS [
>> > >> > > 23.343 s]
>> > >> > > [INFO] REEF Runtime Local .................................
>> > SUCCESS [
>> > >> > > 8.375 s]
>> > >> > > [INFO] REEF Applications ..................................
>> > SUCCESS [
>> > >> > > 0.416 s]
>> > >> > > [INFO] REEF Vortex ........................................
>> > SUCCESS [
>> > >> > > 11.263 s]
>> > >> > > [INFO] REEF HTTP Server ...................................
>> > SUCCESS [
>> > >> > > 9.772 s]
>> > >> > > [INFO] REEF Utils for Hadoop ..............................
>> SUCCESS
>> > [
>> > >> > > 5.881 s]
>> > >> > > [INFO] REEF Runtime for YARN ..............................
>> SUCCESS
>> > [
>> > >> > > 11.041 s]
>> > >> > > [INFO] REEF Runtime for HDInsight .........................
>> SUCCESS
>> > [
>> > >> > > 9.719 s]
>> > >> > > [INFO] REEF IO ............................................
>> > SUCCESS [
>> > >> > > 23.729 s]
>> > >> > > [INFO] REEF Checkpoint ....................................
>> > SUCCESS [
>> > >> > > 5.771 s]
>> > >> > > [INFO] REEF Bridge Java ...................................
>> > SUCCESS [
>> > >> > > 11.981 s]
>> > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
>> SUCCESS
>> > [
>> > >> > > 7.898 s]
>> > >> > > [INFO] REEF Bridge (Client) ...............................
>> > SUCCESS [
>> > >> > > 12.242 s]
>> > >> > > [INFO] REEF Runtime Standalone ............................
>> SUCCESS
>> > [
>> > >> > > 7.779 s]
>> > >> > > [INFO] REEF Runtime for Mesos .............................
>> SUCCESS
>> > [
>> > >> > > 11.103 s]
>> > >> > > [INFO] REEF Poison ........................................
>> > SUCCESS [
>> > >> > > 5.384 s]
>> > >> > > [INFO] REEF Examples ......................................
>> > SUCCESS [
>> > >> > > 14.313 s]
>> > >> > > [INFO] REEF Examples CLR ..................................
>> > SUCCESS [
>> > >> > > 7.532 s]
>> > >> > > [INFO] REEF Examples on HDInsight .........................
>> SUCCESS
>> > [
>> > >> > > 9.213 s]
>> > >> > > [INFO] REEF Tang Tint .....................................
>> > SUCCESS [
>> > >> > > 8.546 s]
>> > >> > > [INFO] REEF Tests .........................................
>> > SUCCESS [
>> > >> > > 15.696 s]
>> > >> > > [INFO] REEF Website .......................................
>> > SUCCESS [
>> > >> > > 1.033 s]
>> > >> > > [INFO]
>> > >> > > ------------------------------------------------------------
>> > >> ------------
>> > >> > > [INFO] BUILD SUCCESS
>> > >> > > [INFO]
>> > >> > > ------------------------------------------------------------
>> > >> ------------
>> > >> > > [INFO] Total time: 04:54 min
>> > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
>> > >> > > [INFO] Final Memory: 125M/1238M
>> > >> > > [INFO]
>> > >> > > ------------------------------------------------------------
>> > >> ------------
>> > >> > >
>> > >> > >
>> > >> > > On to bigger and better things :), we should probably update the
>> > docs
>> > >> to
>> > >> > > reflect the current build process subtleties. Will try windows
>> > next.
>> > >> > >
>> > >> > >
>> > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <
>> bgchun@gmail.com>
>> > >> > wrote:
>> > >> > >
>> > >> > > > Welcome, Saikat!
>> > >> > > >
>> > >> > > >
>> > >> > > >
>> > >> > > >
>> > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <markus@weimo.de
>> >
>> > >> wrote:
>> > >> > > >
>> > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
>> > >> > > > >
>> > >> > > > >> I am a newbie to Apache Reef and am interested in
>> contributing
>> > to
>> > >> > the
>> > >> > > > reef
>> > >> > > > >> dev efforts
>> > >> > > > >>
>> > >> > > > >
>> > >> > > > > Welcome!
>> > >> > > > >
>> > >> > > > > my JIRA id is kanjilal
>> > >> > > > >>
>> > >> > > > >
>> > >> > > > > I have added you to the contributor's list on JIRA. This
>> > basically
>> > >> > > means
>> > >> > > > > that you can self-assign issues to yourself now :)
>> > >> > > > >
>> > >> > > > > Markus
>> > >> > > > >
>> > >> > > >
>> > >> > > >
>> > >> > > >
>> > >> > > > --
>> > >> > > > Byung-Gon Chun
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> > >
>> > >
>> >
>>
>
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
No I am actually running two versions of the Oracle java using
update-alternatives and do not have the open-jdk installed as I apt-get
purged it. Take the time to understand all of the configuration issues on
Linux as you update the documentation. I learned about this the hard way
and ended up changing the wiki many times as figured out how to simplify my
build setup and realized my initial understanding of the environment was
not very clear.
Doug
On Thu, Feb 9, 2017 at 8:52 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> I think part of the difference is the way both of us installed java, my
> setup is using the oracle java as opposed to the open-jdk java provided by
> update-alternatives, I agree with your instructions assessment.
>
>
> On another note I have a question, how did folks install protoc on windows,
> in looking at the wiki it points you to the protoc site where it seems to
> need a whole bunch of supporting tools (cmake/mingw etc), I am using
> gitbash on windows and was wondering if there's an easy way to download the
> protoc binaries and set the path, please forgive me if this is in the
> documentation somewhere, still learning my way around.
>
> On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com>
> wrote:
>
> > What I mean is that we should provide instructions to setup the least
> > complicated build environment that works, not one that is more
> complicated
> > but also works.
> >
> > On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com>
> > wrote:
> >
> > > Do you have update-alternatives installed? Have you run
> > > update-alternatives --config java?
> > >
> > > Sorry I made a mistake in may last email, I actually have JAVA_HOME set
> > to
> > > /usr as listed on the webpage which figured out from Sergiy. However, I
> > do
> > > not need to set the other ones. It is important that our contributing
> to
> > > REEF wiki be general and not specific to a single setup.
> > >
> > > Here is my environment for building REEF on Ubuntu 16.04.
> > >
> > > dougse@reefdevlx:/code/reef [master ↑]$$ env
> > > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > > XDG_SESSION_ID=c2
> > > SHELL=/bin/bash
> > > TERM=xterm
> > > WINDOWID=44144243
> > > USER=dougse
> > > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> > > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> > > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> > > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> > > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> > > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> > > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> > > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> > > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> > > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> > > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> > > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> > > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> > > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> > > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> > > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> > > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> > > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> > > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> > > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> > > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> > > 00;36:*.xspf=00;36:
> > > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
> > > PWD=/code/reef
> > > JAVA_HOME=/usr
> > > LANG=en_US.UTF-8
> > > REEF_HOME=/code/reef
> > > SHLVL=1
> > > HOME=/home/dougse
> > > GTK_OVERLAY_SCROLLING=0
> > > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
> > > ae74bbce18102091c11c7bd458939d1c
> > > UID=1000
> > > LESSOPEN=| /bin/lesspipe %s
> > > XDG_RUNTIME_DIR=/run/user/1000
> > > DISPLAY=:10.0
> > > XDG_CURRENT_DESKTOP=MATE
> > > LESSCLOSE=/bin/lesspipe %s %s
> > > COLORTERM=mate-terminal
> > > _=/usr/bin/env
> > >
> > >
> > > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com>
> > wrote:
> > >
> > >> Weird, yes I did read that pageand yes I had to do those exact steps
> > that
> > >> I
> > >> described, I haven't run the tests yet but fully suspect that I'll
> need
> > to
> > >> increase the ulimit to enable that. If you do a plain maven build
> after
> > >> checking out the reef code in ubuntu it complains that JAVA_HOME is
> not
> > >> set, also its a good idea to set the maven oriented environment
> > variables
> > >> because I highly suspect that in the future we may need to adjust heap
> > >> space settings, finally the LD_LIBRARY_PATH is needed I suspect
> because
> > >> the
> > >> java code is invoking the protoc compiler at some point and in order
> to
> > do
> > >> so it much load some .so files that live in LD_LIBRARY_PATH. Net Net
> we
> > >> should definitely figure out the differences between your and Sergei's
> > >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not
> convinced
> > >> that the version matters if the major version is the same.
> > >> Cheers
> > >>
> > >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <ds...@gmail.com>
> > >> wrote:
> > >>
> > >> > Hello Saikat,
> > >> >
> > >> > Did you read the documentation on this page
> > >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF
> > wiki
> > >> > concerning Java on Ubuntu? I added this page after setting up a
> Linux
> > >> 16.04
> > >> > to build REEF and trading emails with Sergiy on the dev list. Note
> > >> that I
> > >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need
> > to
> > >> > change the default for ulimit -n in bash to get the tests to run
> which
> > >> is
> > >> > also described.
> > >> >
> > >> > Doug
> > >> >
> > >> >
> > >> >
> > >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com>
> > >> wrote:
> > >> >
> > >> > > A battle well fought and won, got reef to build successfully on
> > ubuntu
> > >> > > linux vm after hours of hacking, fyi here's what I had to do:
> > >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc
> version
> > >> 2.5)
> > >> > > 2) added JAVA_HOME and M2_HOME
> > >> > > 3) here's the kicker that's not in the documentation :) (
> > >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md),
> had
> > >> to
> > >> > add
> > >> > > LD_LIBRARY_PATH environment variable and have it point to
> > >> /usr/local/lib
> > >> > > where the shared library for protobuf is installed
> > >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> > >> > documentation
> > >> > > :) )
> > >> > >
> > >> > >
> > >> > > [INFO]
> > >> > > ------------------------------------------------------------
> > >> ------------
> > >> > > [INFO] Reactor Summary:
> > >> > > [INFO]
> > >> > > [INFO] REEF ...............................................
> > SUCCESS [
> > >> > > 4.167 s]
> > >> > > [INFO] REEF Dot Net .......................................
> > SUCCESS [
> > >> > > 1.628 s]
> > >> > > [INFO] REEF Annotations ...................................
> > SUCCESS [
> > >> > > 5.509 s]
> > >> > > [INFO] REEF Utils .........................................
> > SUCCESS [
> > >> > > 5.747 s]
> > >> > > [INFO] REEF Tang Project ..................................
> > SUCCESS [
> > >> > > 0.492 s]
> > >> > > [INFO] Tang Test Jar A ....................................
> > SUCCESS [
> > >> > > 4.276 s]
> > >> > > [INFO] Tang Test Jar B ....................................
> > SUCCESS [
> > >> > > 4.186 s]
> > >> > > [INFO] Tang Test Jar AB ...................................
> > SUCCESS [
> > >> > > 4.376 s]
> > >> > > [INFO] Tang Test Jar B conflict A .........................
> SUCCESS
> > [
> > >> > > 0.440 s]
> > >> > > [INFO] REEF Tang ..........................................
> > SUCCESS [
> > >> > > 24.779 s]
> > >> > > [INFO] REEF Wake Project ..................................
> > SUCCESS [
> > >> > > 0.487 s]
> > >> > > [INFO] REEF Wake ..........................................
> > SUCCESS [
> > >> > > 15.587 s]
> > >> > > [INFO] REEF Common ........................................
> > SUCCESS [
> > >> > > 23.343 s]
> > >> > > [INFO] REEF Runtime Local .................................
> > SUCCESS [
> > >> > > 8.375 s]
> > >> > > [INFO] REEF Applications ..................................
> > SUCCESS [
> > >> > > 0.416 s]
> > >> > > [INFO] REEF Vortex ........................................
> > SUCCESS [
> > >> > > 11.263 s]
> > >> > > [INFO] REEF HTTP Server ...................................
> > SUCCESS [
> > >> > > 9.772 s]
> > >> > > [INFO] REEF Utils for Hadoop ..............................
> SUCCESS
> > [
> > >> > > 5.881 s]
> > >> > > [INFO] REEF Runtime for YARN ..............................
> SUCCESS
> > [
> > >> > > 11.041 s]
> > >> > > [INFO] REEF Runtime for HDInsight .........................
> SUCCESS
> > [
> > >> > > 9.719 s]
> > >> > > [INFO] REEF IO ............................................
> > SUCCESS [
> > >> > > 23.729 s]
> > >> > > [INFO] REEF Checkpoint ....................................
> > SUCCESS [
> > >> > > 5.771 s]
> > >> > > [INFO] REEF Bridge Java ...................................
> > SUCCESS [
> > >> > > 11.981 s]
> > >> > > [INFO] REEF Runtime for multiple runtime scenarios ........
> SUCCESS
> > [
> > >> > > 7.898 s]
> > >> > > [INFO] REEF Bridge (Client) ...............................
> > SUCCESS [
> > >> > > 12.242 s]
> > >> > > [INFO] REEF Runtime Standalone ............................
> SUCCESS
> > [
> > >> > > 7.779 s]
> > >> > > [INFO] REEF Runtime for Mesos .............................
> SUCCESS
> > [
> > >> > > 11.103 s]
> > >> > > [INFO] REEF Poison ........................................
> > SUCCESS [
> > >> > > 5.384 s]
> > >> > > [INFO] REEF Examples ......................................
> > SUCCESS [
> > >> > > 14.313 s]
> > >> > > [INFO] REEF Examples CLR ..................................
> > SUCCESS [
> > >> > > 7.532 s]
> > >> > > [INFO] REEF Examples on HDInsight .........................
> SUCCESS
> > [
> > >> > > 9.213 s]
> > >> > > [INFO] REEF Tang Tint .....................................
> > SUCCESS [
> > >> > > 8.546 s]
> > >> > > [INFO] REEF Tests .........................................
> > SUCCESS [
> > >> > > 15.696 s]
> > >> > > [INFO] REEF Website .......................................
> > SUCCESS [
> > >> > > 1.033 s]
> > >> > > [INFO]
> > >> > > ------------------------------------------------------------
> > >> ------------
> > >> > > [INFO] BUILD SUCCESS
> > >> > > [INFO]
> > >> > > ------------------------------------------------------------
> > >> ------------
> > >> > > [INFO] Total time: 04:54 min
> > >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > >> > > [INFO] Final Memory: 125M/1238M
> > >> > > [INFO]
> > >> > > ------------------------------------------------------------
> > >> ------------
> > >> > >
> > >> > >
> > >> > > On to bigger and better things :), we should probably update the
> > docs
> > >> to
> > >> > > reflect the current build process subtleties. Will try windows
> > next.
> > >> > >
> > >> > >
> > >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bgchun@gmail.com
> >
> > >> > wrote:
> > >> > >
> > >> > > > Welcome, Saikat!
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de>
> > >> wrote:
> > >> > > >
> > >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > >> > > > >
> > >> > > > >> I am a newbie to Apache Reef and am interested in
> contributing
> > to
> > >> > the
> > >> > > > reef
> > >> > > > >> dev efforts
> > >> > > > >>
> > >> > > > >
> > >> > > > > Welcome!
> > >> > > > >
> > >> > > > > my JIRA id is kanjilal
> > >> > > > >>
> > >> > > > >
> > >> > > > > I have added you to the contributor's list on JIRA. This
> > basically
> > >> > > means
> > >> > > > > that you can self-assign issues to yourself now :)
> > >> > > > >
> > >> > > > > Markus
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > --
> > >> > > > Byung-Gon Chun
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
I think part of the difference is the way both of us installed java, my
setup is using the oracle java as opposed to the open-jdk java provided by
update-alternatives, I agree with your instructions assessment.
On another note I have a question, how did folks install protoc on windows,
in looking at the wiki it points you to the protoc site where it seems to
need a whole bunch of supporting tools (cmake/mingw etc), I am using
gitbash on windows and was wondering if there's an easy way to download the
protoc binaries and set the path, please forgive me if this is in the
documentation somewhere, still learning my way around.
On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <ds...@gmail.com> wrote:
> What I mean is that we should provide instructions to setup the least
> complicated build environment that works, not one that is more complicated
> but also works.
>
> On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com>
> wrote:
>
> > Do you have update-alternatives installed? Have you run
> > update-alternatives --config java?
> >
> > Sorry I made a mistake in may last email, I actually have JAVA_HOME set
> to
> > /usr as listed on the webpage which figured out from Sergiy. However, I
> do
> > not need to set the other ones. It is important that our contributing to
> > REEF wiki be general and not specific to a single setup.
> >
> > Here is my environment for building REEF on Ubuntu 16.04.
> >
> > dougse@reefdevlx:/code/reef [master ↑]$$ env
> > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > XDG_SESSION_ID=c2
> > SHELL=/bin/bash
> > TERM=xterm
> > WINDOWID=44144243
> > USER=dougse
> > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> > 00;36:*.xspf=00;36:
> > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
> > PWD=/code/reef
> > JAVA_HOME=/usr
> > LANG=en_US.UTF-8
> > REEF_HOME=/code/reef
> > SHLVL=1
> > HOME=/home/dougse
> > GTK_OVERLAY_SCROLLING=0
> > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
> > ae74bbce18102091c11c7bd458939d1c
> > UID=1000
> > LESSOPEN=| /bin/lesspipe %s
> > XDG_RUNTIME_DIR=/run/user/1000
> > DISPLAY=:10.0
> > XDG_CURRENT_DESKTOP=MATE
> > LESSCLOSE=/bin/lesspipe %s %s
> > COLORTERM=mate-terminal
> > _=/usr/bin/env
> >
> >
> > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
> >
> >> Weird, yes I did read that pageand yes I had to do those exact steps
> that
> >> I
> >> described, I haven't run the tests yet but fully suspect that I'll need
> to
> >> increase the ulimit to enable that. If you do a plain maven build after
> >> checking out the reef code in ubuntu it complains that JAVA_HOME is not
> >> set, also its a good idea to set the maven oriented environment
> variables
> >> because I highly suspect that in the future we may need to adjust heap
> >> space settings, finally the LD_LIBRARY_PATH is needed I suspect because
> >> the
> >> java code is invoking the protoc compiler at some point and in order to
> do
> >> so it much load some .so files that live in LD_LIBRARY_PATH. Net Net we
> >> should definitely figure out the differences between your and Sergei's
> >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not convinced
> >> that the version matters if the major version is the same.
> >> Cheers
> >>
> >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <ds...@gmail.com>
> >> wrote:
> >>
> >> > Hello Saikat,
> >> >
> >> > Did you read the documentation on this page
> >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF
> wiki
> >> > concerning Java on Ubuntu? I added this page after setting up a Linux
> >> 16.04
> >> > to build REEF and trading emails with Sergiy on the dev list. Note
> >> that I
> >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need
> to
> >> > change the default for ulimit -n in bash to get the tests to run which
> >> is
> >> > also described.
> >> >
> >> > Doug
> >> >
> >> >
> >> >
> >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com>
> >> wrote:
> >> >
> >> > > A battle well fought and won, got reef to build successfully on
> ubuntu
> >> > > linux vm after hours of hacking, fyi here's what I had to do:
> >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc version
> >> 2.5)
> >> > > 2) added JAVA_HOME and M2_HOME
> >> > > 3) here's the kicker that's not in the documentation :) (
> >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md), had
> >> to
> >> > add
> >> > > LD_LIBRARY_PATH environment variable and have it point to
> >> /usr/local/lib
> >> > > where the shared library for protobuf is installed
> >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> >> > documentation
> >> > > :) )
> >> > >
> >> > >
> >> > > [INFO]
> >> > > ------------------------------------------------------------
> >> ------------
> >> > > [INFO] Reactor Summary:
> >> > > [INFO]
> >> > > [INFO] REEF ...............................................
> SUCCESS [
> >> > > 4.167 s]
> >> > > [INFO] REEF Dot Net .......................................
> SUCCESS [
> >> > > 1.628 s]
> >> > > [INFO] REEF Annotations ...................................
> SUCCESS [
> >> > > 5.509 s]
> >> > > [INFO] REEF Utils .........................................
> SUCCESS [
> >> > > 5.747 s]
> >> > > [INFO] REEF Tang Project ..................................
> SUCCESS [
> >> > > 0.492 s]
> >> > > [INFO] Tang Test Jar A ....................................
> SUCCESS [
> >> > > 4.276 s]
> >> > > [INFO] Tang Test Jar B ....................................
> SUCCESS [
> >> > > 4.186 s]
> >> > > [INFO] Tang Test Jar AB ...................................
> SUCCESS [
> >> > > 4.376 s]
> >> > > [INFO] Tang Test Jar B conflict A ......................... SUCCESS
> [
> >> > > 0.440 s]
> >> > > [INFO] REEF Tang ..........................................
> SUCCESS [
> >> > > 24.779 s]
> >> > > [INFO] REEF Wake Project ..................................
> SUCCESS [
> >> > > 0.487 s]
> >> > > [INFO] REEF Wake ..........................................
> SUCCESS [
> >> > > 15.587 s]
> >> > > [INFO] REEF Common ........................................
> SUCCESS [
> >> > > 23.343 s]
> >> > > [INFO] REEF Runtime Local .................................
> SUCCESS [
> >> > > 8.375 s]
> >> > > [INFO] REEF Applications ..................................
> SUCCESS [
> >> > > 0.416 s]
> >> > > [INFO] REEF Vortex ........................................
> SUCCESS [
> >> > > 11.263 s]
> >> > > [INFO] REEF HTTP Server ...................................
> SUCCESS [
> >> > > 9.772 s]
> >> > > [INFO] REEF Utils for Hadoop .............................. SUCCESS
> [
> >> > > 5.881 s]
> >> > > [INFO] REEF Runtime for YARN .............................. SUCCESS
> [
> >> > > 11.041 s]
> >> > > [INFO] REEF Runtime for HDInsight ......................... SUCCESS
> [
> >> > > 9.719 s]
> >> > > [INFO] REEF IO ............................................
> SUCCESS [
> >> > > 23.729 s]
> >> > > [INFO] REEF Checkpoint ....................................
> SUCCESS [
> >> > > 5.771 s]
> >> > > [INFO] REEF Bridge Java ...................................
> SUCCESS [
> >> > > 11.981 s]
> >> > > [INFO] REEF Runtime for multiple runtime scenarios ........ SUCCESS
> [
> >> > > 7.898 s]
> >> > > [INFO] REEF Bridge (Client) ...............................
> SUCCESS [
> >> > > 12.242 s]
> >> > > [INFO] REEF Runtime Standalone ............................ SUCCESS
> [
> >> > > 7.779 s]
> >> > > [INFO] REEF Runtime for Mesos ............................. SUCCESS
> [
> >> > > 11.103 s]
> >> > > [INFO] REEF Poison ........................................
> SUCCESS [
> >> > > 5.384 s]
> >> > > [INFO] REEF Examples ......................................
> SUCCESS [
> >> > > 14.313 s]
> >> > > [INFO] REEF Examples CLR ..................................
> SUCCESS [
> >> > > 7.532 s]
> >> > > [INFO] REEF Examples on HDInsight ......................... SUCCESS
> [
> >> > > 9.213 s]
> >> > > [INFO] REEF Tang Tint .....................................
> SUCCESS [
> >> > > 8.546 s]
> >> > > [INFO] REEF Tests .........................................
> SUCCESS [
> >> > > 15.696 s]
> >> > > [INFO] REEF Website .......................................
> SUCCESS [
> >> > > 1.033 s]
> >> > > [INFO]
> >> > > ------------------------------------------------------------
> >> ------------
> >> > > [INFO] BUILD SUCCESS
> >> > > [INFO]
> >> > > ------------------------------------------------------------
> >> ------------
> >> > > [INFO] Total time: 04:54 min
> >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> >> > > [INFO] Final Memory: 125M/1238M
> >> > > [INFO]
> >> > > ------------------------------------------------------------
> >> ------------
> >> > >
> >> > >
> >> > > On to bigger and better things :), we should probably update the
> docs
> >> to
> >> > > reflect the current build process subtleties. Will try windows
> next.
> >> > >
> >> > >
> >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bg...@gmail.com>
> >> > wrote:
> >> > >
> >> > > > Welcome, Saikat!
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de>
> >> wrote:
> >> > > >
> >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> >> > > > >
> >> > > > >> I am a newbie to Apache Reef and am interested in contributing
> to
> >> > the
> >> > > > reef
> >> > > > >> dev efforts
> >> > > > >>
> >> > > > >
> >> > > > > Welcome!
> >> > > > >
> >> > > > > my JIRA id is kanjilal
> >> > > > >>
> >> > > > >
> >> > > > > I have added you to the contributor's list on JIRA. This
> basically
> >> > > means
> >> > > > > that you can self-assign issues to yourself now :)
> >> > > > >
> >> > > > > Markus
> >> > > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > --
> >> > > > Byung-Gon Chun
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
What I mean is that we should provide instructions to setup the least
complicated build environment that works, not one that is more complicated
but also works.
On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <ds...@gmail.com> wrote:
> Do you have update-alternatives installed? Have you run
> update-alternatives --config java?
>
> Sorry I made a mistake in may last email, I actually have JAVA_HOME set to
> /usr as listed on the webpage which figured out from Sergiy. However, I do
> not need to set the other ones. It is important that our contributing to
> REEF wiki be general and not specific to a single setup.
>
> Here is my environment for building REEF on Ubuntu 16.04.
>
> dougse@reefdevlx:/code/reef [master ↑]$$ env
> MATE_DESKTOP_SESSION_ID=this-is-deprecated
> XDG_SESSION_ID=c2
> SHELL=/bin/bash
> TERM=xterm
> WINDOWID=44144243
> USER=dougse
> LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> 00;36:*.xspf=00;36:
> SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
> PWD=/code/reef
> JAVA_HOME=/usr
> LANG=en_US.UTF-8
> REEF_HOME=/code/reef
> SHLVL=1
> HOME=/home/dougse
> GTK_OVERLAY_SCROLLING=0
> DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
> ae74bbce18102091c11c7bd458939d1c
> UID=1000
> LESSOPEN=| /bin/lesspipe %s
> XDG_RUNTIME_DIR=/run/user/1000
> DISPLAY=:10.0
> XDG_CURRENT_DESKTOP=MATE
> LESSCLOSE=/bin/lesspipe %s %s
> COLORTERM=mate-terminal
> _=/usr/bin/env
>
>
> On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
>
>> Weird, yes I did read that pageand yes I had to do those exact steps that
>> I
>> described, I haven't run the tests yet but fully suspect that I'll need to
>> increase the ulimit to enable that. If you do a plain maven build after
>> checking out the reef code in ubuntu it complains that JAVA_HOME is not
>> set, also its a good idea to set the maven oriented environment variables
>> because I highly suspect that in the future we may need to adjust heap
>> space settings, finally the LD_LIBRARY_PATH is needed I suspect because
>> the
>> java code is invoking the protoc compiler at some point and in order to do
>> so it much load some .so files that live in LD_LIBRARY_PATH. Net Net we
>> should definitely figure out the differences between your and Sergei's
>> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not convinced
>> that the version matters if the major version is the same.
>> Cheers
>>
>> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <ds...@gmail.com>
>> wrote:
>>
>> > Hello Saikat,
>> >
>> > Did you read the documentation on this page
>> > https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF wiki
>> > concerning Java on Ubuntu? I added this page after setting up a Linux
>> 16.04
>> > to build REEF and trading emails with Sergiy on the dev list. Note
>> that I
>> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need to
>> > change the default for ulimit -n in bash to get the tests to run which
>> is
>> > also described.
>> >
>> > Doug
>> >
>> >
>> >
>> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com>
>> wrote:
>> >
>> > > A battle well fought and won, got reef to build successfully on ubuntu
>> > > linux vm after hours of hacking, fyi here's what I had to do:
>> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc version
>> 2.5)
>> > > 2) added JAVA_HOME and M2_HOME
>> > > 3) here's the kicker that's not in the documentation :) (
>> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md), had
>> to
>> > add
>> > > LD_LIBRARY_PATH environment variable and have it point to
>> /usr/local/lib
>> > > where the shared library for protobuf is installed
>> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
>> > documentation
>> > > :) )
>> > >
>> > >
>> > > [INFO]
>> > > ------------------------------------------------------------
>> ------------
>> > > [INFO] Reactor Summary:
>> > > [INFO]
>> > > [INFO] REEF ............................................... SUCCESS [
>> > > 4.167 s]
>> > > [INFO] REEF Dot Net ....................................... SUCCESS [
>> > > 1.628 s]
>> > > [INFO] REEF Annotations ................................... SUCCESS [
>> > > 5.509 s]
>> > > [INFO] REEF Utils ......................................... SUCCESS [
>> > > 5.747 s]
>> > > [INFO] REEF Tang Project .................................. SUCCESS [
>> > > 0.492 s]
>> > > [INFO] Tang Test Jar A .................................... SUCCESS [
>> > > 4.276 s]
>> > > [INFO] Tang Test Jar B .................................... SUCCESS [
>> > > 4.186 s]
>> > > [INFO] Tang Test Jar AB ................................... SUCCESS [
>> > > 4.376 s]
>> > > [INFO] Tang Test Jar B conflict A ......................... SUCCESS [
>> > > 0.440 s]
>> > > [INFO] REEF Tang .......................................... SUCCESS [
>> > > 24.779 s]
>> > > [INFO] REEF Wake Project .................................. SUCCESS [
>> > > 0.487 s]
>> > > [INFO] REEF Wake .......................................... SUCCESS [
>> > > 15.587 s]
>> > > [INFO] REEF Common ........................................ SUCCESS [
>> > > 23.343 s]
>> > > [INFO] REEF Runtime Local ................................. SUCCESS [
>> > > 8.375 s]
>> > > [INFO] REEF Applications .................................. SUCCESS [
>> > > 0.416 s]
>> > > [INFO] REEF Vortex ........................................ SUCCESS [
>> > > 11.263 s]
>> > > [INFO] REEF HTTP Server ................................... SUCCESS [
>> > > 9.772 s]
>> > > [INFO] REEF Utils for Hadoop .............................. SUCCESS [
>> > > 5.881 s]
>> > > [INFO] REEF Runtime for YARN .............................. SUCCESS [
>> > > 11.041 s]
>> > > [INFO] REEF Runtime for HDInsight ......................... SUCCESS [
>> > > 9.719 s]
>> > > [INFO] REEF IO ............................................ SUCCESS [
>> > > 23.729 s]
>> > > [INFO] REEF Checkpoint .................................... SUCCESS [
>> > > 5.771 s]
>> > > [INFO] REEF Bridge Java ................................... SUCCESS [
>> > > 11.981 s]
>> > > [INFO] REEF Runtime for multiple runtime scenarios ........ SUCCESS [
>> > > 7.898 s]
>> > > [INFO] REEF Bridge (Client) ............................... SUCCESS [
>> > > 12.242 s]
>> > > [INFO] REEF Runtime Standalone ............................ SUCCESS [
>> > > 7.779 s]
>> > > [INFO] REEF Runtime for Mesos ............................. SUCCESS [
>> > > 11.103 s]
>> > > [INFO] REEF Poison ........................................ SUCCESS [
>> > > 5.384 s]
>> > > [INFO] REEF Examples ...................................... SUCCESS [
>> > > 14.313 s]
>> > > [INFO] REEF Examples CLR .................................. SUCCESS [
>> > > 7.532 s]
>> > > [INFO] REEF Examples on HDInsight ......................... SUCCESS [
>> > > 9.213 s]
>> > > [INFO] REEF Tang Tint ..................................... SUCCESS [
>> > > 8.546 s]
>> > > [INFO] REEF Tests ......................................... SUCCESS [
>> > > 15.696 s]
>> > > [INFO] REEF Website ....................................... SUCCESS [
>> > > 1.033 s]
>> > > [INFO]
>> > > ------------------------------------------------------------
>> ------------
>> > > [INFO] BUILD SUCCESS
>> > > [INFO]
>> > > ------------------------------------------------------------
>> ------------
>> > > [INFO] Total time: 04:54 min
>> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
>> > > [INFO] Final Memory: 125M/1238M
>> > > [INFO]
>> > > ------------------------------------------------------------
>> ------------
>> > >
>> > >
>> > > On to bigger and better things :), we should probably update the docs
>> to
>> > > reflect the current build process subtleties. Will try windows next.
>> > >
>> > >
>> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bg...@gmail.com>
>> > wrote:
>> > >
>> > > > Welcome, Saikat!
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de>
>> wrote:
>> > > >
>> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
>> > > > >
>> > > > >> I am a newbie to Apache Reef and am interested in contributing to
>> > the
>> > > > reef
>> > > > >> dev efforts
>> > > > >>
>> > > > >
>> > > > > Welcome!
>> > > > >
>> > > > > my JIRA id is kanjilal
>> > > > >>
>> > > > >
>> > > > > I have added you to the contributor's list on JIRA. This basically
>> > > means
>> > > > > that you can self-assign issues to yourself now :)
>> > > > >
>> > > > > Markus
>> > > > >
>> > > >
>> > > >
>> > > >
>> > > > --
>> > > > Byung-Gon Chun
>> > > >
>> > >
>> >
>>
>
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
Do you have update-alternatives installed? Have you run update-alternatives
--config java?
Sorry I made a mistake in may last email, I actually have JAVA_HOME set to
/usr as listed on the webpage which figured out from Sergiy. However, I do
not need to set the other ones. It is important that our contributing to
REEF wiki be general and not specific to a single setup.
Here is my environment for building REEF on Ubuntu 16.04.
dougse@reefdevlx:/code/reef [master ↑]$$ env
MATE_DESKTOP_SESSION_ID=this-is-deprecated
XDG_SESSION_ID=c2
SHELL=/bin/bash
TERM=xterm
WINDOWID=44144243
USER=dougse
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:
SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
SESSION_MANAGER=local/reefdevlx:@
/tmp/.ICE-unix/3866,unix/reefdevlx:/tmp/.ICE-unix/3866
PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
PWD=/code/reef
JAVA_HOME=/usr
LANG=en_US.UTF-8
REEF_HOME=/code/reef
SHLVL=1
HOME=/home/dougse
GTK_OVERLAY_SCROLLING=0
DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=ae74bbce18102091c11c7bd458939d1c
UID=1000
LESSOPEN=| /bin/lesspipe %s
XDG_RUNTIME_DIR=/run/user/1000
DISPLAY=:10.0
XDG_CURRENT_DESKTOP=MATE
LESSCLOSE=/bin/lesspipe %s %s
COLORTERM=mate-terminal
_=/usr/bin/env
On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> Weird, yes I did read that pageand yes I had to do those exact steps that I
> described, I haven't run the tests yet but fully suspect that I'll need to
> increase the ulimit to enable that. If you do a plain maven build after
> checking out the reef code in ubuntu it complains that JAVA_HOME is not
> set, also its a good idea to set the maven oriented environment variables
> because I highly suspect that in the future we may need to adjust heap
> space settings, finally the LD_LIBRARY_PATH is needed I suspect because the
> java code is invoking the protoc compiler at some point and in order to do
> so it much load some .so files that live in LD_LIBRARY_PATH. Net Net we
> should definitely figure out the differences between your and Sergei's
> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not convinced
> that the version matters if the major version is the same.
> Cheers
>
> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <ds...@gmail.com>
> wrote:
>
> > Hello Saikat,
> >
> > Did you read the documentation on this page
> > https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF wiki
> > concerning Java on Ubuntu? I added this page after setting up a Linux
> 16.04
> > to build REEF and trading emails with Sergiy on the dev list. Note that
> I
> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need to
> > change the default for ulimit -n in bash to get the tests to run which is
> > also described.
> >
> > Doug
> >
> >
> >
> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com>
> wrote:
> >
> > > A battle well fought and won, got reef to build successfully on ubuntu
> > > linux vm after hours of hacking, fyi here's what I had to do:
> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc version
> 2.5)
> > > 2) added JAVA_HOME and M2_HOME
> > > 3) here's the kicker that's not in the documentation :) (
> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md), had to
> > add
> > > LD_LIBRARY_PATH environment variable and have it point to
> /usr/local/lib
> > > where the shared library for protobuf is installed
> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> > documentation
> > > :) )
> > >
> > >
> > > [INFO]
> > > ------------------------------------------------------------
> ------------
> > > [INFO] Reactor Summary:
> > > [INFO]
> > > [INFO] REEF ............................................... SUCCESS [
> > > 4.167 s]
> > > [INFO] REEF Dot Net ....................................... SUCCESS [
> > > 1.628 s]
> > > [INFO] REEF Annotations ................................... SUCCESS [
> > > 5.509 s]
> > > [INFO] REEF Utils ......................................... SUCCESS [
> > > 5.747 s]
> > > [INFO] REEF Tang Project .................................. SUCCESS [
> > > 0.492 s]
> > > [INFO] Tang Test Jar A .................................... SUCCESS [
> > > 4.276 s]
> > > [INFO] Tang Test Jar B .................................... SUCCESS [
> > > 4.186 s]
> > > [INFO] Tang Test Jar AB ................................... SUCCESS [
> > > 4.376 s]
> > > [INFO] Tang Test Jar B conflict A ......................... SUCCESS [
> > > 0.440 s]
> > > [INFO] REEF Tang .......................................... SUCCESS [
> > > 24.779 s]
> > > [INFO] REEF Wake Project .................................. SUCCESS [
> > > 0.487 s]
> > > [INFO] REEF Wake .......................................... SUCCESS [
> > > 15.587 s]
> > > [INFO] REEF Common ........................................ SUCCESS [
> > > 23.343 s]
> > > [INFO] REEF Runtime Local ................................. SUCCESS [
> > > 8.375 s]
> > > [INFO] REEF Applications .................................. SUCCESS [
> > > 0.416 s]
> > > [INFO] REEF Vortex ........................................ SUCCESS [
> > > 11.263 s]
> > > [INFO] REEF HTTP Server ................................... SUCCESS [
> > > 9.772 s]
> > > [INFO] REEF Utils for Hadoop .............................. SUCCESS [
> > > 5.881 s]
> > > [INFO] REEF Runtime for YARN .............................. SUCCESS [
> > > 11.041 s]
> > > [INFO] REEF Runtime for HDInsight ......................... SUCCESS [
> > > 9.719 s]
> > > [INFO] REEF IO ............................................ SUCCESS [
> > > 23.729 s]
> > > [INFO] REEF Checkpoint .................................... SUCCESS [
> > > 5.771 s]
> > > [INFO] REEF Bridge Java ................................... SUCCESS [
> > > 11.981 s]
> > > [INFO] REEF Runtime for multiple runtime scenarios ........ SUCCESS [
> > > 7.898 s]
> > > [INFO] REEF Bridge (Client) ............................... SUCCESS [
> > > 12.242 s]
> > > [INFO] REEF Runtime Standalone ............................ SUCCESS [
> > > 7.779 s]
> > > [INFO] REEF Runtime for Mesos ............................. SUCCESS [
> > > 11.103 s]
> > > [INFO] REEF Poison ........................................ SUCCESS [
> > > 5.384 s]
> > > [INFO] REEF Examples ...................................... SUCCESS [
> > > 14.313 s]
> > > [INFO] REEF Examples CLR .................................. SUCCESS [
> > > 7.532 s]
> > > [INFO] REEF Examples on HDInsight ......................... SUCCESS [
> > > 9.213 s]
> > > [INFO] REEF Tang Tint ..................................... SUCCESS [
> > > 8.546 s]
> > > [INFO] REEF Tests ......................................... SUCCESS [
> > > 15.696 s]
> > > [INFO] REEF Website ....................................... SUCCESS [
> > > 1.033 s]
> > > [INFO]
> > > ------------------------------------------------------------
> ------------
> > > [INFO] BUILD SUCCESS
> > > [INFO]
> > > ------------------------------------------------------------
> ------------
> > > [INFO] Total time: 04:54 min
> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > > [INFO] Final Memory: 125M/1238M
> > > [INFO]
> > > ------------------------------------------------------------
> ------------
> > >
> > >
> > > On to bigger and better things :), we should probably update the docs
> to
> > > reflect the current build process subtleties. Will try windows next.
> > >
> > >
> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bg...@gmail.com>
> > wrote:
> > >
> > > > Welcome, Saikat!
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de>
> wrote:
> > > >
> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > > > >
> > > > >> I am a newbie to Apache Reef and am interested in contributing to
> > the
> > > > reef
> > > > >> dev efforts
> > > > >>
> > > > >
> > > > > Welcome!
> > > > >
> > > > > my JIRA id is kanjilal
> > > > >>
> > > > >
> > > > > I have added you to the contributor's list on JIRA. This basically
> > > means
> > > > > that you can self-assign issues to yourself now :)
> > > > >
> > > > > Markus
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Byung-Gon Chun
> > > >
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
Weird, yes I did read that pageand yes I had to do those exact steps that I
described, I haven't run the tests yet but fully suspect that I'll need to
increase the ulimit to enable that. If you do a plain maven build after
checking out the reef code in ubuntu it complains that JAVA_HOME is not
set, also its a good idea to set the maven oriented environment variables
because I highly suspect that in the future we may need to adjust heap
space settings, finally the LD_LIBRARY_PATH is needed I suspect because the
java code is invoking the protoc compiler at some point and in order to do
so it much load some .so files that live in LD_LIBRARY_PATH. Net Net we
should definitely figure out the differences between your and Sergei's
setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not convinced
that the version matters if the major version is the same.
Cheers
On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <ds...@gmail.com> wrote:
> Hello Saikat,
>
> Did you read the documentation on this page
> https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF wiki
> concerning Java on Ubuntu? I added this page after setting up a Linux 16.04
> to build REEF and trading emails with Sergiy on the dev list. Note that I
> do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need to
> change the default for ulimit -n in bash to get the tests to run which is
> also described.
>
> Doug
>
>
>
> On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
>
> > A battle well fought and won, got reef to build successfully on ubuntu
> > linux vm after hours of hacking, fyi here's what I had to do:
> > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc version 2.5)
> > 2) added JAVA_HOME and M2_HOME
> > 3) here's the kicker that's not in the documentation :) (
> > https://github.com/apache/reef/blob/master/lang/java/BUILD.md), had to
> add
> > LD_LIBRARY_PATH environment variable and have it point to /usr/local/lib
> > where the shared library for protobuf is installed
> > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> documentation
> > :) )
> >
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] REEF ............................................... SUCCESS [
> > 4.167 s]
> > [INFO] REEF Dot Net ....................................... SUCCESS [
> > 1.628 s]
> > [INFO] REEF Annotations ................................... SUCCESS [
> > 5.509 s]
> > [INFO] REEF Utils ......................................... SUCCESS [
> > 5.747 s]
> > [INFO] REEF Tang Project .................................. SUCCESS [
> > 0.492 s]
> > [INFO] Tang Test Jar A .................................... SUCCESS [
> > 4.276 s]
> > [INFO] Tang Test Jar B .................................... SUCCESS [
> > 4.186 s]
> > [INFO] Tang Test Jar AB ................................... SUCCESS [
> > 4.376 s]
> > [INFO] Tang Test Jar B conflict A ......................... SUCCESS [
> > 0.440 s]
> > [INFO] REEF Tang .......................................... SUCCESS [
> > 24.779 s]
> > [INFO] REEF Wake Project .................................. SUCCESS [
> > 0.487 s]
> > [INFO] REEF Wake .......................................... SUCCESS [
> > 15.587 s]
> > [INFO] REEF Common ........................................ SUCCESS [
> > 23.343 s]
> > [INFO] REEF Runtime Local ................................. SUCCESS [
> > 8.375 s]
> > [INFO] REEF Applications .................................. SUCCESS [
> > 0.416 s]
> > [INFO] REEF Vortex ........................................ SUCCESS [
> > 11.263 s]
> > [INFO] REEF HTTP Server ................................... SUCCESS [
> > 9.772 s]
> > [INFO] REEF Utils for Hadoop .............................. SUCCESS [
> > 5.881 s]
> > [INFO] REEF Runtime for YARN .............................. SUCCESS [
> > 11.041 s]
> > [INFO] REEF Runtime for HDInsight ......................... SUCCESS [
> > 9.719 s]
> > [INFO] REEF IO ............................................ SUCCESS [
> > 23.729 s]
> > [INFO] REEF Checkpoint .................................... SUCCESS [
> > 5.771 s]
> > [INFO] REEF Bridge Java ................................... SUCCESS [
> > 11.981 s]
> > [INFO] REEF Runtime for multiple runtime scenarios ........ SUCCESS [
> > 7.898 s]
> > [INFO] REEF Bridge (Client) ............................... SUCCESS [
> > 12.242 s]
> > [INFO] REEF Runtime Standalone ............................ SUCCESS [
> > 7.779 s]
> > [INFO] REEF Runtime for Mesos ............................. SUCCESS [
> > 11.103 s]
> > [INFO] REEF Poison ........................................ SUCCESS [
> > 5.384 s]
> > [INFO] REEF Examples ...................................... SUCCESS [
> > 14.313 s]
> > [INFO] REEF Examples CLR .................................. SUCCESS [
> > 7.532 s]
> > [INFO] REEF Examples on HDInsight ......................... SUCCESS [
> > 9.213 s]
> > [INFO] REEF Tang Tint ..................................... SUCCESS [
> > 8.546 s]
> > [INFO] REEF Tests ......................................... SUCCESS [
> > 15.696 s]
> > [INFO] REEF Website ....................................... SUCCESS [
> > 1.033 s]
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD SUCCESS
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 04:54 min
> > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > [INFO] Final Memory: 125M/1238M
> > [INFO]
> > ------------------------------------------------------------------------
> >
> >
> > On to bigger and better things :), we should probably update the docs to
> > reflect the current build process subtleties. Will try windows next.
> >
> >
> > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bg...@gmail.com>
> wrote:
> >
> > > Welcome, Saikat!
> > >
> > >
> > >
> > >
> > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de> wrote:
> > >
> > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > > >
> > > >> I am a newbie to Apache Reef and am interested in contributing to
> the
> > > reef
> > > >> dev efforts
> > > >>
> > > >
> > > > Welcome!
> > > >
> > > > my JIRA id is kanjilal
> > > >>
> > > >
> > > > I have added you to the contributor's list on JIRA. This basically
> > means
> > > > that you can self-assign issues to yourself now :)
> > > >
> > > > Markus
> > > >
> > >
> > >
> > >
> > > --
> > > Byung-Gon Chun
> > >
> >
>
Re: Interested in contributing to reef--newbie
Posted by Douglas Service <ds...@gmail.com>.
Hello Saikat,
Did you read the documentation on this page
https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF wiki
concerning Java on Ubuntu? I added this page after setting up a Linux 16.04
to build REEF and trading emails with Sergiy on the dev list. Note that I
do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need to
change the default for ulimit -n in bash to get the tests to run which is
also described.
Doug
On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sx...@gmail.com> wrote:
> A battle well fought and won, got reef to build successfully on ubuntu
> linux vm after hours of hacking, fyi here's what I had to do:
> 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc version 2.5)
> 2) added JAVA_HOME and M2_HOME
> 3) here's the kicker that's not in the documentation :) (
> https://github.com/apache/reef/blob/master/lang/java/BUILD.md), had to add
> LD_LIBRARY_PATH environment variable and have it point to /usr/local/lib
> where the shared library for protobuf is installed
> 4) had to add JAVA_HOME and M2_HOME to path (also not in the documentation
> :) )
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] REEF ............................................... SUCCESS [
> 4.167 s]
> [INFO] REEF Dot Net ....................................... SUCCESS [
> 1.628 s]
> [INFO] REEF Annotations ................................... SUCCESS [
> 5.509 s]
> [INFO] REEF Utils ......................................... SUCCESS [
> 5.747 s]
> [INFO] REEF Tang Project .................................. SUCCESS [
> 0.492 s]
> [INFO] Tang Test Jar A .................................... SUCCESS [
> 4.276 s]
> [INFO] Tang Test Jar B .................................... SUCCESS [
> 4.186 s]
> [INFO] Tang Test Jar AB ................................... SUCCESS [
> 4.376 s]
> [INFO] Tang Test Jar B conflict A ......................... SUCCESS [
> 0.440 s]
> [INFO] REEF Tang .......................................... SUCCESS [
> 24.779 s]
> [INFO] REEF Wake Project .................................. SUCCESS [
> 0.487 s]
> [INFO] REEF Wake .......................................... SUCCESS [
> 15.587 s]
> [INFO] REEF Common ........................................ SUCCESS [
> 23.343 s]
> [INFO] REEF Runtime Local ................................. SUCCESS [
> 8.375 s]
> [INFO] REEF Applications .................................. SUCCESS [
> 0.416 s]
> [INFO] REEF Vortex ........................................ SUCCESS [
> 11.263 s]
> [INFO] REEF HTTP Server ................................... SUCCESS [
> 9.772 s]
> [INFO] REEF Utils for Hadoop .............................. SUCCESS [
> 5.881 s]
> [INFO] REEF Runtime for YARN .............................. SUCCESS [
> 11.041 s]
> [INFO] REEF Runtime for HDInsight ......................... SUCCESS [
> 9.719 s]
> [INFO] REEF IO ............................................ SUCCESS [
> 23.729 s]
> [INFO] REEF Checkpoint .................................... SUCCESS [
> 5.771 s]
> [INFO] REEF Bridge Java ................................... SUCCESS [
> 11.981 s]
> [INFO] REEF Runtime for multiple runtime scenarios ........ SUCCESS [
> 7.898 s]
> [INFO] REEF Bridge (Client) ............................... SUCCESS [
> 12.242 s]
> [INFO] REEF Runtime Standalone ............................ SUCCESS [
> 7.779 s]
> [INFO] REEF Runtime for Mesos ............................. SUCCESS [
> 11.103 s]
> [INFO] REEF Poison ........................................ SUCCESS [
> 5.384 s]
> [INFO] REEF Examples ...................................... SUCCESS [
> 14.313 s]
> [INFO] REEF Examples CLR .................................. SUCCESS [
> 7.532 s]
> [INFO] REEF Examples on HDInsight ......................... SUCCESS [
> 9.213 s]
> [INFO] REEF Tang Tint ..................................... SUCCESS [
> 8.546 s]
> [INFO] REEF Tests ......................................... SUCCESS [
> 15.696 s]
> [INFO] REEF Website ....................................... SUCCESS [
> 1.033 s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 04:54 min
> [INFO] Finished at: 2017-02-09T01:21:17+00:00
> [INFO] Final Memory: 125M/1238M
> [INFO]
> ------------------------------------------------------------------------
>
>
> On to bigger and better things :), we should probably update the docs to
> reflect the current build process subtleties. Will try windows next.
>
>
> On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
>
> > Welcome, Saikat!
> >
> >
> >
> >
> > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de> wrote:
> >
> > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > >
> > >> I am a newbie to Apache Reef and am interested in contributing to the
> > reef
> > >> dev efforts
> > >>
> > >
> > > Welcome!
> > >
> > > my JIRA id is kanjilal
> > >>
> > >
> > > I have added you to the contributor's list on JIRA. This basically
> means
> > > that you can self-assign issues to yourself now :)
> > >
> > > Markus
> > >
> >
> >
> >
> > --
> > Byung-Gon Chun
> >
>
Re: Interested in contributing to reef--newbie
Posted by Saikat Kanjilal <sx...@gmail.com>.
A battle well fought and won, got reef to build successfully on ubuntu
linux vm after hours of hacking, fyi here's what I had to do:
1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc version 2.5)
2) added JAVA_HOME and M2_HOME
3) here's the kicker that's not in the documentation :) (
https://github.com/apache/reef/blob/master/lang/java/BUILD.md), had to add
LD_LIBRARY_PATH environment variable and have it point to /usr/local/lib
where the shared library for protobuf is installed
4) had to add JAVA_HOME and M2_HOME to path (also not in the documentation
:) )
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] REEF ............................................... SUCCESS [
4.167 s]
[INFO] REEF Dot Net ....................................... SUCCESS [
1.628 s]
[INFO] REEF Annotations ................................... SUCCESS [
5.509 s]
[INFO] REEF Utils ......................................... SUCCESS [
5.747 s]
[INFO] REEF Tang Project .................................. SUCCESS [
0.492 s]
[INFO] Tang Test Jar A .................................... SUCCESS [
4.276 s]
[INFO] Tang Test Jar B .................................... SUCCESS [
4.186 s]
[INFO] Tang Test Jar AB ................................... SUCCESS [
4.376 s]
[INFO] Tang Test Jar B conflict A ......................... SUCCESS [
0.440 s]
[INFO] REEF Tang .......................................... SUCCESS [
24.779 s]
[INFO] REEF Wake Project .................................. SUCCESS [
0.487 s]
[INFO] REEF Wake .......................................... SUCCESS [
15.587 s]
[INFO] REEF Common ........................................ SUCCESS [
23.343 s]
[INFO] REEF Runtime Local ................................. SUCCESS [
8.375 s]
[INFO] REEF Applications .................................. SUCCESS [
0.416 s]
[INFO] REEF Vortex ........................................ SUCCESS [
11.263 s]
[INFO] REEF HTTP Server ................................... SUCCESS [
9.772 s]
[INFO] REEF Utils for Hadoop .............................. SUCCESS [
5.881 s]
[INFO] REEF Runtime for YARN .............................. SUCCESS [
11.041 s]
[INFO] REEF Runtime for HDInsight ......................... SUCCESS [
9.719 s]
[INFO] REEF IO ............................................ SUCCESS [
23.729 s]
[INFO] REEF Checkpoint .................................... SUCCESS [
5.771 s]
[INFO] REEF Bridge Java ................................... SUCCESS [
11.981 s]
[INFO] REEF Runtime for multiple runtime scenarios ........ SUCCESS [
7.898 s]
[INFO] REEF Bridge (Client) ............................... SUCCESS [
12.242 s]
[INFO] REEF Runtime Standalone ............................ SUCCESS [
7.779 s]
[INFO] REEF Runtime for Mesos ............................. SUCCESS [
11.103 s]
[INFO] REEF Poison ........................................ SUCCESS [
5.384 s]
[INFO] REEF Examples ...................................... SUCCESS [
14.313 s]
[INFO] REEF Examples CLR .................................. SUCCESS [
7.532 s]
[INFO] REEF Examples on HDInsight ......................... SUCCESS [
9.213 s]
[INFO] REEF Tang Tint ..................................... SUCCESS [
8.546 s]
[INFO] REEF Tests ......................................... SUCCESS [
15.696 s]
[INFO] REEF Website ....................................... SUCCESS [
1.033 s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 04:54 min
[INFO] Finished at: 2017-02-09T01:21:17+00:00
[INFO] Final Memory: 125M/1238M
[INFO]
------------------------------------------------------------------------
On to bigger and better things :), we should probably update the docs to
reflect the current build process subtleties. Will try windows next.
On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
> Welcome, Saikat!
>
>
>
>
> On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de> wrote:
>
> > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> >
> >> I am a newbie to Apache Reef and am interested in contributing to the
> reef
> >> dev efforts
> >>
> >
> > Welcome!
> >
> > my JIRA id is kanjilal
> >>
> >
> > I have added you to the contributor's list on JIRA. This basically means
> > that you can self-assign issues to yourself now :)
> >
> > Markus
> >
>
>
>
> --
> Byung-Gon Chun
>
Re: Interested in contributing to reef--newbie
Posted by Byung-Gon Chun <bg...@gmail.com>.
Welcome, Saikat!
On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <ma...@weimo.de> wrote:
> On 2017-02-08 11:19, Saikat Kanjilal wrote:
>
>> I am a newbie to Apache Reef and am interested in contributing to the reef
>> dev efforts
>>
>
> Welcome!
>
> my JIRA id is kanjilal
>>
>
> I have added you to the contributor's list on JIRA. This basically means
> that you can self-assign issues to yourself now :)
>
> Markus
>
--
Byung-Gon Chun
Re: Interested in contributing to reef--newbie
Posted by Markus Weimer <ma...@weimo.de>.
On 2017-02-08 11:19, Saikat Kanjilal wrote:
> I am a newbie to Apache Reef and am interested in contributing to the reef
> dev efforts
Welcome!
> my JIRA id is kanjilal
I have added you to the contributor's list on JIRA. This basically means
that you can self-assign issues to yourself now :)
Markus