You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@myriad.apache.org by Javi Roman <jr...@gmail.com> on 2018/04/14 09:18:54 UTC

Apache Myriad Project Status

Hi all!

This is an e-mail for tracking the state of Apache Myriad Project.
Many things are happening and I am happy to say the project is
rebooting slowly but strongly. The following is a list of achievements
right now:

1. We have got a Project Roadmap [1] that we are accomplishing happily.
2. We have a chat channel at [2]. Not much activity yet (only 7 users
right now) but this is only the beginning.
3. This list is getting activity again with new active users.
4. A separate document [3] for tracking up the unlocking of JIRA
issues and pending PRs. Special thanks to Alvaro for the initiative
and Juan P. for working in this necessary housekeeping.
5. We have already a nice local development environment based on
Vagrant for Apache Mesos, and for DC/OS community platform.
6. We have new activity at Apache Myriad Twitter account [4]. We are
trying to publish at least one post a day. We have to create Apache
Myriad own content for creating really interesting Twitter posts.

No ready yet, but planning:

1. A set of articles in order to get new users. This is the planning:

Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot

This article explains the state of the project and sets up the targets
for the new releases. We need a new release (0.3.0) in order to follow
the open-source motto "release early, release often".

Article 2 - Apache Myriad Development Environment Based on Apache Mesos

This article is a way to get new users as easily as possible with an
local environment ready for hacking.

Article 3 - Apache Myriad Development Environment Based on Apache Mesos

This article explains a way for developing Apache Myriad using Docker
and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
executed in production at some time will be at DC/OS.

Article 4 - Apache Mesos Data Services a Different Approach

This is a more advance article explaining a different way of data
service development on Apache Mesos. Probably the current approach is
to create data services (such as Kafka, Spark, Elastic ...) based on
Apache Mesos Frameworks. The focus of development is to create native
frameworks for each technology. Mesosphere does a very good work on
that direction with DC/OS SDK (dcos-commons).

The different approach explained in this article is to shift the
development focus towards only one Apache Mesos Framework to maintains
(Apache Myriad) and create applications based on YARN by means of
Apache Slider (a "kind" of YARN SDK). This is really ambitious,
however really interesting point of view from my perspective.

2. It's the time for planning the new release (0.3.0). We have to
discuss the minimal features to include for a new release. This is
really important for the next months.

We have a lot work to do, however I really guess the risk of retiring
this podling is far way right now.

Please, feel free to comment, feedback is welcome!

[1] https://goo.gl/xtD5oT
[2] https://gitter.im/apache-myriad/dev
[3]  https://goo.gl/u7RMFY
[4] https://twitter.com/apachemyriad
--
Javi Roman

Twitter: @javiromanrh
GitHub: github.com/javiroman
Linkedin: es.linkedin.com/in/javiroman
Big Data Blog: dataintensive.info

Re: Apache Myriad Project Status

Posted by Ken Sipe <ke...@mesosphere.io>.
I’m not sure if that checklist is still “officially” used… but yes.    The main criteria is following the layout of version-3.x.   Making sure to use the resources.json for any external links (docker or tar balls)
There is a build script:  https://github.com/mesosphere/universe/blob/version-3.x/scripts/build.sh <https://github.com/mesosphere/universe/blob/version-3.x/scripts/build.sh> to confirm some compliance.
I would focus on the readme at:  https://github.com/mesosphere/universe/ <https://github.com/mesosphere/universe/>

Ken 


> On Apr 17, 2018, at 12:46 AM, Javi Roman <jr...@gmail.com> wrote:
> 
> Ken,
> 
> Regarding Myriad at DC/Os are these instructions still valid?
> 
> https://bit.ly/2qElS7n
> 
> --
> Javi Roman
> 
> Twitter: @javiromanrh
> GitHub: github.com/javiroman
> Linkedin: es.linkedin.com/in/javiroman
> Big Data Blog: dataintensive.info
> 
> 
> On Mon, Apr 16, 2018 at 7:03 PM, Javi Roman <jr...@gmail.com> wrote:
>> On Mon, Apr 16, 2018 at 6:58 PM, Juan P <jp...@gmail.com> wrote:
>>> Hi, congratulations for the work and thank you very much. I think Myriad's
>>> rebound is a reality.
>>> 
>>> - In the list of articles, we could add one on the analysis of a dataset
>>> (Titanic) with Spark. Making the attempt to establish a reference
>>> architecture for analysis: SYM2 (Spark-Yarn-Myriad-Mesos)
>> 
>> Great idea, interesting acronym ;-)
>> 
>>> 
>>> - To release the version, we can generate a document with proposals. For me
>>> it would be interesting to upload the Mesos version as a first
>>> approximation. This would allow us to deploy with DCOS and the Mesos
>>> version that is installed.
>>> 
>> 
>> Totally agree, one of the first steps is test with Mesos 1.5
>> 
>>> Now I'm working on reviewing the old PRs to see what we can take advantage
>>> of, then I intend to regularize Jira's bugs and then start with the new
>>> functionality ...
>>> 
>>> 
>>> Thank you very much again
>> 
>> Many thanks for your contributions!
>> 
>>> 
>>> 
>>> On 15 April 2018 at 20:39, Javi Roman <jr...@gmail.com> wrote:
>>> 
>>>> Hi Ken,
>>>> 
>>>> Good news, slowly we will be able to evolve this interesting project. The
>>>> integration with DC/OS is a guarantee of framework success.
>>>> 
>>>> It would be interesting to know the requirements for getting Apache
>>>> Myriad into the community universe.
>>>> 
>>>> Many thanks for your help!
>>>> --
>>>> Javi Roman
>>>> 
>>>> Twitter: @javiromanrh
>>>> GitHub: github.com/javiroman
>>>> Linkedin: es.linkedin.com/in/javiroman
>>>> Big Data Blog: dataintensive.info
>>>> 
>>>> 
>>>> On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe <ke...@mesosphere.io> wrote:
>>>>> Javi,
>>>>> 
>>>>> Well done and Nice work!
>>>>> 
>>>>> I am one of the original Apache committers on Myriad… however I have
>>>> been MIA for a long time.
>>>>> 
>>>>> I am willing and interested in helping.   At this time I am not able to
>>>> offer up a lot of time but will help where I can.
>>>>> As a part of Mesosphere,   I spent some time being the gatekeeper to the
>>>> DC/OS universe, have written a number CLI subcommands and system
>>>> integration tests and can help in those areas.
>>>>> 
>>>>> Additional areas I will make time for if needed/wanted:
>>>>> 1. PR reviews (and commits)
>>>>> 2. Getting into DCOS universe
>>>>> 3. Help with articles listed below (in particular 3 & 4)
>>>>> 
>>>>> Ken
>>>>> 
>>>>> 
>>>>>> On Apr 14, 2018, at 4:18 AM, Javi Roman <jr...@gmail.com>
>>>> wrote:
>>>>>> 
>>>>>> Hi all!
>>>>>> 
>>>>>> This is an e-mail for tracking the state of Apache Myriad Project.
>>>>>> Many things are happening and I am happy to say the project is
>>>>>> rebooting slowly but strongly. The following is a list of achievements
>>>>>> right now:
>>>>>> 
>>>>>> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
>>>>>> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
>>>>>> right now) but this is only the beginning.
>>>>>> 3. This list is getting activity again with new active users.
>>>>>> 4. A separate document [3] for tracking up the unlocking of JIRA
>>>>>> issues and pending PRs. Special thanks to Alvaro for the initiative
>>>>>> and Juan P. for working in this necessary housekeeping.
>>>>>> 5. We have already a nice local development environment based on
>>>>>> Vagrant for Apache Mesos, and for DC/OS community platform.
>>>>>> 6. We have new activity at Apache Myriad Twitter account [4]. We are
>>>>>> trying to publish at least one post a day. We have to create Apache
>>>>>> Myriad own content for creating really interesting Twitter posts.
>>>>>> 
>>>>>> No ready yet, but planning:
>>>>>> 
>>>>>> 1. A set of articles in order to get new users. This is the planning:
>>>>>> 
>>>>>> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
>>>>>> 
>>>>>> This article explains the state of the project and sets up the targets
>>>>>> for the new releases. We need a new release (0.3.0) in order to follow
>>>>>> the open-source motto "release early, release often".
>>>>>> 
>>>>>> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
>>>>>> 
>>>>>> This article is a way to get new users as easily as possible with an
>>>>>> local environment ready for hacking.
>>>>>> 
>>>>>> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
>>>>>> 
>>>>>> This article explains a way for developing Apache Myriad using Docker
>>>>>> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
>>>>>> executed in production at some time will be at DC/OS.
>>>>>> 
>>>>>> Article 4 - Apache Mesos Data Services a Different Approach
>>>>>> 
>>>>>> This is a more advance article explaining a different way of data
>>>>>> service development on Apache Mesos. Probably the current approach is
>>>>>> to create data services (such as Kafka, Spark, Elastic ...) based on
>>>>>> Apache Mesos Frameworks. The focus of development is to create native
>>>>>> frameworks for each technology. Mesosphere does a very good work on
>>>>>> that direction with DC/OS SDK (dcos-commons).
>>>>>> 
>>>>>> The different approach explained in this article is to shift the
>>>>>> development focus towards only one Apache Mesos Framework to maintains
>>>>>> (Apache Myriad) and create applications based on YARN by means of
>>>>>> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
>>>>>> however really interesting point of view from my perspective.
>>>>>> 
>>>>>> 2. It's the time for planning the new release (0.3.0). We have to
>>>>>> discuss the minimal features to include for a new release. This is
>>>>>> really important for the next months.
>>>>>> 
>>>>>> We have a lot work to do, however I really guess the risk of retiring
>>>>>> this podling is far way right now.
>>>>>> 
>>>>>> Please, feel free to comment, feedback is welcome!
>>>>>> 
>>>>>> [1] https://goo.gl/xtD5oT
>>>>>> [2] https://gitter.im/apache-myriad/dev
>>>>>> [3]  https://goo.gl/u7RMFY
>>>>>> [4] https://twitter.com/apachemyriad
>>>>>> --
>>>>>> Javi Roman
>>>>>> 
>>>>>> Twitter: @javiromanrh
>>>>>> GitHub: github.com/javiroman
>>>>>> Linkedin: es.linkedin.com/in/javiroman
>>>>>> Big Data Blog: dataintensive.info
>>>>> 
>>>> 


Re: Apache Myriad Project Status

Posted by Javi Roman <jr...@gmail.com>.
Ken,

Regarding Myriad at DC/Os are these instructions still valid?

https://bit.ly/2qElS7n

--
Javi Roman

Twitter: @javiromanrh
GitHub: github.com/javiroman
Linkedin: es.linkedin.com/in/javiroman
Big Data Blog: dataintensive.info


On Mon, Apr 16, 2018 at 7:03 PM, Javi Roman <jr...@gmail.com> wrote:
> On Mon, Apr 16, 2018 at 6:58 PM, Juan P <jp...@gmail.com> wrote:
>> Hi, congratulations for the work and thank you very much. I think Myriad's
>> rebound is a reality.
>>
>> - In the list of articles, we could add one on the analysis of a dataset
>> (Titanic) with Spark. Making the attempt to establish a reference
>> architecture for analysis: SYM2 (Spark-Yarn-Myriad-Mesos)
>
> Great idea, interesting acronym ;-)
>
>>
>> - To release the version, we can generate a document with proposals. For me
>> it would be interesting to upload the Mesos version as a first
>> approximation. This would allow us to deploy with DCOS and the Mesos
>> version that is installed.
>>
>
> Totally agree, one of the first steps is test with Mesos 1.5
>
>> Now I'm working on reviewing the old PRs to see what we can take advantage
>> of, then I intend to regularize Jira's bugs and then start with the new
>> functionality ...
>>
>>
>> Thank you very much again
>
> Many thanks for your contributions!
>
>>
>>
>> On 15 April 2018 at 20:39, Javi Roman <jr...@gmail.com> wrote:
>>
>>> Hi Ken,
>>>
>>> Good news, slowly we will be able to evolve this interesting project. The
>>> integration with DC/OS is a guarantee of framework success.
>>>
>>> It would be interesting to know the requirements for getting Apache
>>> Myriad into the community universe.
>>>
>>> Many thanks for your help!
>>> --
>>> Javi Roman
>>>
>>> Twitter: @javiromanrh
>>> GitHub: github.com/javiroman
>>> Linkedin: es.linkedin.com/in/javiroman
>>> Big Data Blog: dataintensive.info
>>>
>>>
>>> On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe <ke...@mesosphere.io> wrote:
>>> > Javi,
>>> >
>>> > Well done and Nice work!
>>> >
>>> > I am one of the original Apache committers on Myriad… however I have
>>> been MIA for a long time.
>>> >
>>> > I am willing and interested in helping.   At this time I am not able to
>>> offer up a lot of time but will help where I can.
>>> > As a part of Mesosphere,   I spent some time being the gatekeeper to the
>>> DC/OS universe, have written a number CLI subcommands and system
>>> integration tests and can help in those areas.
>>> >
>>> > Additional areas I will make time for if needed/wanted:
>>> > 1. PR reviews (and commits)
>>> > 2. Getting into DCOS universe
>>> > 3. Help with articles listed below (in particular 3 & 4)
>>> >
>>> > Ken
>>> >
>>> >
>>> >> On Apr 14, 2018, at 4:18 AM, Javi Roman <jr...@gmail.com>
>>> wrote:
>>> >>
>>> >> Hi all!
>>> >>
>>> >> This is an e-mail for tracking the state of Apache Myriad Project.
>>> >> Many things are happening and I am happy to say the project is
>>> >> rebooting slowly but strongly. The following is a list of achievements
>>> >> right now:
>>> >>
>>> >> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
>>> >> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
>>> >> right now) but this is only the beginning.
>>> >> 3. This list is getting activity again with new active users.
>>> >> 4. A separate document [3] for tracking up the unlocking of JIRA
>>> >> issues and pending PRs. Special thanks to Alvaro for the initiative
>>> >> and Juan P. for working in this necessary housekeeping.
>>> >> 5. We have already a nice local development environment based on
>>> >> Vagrant for Apache Mesos, and for DC/OS community platform.
>>> >> 6. We have new activity at Apache Myriad Twitter account [4]. We are
>>> >> trying to publish at least one post a day. We have to create Apache
>>> >> Myriad own content for creating really interesting Twitter posts.
>>> >>
>>> >> No ready yet, but planning:
>>> >>
>>> >> 1. A set of articles in order to get new users. This is the planning:
>>> >>
>>> >> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
>>> >>
>>> >> This article explains the state of the project and sets up the targets
>>> >> for the new releases. We need a new release (0.3.0) in order to follow
>>> >> the open-source motto "release early, release often".
>>> >>
>>> >> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
>>> >>
>>> >> This article is a way to get new users as easily as possible with an
>>> >> local environment ready for hacking.
>>> >>
>>> >> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
>>> >>
>>> >> This article explains a way for developing Apache Myriad using Docker
>>> >> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
>>> >> executed in production at some time will be at DC/OS.
>>> >>
>>> >> Article 4 - Apache Mesos Data Services a Different Approach
>>> >>
>>> >> This is a more advance article explaining a different way of data
>>> >> service development on Apache Mesos. Probably the current approach is
>>> >> to create data services (such as Kafka, Spark, Elastic ...) based on
>>> >> Apache Mesos Frameworks. The focus of development is to create native
>>> >> frameworks for each technology. Mesosphere does a very good work on
>>> >> that direction with DC/OS SDK (dcos-commons).
>>> >>
>>> >> The different approach explained in this article is to shift the
>>> >> development focus towards only one Apache Mesos Framework to maintains
>>> >> (Apache Myriad) and create applications based on YARN by means of
>>> >> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
>>> >> however really interesting point of view from my perspective.
>>> >>
>>> >> 2. It's the time for planning the new release (0.3.0). We have to
>>> >> discuss the minimal features to include for a new release. This is
>>> >> really important for the next months.
>>> >>
>>> >> We have a lot work to do, however I really guess the risk of retiring
>>> >> this podling is far way right now.
>>> >>
>>> >> Please, feel free to comment, feedback is welcome!
>>> >>
>>> >> [1] https://goo.gl/xtD5oT
>>> >> [2] https://gitter.im/apache-myriad/dev
>>> >> [3]  https://goo.gl/u7RMFY
>>> >> [4] https://twitter.com/apachemyriad
>>> >> --
>>> >> Javi Roman
>>> >>
>>> >> Twitter: @javiromanrh
>>> >> GitHub: github.com/javiroman
>>> >> Linkedin: es.linkedin.com/in/javiroman
>>> >> Big Data Blog: dataintensive.info
>>> >
>>>

Re: Apache Myriad Project Status

Posted by Javi Roman <jr...@gmail.com>.
On Mon, Apr 16, 2018 at 6:58 PM, Juan P <jp...@gmail.com> wrote:
> Hi, congratulations for the work and thank you very much. I think Myriad's
> rebound is a reality.
>
> - In the list of articles, we could add one on the analysis of a dataset
> (Titanic) with Spark. Making the attempt to establish a reference
> architecture for analysis: SYM2 (Spark-Yarn-Myriad-Mesos)

Great idea, interesting acronym ;-)

>
> - To release the version, we can generate a document with proposals. For me
> it would be interesting to upload the Mesos version as a first
> approximation. This would allow us to deploy with DCOS and the Mesos
> version that is installed.
>

Totally agree, one of the first steps is test with Mesos 1.5

> Now I'm working on reviewing the old PRs to see what we can take advantage
> of, then I intend to regularize Jira's bugs and then start with the new
> functionality ...
>
>
> Thank you very much again

Many thanks for your contributions!

>
>
> On 15 April 2018 at 20:39, Javi Roman <jr...@gmail.com> wrote:
>
>> Hi Ken,
>>
>> Good news, slowly we will be able to evolve this interesting project. The
>> integration with DC/OS is a guarantee of framework success.
>>
>> It would be interesting to know the requirements for getting Apache
>> Myriad into the community universe.
>>
>> Many thanks for your help!
>> --
>> Javi Roman
>>
>> Twitter: @javiromanrh
>> GitHub: github.com/javiroman
>> Linkedin: es.linkedin.com/in/javiroman
>> Big Data Blog: dataintensive.info
>>
>>
>> On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe <ke...@mesosphere.io> wrote:
>> > Javi,
>> >
>> > Well done and Nice work!
>> >
>> > I am one of the original Apache committers on Myriad… however I have
>> been MIA for a long time.
>> >
>> > I am willing and interested in helping.   At this time I am not able to
>> offer up a lot of time but will help where I can.
>> > As a part of Mesosphere,   I spent some time being the gatekeeper to the
>> DC/OS universe, have written a number CLI subcommands and system
>> integration tests and can help in those areas.
>> >
>> > Additional areas I will make time for if needed/wanted:
>> > 1. PR reviews (and commits)
>> > 2. Getting into DCOS universe
>> > 3. Help with articles listed below (in particular 3 & 4)
>> >
>> > Ken
>> >
>> >
>> >> On Apr 14, 2018, at 4:18 AM, Javi Roman <jr...@gmail.com>
>> wrote:
>> >>
>> >> Hi all!
>> >>
>> >> This is an e-mail for tracking the state of Apache Myriad Project.
>> >> Many things are happening and I am happy to say the project is
>> >> rebooting slowly but strongly. The following is a list of achievements
>> >> right now:
>> >>
>> >> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
>> >> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
>> >> right now) but this is only the beginning.
>> >> 3. This list is getting activity again with new active users.
>> >> 4. A separate document [3] for tracking up the unlocking of JIRA
>> >> issues and pending PRs. Special thanks to Alvaro for the initiative
>> >> and Juan P. for working in this necessary housekeeping.
>> >> 5. We have already a nice local development environment based on
>> >> Vagrant for Apache Mesos, and for DC/OS community platform.
>> >> 6. We have new activity at Apache Myriad Twitter account [4]. We are
>> >> trying to publish at least one post a day. We have to create Apache
>> >> Myriad own content for creating really interesting Twitter posts.
>> >>
>> >> No ready yet, but planning:
>> >>
>> >> 1. A set of articles in order to get new users. This is the planning:
>> >>
>> >> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
>> >>
>> >> This article explains the state of the project and sets up the targets
>> >> for the new releases. We need a new release (0.3.0) in order to follow
>> >> the open-source motto "release early, release often".
>> >>
>> >> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
>> >>
>> >> This article is a way to get new users as easily as possible with an
>> >> local environment ready for hacking.
>> >>
>> >> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
>> >>
>> >> This article explains a way for developing Apache Myriad using Docker
>> >> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
>> >> executed in production at some time will be at DC/OS.
>> >>
>> >> Article 4 - Apache Mesos Data Services a Different Approach
>> >>
>> >> This is a more advance article explaining a different way of data
>> >> service development on Apache Mesos. Probably the current approach is
>> >> to create data services (such as Kafka, Spark, Elastic ...) based on
>> >> Apache Mesos Frameworks. The focus of development is to create native
>> >> frameworks for each technology. Mesosphere does a very good work on
>> >> that direction with DC/OS SDK (dcos-commons).
>> >>
>> >> The different approach explained in this article is to shift the
>> >> development focus towards only one Apache Mesos Framework to maintains
>> >> (Apache Myriad) and create applications based on YARN by means of
>> >> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
>> >> however really interesting point of view from my perspective.
>> >>
>> >> 2. It's the time for planning the new release (0.3.0). We have to
>> >> discuss the minimal features to include for a new release. This is
>> >> really important for the next months.
>> >>
>> >> We have a lot work to do, however I really guess the risk of retiring
>> >> this podling is far way right now.
>> >>
>> >> Please, feel free to comment, feedback is welcome!
>> >>
>> >> [1] https://goo.gl/xtD5oT
>> >> [2] https://gitter.im/apache-myriad/dev
>> >> [3]  https://goo.gl/u7RMFY
>> >> [4] https://twitter.com/apachemyriad
>> >> --
>> >> Javi Roman
>> >>
>> >> Twitter: @javiromanrh
>> >> GitHub: github.com/javiroman
>> >> Linkedin: es.linkedin.com/in/javiroman
>> >> Big Data Blog: dataintensive.info
>> >
>>

Re: Apache Myriad Project Status

Posted by Juan P <jp...@gmail.com>.
Hi, congratulations for the work and thank you very much. I think Myriad's
rebound is a reality.

- In the list of articles, we could add one on the analysis of a dataset
(Titanic) with Spark. Making the attempt to establish a reference
architecture for analysis: SYM2 (Spark-Yarn-Myriad-Mesos)

- To release the version, we can generate a document with proposals. For me
it would be interesting to upload the Mesos version as a first
approximation. This would allow us to deploy with DCOS and the Mesos
version that is installed.

Now I'm working on reviewing the old PRs to see what we can take advantage
of, then I intend to regularize Jira's bugs and then start with the new
functionality ...


Thank you very much again


On 15 April 2018 at 20:39, Javi Roman <jr...@gmail.com> wrote:

> Hi Ken,
>
> Good news, slowly we will be able to evolve this interesting project. The
> integration with DC/OS is a guarantee of framework success.
>
> It would be interesting to know the requirements for getting Apache
> Myriad into the community universe.
>
> Many thanks for your help!
> --
> Javi Roman
>
> Twitter: @javiromanrh
> GitHub: github.com/javiroman
> Linkedin: es.linkedin.com/in/javiroman
> Big Data Blog: dataintensive.info
>
>
> On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe <ke...@mesosphere.io> wrote:
> > Javi,
> >
> > Well done and Nice work!
> >
> > I am one of the original Apache committers on Myriad… however I have
> been MIA for a long time.
> >
> > I am willing and interested in helping.   At this time I am not able to
> offer up a lot of time but will help where I can.
> > As a part of Mesosphere,   I spent some time being the gatekeeper to the
> DC/OS universe, have written a number CLI subcommands and system
> integration tests and can help in those areas.
> >
> > Additional areas I will make time for if needed/wanted:
> > 1. PR reviews (and commits)
> > 2. Getting into DCOS universe
> > 3. Help with articles listed below (in particular 3 & 4)
> >
> > Ken
> >
> >
> >> On Apr 14, 2018, at 4:18 AM, Javi Roman <jr...@gmail.com>
> wrote:
> >>
> >> Hi all!
> >>
> >> This is an e-mail for tracking the state of Apache Myriad Project.
> >> Many things are happening and I am happy to say the project is
> >> rebooting slowly but strongly. The following is a list of achievements
> >> right now:
> >>
> >> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
> >> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
> >> right now) but this is only the beginning.
> >> 3. This list is getting activity again with new active users.
> >> 4. A separate document [3] for tracking up the unlocking of JIRA
> >> issues and pending PRs. Special thanks to Alvaro for the initiative
> >> and Juan P. for working in this necessary housekeeping.
> >> 5. We have already a nice local development environment based on
> >> Vagrant for Apache Mesos, and for DC/OS community platform.
> >> 6. We have new activity at Apache Myriad Twitter account [4]. We are
> >> trying to publish at least one post a day. We have to create Apache
> >> Myriad own content for creating really interesting Twitter posts.
> >>
> >> No ready yet, but planning:
> >>
> >> 1. A set of articles in order to get new users. This is the planning:
> >>
> >> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
> >>
> >> This article explains the state of the project and sets up the targets
> >> for the new releases. We need a new release (0.3.0) in order to follow
> >> the open-source motto "release early, release often".
> >>
> >> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
> >>
> >> This article is a way to get new users as easily as possible with an
> >> local environment ready for hacking.
> >>
> >> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
> >>
> >> This article explains a way for developing Apache Myriad using Docker
> >> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
> >> executed in production at some time will be at DC/OS.
> >>
> >> Article 4 - Apache Mesos Data Services a Different Approach
> >>
> >> This is a more advance article explaining a different way of data
> >> service development on Apache Mesos. Probably the current approach is
> >> to create data services (such as Kafka, Spark, Elastic ...) based on
> >> Apache Mesos Frameworks. The focus of development is to create native
> >> frameworks for each technology. Mesosphere does a very good work on
> >> that direction with DC/OS SDK (dcos-commons).
> >>
> >> The different approach explained in this article is to shift the
> >> development focus towards only one Apache Mesos Framework to maintains
> >> (Apache Myriad) and create applications based on YARN by means of
> >> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
> >> however really interesting point of view from my perspective.
> >>
> >> 2. It's the time for planning the new release (0.3.0). We have to
> >> discuss the minimal features to include for a new release. This is
> >> really important for the next months.
> >>
> >> We have a lot work to do, however I really guess the risk of retiring
> >> this podling is far way right now.
> >>
> >> Please, feel free to comment, feedback is welcome!
> >>
> >> [1] https://goo.gl/xtD5oT
> >> [2] https://gitter.im/apache-myriad/dev
> >> [3]  https://goo.gl/u7RMFY
> >> [4] https://twitter.com/apachemyriad
> >> --
> >> Javi Roman
> >>
> >> Twitter: @javiromanrh
> >> GitHub: github.com/javiroman
> >> Linkedin: es.linkedin.com/in/javiroman
> >> Big Data Blog: dataintensive.info
> >
>

Re: Apache Myriad Project Status

Posted by Javi Roman <jr...@gmail.com>.
Hi Ken,

Good news, slowly we will be able to evolve this interesting project. The
integration with DC/OS is a guarantee of framework success.

It would be interesting to know the requirements for getting Apache
Myriad into the community universe.

Many thanks for your help!
--
Javi Roman

Twitter: @javiromanrh
GitHub: github.com/javiroman
Linkedin: es.linkedin.com/in/javiroman
Big Data Blog: dataintensive.info


On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe <ke...@mesosphere.io> wrote:
> Javi,
>
> Well done and Nice work!
>
> I am one of the original Apache committers on Myriad… however I have been MIA for a long time.
>
> I am willing and interested in helping.   At this time I am not able to offer up a lot of time but will help where I can.
> As a part of Mesosphere,   I spent some time being the gatekeeper to the DC/OS universe, have written a number CLI subcommands and system integration tests and can help in those areas.
>
> Additional areas I will make time for if needed/wanted:
> 1. PR reviews (and commits)
> 2. Getting into DCOS universe
> 3. Help with articles listed below (in particular 3 & 4)
>
> Ken
>
>
>> On Apr 14, 2018, at 4:18 AM, Javi Roman <jr...@gmail.com> wrote:
>>
>> Hi all!
>>
>> This is an e-mail for tracking the state of Apache Myriad Project.
>> Many things are happening and I am happy to say the project is
>> rebooting slowly but strongly. The following is a list of achievements
>> right now:
>>
>> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
>> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
>> right now) but this is only the beginning.
>> 3. This list is getting activity again with new active users.
>> 4. A separate document [3] for tracking up the unlocking of JIRA
>> issues and pending PRs. Special thanks to Alvaro for the initiative
>> and Juan P. for working in this necessary housekeeping.
>> 5. We have already a nice local development environment based on
>> Vagrant for Apache Mesos, and for DC/OS community platform.
>> 6. We have new activity at Apache Myriad Twitter account [4]. We are
>> trying to publish at least one post a day. We have to create Apache
>> Myriad own content for creating really interesting Twitter posts.
>>
>> No ready yet, but planning:
>>
>> 1. A set of articles in order to get new users. This is the planning:
>>
>> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
>>
>> This article explains the state of the project and sets up the targets
>> for the new releases. We need a new release (0.3.0) in order to follow
>> the open-source motto "release early, release often".
>>
>> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
>>
>> This article is a way to get new users as easily as possible with an
>> local environment ready for hacking.
>>
>> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
>>
>> This article explains a way for developing Apache Myriad using Docker
>> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
>> executed in production at some time will be at DC/OS.
>>
>> Article 4 - Apache Mesos Data Services a Different Approach
>>
>> This is a more advance article explaining a different way of data
>> service development on Apache Mesos. Probably the current approach is
>> to create data services (such as Kafka, Spark, Elastic ...) based on
>> Apache Mesos Frameworks. The focus of development is to create native
>> frameworks for each technology. Mesosphere does a very good work on
>> that direction with DC/OS SDK (dcos-commons).
>>
>> The different approach explained in this article is to shift the
>> development focus towards only one Apache Mesos Framework to maintains
>> (Apache Myriad) and create applications based on YARN by means of
>> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
>> however really interesting point of view from my perspective.
>>
>> 2. It's the time for planning the new release (0.3.0). We have to
>> discuss the minimal features to include for a new release. This is
>> really important for the next months.
>>
>> We have a lot work to do, however I really guess the risk of retiring
>> this podling is far way right now.
>>
>> Please, feel free to comment, feedback is welcome!
>>
>> [1] https://goo.gl/xtD5oT
>> [2] https://gitter.im/apache-myriad/dev
>> [3]  https://goo.gl/u7RMFY
>> [4] https://twitter.com/apachemyriad
>> --
>> Javi Roman
>>
>> Twitter: @javiromanrh
>> GitHub: github.com/javiroman
>> Linkedin: es.linkedin.com/in/javiroman
>> Big Data Blog: dataintensive.info
>

Re: Apache Myriad Project Status

Posted by Ken Sipe <ke...@mesosphere.io>.
Javi,

Well done and Nice work!  

I am one of the original Apache committers on Myriad… however I have been MIA for a long time.

I am willing and interested in helping.   At this time I am not able to offer up a lot of time but will help where I can.
As a part of Mesosphere,   I spent some time being the gatekeeper to the DC/OS universe, have written a number CLI subcommands and system integration tests and can help in those areas.

Additional areas I will make time for if needed/wanted:
1. PR reviews (and commits)
2. Getting into DCOS universe
3. Help with articles listed below (in particular 3 & 4)

Ken 


> On Apr 14, 2018, at 4:18 AM, Javi Roman <jr...@gmail.com> wrote:
> 
> Hi all!
> 
> This is an e-mail for tracking the state of Apache Myriad Project.
> Many things are happening and I am happy to say the project is
> rebooting slowly but strongly. The following is a list of achievements
> right now:
> 
> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
> right now) but this is only the beginning.
> 3. This list is getting activity again with new active users.
> 4. A separate document [3] for tracking up the unlocking of JIRA
> issues and pending PRs. Special thanks to Alvaro for the initiative
> and Juan P. for working in this necessary housekeeping.
> 5. We have already a nice local development environment based on
> Vagrant for Apache Mesos, and for DC/OS community platform.
> 6. We have new activity at Apache Myriad Twitter account [4]. We are
> trying to publish at least one post a day. We have to create Apache
> Myriad own content for creating really interesting Twitter posts.
> 
> No ready yet, but planning:
> 
> 1. A set of articles in order to get new users. This is the planning:
> 
> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
> 
> This article explains the state of the project and sets up the targets
> for the new releases. We need a new release (0.3.0) in order to follow
> the open-source motto "release early, release often".
> 
> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
> 
> This article is a way to get new users as easily as possible with an
> local environment ready for hacking.
> 
> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
> 
> This article explains a way for developing Apache Myriad using Docker
> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
> executed in production at some time will be at DC/OS.
> 
> Article 4 - Apache Mesos Data Services a Different Approach
> 
> This is a more advance article explaining a different way of data
> service development on Apache Mesos. Probably the current approach is
> to create data services (such as Kafka, Spark, Elastic ...) based on
> Apache Mesos Frameworks. The focus of development is to create native
> frameworks for each technology. Mesosphere does a very good work on
> that direction with DC/OS SDK (dcos-commons).
> 
> The different approach explained in this article is to shift the
> development focus towards only one Apache Mesos Framework to maintains
> (Apache Myriad) and create applications based on YARN by means of
> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
> however really interesting point of view from my perspective.
> 
> 2. It's the time for planning the new release (0.3.0). We have to
> discuss the minimal features to include for a new release. This is
> really important for the next months.
> 
> We have a lot work to do, however I really guess the risk of retiring
> this podling is far way right now.
> 
> Please, feel free to comment, feedback is welcome!
> 
> [1] https://goo.gl/xtD5oT
> [2] https://gitter.im/apache-myriad/dev
> [3]  https://goo.gl/u7RMFY
> [4] https://twitter.com/apachemyriad
> --
> Javi Roman
> 
> Twitter: @javiromanrh
> GitHub: github.com/javiroman
> Linkedin: es.linkedin.com/in/javiroman
> Big Data Blog: dataintensive.info