You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by Arvind Prabhakar <ar...@apache.org> on 2014/09/26 20:06:44 UTC
Re: What Source/Sink would you want next?
(cross-posting this to dev@)
While I do not speak for the availability of other committers of the
project, I would like to spend sometime with the contributors to help
identify what are the most important needs of the project, and see how best
we can get those committed into the codebase.
Santiago (and others who would like to contribute) - please go ahead and
create the necessary Jiras if they do not exist already, and invite the
community to vote on those. That way we can prioritize the review and
commit for functionality that is aligned with community requirements.
Regards,
Arvind Prabhakar
On Fri, Sep 26, 2014 at 5:13 AM, jean garutti <la...@yahoo.fr> wrote:
> hi
> This seems to be great.
> I'll wait to have the 'production ready' flag for ELS mapping patch.
> I think more effort should be done to have this sink more configurable
> like what we can do with logstash.
>
> anyway it's nice to share your development to the community
> i'd love to have the mongodb sink packaged in the official flume release.
>
> jean
>
>
> Le Jeudi 25 septembre 2014 9h48, Santiago Mola <sm...@stratio.com> a
> écrit :
>
>
> Hi Jean,
>
> 2014-09-24 22:44 GMT+02:00 Jean <la...@yahoo.fr>:
>
> A solid mongodb source would be Nice.
>
>
> Definitely!
>
>
> I wish the same for elasticsearch sink where we could specify the mapping
> for the headers instead of sending everything as a string
>
>
> We have a serializer that creates mappings for ElasticSearch [1]. It is
> not ready for production [2] but it is one of our priorities.
>
> [1]
> https://github.com/Stratio/stratio-ingestion/tree/develop/stratio-serializers/stratio-elasticsearch-serializer
> [2] https://github.com/Stratio/stratio-ingestion/issues/21
>
> Thanks for your feedback,
>
> --
>
> Santiago M. Mola
>
>
> <http://www.stratio.com/>
> Avenida de Europa, 26. Ática 5. 3ª Planta
> 28224 Pozuelo de Alarcón, Madrid
> Tel: +34 91 352 59 42 // *@stratiobd <https://twitter.com/StratioBD>*
>
>
>
Re: What Source/Sink would you want next?
Posted by Hari Shreedharan <hs...@cloudera.com>.
Strong +1. If there are new features or fixes you want to contribute - please do, I am trying to make sure I spend some time reviewing and committing. If you don’t get a review in a few days, please ping on the jira - I will look at it!
Thanks,
Hari
On Fri, Sep 26, 2014 at 11:07 AM, Arvind Prabhakar <ar...@apache.org>
wrote:
> (cross-posting this to dev@)
> While I do not speak for the availability of other committers of the
> project, I would like to spend sometime with the contributors to help
> identify what are the most important needs of the project, and see how best
> we can get those committed into the codebase.
> Santiago (and others who would like to contribute) - please go ahead and
> create the necessary Jiras if they do not exist already, and invite the
> community to vote on those. That way we can prioritize the review and
> commit for functionality that is aligned with community requirements.
> Regards,
> Arvind Prabhakar
> On Fri, Sep 26, 2014 at 5:13 AM, jean garutti <la...@yahoo.fr> wrote:
>> hi
>> This seems to be great.
>> I'll wait to have the 'production ready' flag for ELS mapping patch.
>> I think more effort should be done to have this sink more configurable
>> like what we can do with logstash.
>>
>> anyway it's nice to share your development to the community
>> i'd love to have the mongodb sink packaged in the official flume release.
>>
>> jean
>>
>>
>> Le Jeudi 25 septembre 2014 9h48, Santiago Mola <sm...@stratio.com> a
>> écrit :
>>
>>
>> Hi Jean,
>>
>> 2014-09-24 22:44 GMT+02:00 Jean <la...@yahoo.fr>:
>>
>> A solid mongodb source would be Nice.
>>
>>
>> Definitely!
>>
>>
>> I wish the same for elasticsearch sink where we could specify the mapping
>> for the headers instead of sending everything as a string
>>
>>
>> We have a serializer that creates mappings for ElasticSearch [1]. It is
>> not ready for production [2] but it is one of our priorities.
>>
>> [1]
>> https://github.com/Stratio/stratio-ingestion/tree/develop/stratio-serializers/stratio-elasticsearch-serializer
>> [2] https://github.com/Stratio/stratio-ingestion/issues/21
>>
>> Thanks for your feedback,
>>
>> --
>>
>> Santiago M. Mola
>>
>>
>> <http://www.stratio.com/>
>> Avenida de Europa, 26. Ática 5. 3ª Planta
>> 28224 Pozuelo de Alarcón, Madrid
>> Tel: +34 91 352 59 42 // *@stratiobd <https://twitter.com/StratioBD>*
>>
>>
>>
Re: What Source/Sink would you want next?
Posted by Hari Shreedharan <hs...@cloudera.com>.
Strong +1. If there are new features or fixes you want to contribute - please do, I am trying to make sure I spend some time reviewing and committing. If you don’t get a review in a few days, please ping on the jira - I will look at it!
Thanks,
Hari
On Fri, Sep 26, 2014 at 11:07 AM, Arvind Prabhakar <ar...@apache.org>
wrote:
> (cross-posting this to dev@)
> While I do not speak for the availability of other committers of the
> project, I would like to spend sometime with the contributors to help
> identify what are the most important needs of the project, and see how best
> we can get those committed into the codebase.
> Santiago (and others who would like to contribute) - please go ahead and
> create the necessary Jiras if they do not exist already, and invite the
> community to vote on those. That way we can prioritize the review and
> commit for functionality that is aligned with community requirements.
> Regards,
> Arvind Prabhakar
> On Fri, Sep 26, 2014 at 5:13 AM, jean garutti <la...@yahoo.fr> wrote:
>> hi
>> This seems to be great.
>> I'll wait to have the 'production ready' flag for ELS mapping patch.
>> I think more effort should be done to have this sink more configurable
>> like what we can do with logstash.
>>
>> anyway it's nice to share your development to the community
>> i'd love to have the mongodb sink packaged in the official flume release.
>>
>> jean
>>
>>
>> Le Jeudi 25 septembre 2014 9h48, Santiago Mola <sm...@stratio.com> a
>> écrit :
>>
>>
>> Hi Jean,
>>
>> 2014-09-24 22:44 GMT+02:00 Jean <la...@yahoo.fr>:
>>
>> A solid mongodb source would be Nice.
>>
>>
>> Definitely!
>>
>>
>> I wish the same for elasticsearch sink where we could specify the mapping
>> for the headers instead of sending everything as a string
>>
>>
>> We have a serializer that creates mappings for ElasticSearch [1]. It is
>> not ready for production [2] but it is one of our priorities.
>>
>> [1]
>> https://github.com/Stratio/stratio-ingestion/tree/develop/stratio-serializers/stratio-elasticsearch-serializer
>> [2] https://github.com/Stratio/stratio-ingestion/issues/21
>>
>> Thanks for your feedback,
>>
>> --
>>
>> Santiago M. Mola
>>
>>
>> <http://www.stratio.com/>
>> Avenida de Europa, 26. Ática 5. 3ª Planta
>> 28224 Pozuelo de Alarcón, Madrid
>> Tel: +34 91 352 59 42 // *@stratiobd <https://twitter.com/StratioBD>*
>>
>>
>>
Re: What Source/Sink would you want next?
Posted by Santiago Mola <sm...@stratio.com>.
Hi Arvind, hi Hari
2014-09-26 20:06 GMT+02:00 Arvind Prabhakar <ar...@apache.org>:
> Santiago (and others who would like to contribute) - please go ahead and
> create the necessary Jiras if they do not exist already, and invite the
> community to vote on those. That way we can prioritize the review and
> commit for functionality that is aligned with community requirements.
>
2014-09-26 20:10 GMT+02:00 Hari Shreedharan <hs...@cloudera.com>:
> Strong +1. If there are new features or fixes you want to contribute -
> please do, I am trying to make sure I spend some time reviewing and
> committing. If you don’t get a review in a few days, please ping on the
> jira - I will look at it!
>
Sure. I'll do. Thanks!
Best,
--
Santiago M. Mola
<http://www.stratio.com/>
Avenida de Europa, 26. Ática 5. 3ª Planta
28224 Pozuelo de Alarcón, Madrid
Tel: +34 91 352 59 42 // *@stratiobd <https://twitter.com/StratioBD>*
Re: What Source/Sink would you want next?
Posted by Santiago Mola <sm...@stratio.com>.
Hi Arvind, hi Hari
2014-09-26 20:06 GMT+02:00 Arvind Prabhakar <ar...@apache.org>:
> Santiago (and others who would like to contribute) - please go ahead and
> create the necessary Jiras if they do not exist already, and invite the
> community to vote on those. That way we can prioritize the review and
> commit for functionality that is aligned with community requirements.
>
2014-09-26 20:10 GMT+02:00 Hari Shreedharan <hs...@cloudera.com>:
> Strong +1. If there are new features or fixes you want to contribute -
> please do, I am trying to make sure I spend some time reviewing and
> committing. If you don’t get a review in a few days, please ping on the
> jira - I will look at it!
>
Sure. I'll do. Thanks!
Best,
--
Santiago M. Mola
<http://www.stratio.com/>
Avenida de Europa, 26. Ática 5. 3ª Planta
28224 Pozuelo de Alarcón, Madrid
Tel: +34 91 352 59 42 // *@stratiobd <https://twitter.com/StratioBD>*