You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Aji Janis <aj...@gmail.com> on 2013/05/21 16:32:18 UTC
ETL Tools
Hello users,
I am interested in hearing about what sort of ETL tools are you using with
your cloud based apps. Ideally, I am looking ETL(s) with the following
feature:
-free (yup)
-open-source/community support
-handles different types of sources or atleast has plugins may be (email,
rss, filesystem, relational databases, etc)
-can load data to Hbase(or hdfs)
-ease of use (eg: setting up a new extract source shouldn't be a week long
effort)
I am open to combining multiple ETLs to get the job done too. Any
suggestions? Thank you for your time
Re: ETL Tools
Posted by Lenin Raj <em...@gmail.com>.
We have used Pentaho in our projects.. it meets all your conditions. It can
connect to hadoop.
Good community support too.
--
Lenin.
Sent from my Android.
On May 22, 2013 2:19 AM, "Aji Janis" <aj...@gmail.com> wrote:
> Thanks for the suggestion. What about Clover or Talend? Have any of you
> tried it before - interested in knowing how it compares against Pentaho
>
>
> On Tue, May 21, 2013 at 12:26 PM, sudhakara st <su...@gmail.com>wrote:
>
>> Hello,
>>
>> Flume is better,more sophisticated one is Pentaho, it open source but you
>> have to pay for support.
>>
>>
>> On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>
>>> For batch imports, I would also suggest Sqoop. Very easy to use,
>>> specially if you have mySql into the play. I have not used Sqoop 2 but that
>>> is suppose to add enterprise level robustness and admin support as well.
>>>
>>> -Shahab
>>>
>>>
>>> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>>>
>>>> Apache Flume is one option.
>>>>
>>>>
>>>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>>>
>>>>> Hello users,
>>>>>
>>>>> I am interested in hearing about what sort of ETL tools are you using
>>>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>>>> feature:
>>>>>
>>>>> -free (yup)
>>>>> -open-source/community support
>>>>> -handles different types of sources or atleast has plugins may be
>>>>> (email, rss, filesystem, relational databases, etc)
>>>>> -can load data to Hbase(or hdfs)
>>>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>>>> long effort)
>>>>>
>>>>> I am open to combining multiple ETLs to get the job done too. Any
>>>>> suggestions? Thank you for your time
>>>>>
>>>>
>>>>
>>>
>>
>>
>> --
>>
>> Regards,
>> ...Sudhakara.st
>>
>>
>
>
Re: ETL Tools
Posted by Lenin Raj <em...@gmail.com>.
We have used Pentaho in our projects.. it meets all your conditions. It can
connect to hadoop.
Good community support too.
--
Lenin.
Sent from my Android.
On May 22, 2013 2:19 AM, "Aji Janis" <aj...@gmail.com> wrote:
> Thanks for the suggestion. What about Clover or Talend? Have any of you
> tried it before - interested in knowing how it compares against Pentaho
>
>
> On Tue, May 21, 2013 at 12:26 PM, sudhakara st <su...@gmail.com>wrote:
>
>> Hello,
>>
>> Flume is better,more sophisticated one is Pentaho, it open source but you
>> have to pay for support.
>>
>>
>> On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>
>>> For batch imports, I would also suggest Sqoop. Very easy to use,
>>> specially if you have mySql into the play. I have not used Sqoop 2 but that
>>> is suppose to add enterprise level robustness and admin support as well.
>>>
>>> -Shahab
>>>
>>>
>>> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>>>
>>>> Apache Flume is one option.
>>>>
>>>>
>>>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>>>
>>>>> Hello users,
>>>>>
>>>>> I am interested in hearing about what sort of ETL tools are you using
>>>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>>>> feature:
>>>>>
>>>>> -free (yup)
>>>>> -open-source/community support
>>>>> -handles different types of sources or atleast has plugins may be
>>>>> (email, rss, filesystem, relational databases, etc)
>>>>> -can load data to Hbase(or hdfs)
>>>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>>>> long effort)
>>>>>
>>>>> I am open to combining multiple ETLs to get the job done too. Any
>>>>> suggestions? Thank you for your time
>>>>>
>>>>
>>>>
>>>
>>
>>
>> --
>>
>> Regards,
>> ...Sudhakara.st
>>
>>
>
>
Re: ETL Tools
Posted by Lenin Raj <em...@gmail.com>.
We have used Pentaho in our projects.. it meets all your conditions. It can
connect to hadoop.
Good community support too.
--
Lenin.
Sent from my Android.
On May 22, 2013 2:19 AM, "Aji Janis" <aj...@gmail.com> wrote:
> Thanks for the suggestion. What about Clover or Talend? Have any of you
> tried it before - interested in knowing how it compares against Pentaho
>
>
> On Tue, May 21, 2013 at 12:26 PM, sudhakara st <su...@gmail.com>wrote:
>
>> Hello,
>>
>> Flume is better,more sophisticated one is Pentaho, it open source but you
>> have to pay for support.
>>
>>
>> On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>
>>> For batch imports, I would also suggest Sqoop. Very easy to use,
>>> specially if you have mySql into the play. I have not used Sqoop 2 but that
>>> is suppose to add enterprise level robustness and admin support as well.
>>>
>>> -Shahab
>>>
>>>
>>> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>>>
>>>> Apache Flume is one option.
>>>>
>>>>
>>>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>>>
>>>>> Hello users,
>>>>>
>>>>> I am interested in hearing about what sort of ETL tools are you using
>>>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>>>> feature:
>>>>>
>>>>> -free (yup)
>>>>> -open-source/community support
>>>>> -handles different types of sources or atleast has plugins may be
>>>>> (email, rss, filesystem, relational databases, etc)
>>>>> -can load data to Hbase(or hdfs)
>>>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>>>> long effort)
>>>>>
>>>>> I am open to combining multiple ETLs to get the job done too. Any
>>>>> suggestions? Thank you for your time
>>>>>
>>>>
>>>>
>>>
>>
>>
>> --
>>
>> Regards,
>> ...Sudhakara.st
>>
>>
>
>
Re: ETL Tools
Posted by Lenin Raj <em...@gmail.com>.
We have used Pentaho in our projects.. it meets all your conditions. It can
connect to hadoop.
Good community support too.
--
Lenin.
Sent from my Android.
On May 22, 2013 2:19 AM, "Aji Janis" <aj...@gmail.com> wrote:
> Thanks for the suggestion. What about Clover or Talend? Have any of you
> tried it before - interested in knowing how it compares against Pentaho
>
>
> On Tue, May 21, 2013 at 12:26 PM, sudhakara st <su...@gmail.com>wrote:
>
>> Hello,
>>
>> Flume is better,more sophisticated one is Pentaho, it open source but you
>> have to pay for support.
>>
>>
>> On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>
>>> For batch imports, I would also suggest Sqoop. Very easy to use,
>>> specially if you have mySql into the play. I have not used Sqoop 2 but that
>>> is suppose to add enterprise level robustness and admin support as well.
>>>
>>> -Shahab
>>>
>>>
>>> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>>>
>>>> Apache Flume is one option.
>>>>
>>>>
>>>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>>>
>>>>> Hello users,
>>>>>
>>>>> I am interested in hearing about what sort of ETL tools are you using
>>>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>>>> feature:
>>>>>
>>>>> -free (yup)
>>>>> -open-source/community support
>>>>> -handles different types of sources or atleast has plugins may be
>>>>> (email, rss, filesystem, relational databases, etc)
>>>>> -can load data to Hbase(or hdfs)
>>>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>>>> long effort)
>>>>>
>>>>> I am open to combining multiple ETLs to get the job done too. Any
>>>>> suggestions? Thank you for your time
>>>>>
>>>>
>>>>
>>>
>>
>>
>> --
>>
>> Regards,
>> ...Sudhakara.st
>>
>>
>
>
Re: ETL Tools
Posted by Aji Janis <aj...@gmail.com>.
Thanks for the suggestion. What about Clover or Talend? Have any of you
tried it before - interested in knowing how it compares against Pentaho
On Tue, May 21, 2013 at 12:26 PM, sudhakara st <su...@gmail.com>wrote:
> Hello,
>
> Flume is better,more sophisticated one is Pentaho, it open source but you
> have to pay for support.
>
>
> On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
>
>> For batch imports, I would also suggest Sqoop. Very easy to use,
>> specially if you have mySql into the play. I have not used Sqoop 2 but that
>> is suppose to add enterprise level robustness and admin support as well.
>>
>> -Shahab
>>
>>
>> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>>
>>> Apache Flume is one option.
>>>
>>>
>>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>>
>>>> Hello users,
>>>>
>>>> I am interested in hearing about what sort of ETL tools are you using
>>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>>> feature:
>>>>
>>>> -free (yup)
>>>> -open-source/community support
>>>> -handles different types of sources or atleast has plugins may be
>>>> (email, rss, filesystem, relational databases, etc)
>>>> -can load data to Hbase(or hdfs)
>>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>>> long effort)
>>>>
>>>> I am open to combining multiple ETLs to get the job done too. Any
>>>> suggestions? Thank you for your time
>>>>
>>>
>>>
>>
>
>
> --
>
> Regards,
> ...Sudhakara.st
>
>
Re: ETL Tools
Posted by Aji Janis <aj...@gmail.com>.
Thanks for the suggestion. What about Clover or Talend? Have any of you
tried it before - interested in knowing how it compares against Pentaho
On Tue, May 21, 2013 at 12:26 PM, sudhakara st <su...@gmail.com>wrote:
> Hello,
>
> Flume is better,more sophisticated one is Pentaho, it open source but you
> have to pay for support.
>
>
> On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
>
>> For batch imports, I would also suggest Sqoop. Very easy to use,
>> specially if you have mySql into the play. I have not used Sqoop 2 but that
>> is suppose to add enterprise level robustness and admin support as well.
>>
>> -Shahab
>>
>>
>> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>>
>>> Apache Flume is one option.
>>>
>>>
>>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>>
>>>> Hello users,
>>>>
>>>> I am interested in hearing about what sort of ETL tools are you using
>>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>>> feature:
>>>>
>>>> -free (yup)
>>>> -open-source/community support
>>>> -handles different types of sources or atleast has plugins may be
>>>> (email, rss, filesystem, relational databases, etc)
>>>> -can load data to Hbase(or hdfs)
>>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>>> long effort)
>>>>
>>>> I am open to combining multiple ETLs to get the job done too. Any
>>>> suggestions? Thank you for your time
>>>>
>>>
>>>
>>
>
>
> --
>
> Regards,
> ...Sudhakara.st
>
>
Re: ETL Tools
Posted by Aji Janis <aj...@gmail.com>.
Thanks for the suggestion. What about Clover or Talend? Have any of you
tried it before - interested in knowing how it compares against Pentaho
On Tue, May 21, 2013 at 12:26 PM, sudhakara st <su...@gmail.com>wrote:
> Hello,
>
> Flume is better,more sophisticated one is Pentaho, it open source but you
> have to pay for support.
>
>
> On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
>
>> For batch imports, I would also suggest Sqoop. Very easy to use,
>> specially if you have mySql into the play. I have not used Sqoop 2 but that
>> is suppose to add enterprise level robustness and admin support as well.
>>
>> -Shahab
>>
>>
>> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>>
>>> Apache Flume is one option.
>>>
>>>
>>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>>
>>>> Hello users,
>>>>
>>>> I am interested in hearing about what sort of ETL tools are you using
>>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>>> feature:
>>>>
>>>> -free (yup)
>>>> -open-source/community support
>>>> -handles different types of sources or atleast has plugins may be
>>>> (email, rss, filesystem, relational databases, etc)
>>>> -can load data to Hbase(or hdfs)
>>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>>> long effort)
>>>>
>>>> I am open to combining multiple ETLs to get the job done too. Any
>>>> suggestions? Thank you for your time
>>>>
>>>
>>>
>>
>
>
> --
>
> Regards,
> ...Sudhakara.st
>
>
Re: ETL Tools
Posted by Aji Janis <aj...@gmail.com>.
Thanks for the suggestion. What about Clover or Talend? Have any of you
tried it before - interested in knowing how it compares against Pentaho
On Tue, May 21, 2013 at 12:26 PM, sudhakara st <su...@gmail.com>wrote:
> Hello,
>
> Flume is better,more sophisticated one is Pentaho, it open source but you
> have to pay for support.
>
>
> On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
>
>> For batch imports, I would also suggest Sqoop. Very easy to use,
>> specially if you have mySql into the play. I have not used Sqoop 2 but that
>> is suppose to add enterprise level robustness and admin support as well.
>>
>> -Shahab
>>
>>
>> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>>
>>> Apache Flume is one option.
>>>
>>>
>>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>>
>>>> Hello users,
>>>>
>>>> I am interested in hearing about what sort of ETL tools are you using
>>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>>> feature:
>>>>
>>>> -free (yup)
>>>> -open-source/community support
>>>> -handles different types of sources or atleast has plugins may be
>>>> (email, rss, filesystem, relational databases, etc)
>>>> -can load data to Hbase(or hdfs)
>>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>>> long effort)
>>>>
>>>> I am open to combining multiple ETLs to get the job done too. Any
>>>> suggestions? Thank you for your time
>>>>
>>>
>>>
>>
>
>
> --
>
> Regards,
> ...Sudhakara.st
>
>
Re: ETL Tools
Posted by sudhakara st <su...@gmail.com>.
Hello,
Flume is better,more sophisticated one is Pentaho, it open source but you
have to pay for support.
On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
> For batch imports, I would also suggest Sqoop. Very easy to use, specially
> if you have mySql into the play. I have not used Sqoop 2 but that is
> suppose to add enterprise level robustness and admin support as well.
>
> -Shahab
>
>
> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>
>> Apache Flume is one option.
>>
>>
>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>
>>> Hello users,
>>>
>>> I am interested in hearing about what sort of ETL tools are you using
>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>> feature:
>>>
>>> -free (yup)
>>> -open-source/community support
>>> -handles different types of sources or atleast has plugins may be
>>> (email, rss, filesystem, relational databases, etc)
>>> -can load data to Hbase(or hdfs)
>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>> long effort)
>>>
>>> I am open to combining multiple ETLs to get the job done too. Any
>>> suggestions? Thank you for your time
>>>
>>
>>
>
--
Regards,
...Sudhakara.st
Re: ETL Tools
Posted by sudhakara st <su...@gmail.com>.
Hello,
Flume is better,more sophisticated one is Pentaho, it open source but you
have to pay for support.
On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
> For batch imports, I would also suggest Sqoop. Very easy to use, specially
> if you have mySql into the play. I have not used Sqoop 2 but that is
> suppose to add enterprise level robustness and admin support as well.
>
> -Shahab
>
>
> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>
>> Apache Flume is one option.
>>
>>
>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>
>>> Hello users,
>>>
>>> I am interested in hearing about what sort of ETL tools are you using
>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>> feature:
>>>
>>> -free (yup)
>>> -open-source/community support
>>> -handles different types of sources or atleast has plugins may be
>>> (email, rss, filesystem, relational databases, etc)
>>> -can load data to Hbase(or hdfs)
>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>> long effort)
>>>
>>> I am open to combining multiple ETLs to get the job done too. Any
>>> suggestions? Thank you for your time
>>>
>>
>>
>
--
Regards,
...Sudhakara.st
Re: ETL Tools
Posted by sudhakara st <su...@gmail.com>.
Hello,
Flume is better,more sophisticated one is Pentaho, it open source but you
have to pay for support.
On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
> For batch imports, I would also suggest Sqoop. Very easy to use, specially
> if you have mySql into the play. I have not used Sqoop 2 but that is
> suppose to add enterprise level robustness and admin support as well.
>
> -Shahab
>
>
> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>
>> Apache Flume is one option.
>>
>>
>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>
>>> Hello users,
>>>
>>> I am interested in hearing about what sort of ETL tools are you using
>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>> feature:
>>>
>>> -free (yup)
>>> -open-source/community support
>>> -handles different types of sources or atleast has plugins may be
>>> (email, rss, filesystem, relational databases, etc)
>>> -can load data to Hbase(or hdfs)
>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>> long effort)
>>>
>>> I am open to combining multiple ETLs to get the job done too. Any
>>> suggestions? Thank you for your time
>>>
>>
>>
>
--
Regards,
...Sudhakara.st
Re: ETL Tools
Posted by sudhakara st <su...@gmail.com>.
Hello,
Flume is better,more sophisticated one is Pentaho, it open source but you
have to pay for support.
On Tue, May 21, 2013 at 9:52 PM, Shahab Yunus <sh...@gmail.com>wrote:
> For batch imports, I would also suggest Sqoop. Very easy to use, specially
> if you have mySql into the play. I have not used Sqoop 2 but that is
> suppose to add enterprise level robustness and admin support as well.
>
> -Shahab
>
>
> On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
>
>> Apache Flume is one option.
>>
>>
>> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>>
>>> Hello users,
>>>
>>> I am interested in hearing about what sort of ETL tools are you using
>>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>>> feature:
>>>
>>> -free (yup)
>>> -open-source/community support
>>> -handles different types of sources or atleast has plugins may be
>>> (email, rss, filesystem, relational databases, etc)
>>> -can load data to Hbase(or hdfs)
>>> -ease of use (eg: setting up a new extract source shouldn't be a week
>>> long effort)
>>>
>>> I am open to combining multiple ETLs to get the job done too. Any
>>> suggestions? Thank you for your time
>>>
>>
>>
>
--
Regards,
...Sudhakara.st
Re: ETL Tools
Posted by Shahab Yunus <sh...@gmail.com>.
For batch imports, I would also suggest Sqoop. Very easy to use, specially
if you have mySql into the play. I have not used Sqoop 2 but that is
suppose to add enterprise level robustness and admin support as well.
-Shahab
On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
> Apache Flume is one option.
>
>
> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>
>> Hello users,
>>
>> I am interested in hearing about what sort of ETL tools are you using
>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>> feature:
>>
>> -free (yup)
>> -open-source/community support
>> -handles different types of sources or atleast has plugins may be (email,
>> rss, filesystem, relational databases, etc)
>> -can load data to Hbase(or hdfs)
>> -ease of use (eg: setting up a new extract source shouldn't be a week
>> long effort)
>>
>> I am open to combining multiple ETLs to get the job done too. Any
>> suggestions? Thank you for your time
>>
>
>
Re: ETL Tools
Posted by Shahab Yunus <sh...@gmail.com>.
For batch imports, I would also suggest Sqoop. Very easy to use, specially
if you have mySql into the play. I have not used Sqoop 2 but that is
suppose to add enterprise level robustness and admin support as well.
-Shahab
On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
> Apache Flume is one option.
>
>
> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>
>> Hello users,
>>
>> I am interested in hearing about what sort of ETL tools are you using
>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>> feature:
>>
>> -free (yup)
>> -open-source/community support
>> -handles different types of sources or atleast has plugins may be (email,
>> rss, filesystem, relational databases, etc)
>> -can load data to Hbase(or hdfs)
>> -ease of use (eg: setting up a new extract source shouldn't be a week
>> long effort)
>>
>> I am open to combining multiple ETLs to get the job done too. Any
>> suggestions? Thank you for your time
>>
>
>
Re: ETL Tools
Posted by Shahab Yunus <sh...@gmail.com>.
For batch imports, I would also suggest Sqoop. Very easy to use, specially
if you have mySql into the play. I have not used Sqoop 2 but that is
suppose to add enterprise level robustness and admin support as well.
-Shahab
On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
> Apache Flume is one option.
>
>
> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>
>> Hello users,
>>
>> I am interested in hearing about what sort of ETL tools are you using
>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>> feature:
>>
>> -free (yup)
>> -open-source/community support
>> -handles different types of sources or atleast has plugins may be (email,
>> rss, filesystem, relational databases, etc)
>> -can load data to Hbase(or hdfs)
>> -ease of use (eg: setting up a new extract source shouldn't be a week
>> long effort)
>>
>> I am open to combining multiple ETLs to get the job done too. Any
>> suggestions? Thank you for your time
>>
>
>
Re: ETL Tools
Posted by Shahab Yunus <sh...@gmail.com>.
For batch imports, I would also suggest Sqoop. Very easy to use, specially
if you have mySql into the play. I have not used Sqoop 2 but that is
suppose to add enterprise level robustness and admin support as well.
-Shahab
On Tue, May 21, 2013 at 12:17 PM, Peyman Mohajerian <mo...@gmail.com>wrote:
> Apache Flume is one option.
>
>
> On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
>
>> Hello users,
>>
>> I am interested in hearing about what sort of ETL tools are you using
>> with your cloud based apps. Ideally, I am looking ETL(s) with the following
>> feature:
>>
>> -free (yup)
>> -open-source/community support
>> -handles different types of sources or atleast has plugins may be (email,
>> rss, filesystem, relational databases, etc)
>> -can load data to Hbase(or hdfs)
>> -ease of use (eg: setting up a new extract source shouldn't be a week
>> long effort)
>>
>> I am open to combining multiple ETLs to get the job done too. Any
>> suggestions? Thank you for your time
>>
>
>
Re: ETL Tools
Posted by Peyman Mohajerian <mo...@gmail.com>.
Apache Flume is one option.
On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
> Hello users,
>
> I am interested in hearing about what sort of ETL tools are you using with
> your cloud based apps. Ideally, I am looking ETL(s) with the following
> feature:
>
> -free (yup)
> -open-source/community support
> -handles different types of sources or atleast has plugins may be (email,
> rss, filesystem, relational databases, etc)
> -can load data to Hbase(or hdfs)
> -ease of use (eg: setting up a new extract source shouldn't be a week long
> effort)
>
> I am open to combining multiple ETLs to get the job done too. Any
> suggestions? Thank you for your time
>
Re: ETL Tools
Posted by Peyman Mohajerian <mo...@gmail.com>.
Apache Flume is one option.
On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
> Hello users,
>
> I am interested in hearing about what sort of ETL tools are you using with
> your cloud based apps. Ideally, I am looking ETL(s) with the following
> feature:
>
> -free (yup)
> -open-source/community support
> -handles different types of sources or atleast has plugins may be (email,
> rss, filesystem, relational databases, etc)
> -can load data to Hbase(or hdfs)
> -ease of use (eg: setting up a new extract source shouldn't be a week long
> effort)
>
> I am open to combining multiple ETLs to get the job done too. Any
> suggestions? Thank you for your time
>
Re: ETL Tools
Posted by Peyman Mohajerian <mo...@gmail.com>.
Apache Flume is one option.
On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
> Hello users,
>
> I am interested in hearing about what sort of ETL tools are you using with
> your cloud based apps. Ideally, I am looking ETL(s) with the following
> feature:
>
> -free (yup)
> -open-source/community support
> -handles different types of sources or atleast has plugins may be (email,
> rss, filesystem, relational databases, etc)
> -can load data to Hbase(or hdfs)
> -ease of use (eg: setting up a new extract source shouldn't be a week long
> effort)
>
> I am open to combining multiple ETLs to get the job done too. Any
> suggestions? Thank you for your time
>
Re: ETL Tools
Posted by Peyman Mohajerian <mo...@gmail.com>.
Apache Flume is one option.
On Tue, May 21, 2013 at 7:32 AM, Aji Janis <aj...@gmail.com> wrote:
> Hello users,
>
> I am interested in hearing about what sort of ETL tools are you using with
> your cloud based apps. Ideally, I am looking ETL(s) with the following
> feature:
>
> -free (yup)
> -open-source/community support
> -handles different types of sources or atleast has plugins may be (email,
> rss, filesystem, relational databases, etc)
> -can load data to Hbase(or hdfs)
> -ease of use (eg: setting up a new extract source shouldn't be a week long
> effort)
>
> I am open to combining multiple ETLs to get the job done too. Any
> suggestions? Thank you for your time
>