need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

Hi,

I'm here to take a expert advise on using Hadoop or not for my
situation/case.

Brief intro: I'm a masters by research student doing research in BigData
area which I wish to explore more by continuing into PhD.

We've a side project in its inception phase (not related to research) for
developing mobile app using Ionic framework. One of the non-functional
requirement of the project is to collect various analytics, for example,
how many times apps downloaded, visited, which feature is used more, which
user uses what etc etc. As a part of proposed solution, we've proposed to
use Google Analytics to capture the required analytics and MangoDB for
storing user's data.

I believe these statistics can be easily captured by GA. However, recently,
I was thinking to use Hadoop and its related technologies (Hive, Impala,
Sqoop etc) for doing analytics work. Why ? Because this way, I will get a
chance to work on Hadoop echosystem which will be a good compliment with my
Master's research which is in BigData.

What I know that Hadoop is mainly used where we have really BigData (in TBs
or more) in a variety of format (unstructured, semi-structured) and where
value out of data is needed by performing analytics.

My question is, we will not have much data in mobile app, but we do have
data analytics work in mobile app. So does it make sense (reasonable?) to
export data from MangoDB into HDFS and use Hive or Impala for doing
analytics ?

Please give feedback. Your expert advise is highly appreciated.

Many thanks.

Viki.

Re: need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

selam,

Thanks, I've checked snowplow but it's coming with a cost. Whereas, I'm
looking completely free software.

I've checked Zeppein and it really looks cool. Very good UI and visualized
data analytics. Still a lot to explore, specifically the technologies
which Ashutosh
mentioned. Just had a quick google on Spark as well, and it looks like
Spark is a good choice as well.


Thanks again

I wish to have more views from other members, specifically for my case,
mentioned in first post. Many thanks in advance to all.

Viki


On Fri, Apr 15, 2016 at 3:10 AM, selam <se...@gmail.com> wrote:

> I am no expert or user of hadoop except hdfs part, but you should
> check snowplow project for analytics stuff and they use hadoop with
> many other proejcts as well.
>
> On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
> <vi...@gmail.com> wrote:
> > Thanks Ashutosh,
> >
> > I'm really unfamiliar of technologies you mentioned. I will explore them
> > hopefully.
> >
> > Actually the motivation here is to get hands-on experience on Hadoop
> > echosystem and data analytic. The good part is that we already have
> Hadoop
> > cluster setup in university.
> >
> > Still looking for insights...
> >
> > Many thanks.
> >
> > Viki
> >
> > On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <ashutosh.k78@gmail.com
> >
> > wrote:
> >>
> >> you can consider
> >>
> >> Kafka-->Spark-->SparkML-Zeppein
> >> OR
> >> Kafka-->Flink-->FlinkML-->Zeppelin
> >>
> >>
> >> Thanks
> >> Ashutosh
> >>
> >> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
> >> <vi...@gmail.com> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I'm here to take a expert advise on using Hadoop or not for my
> >>> situation/case.
> >>>
> >>> Brief intro: I'm a masters by research student doing research in
> BigData
> >>> area which I wish to explore more by continuing into PhD.
> >>>
> >>> We've a side project in its inception phase (not related to research)
> for
> >>> developing mobile app using Ionic framework. One of the non-functional
> >>> requirement of the project is to collect various analytics, for
> example, how
> >>> many times apps downloaded, visited, which feature is used more, which
> user
> >>> uses what etc etc. As a part of proposed solution, we've proposed to
> use
> >>> Google Analytics to capture the required analytics and MangoDB for
> storing
> >>> user's data.
> >>>
> >>> I believe these statistics can be easily captured by GA. However,
> >>> recently, I was thinking to use Hadoop and its related technologies
> (Hive,
> >>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I
> will
> >>> get a chance to work on Hadoop echosystem which will be a good
> compliment
> >>> with my Master's research which is in BigData.
> >>>
> >>> What I know that Hadoop is mainly used where we have really BigData (in
> >>> TBs or more) in a variety of format (unstructured, semi-structured) and
> >>> where value out of data is needed by performing analytics.
> >>>
> >>> My question is, we will not have much data in mobile app, but we do
> have
> >>> data analytics work in mobile app. So does it make sense (reasonable?)
> to
> >>> export data from MangoDB into HDFS and use Hive or Impala for doing
> >>> analytics ?
> >>>
> >>> Please give feedback. Your expert advise is highly appreciated.
> >>>
> >>> Many thanks.
> >>>
> >>> Viki.
> >>>
> >>
> >
>
>
>
> --
> Saygılar && İyi Çalışmalar
> Timu EREN ( a.k.a selam )
>

Re: need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

selam,

Thanks, I've checked snowplow but it's coming with a cost. Whereas, I'm
looking completely free software.

I've checked Zeppein and it really looks cool. Very good UI and visualized
data analytics. Still a lot to explore, specifically the technologies
which Ashutosh
mentioned. Just had a quick google on Spark as well, and it looks like
Spark is a good choice as well.


Thanks again

I wish to have more views from other members, specifically for my case,
mentioned in first post. Many thanks in advance to all.

Viki


On Fri, Apr 15, 2016 at 3:10 AM, selam <se...@gmail.com> wrote:

> I am no expert or user of hadoop except hdfs part, but you should
> check snowplow project for analytics stuff and they use hadoop with
> many other proejcts as well.
>
> On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
> <vi...@gmail.com> wrote:
> > Thanks Ashutosh,
> >
> > I'm really unfamiliar of technologies you mentioned. I will explore them
> > hopefully.
> >
> > Actually the motivation here is to get hands-on experience on Hadoop
> > echosystem and data analytic. The good part is that we already have
> Hadoop
> > cluster setup in university.
> >
> > Still looking for insights...
> >
> > Many thanks.
> >
> > Viki
> >
> > On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <ashutosh.k78@gmail.com
> >
> > wrote:
> >>
> >> you can consider
> >>
> >> Kafka-->Spark-->SparkML-Zeppein
> >> OR
> >> Kafka-->Flink-->FlinkML-->Zeppelin
> >>
> >>
> >> Thanks
> >> Ashutosh
> >>
> >> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
> >> <vi...@gmail.com> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I'm here to take a expert advise on using Hadoop or not for my
> >>> situation/case.
> >>>
> >>> Brief intro: I'm a masters by research student doing research in
> BigData
> >>> area which I wish to explore more by continuing into PhD.
> >>>
> >>> We've a side project in its inception phase (not related to research)
> for
> >>> developing mobile app using Ionic framework. One of the non-functional
> >>> requirement of the project is to collect various analytics, for
> example, how
> >>> many times apps downloaded, visited, which feature is used more, which
> user
> >>> uses what etc etc. As a part of proposed solution, we've proposed to
> use
> >>> Google Analytics to capture the required analytics and MangoDB for
> storing
> >>> user's data.
> >>>
> >>> I believe these statistics can be easily captured by GA. However,
> >>> recently, I was thinking to use Hadoop and its related technologies
> (Hive,
> >>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I
> will
> >>> get a chance to work on Hadoop echosystem which will be a good
> compliment
> >>> with my Master's research which is in BigData.
> >>>
> >>> What I know that Hadoop is mainly used where we have really BigData (in
> >>> TBs or more) in a variety of format (unstructured, semi-structured) and
> >>> where value out of data is needed by performing analytics.
> >>>
> >>> My question is, we will not have much data in mobile app, but we do
> have
> >>> data analytics work in mobile app. So does it make sense (reasonable?)
> to
> >>> export data from MangoDB into HDFS and use Hive or Impala for doing
> >>> analytics ?
> >>>
> >>> Please give feedback. Your expert advise is highly appreciated.
> >>>
> >>> Many thanks.
> >>>
> >>> Viki.
> >>>
> >>
> >
>
>
>
> --
> Saygılar && İyi Çalışmalar
> Timu EREN ( a.k.a selam )
>

Re: need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

selam,

Thanks, I've checked snowplow but it's coming with a cost. Whereas, I'm
looking completely free software.

I've checked Zeppein and it really looks cool. Very good UI and visualized
data analytics. Still a lot to explore, specifically the technologies
which Ashutosh
mentioned. Just had a quick google on Spark as well, and it looks like
Spark is a good choice as well.


Thanks again

I wish to have more views from other members, specifically for my case,
mentioned in first post. Many thanks in advance to all.

Viki


On Fri, Apr 15, 2016 at 3:10 AM, selam <se...@gmail.com> wrote:

> I am no expert or user of hadoop except hdfs part, but you should
> check snowplow project for analytics stuff and they use hadoop with
> many other proejcts as well.
>
> On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
> <vi...@gmail.com> wrote:
> > Thanks Ashutosh,
> >
> > I'm really unfamiliar of technologies you mentioned. I will explore them
> > hopefully.
> >
> > Actually the motivation here is to get hands-on experience on Hadoop
> > echosystem and data analytic. The good part is that we already have
> Hadoop
> > cluster setup in university.
> >
> > Still looking for insights...
> >
> > Many thanks.
> >
> > Viki
> >
> > On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <ashutosh.k78@gmail.com
> >
> > wrote:
> >>
> >> you can consider
> >>
> >> Kafka-->Spark-->SparkML-Zeppein
> >> OR
> >> Kafka-->Flink-->FlinkML-->Zeppelin
> >>
> >>
> >> Thanks
> >> Ashutosh
> >>
> >> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
> >> <vi...@gmail.com> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I'm here to take a expert advise on using Hadoop or not for my
> >>> situation/case.
> >>>
> >>> Brief intro: I'm a masters by research student doing research in
> BigData
> >>> area which I wish to explore more by continuing into PhD.
> >>>
> >>> We've a side project in its inception phase (not related to research)
> for
> >>> developing mobile app using Ionic framework. One of the non-functional
> >>> requirement of the project is to collect various analytics, for
> example, how
> >>> many times apps downloaded, visited, which feature is used more, which
> user
> >>> uses what etc etc. As a part of proposed solution, we've proposed to
> use
> >>> Google Analytics to capture the required analytics and MangoDB for
> storing
> >>> user's data.
> >>>
> >>> I believe these statistics can be easily captured by GA. However,
> >>> recently, I was thinking to use Hadoop and its related technologies
> (Hive,
> >>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I
> will
> >>> get a chance to work on Hadoop echosystem which will be a good
> compliment
> >>> with my Master's research which is in BigData.
> >>>
> >>> What I know that Hadoop is mainly used where we have really BigData (in
> >>> TBs or more) in a variety of format (unstructured, semi-structured) and
> >>> where value out of data is needed by performing analytics.
> >>>
> >>> My question is, we will not have much data in mobile app, but we do
> have
> >>> data analytics work in mobile app. So does it make sense (reasonable?)
> to
> >>> export data from MangoDB into HDFS and use Hive or Impala for doing
> >>> analytics ?
> >>>
> >>> Please give feedback. Your expert advise is highly appreciated.
> >>>
> >>> Many thanks.
> >>>
> >>> Viki.
> >>>
> >>
> >
>
>
>
> --
> Saygılar && İyi Çalışmalar
> Timu EREN ( a.k.a selam )
>

Re: need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

selam,

Thanks, I've checked snowplow but it's coming with a cost. Whereas, I'm
looking completely free software.

I've checked Zeppein and it really looks cool. Very good UI and visualized
data analytics. Still a lot to explore, specifically the technologies
which Ashutosh
mentioned. Just had a quick google on Spark as well, and it looks like
Spark is a good choice as well.


Thanks again

I wish to have more views from other members, specifically for my case,
mentioned in first post. Many thanks in advance to all.

Viki


On Fri, Apr 15, 2016 at 3:10 AM, selam <se...@gmail.com> wrote:

> I am no expert or user of hadoop except hdfs part, but you should
> check snowplow project for analytics stuff and they use hadoop with
> many other proejcts as well.
>
> On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
> <vi...@gmail.com> wrote:
> > Thanks Ashutosh,
> >
> > I'm really unfamiliar of technologies you mentioned. I will explore them
> > hopefully.
> >
> > Actually the motivation here is to get hands-on experience on Hadoop
> > echosystem and data analytic. The good part is that we already have
> Hadoop
> > cluster setup in university.
> >
> > Still looking for insights...
> >
> > Many thanks.
> >
> > Viki
> >
> > On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <ashutosh.k78@gmail.com
> >
> > wrote:
> >>
> >> you can consider
> >>
> >> Kafka-->Spark-->SparkML-Zeppein
> >> OR
> >> Kafka-->Flink-->FlinkML-->Zeppelin
> >>
> >>
> >> Thanks
> >> Ashutosh
> >>
> >> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
> >> <vi...@gmail.com> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I'm here to take a expert advise on using Hadoop or not for my
> >>> situation/case.
> >>>
> >>> Brief intro: I'm a masters by research student doing research in
> BigData
> >>> area which I wish to explore more by continuing into PhD.
> >>>
> >>> We've a side project in its inception phase (not related to research)
> for
> >>> developing mobile app using Ionic framework. One of the non-functional
> >>> requirement of the project is to collect various analytics, for
> example, how
> >>> many times apps downloaded, visited, which feature is used more, which
> user
> >>> uses what etc etc. As a part of proposed solution, we've proposed to
> use
> >>> Google Analytics to capture the required analytics and MangoDB for
> storing
> >>> user's data.
> >>>
> >>> I believe these statistics can be easily captured by GA. However,
> >>> recently, I was thinking to use Hadoop and its related technologies
> (Hive,
> >>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I
> will
> >>> get a chance to work on Hadoop echosystem which will be a good
> compliment
> >>> with my Master's research which is in BigData.
> >>>
> >>> What I know that Hadoop is mainly used where we have really BigData (in
> >>> TBs or more) in a variety of format (unstructured, semi-structured) and
> >>> where value out of data is needed by performing analytics.
> >>>
> >>> My question is, we will not have much data in mobile app, but we do
> have
> >>> data analytics work in mobile app. So does it make sense (reasonable?)
> to
> >>> export data from MangoDB into HDFS and use Hive or Impala for doing
> >>> analytics ?
> >>>
> >>> Please give feedback. Your expert advise is highly appreciated.
> >>>
> >>> Many thanks.
> >>>
> >>> Viki.
> >>>
> >>
> >
>
>
>
> --
> Saygılar && İyi Çalışmalar
> Timu EREN ( a.k.a selam )
>

Re: need expert advise on using Hadoop

[selam <se...@gmail.com>]

I am no expert or user of hadoop except hdfs part, but you should
check snowplow project for analytics stuff and they use hadoop with
many other proejcts as well.

On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
<vi...@gmail.com> wrote:
> Thanks Ashutosh,
>
> I'm really unfamiliar of technologies you mentioned. I will explore them
> hopefully.
>
> Actually the motivation here is to get hands-on experience on Hadoop
> echosystem and data analytic. The good part is that we already have Hadoop
> cluster setup in university.
>
> Still looking for insights...
>
> Many thanks.
>
> Viki
>
> On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <as...@gmail.com>
> wrote:
>>
>> you can consider
>>
>> Kafka-->Spark-->SparkML-Zeppein
>> OR
>> Kafka-->Flink-->FlinkML-->Zeppelin
>>
>>
>> Thanks
>> Ashutosh
>>
>> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
>> <vi...@gmail.com> wrote:
>>>
>>> Hi,
>>>
>>> I'm here to take a expert advise on using Hadoop or not for my
>>> situation/case.
>>>
>>> Brief intro: I'm a masters by research student doing research in BigData
>>> area which I wish to explore more by continuing into PhD.
>>>
>>> We've a side project in its inception phase (not related to research) for
>>> developing mobile app using Ionic framework. One of the non-functional
>>> requirement of the project is to collect various analytics, for example, how
>>> many times apps downloaded, visited, which feature is used more, which user
>>> uses what etc etc. As a part of proposed solution, we've proposed to use
>>> Google Analytics to capture the required analytics and MangoDB for storing
>>> user's data.
>>>
>>> I believe these statistics can be easily captured by GA. However,
>>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>>> get a chance to work on Hadoop echosystem which will be a good compliment
>>> with my Master's research which is in BigData.
>>>
>>> What I know that Hadoop is mainly used where we have really BigData (in
>>> TBs or more) in a variety of format (unstructured, semi-structured) and
>>> where value out of data is needed by performing analytics.
>>>
>>> My question is, we will not have much data in mobile app, but we do have
>>> data analytics work in mobile app. So does it make sense (reasonable?) to
>>> export data from MangoDB into HDFS and use Hive or Impala for doing
>>> analytics ?
>>>
>>> Please give feedback. Your expert advise is highly appreciated.
>>>
>>> Many thanks.
>>>
>>> Viki.
>>>
>>
>



-- 
Saygılar && İyi Çalışmalar
Timu EREN ( a.k.a selam )

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org

Re: need expert advise on using Hadoop

[selam <se...@gmail.com>]

I am no expert or user of hadoop except hdfs part, but you should
check snowplow project for analytics stuff and they use hadoop with
many other proejcts as well.

On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
<vi...@gmail.com> wrote:
> Thanks Ashutosh,
>
> I'm really unfamiliar of technologies you mentioned. I will explore them
> hopefully.
>
> Actually the motivation here is to get hands-on experience on Hadoop
> echosystem and data analytic. The good part is that we already have Hadoop
> cluster setup in university.
>
> Still looking for insights...
>
> Many thanks.
>
> Viki
>
> On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <as...@gmail.com>
> wrote:
>>
>> you can consider
>>
>> Kafka-->Spark-->SparkML-Zeppein
>> OR
>> Kafka-->Flink-->FlinkML-->Zeppelin
>>
>>
>> Thanks
>> Ashutosh
>>
>> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
>> <vi...@gmail.com> wrote:
>>>
>>> Hi,
>>>
>>> I'm here to take a expert advise on using Hadoop or not for my
>>> situation/case.
>>>
>>> Brief intro: I'm a masters by research student doing research in BigData
>>> area which I wish to explore more by continuing into PhD.
>>>
>>> We've a side project in its inception phase (not related to research) for
>>> developing mobile app using Ionic framework. One of the non-functional
>>> requirement of the project is to collect various analytics, for example, how
>>> many times apps downloaded, visited, which feature is used more, which user
>>> uses what etc etc. As a part of proposed solution, we've proposed to use
>>> Google Analytics to capture the required analytics and MangoDB for storing
>>> user's data.
>>>
>>> I believe these statistics can be easily captured by GA. However,
>>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>>> get a chance to work on Hadoop echosystem which will be a good compliment
>>> with my Master's research which is in BigData.
>>>
>>> What I know that Hadoop is mainly used where we have really BigData (in
>>> TBs or more) in a variety of format (unstructured, semi-structured) and
>>> where value out of data is needed by performing analytics.
>>>
>>> My question is, we will not have much data in mobile app, but we do have
>>> data analytics work in mobile app. So does it make sense (reasonable?) to
>>> export data from MangoDB into HDFS and use Hive or Impala for doing
>>> analytics ?
>>>
>>> Please give feedback. Your expert advise is highly appreciated.
>>>
>>> Many thanks.
>>>
>>> Viki.
>>>
>>
>



-- 
Saygılar && İyi Çalışmalar
Timu EREN ( a.k.a selam )

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org

Re: need expert advise on using Hadoop

[selam <se...@gmail.com>]

I am no expert or user of hadoop except hdfs part, but you should
check snowplow project for analytics stuff and they use hadoop with
many other proejcts as well.

On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
<vi...@gmail.com> wrote:
> Thanks Ashutosh,
>
> I'm really unfamiliar of technologies you mentioned. I will explore them
> hopefully.
>
> Actually the motivation here is to get hands-on experience on Hadoop
> echosystem and data analytic. The good part is that we already have Hadoop
> cluster setup in university.
>
> Still looking for insights...
>
> Many thanks.
>
> Viki
>
> On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <as...@gmail.com>
> wrote:
>>
>> you can consider
>>
>> Kafka-->Spark-->SparkML-Zeppein
>> OR
>> Kafka-->Flink-->FlinkML-->Zeppelin
>>
>>
>> Thanks
>> Ashutosh
>>
>> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
>> <vi...@gmail.com> wrote:
>>>
>>> Hi,
>>>
>>> I'm here to take a expert advise on using Hadoop or not for my
>>> situation/case.
>>>
>>> Brief intro: I'm a masters by research student doing research in BigData
>>> area which I wish to explore more by continuing into PhD.
>>>
>>> We've a side project in its inception phase (not related to research) for
>>> developing mobile app using Ionic framework. One of the non-functional
>>> requirement of the project is to collect various analytics, for example, how
>>> many times apps downloaded, visited, which feature is used more, which user
>>> uses what etc etc. As a part of proposed solution, we've proposed to use
>>> Google Analytics to capture the required analytics and MangoDB for storing
>>> user's data.
>>>
>>> I believe these statistics can be easily captured by GA. However,
>>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>>> get a chance to work on Hadoop echosystem which will be a good compliment
>>> with my Master's research which is in BigData.
>>>
>>> What I know that Hadoop is mainly used where we have really BigData (in
>>> TBs or more) in a variety of format (unstructured, semi-structured) and
>>> where value out of data is needed by performing analytics.
>>>
>>> My question is, we will not have much data in mobile app, but we do have
>>> data analytics work in mobile app. So does it make sense (reasonable?) to
>>> export data from MangoDB into HDFS and use Hive or Impala for doing
>>> analytics ?
>>>
>>> Please give feedback. Your expert advise is highly appreciated.
>>>
>>> Many thanks.
>>>
>>> Viki.
>>>
>>
>



-- 
Saygılar && İyi Çalışmalar
Timu EREN ( a.k.a selam )

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org

Re: need expert advise on using Hadoop

[selam <se...@gmail.com>]

I am no expert or user of hadoop except hdfs part, but you should
check snowplow project for analytics stuff and they use hadoop with
many other proejcts as well.

On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
<vi...@gmail.com> wrote:
> Thanks Ashutosh,
>
> I'm really unfamiliar of technologies you mentioned. I will explore them
> hopefully.
>
> Actually the motivation here is to get hands-on experience on Hadoop
> echosystem and data analytic. The good part is that we already have Hadoop
> cluster setup in university.
>
> Still looking for insights...
>
> Many thanks.
>
> Viki
>
> On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <as...@gmail.com>
> wrote:
>>
>> you can consider
>>
>> Kafka-->Spark-->SparkML-Zeppein
>> OR
>> Kafka-->Flink-->FlinkML-->Zeppelin
>>
>>
>> Thanks
>> Ashutosh
>>
>> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
>> <vi...@gmail.com> wrote:
>>>
>>> Hi,
>>>
>>> I'm here to take a expert advise on using Hadoop or not for my
>>> situation/case.
>>>
>>> Brief intro: I'm a masters by research student doing research in BigData
>>> area which I wish to explore more by continuing into PhD.
>>>
>>> We've a side project in its inception phase (not related to research) for
>>> developing mobile app using Ionic framework. One of the non-functional
>>> requirement of the project is to collect various analytics, for example, how
>>> many times apps downloaded, visited, which feature is used more, which user
>>> uses what etc etc. As a part of proposed solution, we've proposed to use
>>> Google Analytics to capture the required analytics and MangoDB for storing
>>> user's data.
>>>
>>> I believe these statistics can be easily captured by GA. However,
>>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>>> get a chance to work on Hadoop echosystem which will be a good compliment
>>> with my Master's research which is in BigData.
>>>
>>> What I know that Hadoop is mainly used where we have really BigData (in
>>> TBs or more) in a variety of format (unstructured, semi-structured) and
>>> where value out of data is needed by performing analytics.
>>>
>>> My question is, we will not have much data in mobile app, but we do have
>>> data analytics work in mobile app. So does it make sense (reasonable?) to
>>> export data from MangoDB into HDFS and use Hive or Impala for doing
>>> analytics ?
>>>
>>> Please give feedback. Your expert advise is highly appreciated.
>>>
>>> Many thanks.
>>>
>>> Viki.
>>>
>>
>



-- 
Saygılar && İyi Çalışmalar
Timu EREN ( a.k.a selam )

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org

Re: need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

Thanks Ashutosh,

I'm really unfamiliar of technologies you mentioned. I will explore them
hopefully.

Actually the motivation here is to get hands-on experience on Hadoop
echosystem and data analytic. The good part is that we already have Hadoop
cluster setup in university.

Still looking for insights...

Many thanks.

Viki

On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <as...@gmail.com>
wrote:

> you can consider
>
> Kafka-->Spark-->SparkML-Zeppein
> OR
> Kafka-->Flink-->FlinkML-->Zeppelin
>
>
> Thanks
> Ashutosh
>
> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <viki.sanjeeva@gmail.com
> > wrote:
>
>> Hi,
>>
>> I'm here to take a expert advise on using Hadoop or not for my
>> situation/case.
>>
>> Brief intro: I'm a masters by research student doing research in BigData
>> area which I wish to explore more by continuing into PhD.
>>
>> We've a side project in its inception phase (not related to research) for
>> developing mobile app using Ionic framework. One of the non-functional
>> requirement of the project is to collect various analytics, for example,
>> how many times apps downloaded, visited, which feature is used more, which
>> user uses what etc etc. As a part of proposed solution, we've proposed to
>> use Google Analytics to capture the required analytics and MangoDB for
>> storing user's data.
>>
>> I believe these statistics can be easily captured by GA. However,
>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>> get a chance to work on Hadoop echosystem which will be a good compliment
>> with my Master's research which is in BigData.
>>
>> What I know that Hadoop is mainly used where we have really BigData (in
>> TBs or more) in a variety of format (unstructured, semi-structured) and
>> where value out of data is needed by performing analytics.
>>
>> My question is, we will not have much data in mobile app, but we do have
>> data analytics work in mobile app. So does it make sense (reasonable?) to
>> export data from MangoDB into HDFS and use Hive or Impala for doing
>> analytics ?
>>
>> Please give feedback. Your expert advise is highly appreciated.
>>
>> Many thanks.
>>
>> Viki.
>>
>>
>

Re: need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

Thanks Ashutosh,

I'm really unfamiliar of technologies you mentioned. I will explore them
hopefully.

Actually the motivation here is to get hands-on experience on Hadoop
echosystem and data analytic. The good part is that we already have Hadoop
cluster setup in university.

Still looking for insights...

Many thanks.

Viki

On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <as...@gmail.com>
wrote:

> you can consider
>
> Kafka-->Spark-->SparkML-Zeppein
> OR
> Kafka-->Flink-->FlinkML-->Zeppelin
>
>
> Thanks
> Ashutosh
>
> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <viki.sanjeeva@gmail.com
> > wrote:
>
>> Hi,
>>
>> I'm here to take a expert advise on using Hadoop or not for my
>> situation/case.
>>
>> Brief intro: I'm a masters by research student doing research in BigData
>> area which I wish to explore more by continuing into PhD.
>>
>> We've a side project in its inception phase (not related to research) for
>> developing mobile app using Ionic framework. One of the non-functional
>> requirement of the project is to collect various analytics, for example,
>> how many times apps downloaded, visited, which feature is used more, which
>> user uses what etc etc. As a part of proposed solution, we've proposed to
>> use Google Analytics to capture the required analytics and MangoDB for
>> storing user's data.
>>
>> I believe these statistics can be easily captured by GA. However,
>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>> get a chance to work on Hadoop echosystem which will be a good compliment
>> with my Master's research which is in BigData.
>>
>> What I know that Hadoop is mainly used where we have really BigData (in
>> TBs or more) in a variety of format (unstructured, semi-structured) and
>> where value out of data is needed by performing analytics.
>>
>> My question is, we will not have much data in mobile app, but we do have
>> data analytics work in mobile app. So does it make sense (reasonable?) to
>> export data from MangoDB into HDFS and use Hive or Impala for doing
>> analytics ?
>>
>> Please give feedback. Your expert advise is highly appreciated.
>>
>> Many thanks.
>>
>> Viki.
>>
>>
>

Re: need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

Thanks Ashutosh,

I'm really unfamiliar of technologies you mentioned. I will explore them
hopefully.

Actually the motivation here is to get hands-on experience on Hadoop
echosystem and data analytic. The good part is that we already have Hadoop
cluster setup in university.

Still looking for insights...

Many thanks.

Viki

On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <as...@gmail.com>
wrote:

> you can consider
>
> Kafka-->Spark-->SparkML-Zeppein
> OR
> Kafka-->Flink-->FlinkML-->Zeppelin
>
>
> Thanks
> Ashutosh
>
> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <viki.sanjeeva@gmail.com
> > wrote:
>
>> Hi,
>>
>> I'm here to take a expert advise on using Hadoop or not for my
>> situation/case.
>>
>> Brief intro: I'm a masters by research student doing research in BigData
>> area which I wish to explore more by continuing into PhD.
>>
>> We've a side project in its inception phase (not related to research) for
>> developing mobile app using Ionic framework. One of the non-functional
>> requirement of the project is to collect various analytics, for example,
>> how many times apps downloaded, visited, which feature is used more, which
>> user uses what etc etc. As a part of proposed solution, we've proposed to
>> use Google Analytics to capture the required analytics and MangoDB for
>> storing user's data.
>>
>> I believe these statistics can be easily captured by GA. However,
>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>> get a chance to work on Hadoop echosystem which will be a good compliment
>> with my Master's research which is in BigData.
>>
>> What I know that Hadoop is mainly used where we have really BigData (in
>> TBs or more) in a variety of format (unstructured, semi-structured) and
>> where value out of data is needed by performing analytics.
>>
>> My question is, we will not have much data in mobile app, but we do have
>> data analytics work in mobile app. So does it make sense (reasonable?) to
>> export data from MangoDB into HDFS and use Hive or Impala for doing
>> analytics ?
>>
>> Please give feedback. Your expert advise is highly appreciated.
>>
>> Many thanks.
>>
>> Viki.
>>
>>
>

Re: need expert advise on using Hadoop

[Vikrama Sanjeeva <vi...@gmail.com>]

Thanks Ashutosh,

I'm really unfamiliar of technologies you mentioned. I will explore them
hopefully.

Actually the motivation here is to get hands-on experience on Hadoop
echosystem and data analytic. The good part is that we already have Hadoop
cluster setup in university.

Still looking for insights...

Many thanks.

Viki

On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <as...@gmail.com>
wrote:

> you can consider
>
> Kafka-->Spark-->SparkML-Zeppein
> OR
> Kafka-->Flink-->FlinkML-->Zeppelin
>
>
> Thanks
> Ashutosh
>
> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <viki.sanjeeva@gmail.com
> > wrote:
>
>> Hi,
>>
>> I'm here to take a expert advise on using Hadoop or not for my
>> situation/case.
>>
>> Brief intro: I'm a masters by research student doing research in BigData
>> area which I wish to explore more by continuing into PhD.
>>
>> We've a side project in its inception phase (not related to research) for
>> developing mobile app using Ionic framework. One of the non-functional
>> requirement of the project is to collect various analytics, for example,
>> how many times apps downloaded, visited, which feature is used more, which
>> user uses what etc etc. As a part of proposed solution, we've proposed to
>> use Google Analytics to capture the required analytics and MangoDB for
>> storing user's data.
>>
>> I believe these statistics can be easily captured by GA. However,
>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>> get a chance to work on Hadoop echosystem which will be a good compliment
>> with my Master's research which is in BigData.
>>
>> What I know that Hadoop is mainly used where we have really BigData (in
>> TBs or more) in a variety of format (unstructured, semi-structured) and
>> where value out of data is needed by performing analytics.
>>
>> My question is, we will not have much data in mobile app, but we do have
>> data analytics work in mobile app. So does it make sense (reasonable?) to
>> export data from MangoDB into HDFS and use Hive or Impala for doing
>> analytics ?
>>
>> Please give feedback. Your expert advise is highly appreciated.
>>
>> Many thanks.
>>
>> Viki.
>>
>>
>

Re: need expert advise on using Hadoop

[Ashutosh Kumar <as...@gmail.com>]

you can consider

Kafka-->Spark-->SparkML-Zeppein
OR
Kafka-->Flink-->FlinkML-->Zeppelin


Thanks
Ashutosh

On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <vi...@gmail.com>
wrote:

> Hi,
>
> I'm here to take a expert advise on using Hadoop or not for my
> situation/case.
>
> Brief intro: I'm a masters by research student doing research in BigData
> area which I wish to explore more by continuing into PhD.
>
> We've a side project in its inception phase (not related to research) for
> developing mobile app using Ionic framework. One of the non-functional
> requirement of the project is to collect various analytics, for example,
> how many times apps downloaded, visited, which feature is used more, which
> user uses what etc etc. As a part of proposed solution, we've proposed to
> use Google Analytics to capture the required analytics and MangoDB for
> storing user's data.
>
> I believe these statistics can be easily captured by GA. However,
> recently, I was thinking to use Hadoop and its related technologies (Hive,
> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
> get a chance to work on Hadoop echosystem which will be a good compliment
> with my Master's research which is in BigData.
>
> What I know that Hadoop is mainly used where we have really BigData (in
> TBs or more) in a variety of format (unstructured, semi-structured) and
> where value out of data is needed by performing analytics.
>
> My question is, we will not have much data in mobile app, but we do have
> data analytics work in mobile app. So does it make sense (reasonable?) to
> export data from MangoDB into HDFS and use Hive or Impala for doing
> analytics ?
>
> Please give feedback. Your expert advise is highly appreciated.
>
> Many thanks.
>
> Viki.
>
>

Re: need expert advise on using Hadoop

[Ashutosh Kumar <as...@gmail.com>]

you can consider

Kafka-->Spark-->SparkML-Zeppein
OR
Kafka-->Flink-->FlinkML-->Zeppelin


Thanks
Ashutosh

On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <vi...@gmail.com>
wrote:

> Hi,
>
> I'm here to take a expert advise on using Hadoop or not for my
> situation/case.
>
> Brief intro: I'm a masters by research student doing research in BigData
> area which I wish to explore more by continuing into PhD.
>
> We've a side project in its inception phase (not related to research) for
> developing mobile app using Ionic framework. One of the non-functional
> requirement of the project is to collect various analytics, for example,
> how many times apps downloaded, visited, which feature is used more, which
> user uses what etc etc. As a part of proposed solution, we've proposed to
> use Google Analytics to capture the required analytics and MangoDB for
> storing user's data.
>
> I believe these statistics can be easily captured by GA. However,
> recently, I was thinking to use Hadoop and its related technologies (Hive,
> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
> get a chance to work on Hadoop echosystem which will be a good compliment
> with my Master's research which is in BigData.
>
> What I know that Hadoop is mainly used where we have really BigData (in
> TBs or more) in a variety of format (unstructured, semi-structured) and
> where value out of data is needed by performing analytics.
>
> My question is, we will not have much data in mobile app, but we do have
> data analytics work in mobile app. So does it make sense (reasonable?) to
> export data from MangoDB into HDFS and use Hive or Impala for doing
> analytics ?
>
> Please give feedback. Your expert advise is highly appreciated.
>
> Many thanks.
>
> Viki.
>
>

Re: need expert advise on using Hadoop

[Ashutosh Kumar <as...@gmail.com>]

you can consider

Kafka-->Spark-->SparkML-Zeppein
OR
Kafka-->Flink-->FlinkML-->Zeppelin


Thanks
Ashutosh

On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <vi...@gmail.com>
wrote:

> Hi,
>
> I'm here to take a expert advise on using Hadoop or not for my
> situation/case.
>
> Brief intro: I'm a masters by research student doing research in BigData
> area which I wish to explore more by continuing into PhD.
>
> We've a side project in its inception phase (not related to research) for
> developing mobile app using Ionic framework. One of the non-functional
> requirement of the project is to collect various analytics, for example,
> how many times apps downloaded, visited, which feature is used more, which
> user uses what etc etc. As a part of proposed solution, we've proposed to
> use Google Analytics to capture the required analytics and MangoDB for
> storing user's data.
>
> I believe these statistics can be easily captured by GA. However,
> recently, I was thinking to use Hadoop and its related technologies (Hive,
> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
> get a chance to work on Hadoop echosystem which will be a good compliment
> with my Master's research which is in BigData.
>
> What I know that Hadoop is mainly used where we have really BigData (in
> TBs or more) in a variety of format (unstructured, semi-structured) and
> where value out of data is needed by performing analytics.
>
> My question is, we will not have much data in mobile app, but we do have
> data analytics work in mobile app. So does it make sense (reasonable?) to
> export data from MangoDB into HDFS and use Hive or Impala for doing
> analytics ?
>
> Please give feedback. Your expert advise is highly appreciated.
>
> Many thanks.
>
> Viki.
>
>

Re: need expert advise on using Hadoop

[Ashutosh Kumar <as...@gmail.com>]

you can consider

Kafka-->Spark-->SparkML-Zeppein
OR
Kafka-->Flink-->FlinkML-->Zeppelin


Thanks
Ashutosh

On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <vi...@gmail.com>
wrote:

> Hi,
>
> I'm here to take a expert advise on using Hadoop or not for my
> situation/case.
>
> Brief intro: I'm a masters by research student doing research in BigData
> area which I wish to explore more by continuing into PhD.
>
> We've a side project in its inception phase (not related to research) for
> developing mobile app using Ionic framework. One of the non-functional
> requirement of the project is to collect various analytics, for example,
> how many times apps downloaded, visited, which feature is used more, which
> user uses what etc etc. As a part of proposed solution, we've proposed to
> use Google Analytics to capture the required analytics and MangoDB for
> storing user's data.
>
> I believe these statistics can be easily captured by GA. However,
> recently, I was thinking to use Hadoop and its related technologies (Hive,
> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
> get a chance to work on Hadoop echosystem which will be a good compliment
> with my Master's research which is in BigData.
>
> What I know that Hadoop is mainly used where we have really BigData (in
> TBs or more) in a variety of format (unstructured, semi-structured) and
> where value out of data is needed by performing analytics.
>
> My question is, we will not have much data in mobile app, but we do have
> data analytics work in mobile app. So does it make sense (reasonable?) to
> export data from MangoDB into HDFS and use Hive or Impala for doing
> analytics ?
>
> Please give feedback. Your expert advise is highly appreciated.
>
> Many thanks.
>
> Viki.
>
>