You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by Sanjeev T <sa...@gmail.com> on 2016/11/07 04:57:49 UTC
How to get latest falcon with ambari
Hi
I am using Ambari: 2.2.1.0
I had used source compiled Falcon 0.8,
how to add the latest falcon with Ambari, can some body give hints so i can
try it out.
Regards
-Sanjeev
Re: How to get latest falcon with ambari
Posted by Sanjeev T <sa...@gmail.com>.
Thanks for help Alejandro Fernandez, will try out.
On Fri, Nov 11, 2016 at 12:18 AM, Alejandro Fernandez <
afernandez@hortonworks.com> wrote:
> HI Sanjeev, you will have to upgrade your cluster to HDP 2.5, which has
> Falcon 0.10.
> First, you will need to upgrade Ambari to version 2.4.
> https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.
> 0/bk_ambari-upgrade/content/upgrading_ambari.html
> Next, you can either perform a Rolling or Express upgrade. https://docs.
> hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-
> upgrade/content/upgrading_HDP_perform_rolling_upgrade.html
>
> Thanks,
> Alejandro
>
> From: Sanjeev T <sa...@gmail.com>
> Date: Wednesday, November 9, 2016 at 10:33 PM
> To: Alejandro Fernandez <af...@hortonworks.com>
> Cc: "user@ambari.apache.org" <us...@ambari.apache.org>, Venkat Ranganathan
> <vr...@hortonworks.com>, Jayush Luniya <jl...@hortonworks.com>
>
> Subject: Re: How to get latest falcon with ambari
>
> Hi Alejandro,
>
> My cluster info
>
> Ambari: Version 2.2.1.0
> HDP: 2.4
>
> $ /var/lib/ambari-server/resources/stacks/HDP/2.4/
> services/FALCON/metainfo.xml
> <version>0.6.1.2.4</version>
>
> As I earlier worked with falcon 0.8, which was more stable(feed lookup,
> instance dependencies, pipeline tags), and had bug fixes over 0.6 version,
> so wanted the latest to be incorporated in our HDP cluster.
>
> Regards
> -Sanjeev
>
>
> On Wed, Nov 9, 2016 at 12:24 AM, Alejandro Fernandez <
> afernandez@hortonworks.com> wrote:
>
>> Hi Sanjeev,
>>
>> Can you provide more details into what you're trying to accomplish?
>> HDP 2.5 has Falcon at version 0.10.
>>
>> If you want your build Falcon from source, you will have to build the
>> RPMs and create a repo. If you go through that route, it will take a lot of
>> work to come up with your own stack.
>> There's another feature called Management Packs, and the eventual goal is
>> to be able to pull in say common services from stack A, and then extend it
>> with your custom services from a different repo, but we're not there yet.
>>
>> Thanks,
>> Alejandro
>>
>> From: Sanjeev T <sa...@gmail.com>
>> Reply-To: "user@ambari.apache.org" <us...@ambari.apache.org>
>> Date: Monday, November 7, 2016 at 8:46 PM
>> To: "user@ambari.apache.org" <us...@ambari.apache.org>
>> Cc: Venkat Ranganathan <vr...@hortonworks.com>
>>
>> Subject: Re: How to get latest falcon with ambari
>>
>> Hi Alejandro,
>>
>>
>> So for change in version do i to add as custom stack or can I replace
>> the existing version with higher version of falcon?
>> https://cwiki.apache.org/confluence/display/AMBARI/Defining+
>> a+Custom+Stack+and+Services
>>
>>
>> Regards
>> -Sanjeev
>>
>>
>> On Tue, Nov 8, 2016 at 12:31 AM, Alejandro Fernandez <
>> afernandez@hortonworks.com> wrote:
>>
>>>
>>>
>>> From: Alejandro Fernandez <af...@hortonworks.com>
>>> Date: Monday, November 7, 2016 at 10:57 AM
>>> To: "user@ambari.apache.org" <us...@ambari.apache.org>, Venkat
>>> Ranganathan <vr...@hortonworks.com>
>>> Subject: Re: How to get latest falcon with ambari
>>>
>>> Hi Sanjeev,
>>>
>>> Ambari works with existing stacks that distribute a version of Falcon.
>>> Which stack are you using?
>>> Are you writing your own? If so, you will need to create RPMs for the
>>> version of Falcon that you want.
>>>
>>> E.g., HDP 2.5 includes Falcon version 0.10
>>>
>>> Thanks,
>>> Alejandro
>>>
>>> From: Sanjeev T <sa...@gmail.com>
>>> Reply-To: "user@ambari.apache.org" <us...@ambari.apache.org>
>>> Date: Sunday, November 6, 2016 at 8:57 PM
>>> To: "user@ambari.apache.org" <us...@ambari.apache.org>
>>> Subject: How to get latest falcon with ambari
>>>
>>> Hi
>>>
>>> I am using Ambari: 2.2.1.0
>>>
>>> I had used source compiled Falcon 0.8,
>>>
>>> how to add the latest falcon with Ambari, can some body give hints so i
>>> can try it out.
>>>
>>> Regards
>>> -Sanjeev
>>>
>>>
>>
>
Re: How to get latest falcon with ambari
Posted by Alejandro Fernandez <af...@hortonworks.com>.
HI Sanjeev, you will have to upgrade your cluster to HDP 2.5, which has Falcon 0.10.
First, you will need to upgrade Ambari to version 2.4. https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-upgrade/content/upgrading_ambari.html
Next, you can either perform a Rolling or Express upgrade. https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-upgrade/content/upgrading_HDP_perform_rolling_upgrade.html
Thanks,
Alejandro
From: Sanjeev T <sa...@gmail.com>>
Date: Wednesday, November 9, 2016 at 10:33 PM
To: Alejandro Fernandez <af...@hortonworks.com>>
Cc: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>, Venkat Ranganathan <vr...@hortonworks.com>>, Jayush Luniya <jl...@hortonworks.com>>
Subject: Re: How to get latest falcon with ambari
Hi Alejandro,
My cluster info
Ambari: Version 2.2.1.0
HDP: 2.4
$ /var/lib/ambari-server/resources/stacks/HDP/2.4/services/FALCON/metainfo.xml
<version>0.6.1.2.4</version>
As I earlier worked with falcon 0.8, which was more stable(feed lookup, instance dependencies, pipeline tags), and had bug fixes over 0.6 version, so wanted the latest to be incorporated in our HDP cluster.
Regards
-Sanjeev
On Wed, Nov 9, 2016 at 12:24 AM, Alejandro Fernandez <af...@hortonworks.com>> wrote:
Hi Sanjeev,
Can you provide more details into what you're trying to accomplish?
HDP 2.5 has Falcon at version 0.10.
If you want your build Falcon from source, you will have to build the RPMs and create a repo. If you go through that route, it will take a lot of work to come up with your own stack.
There's another feature called Management Packs, and the eventual goal is to be able to pull in say common services from stack A, and then extend it with your custom services from a different repo, but we're not there yet.
Thanks,
Alejandro
From: Sanjeev T <sa...@gmail.com>>
Reply-To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Date: Monday, November 7, 2016 at 8:46 PM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Cc: Venkat Ranganathan <vr...@hortonworks.com>>
Subject: Re: How to get latest falcon with ambari
Hi Alejandro,
So for change in version do i to add as custom stack or can I replace the existing version with higher version of falcon?
https://cwiki.apache.org/confluence/display/AMBARI/Defining+a+Custom+Stack+and+Services
Regards
-Sanjeev
On Tue, Nov 8, 2016 at 12:31 AM, Alejandro Fernandez <af...@hortonworks.com>> wrote:
From: Alejandro Fernandez <af...@hortonworks.com>>
Date: Monday, November 7, 2016 at 10:57 AM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>, Venkat Ranganathan <vr...@hortonworks.com>>
Subject: Re: How to get latest falcon with ambari
Hi Sanjeev,
Ambari works with existing stacks that distribute a version of Falcon.
Which stack are you using?
Are you writing your own? If so, you will need to create RPMs for the version of Falcon that you want.
E.g., HDP 2.5 includes Falcon version 0.10
Thanks,
Alejandro
From: Sanjeev T <sa...@gmail.com>>
Reply-To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Date: Sunday, November 6, 2016 at 8:57 PM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Subject: How to get latest falcon with ambari
Hi
I am using Ambari: 2.2.1.0
I had used source compiled Falcon 0.8,
how to add the latest falcon with Ambari, can some body give hints so i can try it out.
Regards
-Sanjeev
Re: How to get latest falcon with ambari
Posted by Sanjeev T <sa...@gmail.com>.
Hi Alejandro,
My cluster info
Ambari: Version 2.2.1.0
HDP: 2.4
$
/var/lib/ambari-server/resources/stacks/HDP/2.4/services/FALCON/metainfo.xml
<version>0.6.1.2.4</version>
As I earlier worked with falcon 0.8, which was more stable(feed lookup,
instance dependencies, pipeline tags), and had bug fixes over 0.6 version,
so wanted the latest to be incorporated in our HDP cluster.
Regards
-Sanjeev
On Wed, Nov 9, 2016 at 12:24 AM, Alejandro Fernandez <
afernandez@hortonworks.com> wrote:
> Hi Sanjeev,
>
> Can you provide more details into what you're trying to accomplish?
> HDP 2.5 has Falcon at version 0.10.
>
> If you want your build Falcon from source, you will have to build the RPMs
> and create a repo. If you go through that route, it will take a lot of work
> to come up with your own stack.
> There's another feature called Management Packs, and the eventual goal is
> to be able to pull in say common services from stack A, and then extend it
> with your custom services from a different repo, but we're not there yet.
>
> Thanks,
> Alejandro
>
> From: Sanjeev T <sa...@gmail.com>
> Reply-To: "user@ambari.apache.org" <us...@ambari.apache.org>
> Date: Monday, November 7, 2016 at 8:46 PM
> To: "user@ambari.apache.org" <us...@ambari.apache.org>
> Cc: Venkat Ranganathan <vr...@hortonworks.com>
>
> Subject: Re: How to get latest falcon with ambari
>
> Hi Alejandro,
>
>
> So for change in version do i to add as custom stack or can I replace the
> existing version with higher version of falcon?
> https://cwiki.apache.org/confluence/display/AMBARI/
> Defining+a+Custom+Stack+and+Services
>
>
> Regards
> -Sanjeev
>
>
> On Tue, Nov 8, 2016 at 12:31 AM, Alejandro Fernandez <
> afernandez@hortonworks.com> wrote:
>
>>
>>
>> From: Alejandro Fernandez <af...@hortonworks.com>
>> Date: Monday, November 7, 2016 at 10:57 AM
>> To: "user@ambari.apache.org" <us...@ambari.apache.org>, Venkat
>> Ranganathan <vr...@hortonworks.com>
>> Subject: Re: How to get latest falcon with ambari
>>
>> Hi Sanjeev,
>>
>> Ambari works with existing stacks that distribute a version of Falcon.
>> Which stack are you using?
>> Are you writing your own? If so, you will need to create RPMs for the
>> version of Falcon that you want.
>>
>> E.g., HDP 2.5 includes Falcon version 0.10
>>
>> Thanks,
>> Alejandro
>>
>> From: Sanjeev T <sa...@gmail.com>
>> Reply-To: "user@ambari.apache.org" <us...@ambari.apache.org>
>> Date: Sunday, November 6, 2016 at 8:57 PM
>> To: "user@ambari.apache.org" <us...@ambari.apache.org>
>> Subject: How to get latest falcon with ambari
>>
>> Hi
>>
>> I am using Ambari: 2.2.1.0
>>
>> I had used source compiled Falcon 0.8,
>>
>> how to add the latest falcon with Ambari, can some body give hints so i
>> can try it out.
>>
>> Regards
>> -Sanjeev
>>
>>
>
Re: How to get latest falcon with ambari
Posted by Alejandro Fernandez <af...@hortonworks.com>.
Hi Sanjeev,
Can you provide more details into what you're trying to accomplish?
HDP 2.5 has Falcon at version 0.10.
If you want your build Falcon from source, you will have to build the RPMs and create a repo. If you go through that route, it will take a lot of work to come up with your own stack.
There's another feature called Management Packs, and the eventual goal is to be able to pull in say common services from stack A, and then extend it with your custom services from a different repo, but we're not there yet.
Thanks,
Alejandro
From: Sanjeev T <sa...@gmail.com>>
Reply-To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Date: Monday, November 7, 2016 at 8:46 PM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Cc: Venkat Ranganathan <vr...@hortonworks.com>>
Subject: Re: How to get latest falcon with ambari
Hi Alejandro,
So for change in version do i to add as custom stack or can I replace the existing version with higher version of falcon?
https://cwiki.apache.org/confluence/display/AMBARI/Defining+a+Custom+Stack+and+Services
Regards
-Sanjeev
On Tue, Nov 8, 2016 at 12:31 AM, Alejandro Fernandez <af...@hortonworks.com>> wrote:
From: Alejandro Fernandez <af...@hortonworks.com>>
Date: Monday, November 7, 2016 at 10:57 AM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>, Venkat Ranganathan <vr...@hortonworks.com>>
Subject: Re: How to get latest falcon with ambari
Hi Sanjeev,
Ambari works with existing stacks that distribute a version of Falcon.
Which stack are you using?
Are you writing your own? If so, you will need to create RPMs for the version of Falcon that you want.
E.g., HDP 2.5 includes Falcon version 0.10
Thanks,
Alejandro
From: Sanjeev T <sa...@gmail.com>>
Reply-To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Date: Sunday, November 6, 2016 at 8:57 PM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Subject: How to get latest falcon with ambari
Hi
I am using Ambari: 2.2.1.0
I had used source compiled Falcon 0.8,
how to add the latest falcon with Ambari, can some body give hints so i can try it out.
Regards
-Sanjeev
Re: How to get latest falcon with ambari
Posted by Sanjeev T <sa...@gmail.com>.
Hi Alejandro,
So for change in version do i to add as custom stack or can I replace the
existing version with higher version of falcon?
https://cwiki.apache.org/confluence/display/AMBARI/Defining+a+Custom+Stack+and+Services
Regards
-Sanjeev
On Tue, Nov 8, 2016 at 12:31 AM, Alejandro Fernandez <
afernandez@hortonworks.com> wrote:
>
>
> From: Alejandro Fernandez <af...@hortonworks.com>
> Date: Monday, November 7, 2016 at 10:57 AM
> To: "user@ambari.apache.org" <us...@ambari.apache.org>, Venkat Ranganathan
> <vr...@hortonworks.com>
> Subject: Re: How to get latest falcon with ambari
>
> Hi Sanjeev,
>
> Ambari works with existing stacks that distribute a version of Falcon.
> Which stack are you using?
> Are you writing your own? If so, you will need to create RPMs for the
> version of Falcon that you want.
>
> E.g., HDP 2.5 includes Falcon version 0.10
>
> Thanks,
> Alejandro
>
> From: Sanjeev T <sa...@gmail.com>
> Reply-To: "user@ambari.apache.org" <us...@ambari.apache.org>
> Date: Sunday, November 6, 2016 at 8:57 PM
> To: "user@ambari.apache.org" <us...@ambari.apache.org>
> Subject: How to get latest falcon with ambari
>
> Hi
>
> I am using Ambari: 2.2.1.0
>
> I had used source compiled Falcon 0.8,
>
> how to add the latest falcon with Ambari, can some body give hints so i
> can try it out.
>
> Regards
> -Sanjeev
>
>
Re: How to get latest falcon with ambari
Posted by Alejandro Fernandez <af...@hortonworks.com>.
From: Alejandro Fernandez <af...@hortonworks.com>>
Date: Monday, November 7, 2016 at 10:57 AM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>, Venkat Ranganathan <vr...@hortonworks.com>>
Subject: Re: How to get latest falcon with ambari
Hi Sanjeev,
Ambari works with existing stacks that distribute a version of Falcon.
Which stack are you using?
Are you writing your own? If so, you will need to create RPMs for the version of Falcon that you want.
E.g., HDP 2.5 includes Falcon version 0.10
Thanks,
Alejandro
From: Sanjeev T <sa...@gmail.com>>
Reply-To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Date: Sunday, November 6, 2016 at 8:57 PM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Subject: How to get latest falcon with ambari
Hi
I am using Ambari: 2.2.1.0
I had used source compiled Falcon 0.8,
how to add the latest falcon with Ambari, can some body give hints so i can try it out.
Regards
-Sanjeev
Re: How to get latest falcon with ambari
Posted by Alejandro Fernandez <af...@hortonworks.com>.
Hi Sanjeev,
Ambari works with existing stacks that distribute a version of Falcon.
Which stack are you using?
Are you writing your own? If so, you will need to create RPMs for the version of Falcon that you want.
E.g., HDP 2.5 includes Falcon version 0.10
Thanks,
Alejandro
From: Sanjeev T <sa...@gmail.com>>
Reply-To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Date: Sunday, November 6, 2016 at 8:57 PM
To: "user@ambari.apache.org<ma...@ambari.apache.org>" <us...@ambari.apache.org>>
Subject: How to get latest falcon with ambari
Hi
I am using Ambari: 2.2.1.0
I had used source compiled Falcon 0.8,
how to add the latest falcon with Ambari, can some body give hints so i can try it out.
Regards
-Sanjeev