You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@bigtop.apache.org by bigtapp_root_aws quek <bi...@gmail.com> on 2023/06/06 18:06:20 UTC
Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Hi
Can any one provide me with the URL for the repo for Bigtop 3.2.0 with
Ubuntu 22.04? Thanks!
Keng
Re: Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Posted by Sebastian Nagel <sn...@apache.org>.
Hi Keng,
when requesting <http://repos.bigtop.apache.org/> you get a result from
the S3 bucket s3://repos.bigtop.apache.org/ - because so many objects are stored
in this bucket, the result is truncated and lists only the artifacts of
the first two releases.
By adding a prefix parameter
http://repos.bigtop.apache.org/?prefix=releases/
you should be able to see the 3.2.0 packages for Ubuntu 22.04.
See [1] for more parameters.
Alternatively, you can install the AWS CLI [2,3] to get the listings:
aws --no-sign-request s3 ls s3://repos.bigtop.apache.org/releases/3.2.0/ubuntu/
Or, even better: configure the apt source and list the packages from Ubuntu:
# install the Bigtop signing keys
mkdir -p /usr/local/share/keyrings/
curl https://downloads.apache.org/bigtop/bigtop-3.2.0/repos/GPG-KEY-bigtop \
| gpg --dearmor | dd of=/usr/local/share/keyrings/bigtop-keyring.gpg
# add the following to /etc/apt/sources.list.d/bigtop-3.2.0.list (a single line)
deb [signed-by=/usr/local/share/keyrings/bigtop-dev-keyring.gpg]
http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH) bigtop contrib
Call
apt update
and then
apt search hadoop-yarn
which should show among other packages:
hadoop-yarn/stable 3.3.4-1 amd64
The Hadoop NextGen MapReduce (YARN)
Best,
Sebastian
[1] https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListObjects.html
[2] https://docs.aws.amazon.com/cli/index.html
[3] https://github.com/aws/aws-cli
On 6/8/23 07:11, bigtapp_root_aws quek wrote:
> Hi all,
> Sorry to be so chatty. When I accessed repos.bigtop.apache.org
> <http://repos.bigtop.apache.org/>, it only showed /releases/1.0.0 and
> release/1.1.0. <http://1.1.0.> Am I missing something?
>
>
> Keng
>
> On Thu, Jun 8, 2023 at 1:07 PM bigtapp_root_aws quek <bigtapp.root.aws@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hi all,
> To elaborate, when I tried to use wget -nv
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64
> <http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64> it gave
> me a 404 error same if the ${ARCH} is amd64.
>
>
> Keng
>
> On Thu, Jun 8, 2023 at 12:58 PM bigtapp_root_aws quek
> <bigtapp.root.aws@gmail.com <ma...@gmail.com>> wrote:
>
> Hi Sebastian,
> So far we have no issue to compile 3.2.0 but we still have issues with
> the repo. We basically cannot seem to access it. Adding it as a repo
> to the apt-get in the box also doesn't work.
>
> Any urgent help is greatly appreciated.
>
>
> Keng
>
>
>
> On Wed, Jun 7, 2023 at 4:02 PM bigtapp_root_aws quek
> <bigtapp.root.aws@gmail.com <ma...@gmail.com>> wrote:
>
> Hi Sebastian,
> Appreciate it! I had read that the way to resolve BIGTOP-3898 was
> to edit the script to install Python v2.7. I will confirm this.
>
> Also does anyone know when BigTop 3.2.1 is coming out? I need to
> install a new site with Ubuntu 22.04 and hope that Hadoop is updated
> to 3.3.4 or 3.3.5 as well. Thanks.
>
>
> Keng
>
> On Wed, Jun 7, 2023 at 3:48 PM Sebastian Nagel <snagel@apache.org
> <ma...@apache.org>> wrote:
>
> Hi Keng,
>
> the URL to add to add to the apt source listing is
>
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH) <http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)>
>
> However, you should check whether BIGTOP-3898 [1] is a blocker.
> It causes the
> installation of a few packages (hive, spark-python, zeppelin,
> ...) to fail.
>
> Best,
> Sebastian
>
> [1] https://issues.apache.org/jira/browse/BIGTOP-3898
> <https://issues.apache.org/jira/browse/BIGTOP-3898>
>
> On 6/6/23 20:06, bigtapp_root_aws quek wrote:
> > Hi
> > Can any one provide me with the URL for the repo for Bigtop
> 3.2.0 with Ubuntu
> > 22.04? Thanks!
> >
> > Keng
>
Re: Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Posted by bigtapp_root_aws quek <bi...@gmail.com>.
Hi all,
Sorry to be so chatty. When I accessed repos.bigtop.apache.org, it only
showed /releases/1.0.0 and release/1.1.0. Am I missing something?
Keng
On Thu, Jun 8, 2023 at 1:07 PM bigtapp_root_aws quek <
bigtapp.root.aws@gmail.com> wrote:
> Hi all,
> To elaborate, when I tried to use wget -nv
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64 it gave
> me a 404 error same if the ${ARCH} is amd64.
>
>
> Keng
>
> On Thu, Jun 8, 2023 at 12:58 PM bigtapp_root_aws quek <
> bigtapp.root.aws@gmail.com> wrote:
>
>> Hi Sebastian,
>> So far we have no issue to compile 3.2.0 but we still have issues with
>> the repo. We basically cannot seem to access it. Adding it as a repo to
>> the apt-get in the box also doesn't work.
>>
>> Any urgent help is greatly appreciated.
>>
>>
>> Keng
>>
>>
>>
>> On Wed, Jun 7, 2023 at 4:02 PM bigtapp_root_aws quek <
>> bigtapp.root.aws@gmail.com> wrote:
>>
>>> Hi Sebastian,
>>> Appreciate it! I had read that the way to resolve BIGTOP-3898 was to
>>> edit the script to install Python v2.7. I will confirm this.
>>>
>>> Also does anyone know when BigTop 3.2.1 is coming out? I need to
>>> install a new site with Ubuntu 22.04 and hope that Hadoop is updated to
>>> 3.3.4 or 3.3.5 as well. Thanks.
>>>
>>>
>>> Keng
>>>
>>> On Wed, Jun 7, 2023 at 3:48 PM Sebastian Nagel <sn...@apache.org>
>>> wrote:
>>>
>>>> Hi Keng,
>>>>
>>>> the URL to add to add to the apt source listing is
>>>>
>>>> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)
>>>>
>>>> However, you should check whether BIGTOP-3898 [1] is a blocker. It
>>>> causes the
>>>> installation of a few packages (hive, spark-python, zeppelin, ...) to
>>>> fail.
>>>>
>>>> Best,
>>>> Sebastian
>>>>
>>>> [1] https://issues.apache.org/jira/browse/BIGTOP-3898
>>>>
>>>> On 6/6/23 20:06, bigtapp_root_aws quek wrote:
>>>> > Hi
>>>> > Can any one provide me with the URL for the repo for Bigtop 3.2.0
>>>> with Ubuntu
>>>> > 22.04? Thanks!
>>>> >
>>>> > Keng
>>>>
>>>
Re: Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Posted by bigtapp_root_aws quek <bi...@gmail.com>.
Everyone, thanks very much. I will try it now. Appreciate everyone's
contribution.
On Thu, Jun 8, 2023 at 4:04 PM Masatake Iwasaki <iw...@oss.nttdata.com>
wrote:
> > To elaborate, when I tried to use wget -nv
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64 <
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64> it gave
> me a 404 error same if the ${ARCH} is amd64.
>
> Try x86_64 instead of amd64.
>
> > However, you should check whether BIGTOP-3898 [1] is a blocker. It
> causes the
> > installation of a few packages (hive, spark-python, zeppelin, ...) to
> fail.
>
> BIGTOP-3930 will resolve the issue.
> https://issues.apache.org/jira/browse/BIGTOP-3930
>
> While we are preparing for Bigtop 3.2.1 release, it usually takes weeks.
> Apply the patch of BIGTOP-3930 and build packages using branch-3.2 if you
> need this now.
>
>
> On 2023/06/08 14:07, bigtapp_root_aws quek wrote:
> > Hi all,
> > To elaborate, when I tried to use wget -nv
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64 <
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64> it gave
> me a 404 error same if the ${ARCH} is amd64.
> >
> >
> > Keng
> >
> > On Thu, Jun 8, 2023 at 12:58 PM bigtapp_root_aws quek <
> bigtapp.root.aws@gmail.com <ma...@gmail.com>> wrote:
> >
> > Hi Sebastian,
> > So far we have no issue to compile 3.2.0 but we still have issues
> with the repo. We basically cannot seem to access it. Adding it as a repo
> to the apt-get in the box also doesn't work.
> >
> > Any urgent help is greatly appreciated.
> >
> >
> > Keng
> >
> >
> >
> > On Wed, Jun 7, 2023 at 4:02 PM bigtapp_root_aws quek <
> bigtapp.root.aws@gmail.com <ma...@gmail.com>> wrote:
> >
> > Hi Sebastian,
> > Appreciate it! I had read that the way to resolve BIGTOP-3898
> was to edit the script to install Python v2.7. I will confirm this.
> >
> > Also does anyone know when BigTop 3.2.1 is coming out? I need
> to install a new site with Ubuntu 22.04 and hope that Hadoop is updated to
> 3.3.4 or 3.3.5 as well. Thanks.
> >
> >
> > Keng
> >
> > On Wed, Jun 7, 2023 at 3:48 PM Sebastian Nagel <
> snagel@apache.org <ma...@apache.org>> wrote:
> >
> > Hi Keng,
> >
> > the URL to add to add to the apt source listing is
> >
> >
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH) <
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)>
> >
> > However, you should check whether BIGTOP-3898 [1] is a
> blocker. It causes the
> > installation of a few packages (hive, spark-python,
> zeppelin, ...) to fail.
> >
> > Best,
> > Sebastian
> >
> > [1] https://issues.apache.org/jira/browse/BIGTOP-3898 <
> https://issues.apache.org/jira/browse/BIGTOP-3898>
> >
> > On 6/6/23 20:06, bigtapp_root_aws quek wrote:
> > > Hi
> > > Can any one provide me with the URL for the repo for
> Bigtop 3.2.0 with Ubuntu
> > > 22.04? Thanks!
> > >
> > > Keng
> >
>
Re: Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Posted by Masatake Iwasaki <iw...@oss.nttdata.com>.
> To elaborate, when I tried to use wget -nv http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64 <http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64> it gave me a 404 error same if the ${ARCH} is amd64.
Try x86_64 instead of amd64.
> However, you should check whether BIGTOP-3898 [1] is a blocker. It causes the
> installation of a few packages (hive, spark-python, zeppelin, ...) to fail.
BIGTOP-3930 will resolve the issue.
https://issues.apache.org/jira/browse/BIGTOP-3930
While we are preparing for Bigtop 3.2.1 release, it usually takes weeks.
Apply the patch of BIGTOP-3930 and build packages using branch-3.2 if you need this now.
On 2023/06/08 14:07, bigtapp_root_aws quek wrote:
> Hi all,
> To elaborate, when I tried to use wget -nv http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64 <http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64> it gave me a 404 error same if the ${ARCH} is amd64.
>
>
> Keng
>
> On Thu, Jun 8, 2023 at 12:58 PM bigtapp_root_aws quek <bigtapp.root.aws@gmail.com <ma...@gmail.com>> wrote:
>
> Hi Sebastian,
> So far we have no issue to compile 3.2.0 but we still have issues with the repo. We basically cannot seem to access it. Adding it as a repo to the apt-get in the box also doesn't work.
>
> Any urgent help is greatly appreciated.
>
>
> Keng
>
>
>
> On Wed, Jun 7, 2023 at 4:02 PM bigtapp_root_aws quek <bigtapp.root.aws@gmail.com <ma...@gmail.com>> wrote:
>
> Hi Sebastian,
> Appreciate it! I had read that the way to resolve BIGTOP-3898 was to edit the script to install Python v2.7. I will confirm this.
>
> Also does anyone know when BigTop 3.2.1 is coming out? I need to install a new site with Ubuntu 22.04 and hope that Hadoop is updated to 3.3.4 or 3.3.5 as well. Thanks.
>
>
> Keng
>
> On Wed, Jun 7, 2023 at 3:48 PM Sebastian Nagel <snagel@apache.org <ma...@apache.org>> wrote:
>
> Hi Keng,
>
> the URL to add to add to the apt source listing is
>
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH) <http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)>
>
> However, you should check whether BIGTOP-3898 [1] is a blocker. It causes the
> installation of a few packages (hive, spark-python, zeppelin, ...) to fail.
>
> Best,
> Sebastian
>
> [1] https://issues.apache.org/jira/browse/BIGTOP-3898 <https://issues.apache.org/jira/browse/BIGTOP-3898>
>
> On 6/6/23 20:06, bigtapp_root_aws quek wrote:
> > Hi
> > Can any one provide me with the URL for the repo for Bigtop 3.2.0 with Ubuntu
> > 22.04? Thanks!
> >
> > Keng
>
Re: Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Posted by bigtapp_root_aws quek <bi...@gmail.com>.
Hi all,
To elaborate, when I tried to use wget -nv
http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64 it gave me
a 404 error same if the ${ARCH} is amd64.
Keng
On Thu, Jun 8, 2023 at 12:58 PM bigtapp_root_aws quek <
bigtapp.root.aws@gmail.com> wrote:
> Hi Sebastian,
> So far we have no issue to compile 3.2.0 but we still have issues with the
> repo. We basically cannot seem to access it. Adding it as a repo to the
> apt-get in the box also doesn't work.
>
> Any urgent help is greatly appreciated.
>
>
> Keng
>
>
>
> On Wed, Jun 7, 2023 at 4:02 PM bigtapp_root_aws quek <
> bigtapp.root.aws@gmail.com> wrote:
>
>> Hi Sebastian,
>> Appreciate it! I had read that the way to resolve BIGTOP-3898 was to
>> edit the script to install Python v2.7. I will confirm this.
>>
>> Also does anyone know when BigTop 3.2.1 is coming out? I need to install
>> a new site with Ubuntu 22.04 and hope that Hadoop is updated to 3.3.4 or
>> 3.3.5 as well. Thanks.
>>
>>
>> Keng
>>
>> On Wed, Jun 7, 2023 at 3:48 PM Sebastian Nagel <sn...@apache.org> wrote:
>>
>>> Hi Keng,
>>>
>>> the URL to add to add to the apt source listing is
>>>
>>> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)
>>>
>>> However, you should check whether BIGTOP-3898 [1] is a blocker. It
>>> causes the
>>> installation of a few packages (hive, spark-python, zeppelin, ...) to
>>> fail.
>>>
>>> Best,
>>> Sebastian
>>>
>>> [1] https://issues.apache.org/jira/browse/BIGTOP-3898
>>>
>>> On 6/6/23 20:06, bigtapp_root_aws quek wrote:
>>> > Hi
>>> > Can any one provide me with the URL for the repo for Bigtop 3.2.0 with
>>> Ubuntu
>>> > 22.04? Thanks!
>>> >
>>> > Keng
>>>
>>
Re: Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Posted by bigtapp_root_aws quek <bi...@gmail.com>.
Hi Sebastian,
So far we have no issue to compile 3.2.0 but we still have issues with the
repo. We basically cannot seem to access it. Adding it as a repo to the
apt-get in the box also doesn't work.
Any urgent help is greatly appreciated.
Keng
On Wed, Jun 7, 2023 at 4:02 PM bigtapp_root_aws quek <
bigtapp.root.aws@gmail.com> wrote:
> Hi Sebastian,
> Appreciate it! I had read that the way to resolve BIGTOP-3898 was to edit
> the script to install Python v2.7. I will confirm this.
>
> Also does anyone know when BigTop 3.2.1 is coming out? I need to install
> a new site with Ubuntu 22.04 and hope that Hadoop is updated to 3.3.4 or
> 3.3.5 as well. Thanks.
>
>
> Keng
>
> On Wed, Jun 7, 2023 at 3:48 PM Sebastian Nagel <sn...@apache.org> wrote:
>
>> Hi Keng,
>>
>> the URL to add to add to the apt source listing is
>>
>> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)
>>
>> However, you should check whether BIGTOP-3898 [1] is a blocker. It causes
>> the
>> installation of a few packages (hive, spark-python, zeppelin, ...) to
>> fail.
>>
>> Best,
>> Sebastian
>>
>> [1] https://issues.apache.org/jira/browse/BIGTOP-3898
>>
>> On 6/6/23 20:06, bigtapp_root_aws quek wrote:
>> > Hi
>> > Can any one provide me with the URL for the repo for Bigtop 3.2.0 with
>> Ubuntu
>> > 22.04? Thanks!
>> >
>> > Keng
>>
>
Re: Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Posted by bigtapp_root_aws quek <bi...@gmail.com>.
Hi Sebastian,
Appreciate it! I had read that the way to resolve BIGTOP-3898 was to edit
the script to install Python v2.7. I will confirm this.
Also does anyone know when BigTop 3.2.1 is coming out? I need to install a
new site with Ubuntu 22.04 and hope that Hadoop is updated to 3.3.4 or
3.3.5 as well. Thanks.
Keng
On Wed, Jun 7, 2023 at 3:48 PM Sebastian Nagel <sn...@apache.org> wrote:
> Hi Keng,
>
> the URL to add to add to the apt source listing is
>
> http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)
>
> However, you should check whether BIGTOP-3898 [1] is a blocker. It causes
> the
> installation of a few packages (hive, spark-python, zeppelin, ...) to fail.
>
> Best,
> Sebastian
>
> [1] https://issues.apache.org/jira/browse/BIGTOP-3898
>
> On 6/6/23 20:06, bigtapp_root_aws quek wrote:
> > Hi
> > Can any one provide me with the URL for the repo for Bigtop 3.2.0 with
> Ubuntu
> > 22.04? Thanks!
> >
> > Keng
>
Re: Repository to use in Bigtop 3.2.0 for Ubuntu 22.04
Posted by Sebastian Nagel <sn...@apache.org>.
Hi Keng,
the URL to add to add to the apt source listing is
http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)
However, you should check whether BIGTOP-3898 [1] is a blocker. It causes the
installation of a few packages (hive, spark-python, zeppelin, ...) to fail.
Best,
Sebastian
[1] https://issues.apache.org/jira/browse/BIGTOP-3898
On 6/6/23 20:06, bigtapp_root_aws quek wrote:
> Hi
> Can any one provide me with the URL for the repo for Bigtop 3.2.0 with Ubuntu
> 22.04? Thanks!
>
> Keng