You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2022/04/06 09:46:09 UTC
[GitHub] [bigtop] iwasakims opened a new pull request, #882: BIGTOP-3662. Bump HBase to 2.4.11.
iwasakims opened a new pull request, #882:
URL: https://github.com/apache/bigtop/pull/882
https://issues.apache.org/jira/browse/BIGTOP-3662
HBase 2.4.11 was released. We can pick this low-hanging fruit for Bigtop 3.1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1090228074
The last commit was only for CentOS 7 because I got no dependency issue on Rocky Linux 8 and Fedora 35.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1090145086
The odd dependency exists even without the patch. It looks just existing problem surfaced. I did the work of [BIGTOP-3598](https://issues.apache.org/jira/browse/BIGTOP-3598)(#830) on CentOS 8.
```
$ rpm -q -p --requires output/hbase/x86_64/hbase-2.4.8-1.el7.x86_64.rpm
/bin/bash
/bin/sh
/bin/sh
/bin/sh
/sbin/chkconfig
/sbin/service
/usr/bin/env
/usr/sbin/useradd
bigtop-utils >= 0.7
config(hbase) = 2.4.8-1.el7
coreutils
hadoop-client
osgi(commonj.sdo)
osgi(org.eclipse.persistence.core)
osgi(org.glassfish.hk2.hk2)
rpmlib(CompressedFileNames) <= 3.0.4-1
rpmlib(FileDigests) <= 4.6.0-1
rpmlib(PayloadFilesHavePrefix) <= 4.0-1
zookeeper >= 3.3.1
rpmlib(PayloadIsXz) <= 5.2-1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
sekikn commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1094485289
+1, successfully built HBase and the components which directly depends on it, and ran their smoke tests except for Phoenix using Docker provisioner on Rocky 8, Debian 10/11 and Ubuntu 18.04/20.04 (x86_64).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1090229517
Smoke-tests of hbase succeeded on CentOS 7.
```
$ ./docker-hadoop.sh \
--create 1 \
--image bigtop/puppet:trunk-centos-7 \
--memory 16g \
--enable-local-repo \
--stack hdfs,yarn,mapreduce,hbase \
--smoke-tests hbase
...(snip)
Now testing...
:bigtop-tests:smoke-tests:hbase:test (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 4 mins 29.598 secs.
BUILD SUCCESSFUL in 5m 51s
36 actionable tasks: 9 executed, 27 up-to-date
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1090115622
Hmm. Installing hbase RPM on CentOS 7 failed with non-existing dependencies.
```
Error: Could not update: Execution of '/usr/bin/yum -d 0 -e 0 -y install hbase-thrift' returned 1: Error: Package: hbase-2.4.11-1.el7.x86_64 (bigtop-home_output)
Requires: osgi(org.glassfish.hk2.hk2)
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
Wrapped exception:
Execution of '/usr/bin/yum -d 0 -e 0 -y install hbase-thrift' returned 1: Error: Package: hbase-2.4.11-1.el7.x86_64 (bigtop-home_output)
Requires: osgi(org.glassfish.hk2.hk2)
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
```
```
$ rpm -q -p --requires output/hbase/x86_64/hbase-2.4.11-1.el7.x86_64.rpm
/bin/bash
/bin/sh
/bin/sh
/bin/sh
/sbin/chkconfig
/sbin/service
/usr/bin/env
/usr/sbin/useradd
bigtop-utils >= 0.7
config(hbase) = 2.4.11-1.el7
coreutils
hadoop-client
osgi(commonj.sdo)
osgi(org.eclipse.persistence.core)
osgi(org.glassfish.hk2.hk2)
rpmlib(CompressedFileNames) <= 3.0.4-1
rpmlib(FileDigests) <= 4.6.0-1
rpmlib(PayloadFilesHavePrefix) <= 4.0-1
zookeeper >= 3.3.1
rpmlib(PayloadIsXz) <= 5.2-1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims merged pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims merged PR #882:
URL: https://github.com/apache/bigtop/pull/882
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1090145398
We seem to have `AutoReq: no` in the SPEC as a workaround for the same issue.
```
$ find . -name '*.spec' | xargs grep AutoReq
./bigtop-packages/src/rpm/ambari/SPECS/ambari.spec:AutoReqProv: no
./bigtop-packages/src/rpm/ambari/SPECS/ambari.spec:AutoReqProv: no
./bigtop-packages/src/rpm/ambari/SPECS/ambari.spec:AutoReqProv: no
./bigtop-packages/src/rpm/bigtop-ambari-mpack/SPECS/bigtop-ambari-mpack.spec:AutoReqProv: no
./bigtop-packages/src/rpm/gpdb/SPECS/gpdb.spec:AutoReqProv: %{autorequire}
./bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec:# to set AutoReq to no in order to minimize confusion. Not ideal, but seems to work.
./bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec:AutoReq: no
./bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec:AutoReq: no
./bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec:AutoReq: no
./bigtop-packages/src/rpm/kibana/SPECS/kibana.spec:AutoReqProv: no
./bigtop-packages/src/rpm/logstash/SPECS/logstash.spec:AutoReqProv: no
./bigtop-packages/src/rpm/ycsb/SPECS/ycsb.spec:AutoReq: no
./bigtop-packages/src/rpm/zeppelin/SPECS/zeppelin.spec:AutoReq: no
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1090072471
I removed `-Dslf4j.version=1.7.25` from MVN_ARGS to solve the following error. It was set for HBase 1.5.0 by BIGTOP-3297. It is useless now.
```
[WARNING] The POM for org.slf4j:slf4j-reload4j:jar:1.7.25 is missing, no dependency information available
```
Recent slf4j-log4j12 artifact is automatically replaced by slf4j-reload4j.
https://www.slf4j.org/news.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1091216131
I got no issue on building phoenix against HBase 2.4.11 and manual testing.
```
$ ./docker-hadoop.sh --create 1 --image bigtop/puppet:trunk-centos-7 --memory 16g --repo file:///bigtop-home/output --disable-gpg-check --stack hdfs,yarn,mapreduce,hbase
$ ./docker-hadoop.sh --exec 1 /bin/bash
# yum --setopt='tsflags=' install phoenix
# ln -s /usr/lib/phoenix/phoenix-server.jar /usr/lib/hbase/lib/phoenix-server.jar
# systemctl restart hbase-master hbase-regionserver
# python3 /usr/lib/phoenix/bin/psql.py /usr/share/doc/phoenix-5.1.2/examples/STOCK_SYMBOL.sql /usr/share/doc/phoenix-5.1.2/examples/STOCK_SYMBOL.csv
# python3 /usr/lib/phoenix/bin/sqlline.py
> SELECT * FROM stock_symbol;
+--------+----------------------+
| SYMBOL | COMPANY |
+--------+----------------------+
| AAPL | APPLE Inc. |
| CRM | SALESFORCE |
| GOOG | Google |
| HOG | Harlet-Davidson Inc. |
| HPQ | Hewlett Packard |
| INTC | Intel |
| MSFT | Microsoft |
| WAG | Walgreens |
| WMT | Walmart |
+--------+----------------------+
9 rows selected (0.052 seconds)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1094494355
I merged this to master. Thanks, @sekikn.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #882: BIGTOP-3662. Bump HBase to 2.4.11.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on PR #882:
URL: https://github.com/apache/bigtop/pull/882#issuecomment-1090200617
dependency of CentOS 7 RPM after disable AutoReq:
```
$ rpm -q -p --requires output/hbase/x86_64/hbase-2.4.11-1.el7.x86_64.rpm
coreutils
/usr/sbin/useradd
/sbin/chkconfig
/sbin/service
hadoop-client
zookeeper >= 3.3.1
bigtop-utils >= 0.7
/bin/sh
/bin/sh
/bin/sh
rpmlib(FileDigests) <= 4.6.0-1
rpmlib(PayloadFilesHavePrefix) <= 4.0-1
rpmlib(CompressedFileNames) <= 3
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org