You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2020/11/09 10:52:06 UTC
[GitHub] [bigtop] elukey opened a new pull request #694: BIGTOP-3440: disable flume solr sink to avoid build failures
elukey opened a new pull request #694:
URL: https://github.com/apache/bigtop/pull/694
The solr sink currently depends on kite, that it is a library not
developed anymore. There are currently build failures due to
the ua_parser library, that was available in a Twitter maven repository
not maintained anymore (since it throws HTTP 503s consistently).
Flume upstream moved the dependency to another repository,
https://github.com/apache/flume/commit/9e0bc5bf4865673e6989ba887d27f468991c1e27
that fixes the Twitter problem but that brings in another build failure
for the 'rome' dependency.
This commit removes the solr sink from the build list, resolving the
overall build problem for Flume.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #694: BIGTOP-3440: disable flume solr sink to avoid build failures
Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #694:
URL: https://github.com/apache/bigtop/pull/694#issuecomment-724030953
+1, tested on Ubuntu 18.04 x86_64 and confirmed that flume was successfully built (without Solr sink). Thanks for the PR @elukey!
```
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Build Support ...................................... SUCCESS [ 1.941 s]
[INFO] Apache Flume 1.9.0 ................................. SUCCESS [ 8.033 s]
[INFO] Flume NG SDK ....................................... SUCCESS [ 33.693 s]
[INFO] Flume NG Hadoop Credential Store Config Filter ..... SUCCESS [ 0.276 s]
[INFO] Flume NG Config Filters API ........................ SUCCESS [ 8.180 s]
[INFO] Flume NG Configuration ............................. SUCCESS [ 16.062 s]
[INFO] Flume Auth ......................................... SUCCESS [03:10 min]
[INFO] Flume NG Core ...................................... SUCCESS [ 56.265 s]
[INFO] Flume NG Sinks ..................................... SUCCESS [ 0.402 s]
[INFO] Flume NG HDFS Sink ................................. SUCCESS [ 17.729 s]
[INFO] Flume NG IRC Sink .................................. SUCCESS [ 7.439 s]
[INFO] Flume NG Channels .................................. SUCCESS [ 3.010 s]
[INFO] Flume NG JDBC channel .............................. SUCCESS [ 16.148 s]
[INFO] Flume NG file-based channel ........................ SUCCESS [ 28.746 s]
[INFO] Flume NG Spillable Memory channel .................. SUCCESS [ 8.827 s]
[INFO] Flume NG Node ...................................... SUCCESS [ 15.185 s]
[INFO] Flume NG Embedded Agent ............................ SUCCESS [ 8.296 s]
[INFO] Flume NG HBase Sink ................................ SUCCESS [ 18.920 s]
[INFO] Flume NG HBase2 Sink ............................... SUCCESS [ 24.145 s]
[INFO] Flume NG ElasticSearch Sink ........................ SUCCESS [ 10.565 s]
[INFO] Flume Shared Utils ................................. SUCCESS [ 0.229 s]
[INFO] Flume Shared Kafka ................................. SUCCESS [ 6.870 s]
[INFO] Flume Shared Kafka Test Utils ...................... SUCCESS [ 11.984 s]
[INFO] Flume Kafka Sink ................................... SUCCESS [ 9.674 s]
[INFO] Flume HTTP/S Sink .................................. SUCCESS [ 10.824 s]
[INFO] Flume NG Kite Dataset Sink ......................... SUCCESS [ 43.380 s]
[INFO] Flume NG Hive Sink ................................. SUCCESS [ 23.820 s]
[INFO] Flume Sources ...................................... SUCCESS [ 0.176 s]
[INFO] Flume Scribe Source ................................ SUCCESS [ 10.006 s]
[INFO] Flume JMS Source ................................... SUCCESS [ 8.107 s]
[INFO] Flume Twitter Source ............................... SUCCESS [ 7.730 s]
[INFO] Flume Kafka Source ................................. SUCCESS [ 9.082 s]
[INFO] Flume Taildir Source ............................... SUCCESS [ 10.835 s]
[INFO] flume-kafka-channel ................................ SUCCESS [ 9.513 s]
[INFO] Flume legacy Sources ............................... SUCCESS [ 0.075 s]
[INFO] Flume legacy Avro source ........................... SUCCESS [ 6.981 s]
[INFO] Flume legacy Thrift Source ......................... SUCCESS [ 10.253 s]
[INFO] Flume NG Environment Variable Config Filter ........ SUCCESS [ 4.611 s]
[INFO] flume-ng-hadoop-credential-store-config-filter ..... SUCCESS [ 6.117 s]
[INFO] Flume NG External Process Config Filter ............ SUCCESS [ 4.771 s]
[INFO] Flume NG Clients ................................... SUCCESS [ 0.095 s]
[INFO] Flume NG Log4j Appender ............................ SUCCESS [ 10.936 s]
[INFO] Flume NG Tools ..................................... SUCCESS [ 6.751 s]
[INFO] Flume NG distribution .............................. SUCCESS [ 15.288 s]
[INFO] Flume NG Integration Tests 1.9.0 ................... SUCCESS [ 6.600 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 11:49 min
[INFO] Finished at: 2020-11-09T22:53:09+09:00
[INFO] ------------------------------------------------------------------------
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn merged pull request #694: BIGTOP-3440: disable flume solr sink to avoid build failures
Posted by GitBox <gi...@apache.org>.
sekikn merged pull request #694:
URL: https://github.com/apache/bigtop/pull/694
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] evans-ye commented on pull request #694: BIGTOP-3440: disable flume solr sink to avoid build failures
Posted by GitBox <gi...@apache.org>.
evans-ye commented on pull request #694:
URL: https://github.com/apache/bigtop/pull/694#issuecomment-724510129
LGTM. Thanks @elukey @sekikn .
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org