You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/10/21 10:48:24 UTC
[GitHub] [incubator-seatunnel] harveyyue commented on pull request #3146: [Improve][Connector-V2][ElasticSearch] Add index_id option to specify the primary keys for index
harveyyue commented on PR #3146:
URL: https://github.com/apache/incubator-seatunnel/pull/3146#issuecomment-1286787232
Currently, I disabled this e2e module because the spark container is running without any response, but the flink is work fine.
Flink log:
`==================== ExecuteConfigFile: /tmp/fake-to-elasticsearch.conf STDOUT end ====================
22/10/21 18:01:36 WARN RestClient: request [POST http://localhost:65164/seatunnel_test_e2e/_search] returned 1 warnings: [299 Elasticsearch-7.17.6-f65e9d338dc1d07b642e14a27f338990148ee5b6 "Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html to enable security."]
22/10/21 18:01:36 INFO 11_hadoop27:jobmanager]: STDOUT: 2022-10-21 10:01:36,845 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink-metrics@172.18.0.4:41155] has failed, address is now gated for [50] ms. Reason: [Disassociated]
22/10/21 18:01:36 INFO 11_hadoop27:jobmanager]: STDOUT: 2022-10-21 10:01:36,846 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@172.18.0.4:37045] has failed, address is now gated for [50] ms. Reason: [Disassociated]
22/10/21 18:01:37 INFO TestCaseInvocationContextProvider: The TestContainer[Flink:1.13.6] is closed.
22/10/21 18:01:37 INFO TestLoggerExtension: `
Spark log:
`22/10/21 18:01:38 INFO 6]: Container bitnami/spark:2.4.6 is starting: 3720681794bea6b4daf5db1cfcf66dc576bd1ec6e869a41fe0f75f506dcb690b
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.73
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.73 Welcome to the Bitnami spark container
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.74 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-spark
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.74 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-spark/issues
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.74
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.74 INFO ==> ** Starting Spark setup **
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.83 INFO ==> Generating Spark configuration file...
22/10/21 18:01:38 INFO 6]: STDOUT:
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.84 INFO ==> ** Spark setup finished! **
22/10/21 18:01:38 INFO 6]: STDERR: 10:01:38.86 INFO ==> ** Starting Spark in master mode **
22/10/21 18:01:38 INFO 6]: STDOUT: starting org.apache.spark.deploy.master.Master, logging to /opt/bitnami/spark/logs/spark--org.apache.spark.deploy.master.Master-1-3720681794be.out
22/10/21 18:01:39 INFO 6]: STDERR: Spark Command: /opt/bitnami/java/bin/java -cp /opt/bitnami/spark/conf/:/opt/bitnami/spark/jars/* -Xmx1g org.apache.spark.deploy.master.Master --host 3720681794be --port 7077 --webui-port 8080
22/10/21 18:01:39 INFO 6]: STDERR: ========================================
22/10/21 18:01:40 INFO 6]: STDERR: Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
22/10/21 18:01:40 INFO 6]: STDERR: 22/10/21 10:01:40 INFO Master: Started daemon with process name: 56@3720681794be
22/10/21 18:01:40 INFO 6]: STDERR: 22/10/21 10:01:40 INFO SignalUtils: Registered signal handler for TERM
22/10/21 18:01:40 INFO 6]: STDERR: 22/10/21 10:01:40 INFO SignalUtils: Registered signal handler for HUP
22/10/21 18:01:40 INFO 6]: STDERR: 22/10/21 10:01:40 INFO SignalUtils: Registered signal handler for INT
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 INFO SecurityManager: Changing view acls to: spark
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 INFO SecurityManager: Changing modify acls to: spark
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 INFO SecurityManager: Changing view acls groups to:
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 INFO SecurityManager: Changing modify acls groups to:
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set()
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 INFO Utils: Successfully started service 'sparkMaster' on port 7077.
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 INFO Master: Starting Spark master at spark://3720681794be:7077
22/10/21 18:01:41 INFO 6]: Container bitnami/spark:2.4.6 started in PT4.363S
22/10/21 18:01:41 INFO TestCaseInvocationContextProvider: The TestContainer[Spark:2.4.3] is running.
22/10/21 18:01:41 INFO 6]: STDERR: 22/10/21 10:01:41 INFO Master: Running Spark version 2.4.6
22/10/21 18:01:42 INFO 6]: STDERR: 22/10/21 10:01:42 INFO Utils: Successfully started service 'MasterUI' on port 8080.
22/10/21 18:01:42 INFO 6]: STDERR: 22/10/21 10:01:42 INFO MasterWebUI: Bound MasterWebUI to 0.0.0.0, and started at http://3720681794be:8080
22/10/21 18:01:42 INFO 6]: STDERR: 22/10/21 10:01:42 INFO Master: I have been elected leader! New state: ALIVE`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org