You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "brighteast (JIRA)" <ji...@apache.org> on 2017/09/06 07:22:01 UTC
[jira] [Created] (FLINK-7592) How to close the output log like
"Connected to JobManager at Actor" and "Job execution switched to status
RUNNING."?
brighteast created FLINK-7592:
---------------------------------
Summary: How to close the output log like "Connected to JobManager at Actor" and "Job execution switched to status RUNNING."?
Key: FLINK-7592
URL: https://issues.apache.org/jira/browse/FLINK-7592
Project: Flink
Issue Type: Wish
Components: Configuration
Affects Versions: 1.3.2
Environment: jdk 1.8
Reporter: brighteast
Fix For: 1.3.2
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#1060959513] with leader session id 59ff044a-ab2b-4518-b7b8-8352da361511.
09/06/2017 15:06:35 Job execution switched to status RUNNING.
09/06/2017 15:06:35 CHAIN DataSource (at org.apache.flink.api.scala.ExecutionEnvironment.fromElements(ExecutionEnvironment.scala:601) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:10)) -> Map (Map at flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:11)) -> Combine(SUM(1))(1/1) switched to SCHEDULED
09/06/2017 15:06:35 CHAIN DataSource (at org.apache.flink.api.scala.ExecutionEnvironment.fromElements(ExecutionEnvironment.scala:601) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:10)) -> Map (Map at flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:11)) -> Combine(SUM(1))(1/1) switched to DEPLOYING
09/06/2017 15:06:35 CHAIN DataSource (at org.apache.flink.api.scala.ExecutionEnvironment.fromElements(ExecutionEnvironment.scala:601) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:10)) -> Map (Map at flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:11)) -> Combine(SUM(1))(1/1) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(2/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(1/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(3/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(4/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(5/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(6/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(7/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(8/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(4/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(8/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(7/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(6/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(3/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(1/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(5/8) switched to DEPLOYING
09/06/2017 15:06:35 CHAIN DataSource (at org.apache.flink.api.scala.ExecutionEnvironment.fromElements(ExecutionEnvironment.scala:601) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:10)) -> Map (Map at flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:11)) -> Combine(SUM(1))(1/1) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(2/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(5/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(8/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(7/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(2/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(3/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(6/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(4/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(1/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(1/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(8/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(8/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(1/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(4/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(4/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(1/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(8/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(4/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(5/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(5/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(2/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(2/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(5/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(2/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(3/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(3/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(3/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(6/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(6/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(6/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(7/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(7/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(5/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(5/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(4/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(1/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(8/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(4/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(1/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(7/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(6/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(8/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(2/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(2/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(6/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(3/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(7/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(3/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(7/8) switched to FINISHED
09/06/2017 15:06:35 Job execution switched to status FINISHED.
(is,1)
(a,1)
(in,1)
(mind,1)
(or,2)
(against,1)
(arms,1)
(not,1)
(sea,1)
(the,3)
(troubles,1)
('tis,1)
(fortune,1)
(take,1)
(to,4)
(and,1)
(arrows,1)
(nobler,1)
(of,2)
(be,,1)
(slings,1)
(suffer,1)
(outrageous,1)
(whether,1)
(be,--that,1)
(question:--,1)
The above are the output of these run:
import org.apache.flink.api.scala._
object flinkTest extends App {
val flink=ExecutionEnvironment.getExecutionEnvironment
val text = flink.fromElements("To be, or not to be,--that is the question:--",
"Whether 'tis nobler in the mind to suffer", "The slings and arrows of outrageous fortune",
"Or to take arms against a sea of troubles")
val counts = text.flatMap { _.toLowerCase.split("\\s+") }
.map { (_, 1) }
.groupBy(0)
.sum(1)
// execute and print result
counts.print()
}
how to close the log like "Reduce (SUM(1))(3/8) switched to FINISHED"? I attemp to set off those logging output by configure akka's log, but in vain. If the log were closed, many disk space could be saved a lot.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)