You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by mx...@apache.org on 2015/07/01 11:21:22 UTC
flink-web git commit: merge FAQ from main repository and use
variables for URLs
Repository: flink-web
Updated Branches:
refs/heads/asf-site 630f25830 -> e418ca0f2
merge FAQ from main repository and use variables for URLs
Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/e418ca0f
Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/e418ca0f
Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/e418ca0f
Branch: refs/heads/asf-site
Commit: e418ca0f2e590ed0da960d8cfd38d18b6a428a10
Parents: 630f258
Author: Maximilian Michels <mx...@apache.org>
Authored: Wed Jul 1 11:16:55 2015 +0200
Committer: Maximilian Michels <mx...@apache.org>
Committed: Wed Jul 1 11:19:47 2015 +0200
----------------------------------------------------------------------
content/faq.html | 25 ++++++++++++++++++++++---
faq.md | 42 ++++++++++++++++++++++++++++++++----------
2 files changed, 54 insertions(+), 13 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/flink-web/blob/e418ca0f/content/faq.html
----------------------------------------------------------------------
diff --git a/content/faq.html b/content/faq.html
index 2884f16..85fa392 100644
--- a/content/faq.html
+++ b/content/faq.html
@@ -5,7 +5,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
- <title>Apache Flink: F.A.Q.</title>
+ <title>Apache Flink: Frequently Asked Questions (FAQ)</title>
<link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
<link rel="icon" href="/favicon.ico" type="image/x-icon">
@@ -142,9 +142,28 @@
<div class="row">
<div class="col-sm-8 col-sm-offset-2">
<div class="row">
- <div class="col-sm-12"><h1>F.A.Q.</h1></div>
+ <div class="col-sm-12"><h1>Frequently Asked Questions (FAQ)</h1></div>
</div>
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
<p>The following questions are frequently asked with regard to the Flink project <strong>in general</strong>. If you have further questions, make sure to consult the <a href="">documentation</a> or <a href="">ask the community</a>.</p>
<div class="page-toc">
@@ -276,7 +295,7 @@ parallelism has to be 1 and set it accordingly.</p>
<p>The parallelism can be set in numerous ways to ensure a fine-grained control
over the execution of a Flink program. See
the <a href="http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#common-options">Configuration guide</a> for detailed instructions on how to
-set the parallelism. Also check out <a href="http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#configuring-taskmanager-processing-slots">this figure</a> detailing
+set the parallelism. Also check out <a href="http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#configuring-taskmanager-processing-slots">this figure</a> detailing
how the processing slots and parallelism are related to each other.</p>
<h2 id="errors">Errors</h2>
http://git-wip-us.apache.org/repos/asf/flink-web/blob/e418ca0f/faq.md
----------------------------------------------------------------------
diff --git a/faq.md b/faq.md
index a8c0c8e..85299e8 100644
--- a/faq.md
+++ b/faq.md
@@ -1,11 +1,33 @@
---
-title: "F.A.Q."
+title: "Frequently Asked Questions (FAQ)"
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
The following questions are frequently asked with regard to the Flink project **in general**. If you have further questions, make sure to consult the [documentation]() or [ask the community]().
{% toc %}
+
+
+
+
## General
### Is Flink a Hadoop Project?
@@ -60,10 +82,10 @@ of the master and the worker where the exception occurred
### How do I debug Flink programs?
-- When you start a program locally with the [LocalExecutor](http://ci.apache.org/projects/flink/flink-docs-master/apis/local_execution.html),
+- When you start a program locally with the [LocalExecutor]({{site.docs-snapshot}}/apis/local_execution.html),
you can place breakpoints in your functions and debug them like normal
Java/Scala programs.
-- The [Accumulators](http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#accumulators--counters) are very helpful in
+- The [Accumulators]({{ site.docs-snapshot }}/apis/programming_guide.html#accumulators--counters) are very helpful in
tracking the behavior of the parallel execution. They allow you to gather
information inside the program's operations and show them after the program
execution.
@@ -86,8 +108,8 @@ parallelism has to be 1 and set it accordingly.
The parallelism can be set in numerous ways to ensure a fine-grained control
over the execution of a Flink program. See
-the [Configuration guide](http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#common-options) for detailed instructions on how to
-set the parallelism. Also check out [this figure](http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#configuring-taskmanager-processing-slots) detailing
+the [Configuration guide]({{ site.docs-snapshot }}/setup/config.html#common-options) for detailed instructions on how to
+set the parallelism. Also check out [this figure]({{ site.docs-snapshot }}/setup/config.html#configuring-taskmanager-processing-slots) detailing
how the processing slots and parallelism are related to each other.
## Errors
@@ -122,7 +144,7 @@ def myFunction[T: TypeInformation](input: DataSet[T]): DataSet[Seq[T]] = {
}
~~~
-See [Type Extraction and Serialization](http://ci.apache.org/projects/flink/flink-docs-master/internals/types_serialization.html) for
+See [Type Extraction and Serialization]({{ site.docs-snapshot }}/internals/types_serialization.html) for
an in-depth discussion of how Flink handles types.
### I get an error message saying that not enough buffers are available. How do I fix this?
@@ -132,7 +154,7 @@ you need to adapt the number of network buffers via the config parameter
`taskmanager.network.numberOfBuffers`.
As a rule-of-thumb, the number of buffers should be at least
`4 * numberOfNodes * numberOfTasksPerNode^2`. See
-[Configuration Reference](http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html) for details.
+[Configuration Reference]({{ site.docs-snapshot }}/setup/config.html) for details.
### My job fails early with a java.io.EOFException. What could be the cause?
@@ -250,7 +272,7 @@ destage operations to disk, if necessary. By default, the system reserves around
70% of the memory. If you frequently run applications that need more memory in
the user-defined functions, you can reduce that value using the configuration
entries `taskmanager.memory.fraction` or `taskmanager.memory.size`. See the
-[Configuration Reference](http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html) for details. This will leave more memory to JVM heap,
+[Configuration Reference]({{ site.docs-snapshot }}/setup/config.html) for details. This will leave more memory to JVM heap,
but may cause data processing tasks to go to disk more often.
### Why do the TaskManager log files become so huge?
@@ -367,9 +389,9 @@ open source project in the next versions.
### Are Hadoop-like utilities, such as Counters and the DistributedCache supported?
-[Flink's Accumulators](http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#accumulators--counters) work very similar like
+[Flink's Accumulators]({{ site.docs-snapshot }}/apis/programming_guide.html#accumulators--counters) work very similar like
[Hadoop's counters, but are more powerful.
Flink has a {% github /flink-core/src/main/java/org/apache/flink/api/common/cache/DistributedCache.java "Distributed Cache" %} that is deeply integrated with the APIs. Please refer to the {% github /flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java#L561 "JavaDocs" %} for details on how to use it.
-In order to make data sets available on all tasks, we encourage you to use [Broadcast Variables](http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#broadcast-variables) instead. They are more efficient and easier to use than the distributed cache.
+In order to make data sets available on all tasks, we encourage you to use [Broadcast Variables]({{ site.docs-snapshot }}/apis/programming_guide.html#broadcast-variables) instead. They are more efficient and easier to use than the distributed cache.