You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by me...@apache.org on 2018/02/27 17:57:02 UTC
[beam-site] branch asf-site updated (e51719a -> 1333c13)
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.
from e51719a Prepare repository for deployment.
add b4d09a2 Updates list of built-in IO transforms
add d77143a This closes #394
new 1333c13 Prepare repository for deployment.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
content/documentation/io/built-in/index.html | 25 ++++++++--------------
.../get-started/mobile-gaming-example/index.html | 4 ++--
src/documentation/io/built-in.md | 25 ++++++++--------------
3 files changed, 20 insertions(+), 34 deletions(-)
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.
[beam-site] 01/01: Prepare repository for deployment.
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit 1333c13e61849c00947efee7c4647959024b984a
Author: Mergebot <me...@apache.org>
AuthorDate: Tue Feb 27 09:57:00 2018 -0800
Prepare repository for deployment.
---
content/documentation/io/built-in/index.html | 25 ++++++++--------------
.../get-started/mobile-gaming-example/index.html | 4 ++--
2 files changed, 11 insertions(+), 18 deletions(-)
diff --git a/content/documentation/io/built-in/index.html b/content/documentation/io/built-in/index.html
index 4877274..272f241 100644
--- a/content/documentation/io/built-in/index.html
+++ b/content/documentation/io/built-in/index.html
@@ -211,11 +211,13 @@
<tr>
<td>Java</td>
<td>
- <p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/hadoop-file-system">Apache Hadoop File System</a></p>
+ <p>Beam Java supports Apache HDFS, Amazon S3, Google Cloud Storage, and local filesystems.</p>
+ <p><a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/FileIO.java">FileIO</a> (general-purpose reading, writing, and matching of files)</p>
<p><a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/AvroIO.java">AvroIO</a></p>
<p><a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TextIO.java">TextIO</a></p>
<p><a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java">TFRecordIO</a></p>
- <p><a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/">XML</a></p>
+ <p><a href="https://github.com/apache/beam/blob/master/sdks/java/io/xml/src/main/java/org/apache/beam/sdk/io/xml/XmlIO.java">XmlIO</a></p>
+ <p><a href="https://github.com/apache/beam/blob/master/sdks/java/io/tika/src/main/java/org/apache/beam/sdk/io/tika/TikaIO.java">TikaIO</a></p>
</td>
<td>
<p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/kinesis">Amazon Kinesis</a></p>
@@ -235,6 +237,7 @@
<p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery">Google BigQuery</a></p>
<p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable">Google Cloud Bigtable</a></p>
<p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore">Google Cloud Datastore</a></p>
+ <p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner">Google Cloud Spanner</a></p>
<p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/jdbc">JDBC</a></p>
<p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/mongodb">MongoDB</a></p>
<p><a href="https://github.com/apache/beam/tree/master/sdks/java/io/redis">Redis</a></p>
@@ -243,9 +246,11 @@
<tr>
<td>Python</td>
<td>
+ <p>Beam Python supports Google Cloud Storage and local filesystems.</p>
<p><a href="https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/avroio.py">avroio</a></p>
<p><a href="https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/textio.py">textio</a></p>
<p><a href="https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/tfrecordio.py">tfrecordio</a></p>
+ <p><a href="https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/vcfio.py">vcfio</a></p>
</td>
<td>
</td>
@@ -266,8 +271,8 @@
<th>Name</th><th>Language</th><th>JIRA</th>
</tr>
<tr>
- <td>Amazon S3 File System</td><td>Java</td>
- <td><a href="https://issues.apache.org/jira/browse/BEAM-2500">BEAM-2500</a></td>
+ <td>Apache HDFS support</td><td>Python</td>
+ <td><a href="https://issues.apache.org/jira/browse/BEAM-3099">BEAM-3099</a></td>
</tr>
<tr>
<td>Apache DistributedLog</td><td>Java</td>
@@ -286,18 +291,10 @@
<td><a href="https://issues.apache.org/jira/browse/BEAM-1893">BEAM-1893</a></td>
</tr>
<tr>
- <td>Google Cloud Spanner</td><td>Java</td>
- <td><a href="https://issues.apache.org/jira/browse/BEAM-1542">BEAM-1542</a></td>
- </tr>
- <tr>
<td>InfluxDB</td><td>Java</td>
<td><a href="https://issues.apache.org/jira/browse/BEAM-2546">BEAM-2546</a></td>
</tr>
<tr>
- <td>JSON</td><td>Java</td>
- <td><a href="https://issues.apache.org/jira/browse/BEAM-1581">BEAM-1581</a></td>
- </tr>
- <tr>
<td>Memcached</td><td>Java</td>
<td><a href="https://issues.apache.org/jira/browse/BEAM-1678">BEAM-1678</a></td>
</tr>
@@ -313,10 +310,6 @@
<td>RestIO</td><td>Java</td>
<td><a href="https://issues.apache.org/jira/browse/BEAM-1946">BEAM-1946</a></td>
</tr>
- <tr>
- <td>TikaIO</td><td>Java</td>
- <td><a href="https://issues.apache.org/jira/browse/BEAM-2328">BEAM-2328</a></td>
- </tr>
</table>
</div>
diff --git a/content/get-started/mobile-gaming-example/index.html b/content/get-started/mobile-gaming-example/index.html
index 1d6a84a..8a63425 100644
--- a/content/get-started/mobile-gaming-example/index.html
+++ b/content/get-started/mobile-gaming-example/index.html
@@ -957,8 +957,8 @@ late results.</em></p>
<span class="n">sum_scores</span>
<span class="c"># Use the derived mean total score (global_mean_score) as a side input.</span>
<span class="o">|</span> <span class="s">'ProcessAndFilter'</span> <span class="o">>></span> <span class="n">beam</span><span class="o">.</span><span class="n">Filter</span><span class="p">(</span>
- <span class="k">lambda</span> <span class="p">(</span><span class="n">_</span><span class="p">,</span> <span class="n">score</span><span class="p">),</span> <span class="n">global_mean</span><span class="p">:</span>\
- <span class="n">score</span> <span class="o">></span> <span class="n">global_mean</span> <span class="o">*</span> <span class="bp">self</span><span class="o">.</span><span class="n">SCORE_WEIGHT</span><span class="p">,</span>
+ <span class="k">lambda</span> <span class="n">key_score</span><span class="p">,</span> <span class="n">global_mean</span><span class="p">:</span>\
+ <span class="n">key_score</span><span class="p">[</span><span class="mi">1</span><span class="p">]</span> <span class="o">></span> <span class="n">global_mean</span> <span class="o">*</span> <span class="bp">self</span><span class="o">.</span><span class="n">SCORE_WEIGHT</span><span class="p">,</span>
<span class="n">global_mean_score</span><span class="p">))</span>
<span class="k">return</span> <span class="n">filtered</span>
</code></pre>
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.