You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@bahir.apache.org by lr...@apache.org on 2020/03/14 04:21:44 UTC
[bahir-website] branch master updated (84f20db -> c7eb176)
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/bahir-website.git.
from 84f20db Release 2.3.3 updates
new 417f435 Set ASSETH_PATH for theme assets
new aa57e44 Fix sample code syntax for pubnub extension
new db3cf05 Fix broken link generation
new 37ddaf3 Update README with jekyll version
new 9f28dd7 Release 2.3.4 updates
new 419b1d4 Update Apache download URL
new c7eb176 Cleanup obsolete news items
The 7 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 2 +-
site/_config.yml | 6 +++-
site/_data/project.yml | 8 ++---
site/_data/releases.yml | 9 ++++++
site/_posts/2015-09-25-release-0.1.0.md | 31 ------------------
site/_posts/2015-11-08-new-committers.md | 31 ------------------
site/_posts/2015-11-10-release-0.2.0.md | 34 --------------------
site/docs/spark/2.3.0/spark-streaming-pubnub.md | 16 +++++-----
site/docs/spark/2.3.1/spark-streaming-pubnub.md | 16 +++++-----
site/docs/spark/2.3.2/spark-streaming-pubnub.md | 16 +++++-----
site/docs/spark/current/spark-streaming-pubnub.md | 16 +++++-----
.../spark/{2.3.3 => 2.3.4}/release-notes.md | 37 +---------------------
12 files changed, 52 insertions(+), 170 deletions(-)
delete mode 100644 site/_posts/2015-09-25-release-0.1.0.md
delete mode 100644 site/_posts/2015-11-08-new-committers.md
delete mode 100644 site/_posts/2015-11-10-release-0.2.0.md
copy site/releases/spark/{2.3.3 => 2.3.4}/release-notes.md (97%)
[bahir-website] 07/07: Cleanup obsolete news items
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/bahir-website.git
commit c7eb1766c6e9c93c48d08dcf171b5bcde822ce12
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Fri Mar 13 21:21:12 2020 -0700
Cleanup obsolete news items
---
site/_posts/2015-09-25-release-0.1.0.md | 31 -----------------------------
site/_posts/2015-11-08-new-committers.md | 31 -----------------------------
site/_posts/2015-11-10-release-0.2.0.md | 34 --------------------------------
3 files changed, 96 deletions(-)
diff --git a/site/_posts/2015-09-25-release-0.1.0.md b/site/_posts/2015-09-25-release-0.1.0.md
deleted file mode 100644
index 3125b4b..0000000
--- a/site/_posts/2015-09-25-release-0.1.0.md
+++ /dev/null
@@ -1,31 +0,0 @@
----
-layout: news_item
-date: "2015-09-25 12:00:00 +0000"
-author: jhyde
-version: 0.1.0
-categories: [release]
-tag: v0-1-0
-sha: cafecafe
----
-<!--
-{% comment %}
-Licensed to the Apache Software Foundation (ASF) under one or more
-contributor license agreements. See the NOTICE file distributed with
-this work for additional information regarding copyright ownership.
-The ASF licenses this file to you under the Apache License, Version 2.0
-(the "License"); you may not use this file except in compliance with
-the License. You may obtain a copy of the License at
-
-http://www.apache.org/licenses/LICENSE-2.0
-
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
-{% endcomment %}
--->
-
-This is our first release!
-
-We're so pleased to be in the Apache Incbuator.
\ No newline at end of file
diff --git a/site/_posts/2015-11-08-new-committers.md b/site/_posts/2015-11-08-new-committers.md
deleted file mode 100644
index 95fc4bf..0000000
--- a/site/_posts/2015-11-08-new-committers.md
+++ /dev/null
@@ -1,31 +0,0 @@
----
-layout: news_item
-title: "Project adds 2 committers"
-date: "2015-11-08 19:03:07 -0800"
-author: jhyde
-categories: [team]
----
-<!--
-{% comment %}
-Licensed to the Apache Software Foundation (ASF) under one or more
-contributor license agreements. See the NOTICE file distributed with
-this work for additional information regarding copyright ownership.
-The ASF licenses this file to you under the Apache License, Version 2.0
-(the "License"); you may not use this file except in compliance with
-the License. You may obtain a copy of the License at
-
-http://www.apache.org/licenses/LICENSE-2.0
-
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
-{% endcomment %}
--->
-
-The {{ site.data.project.short_name }} project management committee today added two new
-committers for their work on the project. Welcome!
-
-* Darth Vader
-* Princess Leia
diff --git a/site/_posts/2015-11-10-release-0.2.0.md b/site/_posts/2015-11-10-release-0.2.0.md
deleted file mode 100644
index cb1bad7..0000000
--- a/site/_posts/2015-11-10-release-0.2.0.md
+++ /dev/null
@@ -1,34 +0,0 @@
----
-layout: news_item
-date: "2015-11-10 12:00:00 +0000"
-author: lresenda
-version: 0.2.0
-categories: [release]
-tag: v0-2-0
-sha: ba6e43c
----
-<!--
-{% comment %}
-Licensed to the Apache Software Foundation (ASF) under one or more
-contributor license agreements. See the NOTICE file distributed with
-this work for additional information regarding copyright ownership.
-The ASF licenses this file to you under the Apache License, Version 2.0
-(the "License"); you may not use this file except in compliance with
-the License. You may obtain a copy of the License at
-
-http://www.apache.org/licenses/LICENSE-2.0
-
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
-{% endcomment %}
--->
-
-This is our second release! Thanks to everyone who has contributed to
-it.
-
-In addition to a large number of bug fixes and minor enhancements,
-this release includes faster-than-light travel and chewing gum that
-never loses its flavor.
[bahir-website] 03/07: Fix broken link generation
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/bahir-website.git
commit db3cf05874a0c89dfb43f32cc11f4fa47565bdaf
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Fri Mar 13 20:59:58 2020 -0700
Fix broken link generation
The recent Jekyll (2.4.0) requires permlink
configuration to properly generate links
to internal site pages
---
site/_config.yml | 5 ++++-
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git a/site/_config.yml b/site/_config.yml
index e013680..39bb8eb 100644
--- a/site/_config.yml
+++ b/site/_config.yml
@@ -24,7 +24,10 @@ github_username: apache
# Build settings
markdown: kramdown
-permalink: /news/:year/:month/:day/:title/
+kramdown:
+ parse_block_html: true
+
+permalink: pretty
excerpt_separator: ""
repository: https://github.com/apache/bahir-website
[bahir-website] 06/07: Update Apache download URL
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/bahir-website.git
commit 419b1d49a6237e4a8847d08a2837b9664084bce9
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Fri Mar 13 21:18:34 2020 -0700
Update Apache download URL
---
site/_data/project.yml | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/site/_data/project.yml b/site/_data/project.yml
index f31d7cc..6cf6302 100644
--- a/site/_data/project.yml
+++ b/site/_data/project.yml
@@ -60,7 +60,7 @@ spark_github_project_name: bahir
spark_latest_release: 2.3.4
spark_latest_release_date: 09/23/2019
-spark_latest_release_location: https://www.apache.org/dist/bahir/bahir-spark
+spark_latest_release_location: https://downloads.apache.org/bahir/bahir-spark
spark_latest_release_location_mirror: https://www.apache.org/dyn/closer.lua/bahir/bahir-spark
spark_download: /downloads/spark
@@ -74,7 +74,7 @@ flink_github_project_name: bahir-flink
flink_latest_release: 1.0
flink_latest_release_date: 05/24/2017
-flink_latest_release_location: https://www.apache.org/dist/bahir/bahir-flink
+flink_latest_release_location: https://downloads.apache.org/bahir/bahir-flink
flink_latest_release_location_mirror: https://www.apache.org/dyn/closer.lua/bahir/bahir-flink
flink_download: /downloads/flink
[bahir-website] 05/07: Release 2.3.4 updates
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/bahir-website.git
commit 9f28dd777ba3dfd93cef33265b22306050dc593a
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Fri Mar 13 21:16:49 2020 -0700
Release 2.3.4 updates
---
site/_data/project.yml | 4 +--
site/_data/releases.yml | 9 +++++
site/releases/spark/2.3.4/release-notes.md | 53 ++++++++++++++++++++++++++++++
3 files changed, 64 insertions(+), 2 deletions(-)
diff --git a/site/_data/project.yml b/site/_data/project.yml
index 2b889a8..f31d7cc 100644
--- a/site/_data/project.yml
+++ b/site/_data/project.yml
@@ -58,8 +58,8 @@ podling: false
spark_unix_name: bahir
spark_github_project_name: bahir
-spark_latest_release: 2.3.3
-spark_latest_release_date: 05/27/2019
+spark_latest_release: 2.3.4
+spark_latest_release_date: 09/23/2019
spark_latest_release_location: https://www.apache.org/dist/bahir/bahir-spark
spark_latest_release_location_mirror: https://www.apache.org/dyn/closer.lua/bahir/bahir-spark
spark_download: /downloads/spark
diff --git a/site/_data/releases.yml b/site/_data/releases.yml
index f2c2a75..2b5bc79 100644
--- a/site/_data/releases.yml
+++ b/site/_data/releases.yml
@@ -14,6 +14,15 @@
# limitations under the License.
#
+- version: 2.3.4
+ date: 09/23/2019
+
+- version: 2.3.3
+ date: 06/08/2019
+
+- version: 2.2.3
+ date: 06/08/2019
+
- version: 2.3.2
date: 12/04/2018
diff --git a/site/releases/spark/2.3.4/release-notes.md b/site/releases/spark/2.3.4/release-notes.md
new file mode 100644
index 0000000..ce66794
--- /dev/null
+++ b/site/releases/spark/2.3.4/release-notes.md
@@ -0,0 +1,53 @@
+---
+layout: page
+title: Bahir Release 2.1.0
+description: Release Notes for Apache Bahir 2.1.0
+group: nav-right
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+{% include JB/setup %}
+
+
+# Apache Bahir for Apache Spark 2.3.4
+
+Below are all the enhancements and bug fixes for the 2.3.x releases.
+
+
+Release Notes - Bahir - Version Spark-2.3.0
+
+ * [BAHIR-46] - Handle re-delivery of message in MQTT structured streaming source.
+ * [BAHIR-104] - MQTT Dstream returned by the new multi topic support API is not a pairRDD
+ * [BAHIR-128] - Test failing sporadically in sql-cloudant's CloudantChangesDFSuite
+ * [BAHIR-139] - Scala-maven-plugin does not respect Java compile level
+ * [BAHIR-152] - License header not enforced for Java sources
+ * [BAHIR-159] - Our project needs to use org.apache.bahir:spark-sql-streaming-mqtt_2.11:2.2.0, which has dependency conflict problem.
+ * [BAHIR-165] - The avro messages to streaming-mqtt gives negative value.
+ * [BAHIR-66] - Add test that ZeroMQ streaming connector can receive data
+ * [BAHIR-164] - Spark Streaming with MQTT fails with Spark 2.3.0
+ * [BAHIR-166] - Migrate akka sql streaming source to datasrouce v2 API
+ * [BAHIR-49] - Add MQTTSink to SQL Streaming MQTT.
+ * [BAHIR-182] - Create PubNub extension for Apache Spark Streaming
+ * [BAHIR-137] - Load performance improvements for _changes API in sql-cloudant
+ * [BAHIR-154] - Refactor sql-cloudant to use Cloudant's java-cloudant features
+ * [BAHIR-181] - username and password should be available for pyspark when using mqtt streaming
+ * [BAHIR-123] - Fix errors to support the latest version of Play JSON library for sql-cloudant
+ * [BAHIR-138] - Fix sql-cloudant deprecation messages
+ * [BAHIR-150] - Jenkins PR builder should not abort build after first failed module
[bahir-website] 01/07: Set ASSETH_PATH for theme assets
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/bahir-website.git
commit 417f4359cbb9f52ba6c7e14c4163b228cfff052d
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Fri Mar 13 20:43:16 2020 -0700
Set ASSETH_PATH for theme assets
Related to:
https://github.com/plusjade/jekyll-bootstrap/issues/290
---
site/_config.yml | 1 +
1 file changed, 1 insertion(+)
diff --git a/site/_config.yml b/site/_config.yml
index 934f923..e013680 100644
--- a/site/_config.yml
+++ b/site/_config.yml
@@ -34,6 +34,7 @@ keep_files: [".git", ".svn", "apidocs"]
# if 'analytics_on' is true, analytics section will be rendered on the HTML pages
JB:
+ ASSET_PATH: "/assets/themes/apache-clean"
analytics:
provider: google_universal
google_universal:
[bahir-website] 04/07: Update README with jekyll version
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/bahir-website.git
commit 37ddaf314655324d2ed355b54056d6e734e89f50
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Fri Mar 13 21:02:25 2020 -0700
Update README with jekyll version
---
README.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/README.md b/README.md
index 2e9b311..6252947 100644
--- a/README.md
+++ b/README.md
@@ -22,7 +22,7 @@ Apache Bahir Website
The Apache Bahir website was forked from the [Apache Website Template](https://github.com/apache/apache-website-template).
-The website gets generated using [Jekyll](https://jekyllrb.com/).
+The website gets generated using [Jekyll](https://jekyllrb.com/) 2.4.0.
How to deploy your project's web site
=====================================
[bahir-website] 02/07: Fix sample code syntax for pubnub extension
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/bahir-website.git
commit aa57e4495481bc349132bfe4588cbfbc30be2695
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Fri Mar 13 20:44:46 2020 -0700
Fix sample code syntax for pubnub extension
---
site/docs/spark/2.3.0/spark-streaming-pubnub.md | 16 ++++++++--------
site/docs/spark/2.3.1/spark-streaming-pubnub.md | 16 ++++++++--------
site/docs/spark/2.3.2/spark-streaming-pubnub.md | 16 ++++++++--------
site/docs/spark/current/spark-streaming-pubnub.md | 16 ++++++++--------
4 files changed, 32 insertions(+), 32 deletions(-)
diff --git a/site/docs/spark/2.3.0/spark-streaming-pubnub.md b/site/docs/spark/2.3.0/spark-streaming-pubnub.md
index 0ebbf88..5407747 100644
--- a/site/docs/spark/2.3.0/spark-streaming-pubnub.md
+++ b/site/docs/spark/2.3.0/spark-streaming-pubnub.md
@@ -31,11 +31,11 @@ Library for reading data from real-time messaging infrastructure [PubNub](https:
## Linking
Using SBT:
-
+
libraryDependencies += "org.apache.bahir" %% "spark-streaming-pubnub" % "2.3.0"
-
+
Using Maven:
-
+
<dependency>
<groupId>org.apache.bahir</groupId>
<artifactId>spark-streaming-pubnub_2.11</artifactId>
@@ -64,7 +64,7 @@ For complete code examples, please review _examples_ directory.
import com.pubnub.api.PNConfiguration
import com.pubnub.api.enums.PNReconnectionPolicy
-
+
import org.apache.spark.streaming.pubnub.{PubNubUtils, SparkPubNubMessage}
val config = new PNConfiguration
@@ -81,7 +81,7 @@ For complete code examples, please review _examples_ directory.
import com.pubnub.api.PNConfiguration
import com.pubnub.api.enums.PNReconnectionPolicy
-
+
import org.apache.spark.streaming.pubnub.PubNubUtils
import org.apache.spark.streaming.pubnub.SparkPubNubMessage
@@ -89,9 +89,9 @@ For complete code examples, please review _examples_ directory.
config.setSubscribeKey(subscribeKey)
config.setSecure(true)
config.setReconnectionPolicy(PNReconnectionPolicy.LINEAR)
- Set<String> channels = new HashSet<String>() {{
+ Set<String> channels = new HashSet<String>() {
add("my-channel");
- }};
+ };
ReceiverInputDStream<SparkPubNubMessage> pubNubStream = PubNubUtils.createStream(
ssc, config, channels, Collections.EMPTY_SET, null,
@@ -100,4 +100,4 @@ For complete code examples, please review _examples_ directory.
## Unit Test
-Unit tests take advantage of publicly available _demo_ subscription and and publish key, which has limited request rate.
\ No newline at end of file
+Unit tests take advantage of publicly available _demo_ subscription and and publish key, which has limited request rate.
diff --git a/site/docs/spark/2.3.1/spark-streaming-pubnub.md b/site/docs/spark/2.3.1/spark-streaming-pubnub.md
index 8b16407..8cebb51 100644
--- a/site/docs/spark/2.3.1/spark-streaming-pubnub.md
+++ b/site/docs/spark/2.3.1/spark-streaming-pubnub.md
@@ -31,11 +31,11 @@ Library for reading data from real-time messaging infrastructure [PubNub](https:
## Linking
Using SBT:
-
+
libraryDependencies += "org.apache.bahir" %% "spark-streaming-pubnub" % "2.3.1"
-
+
Using Maven:
-
+
<dependency>
<groupId>org.apache.bahir</groupId>
<artifactId>spark-streaming-pubnub_2.11</artifactId>
@@ -64,7 +64,7 @@ For complete code examples, please review _examples_ directory.
import com.pubnub.api.PNConfiguration
import com.pubnub.api.enums.PNReconnectionPolicy
-
+
import org.apache.spark.streaming.pubnub.{PubNubUtils, SparkPubNubMessage}
val config = new PNConfiguration
@@ -81,7 +81,7 @@ For complete code examples, please review _examples_ directory.
import com.pubnub.api.PNConfiguration
import com.pubnub.api.enums.PNReconnectionPolicy
-
+
import org.apache.spark.streaming.pubnub.PubNubUtils
import org.apache.spark.streaming.pubnub.SparkPubNubMessage
@@ -89,9 +89,9 @@ For complete code examples, please review _examples_ directory.
config.setSubscribeKey(subscribeKey)
config.setSecure(true)
config.setReconnectionPolicy(PNReconnectionPolicy.LINEAR)
- Set<String> channels = new HashSet<String>() {{
+ Set<String> channels = new HashSet<String>() {
add("my-channel");
- }};
+ };
ReceiverInputDStream<SparkPubNubMessage> pubNubStream = PubNubUtils.createStream(
ssc, config, channels, Collections.EMPTY_SET, null,
@@ -100,4 +100,4 @@ For complete code examples, please review _examples_ directory.
## Unit Test
-Unit tests take advantage of publicly available _demo_ subscription and and publish key, which has limited request rate.
\ No newline at end of file
+Unit tests take advantage of publicly available _demo_ subscription and and publish key, which has limited request rate.
diff --git a/site/docs/spark/2.3.2/spark-streaming-pubnub.md b/site/docs/spark/2.3.2/spark-streaming-pubnub.md
index 7901044..50d0445 100644
--- a/site/docs/spark/2.3.2/spark-streaming-pubnub.md
+++ b/site/docs/spark/2.3.2/spark-streaming-pubnub.md
@@ -31,11 +31,11 @@ Library for reading data from real-time messaging infrastructure [PubNub](https:
## Linking
Using SBT:
-
+
libraryDependencies += "org.apache.bahir" %% "spark-streaming-pubnub" % "2.3.2"
-
+
Using Maven:
-
+
<dependency>
<groupId>org.apache.bahir</groupId>
<artifactId>spark-streaming-pubnub_2.11</artifactId>
@@ -64,7 +64,7 @@ For complete code examples, please review _examples_ directory.
import com.pubnub.api.PNConfiguration
import com.pubnub.api.enums.PNReconnectionPolicy
-
+
import org.apache.spark.streaming.pubnub.{PubNubUtils, SparkPubNubMessage}
val config = new PNConfiguration
@@ -81,7 +81,7 @@ For complete code examples, please review _examples_ directory.
import com.pubnub.api.PNConfiguration
import com.pubnub.api.enums.PNReconnectionPolicy
-
+
import org.apache.spark.streaming.pubnub.PubNubUtils
import org.apache.spark.streaming.pubnub.SparkPubNubMessage
@@ -89,9 +89,9 @@ For complete code examples, please review _examples_ directory.
config.setSubscribeKey(subscribeKey)
config.setSecure(true)
config.setReconnectionPolicy(PNReconnectionPolicy.LINEAR)
- Set<String> channels = new HashSet<String>() {{
+ Set<String> channels = new HashSet<String>() {
add("my-channel");
- }};
+ };
ReceiverInputDStream<SparkPubNubMessage> pubNubStream = PubNubUtils.createStream(
ssc, config, channels, Collections.EMPTY_SET, null,
@@ -100,4 +100,4 @@ For complete code examples, please review _examples_ directory.
## Unit Test
-Unit tests take advantage of publicly available _demo_ subscription and and publish key, which has limited request rate.
\ No newline at end of file
+Unit tests take advantage of publicly available _demo_ subscription and and publish key, which has limited request rate.
diff --git a/site/docs/spark/current/spark-streaming-pubnub.md b/site/docs/spark/current/spark-streaming-pubnub.md
index e190934..84f7fe8 100644
--- a/site/docs/spark/current/spark-streaming-pubnub.md
+++ b/site/docs/spark/current/spark-streaming-pubnub.md
@@ -31,11 +31,11 @@ Library for reading data from real-time messaging infrastructure [PubNub](https:
## Linking
Using SBT:
-
+
libraryDependencies += "org.apache.bahir" %% "spark-streaming-pubnub" % "{{site.SPARK_VERSION}}"
-
+
Using Maven:
-
+
<dependency>
<groupId>org.apache.bahir</groupId>
<artifactId>spark-streaming-pubnub_{{site.SCALA_BINARY_VERSION}}</artifactId>
@@ -64,7 +64,7 @@ For complete code examples, please review _examples_ directory.
import com.pubnub.api.PNConfiguration
import com.pubnub.api.enums.PNReconnectionPolicy
-
+
import org.apache.spark.streaming.pubnub.{PubNubUtils, SparkPubNubMessage}
val config = new PNConfiguration
@@ -81,7 +81,7 @@ For complete code examples, please review _examples_ directory.
import com.pubnub.api.PNConfiguration
import com.pubnub.api.enums.PNReconnectionPolicy
-
+
import org.apache.spark.streaming.pubnub.PubNubUtils
import org.apache.spark.streaming.pubnub.SparkPubNubMessage
@@ -89,9 +89,9 @@ For complete code examples, please review _examples_ directory.
config.setSubscribeKey(subscribeKey)
config.setSecure(true)
config.setReconnectionPolicy(PNReconnectionPolicy.LINEAR)
- Set<String> channels = new HashSet<String>() {{
+ Set<String> channels = new HashSet<String>() {
add("my-channel");
- }};
+ };
ReceiverInputDStream<SparkPubNubMessage> pubNubStream = PubNubUtils.createStream(
ssc, config, channels, Collections.EMPTY_SET, null,
@@ -100,4 +100,4 @@ For complete code examples, please review _examples_ directory.
## Unit Test
-Unit tests take advantage of publicly available _demo_ subscription and and publish key, which has limited request rate.
\ No newline at end of file
+Unit tests take advantage of publicly available _demo_ subscription and and publish key, which has limited request rate.