You are viewing a plain text version of this content. The canonical link for it is here.
Posted to s4-commits@incubator.apache.org by mm...@apache.org on 2013/03/10 20:07:09 UTC
[11/12] git commit: Update release notes + fix distribution build
Update release notes + fix distribution build
Project: http://git-wip-us.apache.org/repos/asf/incubator-s4/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-s4/commit/47620a5f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-s4/tree/47620a5f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-s4/diff/47620a5f
Branch: refs/heads/dev
Commit: 47620a5f7929ce66176648f2837a9c2bd5475e94
Parents: 96f04a6
Author: Matthieu Morel <mm...@apache.org>
Authored: Sun Mar 10 16:51:26 2013 +0100
Committer: Matthieu Morel <mm...@apache.org>
Committed: Sun Mar 10 17:50:22 2013 +0100
----------------------------------------------------------------------
RELEASE_NOTES.html | 109 +++++++--------
build.gradle | 1 +
subprojects/s4-benchmarks/s4-benchmarks.gradle | 1 -
.../src/main/resources/templates/newApp.README | 2 +-
4 files changed, 54 insertions(+), 59 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-s4/blob/47620a5f/RELEASE_NOTES.html
----------------------------------------------------------------------
diff --git a/RELEASE_NOTES.html b/RELEASE_NOTES.html
index afe12e6..c2ea03e 100644
--- a/RELEASE_NOTES.html
+++ b/RELEASE_NOTES.html
@@ -1,119 +1,114 @@
<p>
- Release Notes - Apache S4 - Version 0.5.0
+ Release Notes - Apache S4 - Version 0.6.0
</p>
<p>
-S4 is a general-purpose, distributed, scalable, partially fault-tolerant, pluggable platform
+S4 is a general-purpose, distributed, scalable, fault-tolerant, pluggable platform
that allows programmers to easily develop applications for processing continuous unbounded streams of data.
</p>
<p>
-Apache S4 0.5.0 is the first release of S4 as an Apache Incubator project.
-It is also a complete refactoring of the previous S4 codebase.
-</p>
-
-<h2> Sub-task
+
+Apache S4 0.6 contains grounds on the same basis than 0.5 and brings major performance and usability improvements.
+
+<h2> Bug
</h2>
<ul>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-24'>S4-24</a>] - Dynamic deployment of S4 applications from a remote repository
-</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-29'>S4-29</a>] - Remove file-based configurations
-</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-33'>S4-33</a>] - TestUtils and modules should be split across s4-comm and s4-core
+<li>[<a href='https://issues.apache.org/jira/browse/S4-54'>S4-54</a>] - script can't be executed on cygwin
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-36'>S4-36</a>] - CommTests should use ZkBasedClusterManagement
+<li>[<a href='https://issues.apache.org/jira/browse/S4-55'>S4-55</a>] - s4-piper can‘t be executed success on cygwin
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-65'>S4-65</a>] - Create s4 status command
+<li>[<a href='https://issues.apache.org/jira/browse/S4-64'>S4-64</a>] - S4-piper cannot be built on RHEL 5 Linux
</li>
-</ul>
-
-<h2> Bug
-</h2>
-<ul>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-12'>S4-12</a>] - Dynamic Method Dispatching
+<li>[<a href='https://issues.apache.org/jira/browse/S4-68'>S4-68</a>] - PE Prototypes are created from a Thread with the wrong ClassLoader
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-14'>S4-14</a>] - Listener.recv() behavior when interrupted
+<li>[<a href='https://issues.apache.org/jira/browse/S4-90'>S4-90</a>] - "unchecked or unsafe operations" warning
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-18'>S4-18</a>] - gradle test fails
+<li>[<a href='https://issues.apache.org/jira/browse/S4-98'>S4-98</a>] - Remove duplicate Key class
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-23'>S4-23</a>] - NettyEmitter -- 1. Infinitely waiting on connection, 2. numPartitions is same as numClusterNodes
+<li>[<a href='https://issues.apache.org/jira/browse/S4-103'>S4-103</a>] - Inconsistent Event API on streamName/streamId
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-26'>S4-26</a>] - standalone application build script fails when the source directory contains more than 1 class
+<li>[<a href='https://issues.apache.org/jira/browse/S4-105'>S4-105</a>] - Incorrect method implementation in org.apache.s4.core.Stream
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-43'>S4-43</a>] - Replace deprecated method in Gradle
+<li>[<a href='https://issues.apache.org/jira/browse/S4-106'>S4-106</a>] - OverloadDispatcherGenerator generates a lot of files under the /tmp folder
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-56'>S4-56</a>] - Prevent concurrent access to published s4r files
+<li>[<a href='https://issues.apache.org/jira/browse/S4-107'>S4-107</a>] - zkClient connect timeout when deploy application
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-61'>S4-61</a>] - Threads running the PEs don't have a Context Class Loader
+<li>[<a href='https://issues.apache.org/jira/browse/S4-109'>S4-109</a>] - TCPEmitter#send() should return false when it doesn't send a packet across
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-63'>S4-63</a>] - onTime() events are not synchronized correctly
+<li>[<a href='https://issues.apache.org/jira/browse/S4-111'>S4-111</a>] - Deployment fails getting the .s4r file from the web
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-70'>S4-70</a>] - s4 node command ignores -zk parameter
+<li>[<a href='https://issues.apache.org/jira/browse/S4-112'>S4-112</a>] - Gradle doesn't resolve dependencies when they are partially in the maven repository
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-71'>S4-71</a>] - s4 deploy mismanages s4r URI
+<li>[<a href='https://issues.apache.org/jira/browse/S4-116'>S4-116</a>] - Multiple bindings of RemoteEmitters in DefaultCommModule
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-74'>S4-74</a>] - NullPointerException on TCPEmitter.onChange()
+<li>[<a href='https://issues.apache.org/jira/browse/S4-120'>S4-120</a>] - User singleton scope for injections that should have a unique instance
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-82'>S4-82</a>] - Fix local communication optimization
+<li>[<a href='https://issues.apache.org/jira/browse/S4-123'>S4-123</a>] - Fix incomplete javadoc in AbstractSlidingWindowPE + other javadoc updates
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-87'>S4-87</a>] - Checkpointing: recovery : avoid rejections upon fetching
+<li>[<a href='https://issues.apache.org/jira/browse/S4-126'>S4-126</a>] - Log two times when error happens during create App
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-89'>S4-89</a>] - Fix references to S4 libs when resolving classpath for adapter in new S4 application
+<li>[<a href='https://issues.apache.org/jira/browse/S4-127'>S4-127</a>] - S4 status error due to invalid parsing
</li>
</ul>
-
+
<h2> Improvement
</h2>
<ul>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-6'>S4-6</a>] - Netty initialization
+<li>[<a href='https://issues.apache.org/jira/browse/S4-8'>S4-8</a>] - Blocking stream queues in cluster mode
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/S4-48'>S4-48</a>] - When Emitter buffers fill up, enable App-specific behavior to drop/block/throttle input
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/S4-59'>S4-59</a>] - Resource loading from the S4 node classpath
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-17'>S4-17</a>] - Put tmp dir under build
+<li>[<a href='https://issues.apache.org/jira/browse/S4-62'>S4-62</a>] - Multithreaded Streams
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-21'>S4-21</a>] - Create standard PEs, and Event classes
+<li>[<a href='https://issues.apache.org/jira/browse/S4-66'>S4-66</a>] - S4R packaging: improve app class resolution
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-22'>S4-22</a>] - Adaptor + inter app communication
+<li>[<a href='https://issues.apache.org/jira/browse/S4-73'>S4-73</a>] - Remove appsDir concept
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-27'>S4-27</a>] - extensions to cluster configuration through Zookeeper
+<li>[<a href='https://issues.apache.org/jira/browse/S4-76'>S4-76</a>] - Remove unused appId identifiers
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-34'>S4-34</a>] - Rename s4.comm.netty and constituents to s4.comm.tcp
+<li>[<a href='https://issues.apache.org/jira/browse/S4-79'>S4-79</a>] - Validate -appClass parameter of s4r command
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-44'>S4-44</a>] - optional backoff upon multiple consecutive failed checkpoint fetches
+<li>[<a href='https://issues.apache.org/jira/browse/S4-94'>S4-94</a>] - Update kryo to version 2
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-57'>S4-57</a>] - Document and improve the windowing PE
+<li>[<a href='https://issues.apache.org/jira/browse/S4-95'>S4-95</a>] - Performance improvements
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-60'>S4-60</a>] - Development mode for rapid application development and testing
+<li>[<a href='https://issues.apache.org/jira/browse/S4-96'>S4-96</a>] - Log uncaught exception in spawned threads
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-67'>S4-67</a>] - S4R packaging: improve packaging of dependencies
+<li>[<a href='https://issues.apache.org/jira/browse/S4-99'>S4-99</a>] - Provide injectable load shedding mechanism
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-69'>S4-69</a>] - Update gradle to 1.0
+<li>[<a href='https://issues.apache.org/jira/browse/S4-102'>S4-102</a>] - Add facilities for accessing partition information from the application
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-72'>S4-72</a>] - Resource loading from S4R
+<li>[<a href='https://issues.apache.org/jira/browse/S4-108'>S4-108</a>] - Share ZooKeeper client connections from S4 nodes
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-75'>S4-75</a>] - Code improvements in comm layer
+<li>[<a href='https://issues.apache.org/jira/browse/S4-117'>S4-117</a>] - Improve initialization and bootstrapping
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-78'>S4-78</a>] - Gradle tasks don't finish as soon as possible
+<li>[<a href='https://issues.apache.org/jira/browse/S4-118'>S4-118</a>] - Check whether the app class exists when build s4r file
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-81'>S4-81</a>] - S4 tools syntax: remove curly braces + expose custom modules config
+<li>[<a href='https://issues.apache.org/jira/browse/S4-119'>S4-119</a>] - Publish S4 maven artifacts on public maven repository
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-85'>S4-85</a>] - Improve handling of ZK connection changes
+<li>[<a href='https://issues.apache.org/jira/browse/S4-122'>S4-122</a>] - Add debug option for s4 tools
</li>
</ul>
<h2> New Feature
</h2>
<ul>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-4'>S4-4</a>] - Dynamic App Loading
+<li>[<a href='https://issues.apache.org/jira/browse/S4-5'>S4-5</a>] - Prototype app builder
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-11'>S4-11</a>] - add checkpointing mechanism to s4-piper
+<li>[<a href='https://issues.apache.org/jira/browse/S4-83'>S4-83</a>] - S4 command for preparing S4 projects for IDEs: eclipsify|idealize etc..
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-38'>S4-38</a>] - S4 command line utility
+<li>[<a href='https://issues.apache.org/jira/browse/S4-86'>S4-86</a>] - Metrics
</li>
</ul>
-
+
<h2> Task
</h2>
<ul>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-31'>S4-31</a>] - Facilities for packaging example and test apps
+<li>[<a href='https://issues.apache.org/jira/browse/S4-97'>S4-97</a>] - Add a build task for easily running Apache Creadur/Rat
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/S4-88'>S4-88</a>] - Prepare 0.5.0 release
+<li>[<a href='https://issues.apache.org/jira/browse/S4-124'>S4-124</a>] - Update documentation for 0.6.0 release
</li>
</ul>
+
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/incubator-s4/blob/47620a5f/build.gradle
----------------------------------------------------------------------
diff --git a/build.gradle b/build.gradle
index b5428a0..00511f9 100644
--- a/build.gradle
+++ b/build.gradle
@@ -292,6 +292,7 @@ task srcDist(dependsOn: ["javadoc"], type: Zip) {
exclude ('**/build/**')
exclude ('**/tmp/**')
exclude ('**/bin/**')
+ exclude ('website/**')
into (baseName+'-'+version+'-'+classifier)
}
http://git-wip-us.apache.org/repos/asf/incubator-s4/blob/47620a5f/subprojects/s4-benchmarks/s4-benchmarks.gradle
----------------------------------------------------------------------
diff --git a/subprojects/s4-benchmarks/s4-benchmarks.gradle b/subprojects/s4-benchmarks/s4-benchmarks.gradle
index 222d1b4..5ed58c0 100644
--- a/subprojects/s4-benchmarks/s4-benchmarks.gradle
+++ b/subprojects/s4-benchmarks/s4-benchmarks.gradle
@@ -31,7 +31,6 @@ group = 'org.apache.s4'
apply plugin: 'java'
apply plugin: 'eclipse'
apply plugin: 'idea'
-apply plugin:'application'
/* Set Java version. */
sourceCompatibility = 1.6
http://git-wip-us.apache.org/repos/asf/incubator-s4/blob/47620a5f/subprojects/s4-tools/src/main/resources/templates/newApp.README
----------------------------------------------------------------------
diff --git a/subprojects/s4-tools/src/main/resources/templates/newApp.README b/subprojects/s4-tools/src/main/resources/templates/newApp.README
index e572737..69975c7 100644
--- a/subprojects/s4-tools/src/main/resources/templates/newApp.README
+++ b/subprojects/s4-tools/src/main/resources/templates/newApp.README
@@ -24,7 +24,7 @@
2. define a logical cluster for your application "./s4 newCluster -cluster=<nameOfTheCluster> -nbTasks=<number of partitions> -flp=<a port number for the first node, other nodes use an increment on this initial port>"
3. start a node and attach it to the cluster "./s4 node -cluster=<nameOfTheCluster>"
4. package the application "./s4 s4r -a=<app class> -b=`pwd`/build.gradle <package name>
- 5. deploy the application "./s4 deploy -s4r=`pwd`/build/libs/<package name>.s4r -c=<nameOfTheCluster> -appName=<app name in Zookeeper>"
+ 5. deploy (configure) the application "./s4 deploy -s4r=`pwd`/build/libs/<package name>.s4r -c=<nameOfTheCluster> -appName=<app name in Zookeeper>"
6. check the status of the S4 cluster "s4 status"
If you want to inject events from application 2 into application 1 on cluster 1: