You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gearpump.apache.org by Kam Kasravi <ka...@gmail.com> on 2016/11/01 17:10:33 UTC
Start of release 0.8.2-incubating
This is notice that we will begin getting 0.8.2-incubating ready for
release.
I would like to volunteer to be the release manager for 0.8.2-incubating.
This next version (0.8.2-incubating) will be a binary release,
so it will require different LICENSE and NOTICE files.
We would like to minimally include the following JIRA's (pending feedback).
They have been
categorized by resolved and open. Our target date is within 3 weeks from
today to submit a RELEASE vote in dev, followed by the RELEASE vote in
incubator. We will update the JIRA's below within this thread as feedback
is provided.
Thanks
Kam
Open
GEARPUMP-22 Support akka-streams Gearpump Materializer
GEARPUMP-112 DAG chart in dashboard does not show data, when flow is small
GEARPUMP-144 Modify Gearpump's yarnclient so it can use provided user for
HDFS and YARN
GEARPUMP-190 Add logo with text to site
GEARPUMP-191 add ability to control rate to TaskActor
GEARPUMP-193 Need ability to request upstream messages (pull)
GEARPUMP-198 empty kafka topics show very high receive throughput
GEARPUMP-199 high throughput results in high GC costs
GEARPUMP-200 A missing gear.conf in services and other gearpump commands
should result in an ERROR to the log
GEARPUMP-206 access to upstream and downstream processors
GEARPUMP-211 Look at merging or unifying akka-stream DSL and Gearpump DSL
GEARPUMP-223 Support Redis Cluster Sink
Resolved
GEARPUMP-15 Define initial Apache branded home website
GEARPUMP-32 Minimum clock of source Tasks maybe inaccurate
GEARPUMP-37 Sometimes application clock is "not started" when the data
stream is very slow
GEARPUMP-48 Improve Java interoperability
GEARPUMP-171 Fix some typos
GEARPUMP-185 Yarn kills Apache Gearpump's worker if the memory usage is too
high
GEARPUMP-188 use java.time.Instant for Task start time
GEARPUMP-189 Update project/Build.scala to enable publishing releases to
https://repository.apache.org/content/repositories/releases/org/apache/gearpump/
GEARPUMP-197 Busy loop in FetchThread when incoming queue is full
GEARPUMP-201 integration test failure
GEARPUMP-203 Use DataSourceTask / DataSinkTask for DSL
GEARPUMP-205 remove hdfs dependency from command gear's classpath
GEARPUMP-207 remove hadoop dependency out of application path from dashboard
GEARPUMP-208 Demo site goes down a lot. Also references gearpump.io when
connection is refused
GEARPUMP-212 Make Gearpump's shaded artifacts publishable
GEARPUMP-215 Gearpump Redis Integration - RedisStorage
GEARPUMP-222 DFSJarStore is loaded even when local file path is configured
GEARPUMP-224 Merge gearpump-daemon to gearpump-core
GEARPUMP-225 move partitioner from gearpump-core to module
gearpump-streaming
GEARPUMP-227 remove unneeded license files
-
Re: Start of release 0.8.2-incubating
Posted by Kam Kasravi <ka...@gmail.com>.
I've been updating the LICENSE file to include binary related licenses.
According to apache release process - binary LICENSE should differ from
source LICENSE - where source LICENSE only includes source related license
dependencies. This doesn't seem to be the case with flink - downloading
flink-1.1.3-bin-hadoop27-scala_2.11.tgz and flink-1.1.3-src.tgz from
https://dist.apache.org/repos/dist/release/flink/flink-1.1.3/ and comparing
LICENSE files shows no differences. Other apache projects like Beam,
PredictionIO have only released source thus far. I'll try flink's approach
- including a binary LICENSE for both src and bin releases and see what
happens.
On Thu, Nov 3, 2016 at 9:18 AM, Kam Kasravi <ka...@gmail.com> wrote:
> Thanks Manu
>
> For gearpump-0.8.2-incubating we're going to limit the release to resolved
> bugs and provide a binary release.
> The binary release may result in several RC's when we vote within the
> incubator due to the more complicated dependencies tracking / auditing.
> The release will include (and will be noted within release notes) the
> following JIRA's
>
> GEARPUMP-15 Define initial Apache branded home website
> GEARPUMP-32 Minimum clock of source Tasks maybe inaccurate
> GEARPUMP-37 Sometimes application clock is "not started" when the data
> stream is very slow
> GEARPUMP-48 Improve Java interoperability
> GEARPUMP-171 Fix some typos
> GEARPUMP-185 Yarn kills Apache Gearpump's worker if the memory usage is
> too high
> GEARPUMP-188 use java.time.Instant for Task start time
> GEARPUMP-189 Update project/Build.scala to enable publishing releases to
> https://repository.apache.org/content/repositories/releas
> es/org/apache/gearpump/
> GEARPUMP-197 Busy loop in FetchThread when incoming queue is full
> GEARPUMP-201 integration test failure
> GEARPUMP-203 Use DataSourceTask / DataSinkTask for DSL
> GEARPUMP-205 remove hdfs dependency from command gear's classpath
> GEARPUMP-207 remove hadoop dependency out of application path from
> dashboard
> GEARPUMP-208 Demo site goes down a lot. Also references gearpump.io when
> connection is refused
> GEARPUMP-212 Make Gearpump's shaded artifacts publishable
> GEARPUMP-215 Gearpump Redis Integration - RedisStorage
> GEARPUMP-222 DFSJarStore is loaded even when local file path is configured
> GEARPUMP-224 Merge gearpump-daemon to gearpump-core
> GEARPUMP-225 move partitioner from gearpump-core to module
> gearpump-streaming
> GEARPUMP-226 run 'sbt clean assembly' failed
> GEARPUMP-227 remove unneeded license files
> GEARPUMP-231 error when build package
>
> The open bugs targeted for 0.8.2 will be pushed to 0.8.3. In particular
> the akka-streams integration has a dependency on
> https://github.com/akka/akka/pull/21688 which will be included in
> akka-2.4.13. Gearpump-0.8.3-incubating will therefore more to a recent akka
> 2.4.X release.
> More details following our release of gearpump-0.8.2-incubating.
>
> Thanks
> Kam
>
>
> On Wed, Nov 2, 2016 at 8:35 PM, Manu Zhang <ow...@gmail.com>
> wrote:
>
>> Thanks Kam for volunteering as the release manager. Please shout on the
>> list if any help is needed.
>>
>> It's been quite a while since last release and we have put in a lot of bug
>> fixes and improvements.
>> Meanwhile, the binary release is required for Gearpump integration with
>> other projects.
>>
>> For example,
>> SAMOA-59: add an adapter for Apache Gearpump
>> <https://github.com/apache/incubator-samoa/pull/54>
>> add gearpump benchmark for yahoo streaming benchmarks
>> <https://github.com/yahoo/streaming-benchmarks/pull/10>
>>
>> We'd better release in shorter cycles in the future.
>>
>> Now, let's roll it out !
>>
>> Cheers,
>> Manu
>>
>>
>> On Wed, Nov 2, 2016 at 1:10 AM Kam Kasravi <ka...@gmail.com> wrote:
>>
>> > This is notice that we will begin getting 0.8.2-incubating ready for
>> > release.
>> > I would like to volunteer to be the release manager for
>> 0.8.2-incubating.
>> > This next version (0.8.2-incubating) will be a binary release,
>> > so it will require different LICENSE and NOTICE files.
>> >
>> > We would like to minimally include the following JIRA's (pending
>> feedback).
>> > They have been
>> > categorized by resolved and open. Our target date is within 3 weeks from
>> > today to submit a RELEASE vote in dev, followed by the RELEASE vote in
>> > incubator. We will update the JIRA's below within this thread as
>> feedback
>> > is provided.
>> >
>> > Thanks
>> > Kam
>> >
>> >
>> > Open
>> > GEARPUMP-22 Support akka-streams Gearpump Materializer
>> > GEARPUMP-112 DAG chart in dashboard does not show data, when flow is
>> small
>> > GEARPUMP-144 Modify Gearpump's yarnclient so it can use provided user
>> for
>> > HDFS and YARN
>> > GEARPUMP-190 Add logo with text to site
>> > GEARPUMP-191 add ability to control rate to TaskActor
>> > GEARPUMP-193 Need ability to request upstream messages (pull)
>> > GEARPUMP-198 empty kafka topics show very high receive throughput
>> > GEARPUMP-199 high throughput results in high GC costs
>> > GEARPUMP-200 A missing gear.conf in services and other gearpump commands
>> > should result in an ERROR to the log
>> > GEARPUMP-206 access to upstream and downstream processors
>> > GEARPUMP-211 Look at merging or unifying akka-stream DSL and Gearpump
>> DSL
>> > GEARPUMP-223 Support Redis Cluster Sink
>> >
>> > Resolved
>> > GEARPUMP-15 Define initial Apache branded home website
>> > GEARPUMP-32 Minimum clock of source Tasks maybe inaccurate
>> > GEARPUMP-37 Sometimes application clock is "not started" when the data
>> > stream is very slow
>> > GEARPUMP-48 Improve Java interoperability
>> > GEARPUMP-171 Fix some typos
>> > GEARPUMP-185 Yarn kills Apache Gearpump's worker if the memory usage is
>> too
>> > high
>> > GEARPUMP-188 use java.time.Instant for Task start time
>> > GEARPUMP-189 Update project/Build.scala to enable publishing releases to
>> >
>> > https://repository.apache.org/content/repositories/releases/
>> org/apache/gearpump/
>> > GEARPUMP-197
>> > <https://repository.apache.org/content/repositories/releases
>> /org/apache/gearpump/GEARPUMP-197>
>> > Busy loop in FetchThread when incoming queue is full
>> > GEARPUMP-201 integration test failure
>> > GEARPUMP-203 Use DataSourceTask / DataSinkTask for DSL
>> > GEARPUMP-205 remove hdfs dependency from command gear's classpath
>> > GEARPUMP-207 remove hadoop dependency out of application path from
>> > dashboard
>> > GEARPUMP-208 Demo site goes down a lot. Also references gearpump.io
>> when
>> > connection is refused
>> > GEARPUMP-212 Make Gearpump's shaded artifacts publishable
>> > GEARPUMP-215 Gearpump Redis Integration - RedisStorage
>> > GEARPUMP-222 DFSJarStore is loaded even when local file path is
>> configured
>> > GEARPUMP-224 Merge gearpump-daemon to gearpump-core
>> > GEARPUMP-225 move partitioner from gearpump-core to module
>> > gearpump-streaming
>> > GEARPUMP-227 remove unneeded license files
>> >
>> >
>> >
>> >
>> > -
>> >
>>
>
>
Re: Start of release 0.8.2-incubating
Posted by Kam Kasravi <ka...@gmail.com>.
Thanks Manu
For gearpump-0.8.2-incubating we're going to limit the release to resolved
bugs and provide a binary release.
The binary release may result in several RC's when we vote within the
incubator due to the more complicated dependencies tracking / auditing.
The release will include (and will be noted within release notes) the
following JIRA's
GEARPUMP-15 Define initial Apache branded home website
GEARPUMP-32 Minimum clock of source Tasks maybe inaccurate
GEARPUMP-37 Sometimes application clock is "not started" when the data
stream is very slow
GEARPUMP-48 Improve Java interoperability
GEARPUMP-171 Fix some typos
GEARPUMP-185 Yarn kills Apache Gearpump's worker if the memory usage is too
high
GEARPUMP-188 use java.time.Instant for Task start time
GEARPUMP-189 Update project/Build.scala to enable publishing releases to
https://repository.apache.org/content/repositories/
releases/org/apache/gearpump/
GEARPUMP-197 Busy loop in FetchThread when incoming queue is full
GEARPUMP-201 integration test failure
GEARPUMP-203 Use DataSourceTask / DataSinkTask for DSL
GEARPUMP-205 remove hdfs dependency from command gear's classpath
GEARPUMP-207 remove hadoop dependency out of application path from dashboard
GEARPUMP-208 Demo site goes down a lot. Also references gearpump.io when
connection is refused
GEARPUMP-212 Make Gearpump's shaded artifacts publishable
GEARPUMP-215 Gearpump Redis Integration - RedisStorage
GEARPUMP-222 DFSJarStore is loaded even when local file path is configured
GEARPUMP-224 Merge gearpump-daemon to gearpump-core
GEARPUMP-225 move partitioner from gearpump-core to module
gearpump-streaming
GEARPUMP-226 run 'sbt clean assembly' failed
GEARPUMP-227 remove unneeded license files
GEARPUMP-231 error when build package
The open bugs targeted for 0.8.2 will be pushed to 0.8.3. In particular the
akka-streams integration has a dependency on
https://github.com/akka/akka/pull/21688 which will be included in
akka-2.4.13. Gearpump-0.8.3-incubating will therefore more to a recent akka
2.4.X release.
More details following our release of gearpump-0.8.2-incubating.
Thanks
Kam
On Wed, Nov 2, 2016 at 8:35 PM, Manu Zhang <ow...@gmail.com> wrote:
> Thanks Kam for volunteering as the release manager. Please shout on the
> list if any help is needed.
>
> It's been quite a while since last release and we have put in a lot of bug
> fixes and improvements.
> Meanwhile, the binary release is required for Gearpump integration with
> other projects.
>
> For example,
> SAMOA-59: add an adapter for Apache Gearpump
> <https://github.com/apache/incubator-samoa/pull/54>
> add gearpump benchmark for yahoo streaming benchmarks
> <https://github.com/yahoo/streaming-benchmarks/pull/10>
>
> We'd better release in shorter cycles in the future.
>
> Now, let's roll it out !
>
> Cheers,
> Manu
>
>
> On Wed, Nov 2, 2016 at 1:10 AM Kam Kasravi <ka...@gmail.com> wrote:
>
> > This is notice that we will begin getting 0.8.2-incubating ready for
> > release.
> > I would like to volunteer to be the release manager for 0.8.2-incubating.
> > This next version (0.8.2-incubating) will be a binary release,
> > so it will require different LICENSE and NOTICE files.
> >
> > We would like to minimally include the following JIRA's (pending
> feedback).
> > They have been
> > categorized by resolved and open. Our target date is within 3 weeks from
> > today to submit a RELEASE vote in dev, followed by the RELEASE vote in
> > incubator. We will update the JIRA's below within this thread as feedback
> > is provided.
> >
> > Thanks
> > Kam
> >
> >
> > Open
> > GEARPUMP-22 Support akka-streams Gearpump Materializer
> > GEARPUMP-112 DAG chart in dashboard does not show data, when flow is
> small
> > GEARPUMP-144 Modify Gearpump's yarnclient so it can use provided user for
> > HDFS and YARN
> > GEARPUMP-190 Add logo with text to site
> > GEARPUMP-191 add ability to control rate to TaskActor
> > GEARPUMP-193 Need ability to request upstream messages (pull)
> > GEARPUMP-198 empty kafka topics show very high receive throughput
> > GEARPUMP-199 high throughput results in high GC costs
> > GEARPUMP-200 A missing gear.conf in services and other gearpump commands
> > should result in an ERROR to the log
> > GEARPUMP-206 access to upstream and downstream processors
> > GEARPUMP-211 Look at merging or unifying akka-stream DSL and Gearpump DSL
> > GEARPUMP-223 Support Redis Cluster Sink
> >
> > Resolved
> > GEARPUMP-15 Define initial Apache branded home website
> > GEARPUMP-32 Minimum clock of source Tasks maybe inaccurate
> > GEARPUMP-37 Sometimes application clock is "not started" when the data
> > stream is very slow
> > GEARPUMP-48 Improve Java interoperability
> > GEARPUMP-171 Fix some typos
> > GEARPUMP-185 Yarn kills Apache Gearpump's worker if the memory usage is
> too
> > high
> > GEARPUMP-188 use java.time.Instant for Task start time
> > GEARPUMP-189 Update project/Build.scala to enable publishing releases to
> >
> > https://repository.apache.org/content/repositories/releases/
> org/apache/gearpump/
> > GEARPUMP-197
> > <https://repository.apache.org/content/repositories/
> releases/org/apache/gearpump/GEARPUMP-197>
> > Busy loop in FetchThread when incoming queue is full
> > GEARPUMP-201 integration test failure
> > GEARPUMP-203 Use DataSourceTask / DataSinkTask for DSL
> > GEARPUMP-205 remove hdfs dependency from command gear's classpath
> > GEARPUMP-207 remove hadoop dependency out of application path from
> > dashboard
> > GEARPUMP-208 Demo site goes down a lot. Also references gearpump.io when
> > connection is refused
> > GEARPUMP-212 Make Gearpump's shaded artifacts publishable
> > GEARPUMP-215 Gearpump Redis Integration - RedisStorage
> > GEARPUMP-222 DFSJarStore is loaded even when local file path is
> configured
> > GEARPUMP-224 Merge gearpump-daemon to gearpump-core
> > GEARPUMP-225 move partitioner from gearpump-core to module
> > gearpump-streaming
> > GEARPUMP-227 remove unneeded license files
> >
> >
> >
> >
> > -
> >
>
Re: Start of release 0.8.2-incubating
Posted by Manu Zhang <ow...@gmail.com>.
Thanks Kam for volunteering as the release manager. Please shout on the
list if any help is needed.
It's been quite a while since last release and we have put in a lot of bug
fixes and improvements.
Meanwhile, the binary release is required for Gearpump integration with
other projects.
For example,
SAMOA-59: add an adapter for Apache Gearpump
<https://github.com/apache/incubator-samoa/pull/54>
add gearpump benchmark for yahoo streaming benchmarks
<https://github.com/yahoo/streaming-benchmarks/pull/10>
We'd better release in shorter cycles in the future.
Now, let's roll it out !
Cheers,
Manu
On Wed, Nov 2, 2016 at 1:10 AM Kam Kasravi <ka...@gmail.com> wrote:
> This is notice that we will begin getting 0.8.2-incubating ready for
> release.
> I would like to volunteer to be the release manager for 0.8.2-incubating.
> This next version (0.8.2-incubating) will be a binary release,
> so it will require different LICENSE and NOTICE files.
>
> We would like to minimally include the following JIRA's (pending feedback).
> They have been
> categorized by resolved and open. Our target date is within 3 weeks from
> today to submit a RELEASE vote in dev, followed by the RELEASE vote in
> incubator. We will update the JIRA's below within this thread as feedback
> is provided.
>
> Thanks
> Kam
>
>
> Open
> GEARPUMP-22 Support akka-streams Gearpump Materializer
> GEARPUMP-112 DAG chart in dashboard does not show data, when flow is small
> GEARPUMP-144 Modify Gearpump's yarnclient so it can use provided user for
> HDFS and YARN
> GEARPUMP-190 Add logo with text to site
> GEARPUMP-191 add ability to control rate to TaskActor
> GEARPUMP-193 Need ability to request upstream messages (pull)
> GEARPUMP-198 empty kafka topics show very high receive throughput
> GEARPUMP-199 high throughput results in high GC costs
> GEARPUMP-200 A missing gear.conf in services and other gearpump commands
> should result in an ERROR to the log
> GEARPUMP-206 access to upstream and downstream processors
> GEARPUMP-211 Look at merging or unifying akka-stream DSL and Gearpump DSL
> GEARPUMP-223 Support Redis Cluster Sink
>
> Resolved
> GEARPUMP-15 Define initial Apache branded home website
> GEARPUMP-32 Minimum clock of source Tasks maybe inaccurate
> GEARPUMP-37 Sometimes application clock is "not started" when the data
> stream is very slow
> GEARPUMP-48 Improve Java interoperability
> GEARPUMP-171 Fix some typos
> GEARPUMP-185 Yarn kills Apache Gearpump's worker if the memory usage is too
> high
> GEARPUMP-188 use java.time.Instant for Task start time
> GEARPUMP-189 Update project/Build.scala to enable publishing releases to
>
> https://repository.apache.org/content/repositories/releases/org/apache/gearpump/
> GEARPUMP-197
> <https://repository.apache.org/content/repositories/releases/org/apache/gearpump/GEARPUMP-197>
> Busy loop in FetchThread when incoming queue is full
> GEARPUMP-201 integration test failure
> GEARPUMP-203 Use DataSourceTask / DataSinkTask for DSL
> GEARPUMP-205 remove hdfs dependency from command gear's classpath
> GEARPUMP-207 remove hadoop dependency out of application path from
> dashboard
> GEARPUMP-208 Demo site goes down a lot. Also references gearpump.io when
> connection is refused
> GEARPUMP-212 Make Gearpump's shaded artifacts publishable
> GEARPUMP-215 Gearpump Redis Integration - RedisStorage
> GEARPUMP-222 DFSJarStore is loaded even when local file path is configured
> GEARPUMP-224 Merge gearpump-daemon to gearpump-core
> GEARPUMP-225 move partitioner from gearpump-core to module
> gearpump-streaming
> GEARPUMP-227 remove unneeded license files
>
>
>
>
> -
>