You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by Neville Li <ne...@gmail.com> on 2020/03/20 18:10:37 UTC

Scio 0.8.3 released

Hi all,

We just released Scio 0.8.3. This is mainly a bug fix release with some
minor improvements.

*Notes on JDK 11*
JDK 11 is now supported starting with 0.8.2. To upgrade, you'll need to
build your code and submit jobs to Dataflow with JDK 11.

*Notes on Scala 2.11*
Scio 0.8.x will be the last releases to support Scala 2.11. 0.9.x will
support 2.12 & 2.13 only. Upgrading to 2.12 should be mostly transparent
barring some stale external dependencies. Please reach out if you run into
any issues.

Cheers,
Neville

https://github.com/spotify/scio/releases/tag/v0.8.3

*"Draconifors"*
Features

   - Add CsvIO (#2701 <https://github.com/spotify/scio/pull/2701>)
   - Implement hashSubtractByKey (#2769
   <https://github.com/spotify/scio/pull/2769>)
   - Add directory treatment and compression option to readFiles (#2756
   <https://github.com/spotify/scio/pull/2756>)
   - Add FileNaming and prefix support to BinaryIO (#2759
   <https://github.com/spotify/scio/pull/2759>)
   - Add Header and Footer support to TextIO (#2758
   <https://github.com/spotify/scio/pull/2758>)
   - Add GenericJson coder (#2742
   <https://github.com/spotify/scio/pull/2742>)
   - Add ProtobufUtil for Message<->Avro conversions (#2743
   <https://github.com/spotify/scio/pull/2743>)

Bug fixes & improvements

   - Add schema cache support in BigQueryType (#2775
   <https://github.com/spotify/scio/pull/2775>)
   - Optimize KeyGroupIterator (#2779
   <https://github.com/spotify/scio/pull/2779>)
   - Make CoGbkResult Iterable slightly lazy (#2749
   <https://github.com/spotify/scio/pull/2749>)
   - Make java Enum coder deterministic #2761
   <https://github.com/spotify/scio/issues/2761> #2764
   <https://github.com/spotify/scio/pull/2764>
   - Fix saveAsTypedBigQuery deprecation message (#2763
   <https://github.com/spotify/scio/pull/2763>)
   - Patch SortValues doFn to avoid re-enconding bytes (#2748
   <https://github.com/spotify/scio/pull/2748>)
   - Fix: remove redundant withExtendedErrorInfo in dynamic BigQuery (#2744
   <https://github.com/spotify/scio/pull/2744>)

Re: Scio 0.8.3 released

Posted by Neville Li <ne...@gmail.com>.

A quick follow up, we just released Scio 0.8.4. This is mostly a minor bug
fix release and the last one for 0.8.x.
We'll hopefully get an initial 0.9.0 release out in a few weeks.

https://github.com/spotify/scio/releases/tag/v0.8.4

*"Expecto Patronum"*
Features

   - Initial flink runner support #2785
   <https://github.com/spotify/scio/pull/2785>
   - Add support for default transform names #2760
   <https://github.com/spotify/scio/issues/2760> #2803
   <https://github.com/spotify/scio/pull/2803>
   - Add fromStorage doc #2792 <https://github.com/spotify/scio/issues/2792>

Bug fixes & improvements

   - Fix offset in SlidingWindows #2790
   <https://github.com/spotify/scio/pull/2790>
   - Reduce Consumer impl leak in SortedBucketTransform (#2795
   <https://github.com/spotify/scio/pull/2795>)
   - Revert "make CoGbkResult Iterable slightly lazy (#2749
   <https://github.com/spotify/scio/pull/2749>)" #2791
   <https://github.com/spotify/scio/pull/2791>


On Fri, Mar 20, 2020 at 2:10 PM Neville Li <ne...@gmail.com> wrote:

> Hi all,
>
> We just released Scio 0.8.3. This is mainly a bug fix release with some
> minor improvements.
>
> *Notes on JDK 11*
> JDK 11 is now supported starting with 0.8.2. To upgrade, you'll need to
> build your code and submit jobs to Dataflow with JDK 11.
>
> *Notes on Scala 2.11*
> Scio 0.8.x will be the last releases to support Scala 2.11. 0.9.x will
> support 2.12 & 2.13 only. Upgrading to 2.12 should be mostly transparent
> barring some stale external dependencies. Please reach out if you run into
> any issues.
>
> Cheers,
> Neville
>
> https://github.com/spotify/scio/releases/tag/v0.8.3
>
> *"Draconifors"*
> Features
>
>    - Add CsvIO (#2701 <https://github.com/spotify/scio/pull/2701>)
>    - Implement hashSubtractByKey (#2769
>    <https://github.com/spotify/scio/pull/2769>)
>    - Add directory treatment and compression option to readFiles (#2756
>    <https://github.com/spotify/scio/pull/2756>)
>    - Add FileNaming and prefix support to BinaryIO (#2759
>    <https://github.com/spotify/scio/pull/2759>)
>    - Add Header and Footer support to TextIO (#2758
>    <https://github.com/spotify/scio/pull/2758>)
>    - Add GenericJson coder (#2742
>    <https://github.com/spotify/scio/pull/2742>)
>    - Add ProtobufUtil for Message<->Avro conversions (#2743
>    <https://github.com/spotify/scio/pull/2743>)
>
> Bug fixes & improvements
>
>    - Add schema cache support in BigQueryType (#2775
>    <https://github.com/spotify/scio/pull/2775>)
>    - Optimize KeyGroupIterator (#2779
>    <https://github.com/spotify/scio/pull/2779>)
>    - Make CoGbkResult Iterable slightly lazy (#2749
>    <https://github.com/spotify/scio/pull/2749>)
>    - Make java Enum coder deterministic #2761
>    <https://github.com/spotify/scio/issues/2761> #2764
>    <https://github.com/spotify/scio/pull/2764>
>    - Fix saveAsTypedBigQuery deprecation message (#2763
>    <https://github.com/spotify/scio/pull/2763>)
>    - Patch SortValues doFn to avoid re-enconding bytes (#2748
>    <https://github.com/spotify/scio/pull/2748>)
>    - Fix: remove redundant withExtendedErrorInfo in dynamic BigQuery (
>    #2744 <https://github.com/spotify/scio/pull/2744>)
>
>