You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Neville Li <ne...@gmail.com> on 2019/10/16 17:04:42 UTC

Scio 0.8.0-beta2 released

Hi all,

We've just released Scio 0.8.0-beta2 (Scala API for Apache Beam for those
on the Beam mailing list). This will likely be the last beta before 0.8.0
stable release.

Cheers,
Neville

https://github.com/spotify/scio/releases/tag/v0.8.0-beta2

Features

   - Bump Beam to 2.16.0 (#2292 <https://github.com/spotify/scio/pull/2292>)
   - Bump featran to 0.4.0
   - Add DelegatingSideInput and TypedSparkeySideInput. (#2287
   <https://github.com/spotify/scio/pull/2287>)
   - Add initial BigQuery methods with Beam schema (#2197
   <https://github.com/spotify/scio/pull/2197>)
   - Allow user to pass in Bigtable GcRule (#2256
   <https://github.com/spotify/scio/pull/2256>)
   - Support accessing all counters within JobTest (fix #2007
   <https://github.com/spotify/scio/issues/2007>) (#2247
   <https://github.com/spotify/scio/pull/2247>)
   - Add BigQuery Source type (#2214
   <https://github.com/spotify/scio/pull/2214>)
   - Add Storage API read from query (#2204
   <https://github.com/spotify/scio/pull/2204>)

Bug Fixes & Improvements

   - Segregate and deprecate avro reflective records support (#2300
   <https://github.com/spotify/scio/pull/2300>)
   - Fix lambda ser/de in SCollectionMatchers, #2294
   <https://github.com/spotify/scio/issues/2294> (#2296
   <https://github.com/spotify/scio/pull/2296>)
   - Use PubsubIO.readMessagesWithCoderAndParseFn from Beam 2.16 (#2295
   <https://github.com/spotify/scio/pull/2295>)
   - Wrap PubsubWithAttributes write in composite PTransform (fix #2286
   <https://github.com/spotify/scio/issues/2286>) (#2288
   <https://github.com/spotify/scio/pull/2288>)
   - AvroType macro shouldn't generate duplicate record classes fix #2264
   <https://github.com/spotify/scio/issues/2264>) (#2267
   <https://github.com/spotify/scio/pull/2267>)
   - Add Paradise dependency back to scio-repl classpath (fix #2265
   <https://github.com/spotify/scio/issues/2265>) (#2266
   <https://github.com/spotify/scio/pull/2266>)
   - Use JavaSerializer for encoding Throwable (fix #2249
   <https://github.com/spotify/scio/issues/2249>) (#2261
   <https://github.com/spotify/scio/pull/2261>)
   - Check name uniqueness without running on Dataflow (#2252
   <https://github.com/spotify/scio/pull/2252>)
   - Added fix for BinaryIO output. (#2251
   <https://github.com/spotify/scio/pull/2251>)
   - Truncate app args if long (#2244
   <https://github.com/spotify/scio/pull/2244>)
   - Fix: run repl with jdk11 (#2246
   <https://github.com/spotify/scio/pull/2246>)
   - Reduce guava usage #2223 <https://github.com/spotify/scio/pull/2223>
   #2242 <https://github.com/spotify/scio/pull/2242>
   - Use upstream magnolia for scala >= 2.12, fix #2192
   <https://github.com/spotify/scio/issues/2192> (#2241
   <https://github.com/spotify/scio/pull/2241>)
   - Fix #2096 <https://github.com/spotify/scio/issues/2096>: restore sbt <
   1.3.0 behaviour by not closing classloader (#2224
   <https://github.com/spotify/scio/pull/2224>)
   - Update version check message (#2227
   <https://github.com/spotify/scio/pull/2227>)
   - Don't wrap exceptions in WrappedBCoder (#2266
   <https://github.com/spotify/scio/pull/2266>)
   - Bypass nullable coder for ObjectFileIO, fix #2187
   <https://github.com/spotify/scio/issues/2187> (#2188
   <https://github.com/spotify/scio/pull/2188>)

Breaking Changes

   - Decouple SQL extension from scio-core (#2201
   <https://github.com/spotify/scio/pull/2201>)