You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Neville Li <ne...@gmail.com> on 2019/10/16 17:04:42 UTC
Scio 0.8.0-beta2 released
Hi all,
We've just released Scio 0.8.0-beta2 (Scala API for Apache Beam for those
on the Beam mailing list). This will likely be the last beta before 0.8.0
stable release.
Cheers,
Neville
https://github.com/spotify/scio/releases/tag/v0.8.0-beta2
Features
- Bump Beam to 2.16.0 (#2292 <https://github.com/spotify/scio/pull/2292>)
- Bump featran to 0.4.0
- Add DelegatingSideInput and TypedSparkeySideInput. (#2287
<https://github.com/spotify/scio/pull/2287>)
- Add initial BigQuery methods with Beam schema (#2197
<https://github.com/spotify/scio/pull/2197>)
- Allow user to pass in Bigtable GcRule (#2256
<https://github.com/spotify/scio/pull/2256>)
- Support accessing all counters within JobTest (fix #2007
<https://github.com/spotify/scio/issues/2007>) (#2247
<https://github.com/spotify/scio/pull/2247>)
- Add BigQuery Source type (#2214
<https://github.com/spotify/scio/pull/2214>)
- Add Storage API read from query (#2204
<https://github.com/spotify/scio/pull/2204>)
Bug Fixes & Improvements
- Segregate and deprecate avro reflective records support (#2300
<https://github.com/spotify/scio/pull/2300>)
- Fix lambda ser/de in SCollectionMatchers, #2294
<https://github.com/spotify/scio/issues/2294> (#2296
<https://github.com/spotify/scio/pull/2296>)
- Use PubsubIO.readMessagesWithCoderAndParseFn from Beam 2.16 (#2295
<https://github.com/spotify/scio/pull/2295>)
- Wrap PubsubWithAttributes write in composite PTransform (fix #2286
<https://github.com/spotify/scio/issues/2286>) (#2288
<https://github.com/spotify/scio/pull/2288>)
- AvroType macro shouldn't generate duplicate record classes fix #2264
<https://github.com/spotify/scio/issues/2264>) (#2267
<https://github.com/spotify/scio/pull/2267>)
- Add Paradise dependency back to scio-repl classpath (fix #2265
<https://github.com/spotify/scio/issues/2265>) (#2266
<https://github.com/spotify/scio/pull/2266>)
- Use JavaSerializer for encoding Throwable (fix #2249
<https://github.com/spotify/scio/issues/2249>) (#2261
<https://github.com/spotify/scio/pull/2261>)
- Check name uniqueness without running on Dataflow (#2252
<https://github.com/spotify/scio/pull/2252>)
- Added fix for BinaryIO output. (#2251
<https://github.com/spotify/scio/pull/2251>)
- Truncate app args if long (#2244
<https://github.com/spotify/scio/pull/2244>)
- Fix: run repl with jdk11 (#2246
<https://github.com/spotify/scio/pull/2246>)
- Reduce guava usage #2223 <https://github.com/spotify/scio/pull/2223>
#2242 <https://github.com/spotify/scio/pull/2242>
- Use upstream magnolia for scala >= 2.12, fix #2192
<https://github.com/spotify/scio/issues/2192> (#2241
<https://github.com/spotify/scio/pull/2241>)
- Fix #2096 <https://github.com/spotify/scio/issues/2096>: restore sbt <
1.3.0 behaviour by not closing classloader (#2224
<https://github.com/spotify/scio/pull/2224>)
- Update version check message (#2227
<https://github.com/spotify/scio/pull/2227>)
- Don't wrap exceptions in WrappedBCoder (#2266
<https://github.com/spotify/scio/pull/2266>)
- Bypass nullable coder for ObjectFileIO, fix #2187
<https://github.com/spotify/scio/issues/2187> (#2188
<https://github.com/spotify/scio/pull/2188>)
Breaking Changes
- Decouple SQL extension from scio-core (#2201
<https://github.com/spotify/scio/pull/2201>)