You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Filipe Regadas <re...@spotify.com> on 2020/07/02 20:10:21 UTC

Scio v0.9.2 release

Hi all,

We just released scio v0.9.2. If you are upgrading from 0.8.x see our Migration Guide <https://spotify.github.io/scio/migrations/v0.9.0-Migration-Guide.html> for detailed instructions.

I’ll take this opportunity to announce that we moved from Gitter to Spotify FOSS Slack, you can find us in the #scio channel! (get an invite here <https://slackin.spotify.com/>)


Cheers,
Filipe Regadas

https://github.com/spotify/scio/releases/tag/v0.9.2 <https://github.com/spotify/scio/releases/tag/v0.9.2>

"Alohomora"
Improvements

Add more info to RateLimiterDoFn javadoc (#3054 <https://github.com/spotify/scio/pull/3054>)
Add OnTimeBehaviour window option (#3063 <https://github.com/spotify/scio/pull/3063>)
add small SMB sink optimizations (#3079 <https://github.com/spotify/scio/pull/3079>)
Add support for PipelineOptions in ContextAndArgs (#3121 <https://github.com/spotify/scio/pull/3121>)
Add support for read only ensureTable (#3114 <https://github.com/spotify/scio/pull/3114>)
Add support for sharded JDBC reads from tables (#3020 <https://github.com/spotify/scio/pull/3020>)
Add support for String/ByteString TF Bucket key types (#3098 <https://github.com/spotify/scio/pull/3098>)
Ensures the future returned by addCallback will complete (#3099 <https://github.com/spotify/scio/pull/3099>)
Update BigQueryType and AvroType compileTimeOnly msg (#3107 <https://github.com/spotify/scio/pull/3107>)
Cleanup scio-repl classloader (#3118 <https://github.com/spotify/scio/pull/3118>)
Initialize ScioContext on :reset (#3109 <https://github.com/spotify/scio/pull/3109>)
Remove unnecessary cache of client interceptors (#3091 <https://github.com/spotify/scio/pull/3091>)
Refactor scio-repl underlying ILoop (#3108 <https://github.com/spotify/scio/pull/3108>)
Make SMB source a splittable BoundedSource (#3005 <https://github.com/spotify/scio/pull/3005>)
More Coder doc (#3025 <https://github.com/spotify/scio/pull/3025>)
Use a sampled subset of files to compute estimated SMB source size (#3037 <https://github.com/spotify/scio/pull/3037>)
Use IndexRecord upper bound (#3028 <https://github.com/spotify/scio/pull/3028>)
Use MonoidAggregator when available (#3051 <https://github.com/spotify/scio/pull/3051>)
Wrap skewedJoin internals in transform (#3104 <https://github.com/spotify/scio/pull/3104>)
Update deprecated .toIterator with .iterator (#3053 <https://github.com/spotify/scio/pull/3053>)
Update to use testId instead of toString (#3115 <https://github.com/spotify/scio/pull/3115>)
Bug Fixes

Fix additional exception wrappings for Flink (#3035 <https://github.com/spotify/scio/pull/3035>)
Fix classpath issue when running from IntelliJ or Bloop (#3087 <https://github.com/spotify/scio/pull/3087>)
Fix containValue serialization (#3128 <https://github.com/spotify/scio/pull/3128>)
Fix doc site edit page link (#3062 <https://github.com/spotify/scio/pull/3062>)
Fix javafmt from #3054 <https://github.com/spotify/scio/pull/3054>
Fix repl-generated classfiles output directory (#3106 <https://github.com/spotify/scio/pull/3106>)
Fix scio-repl scala specific repl settings (#3089 <https://github.com/spotify/scio/pull/3089>)
fix site homepage formatting
fix SMB doc formatting (#3078 <https://github.com/spotify/scio/pull/3078>)
Fix tuplecoders script
Fix: Add extra schema encoding step if coder already set (#3027 <https://github.com/spotify/scio/pull/3027>)
Fix: propagate PipelineOptions in job test (#3026 <https://github.com/spotify/scio/pull/3026>)
Fix: support mutable zeroValue in aggregate/combine/fold (#3033 <https://github.com/spotify/scio/pull/3033>)
Add missing Dataflow runner to scio-repl (#3081 <https://github.com/spotify/scio/pull/3081>)
Dependency Updates

Update auto-value, auto-value-annotations to 1.7.3 (#3042 <https://github.com/spotify/scio/pull/3042>)
Update Beam to 2.22.0 (#3039 <https://github.com/spotify/scio/pull/3039>)
Update caffeine to 2.8.5 (#3112 <https://github.com/spotify/scio/pull/3112>)
Update case-app, case-app-annotations, ... to 2.0.3 (#3094 <https://github.com/spotify/scio/pull/3094>)
Update elasticsearch-rest-client, ... to 7.8.0 (#3067 <https://github.com/spotify/scio/pull/3067>)
Update magnolify-avro, magnolify-bigtable, ... to 0.2.1 (#3127 <https://github.com/spotify/scio/pull/3127>)
Update scala to 2.13.3 (#3130 <https://github.com/spotify/scio/pull/3130>)
Update scalactic to 3.2.0 (#3072 <https://github.com/spotify/scio/pull/3072>)
Update scalatest to 3.2.0 (#3073 <https://github.com/spotify/scio/pull/3073>)
Update transport to 6.8.10 (#3047 <https://github.com/spotify/scio/pull/3047>)