Release v0.11.3

NOTE Please skip to v0.11.4, it contains a bug fix from this release. Thanks!

🚀 Enhancements

• Un-deprecate AvroConverters by @kellen in #4185
• Add helper methods for org.scalacheck.Gen to PipelineSpec by @kellen in #4157
• Add support for Redis ZADD command for RedisIO Write by @anish749 in #4169
• Add methods for sortMergeTransform to read additional sources by @bkalra23 in #4091
• use google-github-actions/auth in GHA by @clairemcginty in #4176

🐛 Bug Fixes

• Fix build regex handling by @kellen in #4173
• Fix sortMergeTransform return type by @regadas in #4179
• Fix parquet avro generic records read by @stormy-ua in #4195

📗 Documentation

• update SMB Tuning page on github site by @clairemcginty in #4170
• Update Beam version matrix + include info on Beam dependencies by @clairemcginty in #4192
• add Beam info for 0.11.3 release by @clairemcginty in #4204
• add a note about parquet issue in 0.11.2 by @stormy-ua in #4205

🌱 Dependency Updates

• upgrade to Beam 2.35.0 by @clairemcginty in #4168
• Switch from adopt jvm to temurin by @regadas in #4150
• Update socco-ng to v0.1.6 by @regadas in #4156
• Update sbt to 1.6.1 by @scala-steward in #4163
• Update sbt-scalafmt to 2.4.6 by @scala-steward in #4160
• Update scalafmt-core to 3.2.2 by @scala-steward in #4159
• Update junit-interface to 0.13.3 by @scala-steward in #4164
• Update scalafmt-core to 3.3.1 by @scala-steward in #4167
• Update protobuf-java to 3.18.2 by @scala-steward in #4172
• Update mysql-socket-factory to 1.4.2 by @scala-steward in #4174
• Use scala213source3 salafmt dialect by @regadas in #4181
• bump gcs-connector to 2.2.4 by @clairemcginty in #4183
• Update Flink runner to 1.13 by @regadas in #4180
• Update sbt-scalafix to 0.9.34 by @scala-steward in #4189
• Update sbt-scoverage to 1.9.3 by @scala-steward in #4188
• Bump JamesIves/github-pages-deploy-action from 4.2.1 to 4.2.2 by @dependabot in #4187
• Update transport to 6.8.23 by @scala-steward in #4199
• update grpc to 1.41.1 by @clairemcginty in #4202
• Update elasticsearch-rest-client, ... to 7.16.3 by @scala-steward in #4198
• Update slf4j-api, slf4j-nop, slf4j-simple to 1.7.33 by @scala-steward in #4201
• Update scala-compiler, scala-library, ... to 2.13.8 by @scala-steward in #4200

Full Changelog: v0.11.2...v0.11.3

Release v0.11.2

"Batavia"

🚀 Enhancements

• Deduplicate async lookup requests (#4100) @kellen
• update GcsConnectorUtil to remove deprecated auth & search for ADC (#4099) @clairemcginty
• Set value coder for HadoopIO in ParquetTypeIO (#4108) @lofifnc
• add unit test for Avro Source+PTransform serialization (#4052) @clairemcginty
• Add support for using the Elasticsearch credentials in IndexAdmin (#4067) @jordiolivares
• Whitelist ~/.m2 ~/.ivy2 and ~/.cache/coursier, fixes #4016 (#4090) @kellen

🐛 Bug Fixes

• Fix SMBTransform callsite name for Dataflow graph (#4127) @clairemcginty
• (fix #4082) numBuckets should be a required SMB param (#4093) @clairemcginty

📗 Documentation

• Clarify ParquetExample inputs and outputs (#4128) @clairemcginty
• Parquet schema evolution doc: no need to append new fields to the end of a record. (#4096) @stormy-ua
• Add link to hub install documentation (#4060) @kellen
• Remove scio_sql since it get dropped in latest release (#4086) @izhangzhihao

🌱 Dependency Updates

• Update sbt to 1.5.6 (#4129) @scala-steward
• upgrade google-cloud libraries according to BOM (#4124) @clairemcginty
• update to elasticsearch 7.16.0 (#4125) @clairemcginty
• Update mysql-socket-factory to 1.4.1 (#4121) @scala-steward
• Bump magnolify to 0.4.5 (#4119) @stormy-ua
• Update caffeine to 2.9.3 (#4111) @scala-steward
• Update scalafmt-core to 3.2.1 (#4112) @scala-steward
• Update sbt-scalafmt to 2.4.5 (#4114) @scala-steward
• Upgrade Beam to 2.34 (#4104) @jto
• Update algebra to 2.7.0 (#4106) @scala-steward
• Update scala-collection-compat to 2.6.0 (#4081) @scala-steward
• Update sbt-avro to 3.4.0 (#4092) @scala-steward
• Bump actions/checkout from 2.3.5 to 2.4.0 (#4076) @dependabot
• Update elasticsearch, ... to 7.15.2 (#4083) @scala-steward
• Update algebird-core, algebird-test to 0.13.9 (#4079) @scala-steward
• Update jna to 5.10.0 (#4080) @scala-steward
• Bump JamesIves/github-pages-deploy-action from 4.1.5 to 4.1.7 (#4107) @dependabot
• Update sbt-scalafix to 0.9.33 (#4105) @scala-steward
• Update auto-service to 1.0.1 (#4078) @scala-steward
• Update mysql-socket-factory to 1.4.0 (#4077) @scala-steward
• Revert "Update zoltar-api, zoltar-core, ... to 0.6.0-M4" (#4103) @regadas
• Update scalafmt-core to 3.0.8 (#4072) @scala-steward
• Update sbt-scoverage to 1.9.2 (#4074) @scala-steward
• Update sbt-java-formatter to 0.7.0 (#4095) @scala-steward
• Update sbt-scalafmt to 2.4.4 (#4097) @scala-steward
• Update sbt-bloop to 1.4.11 (#4075) @scala-steward
• Update scalactic to 3.2.10 (#4007) @scala-steward
• Update sbt-bloop to 1.4.10 (#4059) @scala-steward
• Update zoltar-api, zoltar-core, ... to 0.6.0-M4 (#4068) @scala-steward
• Update joda-time to 2.10.13 (#4064) @scala-steward
• Update sbt-scalafix to 0.9.32 (#4089) @scala-steward
• Bump dep versions for M1 Apple silicon (#4051) @troyd-spotify-com
• Update sbt-mdoc to 2.2.24 (#4056) @scala-steward
• Update scalafmt-core to 3.0.7 (#4057) @scala-steward
• Update sbt-unidoc to 0.5.0 (#4062) @scala-steward
• Update junit-interface to 0.13.2 (#4063) @scala-steward

Contributors to this release

@clairemcginty, @dependabot, @dependabot[bot], @izhangzhihao, @jordiolivares, @jto, @kellen, @lofifnc, @regadas, @scala-steward, @stormy-ua and @troyd-spotify-com

Release v0.11.1

"Armorica"

🚀 Enhancements

• upgrade beam to 2.33.0 (#4041) @clairemcginty

🐛 Bug Fixes

• (fix #4054) synchronize lazy initializing in ParquetBucketMetadata (#4055) @clairemcginty
• (fix #4034) support setting tempDirectory in file writes (#4035) @clairemcginty
• Fix contains in any order matcher (#3992) @jwiklund
• Set max heap size for the docs generating workflow (#3986) @stormy-ua
• Do not unwrap a wrapped Beam coder to avoid NPE (#4006) @stormy-ua

📗 Documentation

• 0.11.1 release documentation update (#4053) @kellen

🪦 Deprecations

• n/a

🌱 Dependency Updates

• Update sbt-scoverage to 1.9.1 (#4039) @scala-steward
• Update protobuf-java to 3.18.1 (#4029) @scala-steward
• Update scala-compiler, scala-library, ... to 2.12.15 (#3998) @scala-steward
• Update elasticsearch, ... to 7.14.2 (#4012) @scala-steward
• Update elasticsearch, ... to 6.8.19 (#4011) @scala-steward
• Update scalafmt-core to 3.0.6 (#4027) @scala-steward
• Update breeze to 2.0 (#4028) @scala-steward
• Update mysql-socket-factory to 1.3.4 (#4031) @scala-steward
• Update sbt-mima-plugin to 1.0.1 (#4032) @scala-steward
• Update sbt-protobuf to 0.7.1 (#4025) @scala-steward
• Update sbt-avro to 3.3.0 (#4000) @scala-steward
• Update protobuf-java to 3.18.0 (#4001) @scala-steward
• Update kantan.csv to 0.6.2 (#4022) @scala-steward
• Update joda-time to 2.10.12 (#4021) @scala-steward
• Update scalafmt-core to 3.0.5 (#4020) @scala-steward
• Update sbt-ci-release to 1.5.9 (#4017) @scala-steward
• Update scalatest to 3.2.10 (#4009) @scala-steward
• Update sbt-scoverage to 1.9.0 (#4003) @scala-steward
• Update sbt-scalafix to 0.9.31 (#4004) @scala-steward
• Update transport to 6.8.19 (#4014) @scala-steward
• Update sbt-ci-release to 1.5.10 (#4042) @scala-steward
• Bump actions/checkout from 2.3.4 to 2.3.5 (#4048) @dependabot
• Update mysql-connector-java to 8.0.27 (#4050) @scala-steward
• Update parquet-avro, parquet-column, ... to 1.12.2 (#4033) @scala-steward
• Update scalafmt-core to 3.0.3 (#3995) @scala-steward
• Update sbt-bloop to 1.4.9 (#3997) @scala-steward
• Update mysql-socket-factory to 1.3.3 (#3991) @scala-steward
• Update scalafmt-core to 3.0.2 (#3987) @scala-steward
• Update elasticsearch, ... to 6.8.20 (#4043) @scala-steward
• Update elasticsearch-rest-client, ... to 7.15.1 (#4046) @scala-steward

Contributors to this release

@clairemcginty, @dependabot, @dependabot[bot], @jwiklund, @kellen, @scala-steward and @stormy-ua

Release v0.11.0

"Ariana"

🚀 Enhancements

• Side inputs for SMB transforms (#3915) @kellen
• (fix #3944) ToTable implements selectedFields (#3956) @clairemcginty
• Add outputParallelization for JdbcReadOptions (#3941) @LeReunionais
• (fix #3913) parquet-avro TestIO includes map function (#3924) @clairemcginty
• make SMB rename more fault-tolerant, fix #3766 (#3949) @nevillelyh
• Shade updated AvroCoder until Beam 2.33.0 is released (#3957) @clairemcginty
• Remove printstacktrace in Coders (#3982) @jto
• Add a script and methods for smb cogroup with additional sources (#3904) @bkalra23
• Replace setup-scala action and tweak .jvmopts (#3925) @regadas

🐛 Bug Fixes

• Rename Sparkey hash* methods to avoid shadowing regular methods (#3894) @devictr
• Rollback covary* resetting coder logic (#3969) @stormy-ua
• Ensure MutableScalableBloomFilter initialCapacity > 0 (#3961) @kellen
• Defer ResourceId materialization in SMB to get around Flink FileSystems init issue (#3954) @stormy-ua
• (fix #3912) fix unionAll withName issue (#3931) @clairemcginty
• Get rid of an Iterable re-iteration twice in the asMapSingletonSideInput (#3926) @stormy-ua
• Fix Elasticsearch authentication (#3888) @mrkm4ntr
• update zone in BigtableIT (#3984) @clairemcginty
• explicitly set coders.tableRowCoder in BQ write (#3942) @clairemcginty

📗 Documentation

• Update the REPL documentation to use vals in place of defs. (#3891) @jmcconnell
• Adds a Parquet example (#3903) @live-wire
• 0.11.0 release docs update (#3985) @stormy-ua
• Add SMB String decoding doc to Site (#3980) @clairemcginty
• Release v0.10.4 docs updates (#3886) @live-wire

🪦 Deprecations

• Disable mdoc for scio-sql code blocks in the documentation (#3983) @stormy-ua
• Deprecate pacakage com.spotify.scio.extra.bigquery #3494 (#3974) @stormy-ua
• Deprecate and remove scio-sql #3695 (#3973) @stormy-ua

🌱 Dependency Updates

• Bump TensorFlow to 0.3.2 plus related dependencies (#3971) @nevillelyh
• Update elasticsearch to 7.14.0 (#3976) @regadas
• Bump beam deps to 2.32.0 + bigdataoss to 2.2.2 (#3967) @stormy-ua
• Remove support for the case-app typed arguments parsing #3772 (#3970) @stormy-ua
• Update magnolify-avro, magnolify-bigtable, ... to 0.4.4 (#3962) @scala-steward
• Update jackson-module-scala to 2.12.5 (#3965) @scala-steward
• Update jna to 5.9.0 (#3951) @scala-steward
• Update tensorflow-core-platform to 0.3.3 (#3975) @scala-steward
• Update elasticsearch, ... to 7.14.1 (#3977) @scala-steward
• update scalafix to 0.9.30 (#3946) @nevillelyh
• Update scalafmt-core to 3.0.1 (#3968) @scala-steward
• Bump JamesIves/github-pages-deploy-action from 4.1.4 to 4.1.5 (#3964) @dependabot
• Update sbt-mdoc to 2.2.23 (#3966) @scala-steward
• Update sbt-java-formatter to 0.6.1 (#3958) @scala-steward
• Update sbt-mima-plugin to 1.0.0 (#3955) @scala-steward
• Update scalafmt to 3.0.0 (#3953) @nevillelyh
• Update breeze to 1.3 (#3943) @scala-steward
• Update case-app, case-app-annotations, ... to 2.1.0-M6 (#3940) @scala-steward
• Bump shapeless to 2.3.7 plus downstreams (#3869) @nevillelyh
• Update transport to 6.8.18 (#3935) @scala-steward
• Update mysql-socket-factory to 1.3.2 (#3936) @scala-steward
• Update cassandra-all to 3.11.11 (#3929) @scala-steward
• Update elasticsearch-rest-client, ... to 7.13.4 (#3921) @scala-steward
• Update sbt-mdoc to 2.2.22 (#3923) @scala-steward
• Update mysql-connector-java to 8.0.26 (#3918) @scala-steward
• Update commons-io to 2.11.0 (#3914) @scala-steward
• Update sbt to 1.5.5 (#3909) @scala-steward
• Update slf4j-api, slf4j-nop, slf4j-simple to 1.7.32 (#3920) @scala-steward
• Update commons-compress to 1.21 (#3911) @scala-steward
• Update mysql-socket-factory to 1.3.1 (#3916) @scala-steward
• Update auto-value, auto-value-annotations to 1.8.2 (#3917) @scala-steward
• Update elasticsearch, ... to 7.13.3 (#3900) @scala-steward
• Update sbt-scalafmt to 2.4.3 (#3906) @scala-steward
• Update scala-collection-compat to 2.5.0 (#3907) @scala-steward
• Update elasticsearch, ... to 6.8.17 (#3899) @scala-steward
• Update jackson-module-scala to 2.12.4 (#3898) @scala-steward
• Update caffeine to 2.9.2 (#3892) @scala-steward

Contributors to this release

@LeReunionais, @bkalra23, @clairemcginty, @dependabot, @dependabot[bot], @devictr, @jmcconnell, @jto, @kellen, @live-wire, @mrkm4ntr, @nevillelyh, @regadas, @scala-steward and @stormy-ua

Release v0.10.4

"Edessa"

🚀 Enhancements

• Yet another build tweak (#3865) @regadas
• covary etc. should reset coder #3809 (#3868) @stormy-ua
• Remove java8 steps (#3860) @regadas
• deprecate case-app based typed argument parsing, #3772 (#3857) @nevillelyh

🐛 Bug Fixes

• Fix algebirds Moments Coder (#3883) @jto
• Fix memory leak in AsyncDoFns due to race-condition and large bundles (#3882) @jordiolivares
• Fix RedisDoFn ExecutionContext (#3842) @regadas

🌱 Dependency Updates

• Bump Beam to 2.30.0, update transitives (#3880) @nevillelyh
• Update slf4j-api, slf4j-nop, slf4j-simple to 1.7.31 (#3881) @scala-steward
• Update elasticsearch-rest-client, ... to 7.13.2 (#3876) @scala-steward
• Update sbt to 1.5.4 (#3874) @scala-steward
• Update commons-io to 2.10.0 (#3873) @scala-steward
• Update protobuf-java to 3.17.3 (#3870) @scala-steward
• Bump JamesIves/github-pages-deploy-action from 4.1.3 to 4.1.4 (#3867) @dependabot
• Update chill, chill-algebird, chill-java, ... to 0.10.0 (#3866) @scala-steward
• Update sbt to 1.5.3 (#3849) @scala-steward
• Bump sbt-scalafix to 0.9.29 (#3863) @nevillelyh
• Bump scala versions in CI (#3862) @nevillelyh
• Bump scala to 2.13.6 (#3861) @nevillelyh
• Update scala-compiler, scala-library, ... to 2.12.14 (#3843) @scala-steward
• Update socco-ng to v0.1.5 (#3859) @regadas
• Update protobuf-java to 3.17.2 (#3858) @scala-steward
• Update elasticsearch, ... to 7.13.1 (#3854) @scala-steward
• Update elasticsearch-rest-client, ... to 7.13.1 (#3855) @scala-steward
• Bump actions/create-release from 1 to 1.1.4 (#3810) @dependabot
• Bump JamesIves/github-pages-deploy-action from 4.1.1 to 4.1.3 (#3811) @dependabot
• Bump olafurpg/setup-scala from 10 to 12 (#3853) @dependabot
• Update mysql-socket-factory to 1.3.0 (#3852) @scala-steward
• Update sbt-jmh to 0.4.3 (#3850) @scala-steward
• Update sbt-scoverage to 1.8.2 (#3845) @scala-steward
• Update algebra to 2.2.3 (#3846) @scala-steward
• update bump_scio.rb with correct REPL asset path (#3844) @clairemcginty

Contributors to this release

@clairemcginty, @dependabot, @dependabot[bot], @jordiolivares, @jto, @nevillelyh, @regadas, @scala-steward, @stormy-ua and @syodage

Release v0.10.3

"Dallasium"

🚀 Enhancements

• Add support for tearing down the resources automatically if the resource is AutoCloseable (#3828) @jordiolivares
• Document ordering of selectedFields (#3824) @iezer
• add SMB local disk buffer (#3805) @nevillelyh
• Add some SMB read tuning options (#3758) @nevillelyh
• support multiple input directories in JsonSortedBucketIO (#3749) @nevillelyh
• Use the same hash fn in hashPartition and hashPartitionByKey (#3771) @anish749
• Update the deprecated SemanticRuleSuite trait in Scalafix (#3796) @mlachkar
• Increase counters in ElasticsearchWriter that tracks request size (#3762) @mkrajc
• Make beam version mismatch a warning (#3748) @jto

🐛 Bug Fixes

• fix specific record NPE in ParquetAvroSortedBucketIO (#3834) @nevillelyh
• Fix removed dependency (#3820) @kndarp
• Fix #3753, SMB source coder warning (#3791) @nevillelyh
• fix deprecated sbt syntax (#3786) @nevillelyh
• fix sparse transforms split on the wrong side (#3770) @nevillelyh

🌱 Dependency Updates

• Bump Beam to 2.29.0 (#3793) @nevillelyh
• Update algebird-core, algebird-test to 0.13.8 (#3827) @scala-steward
• Update commons-io to 2.9.0 (#3835) @scala-steward
• Update sbt-mima-plugin to 0.9.2 (#3837) @scala-steward
• Update elasticsearch, ... to 7.13.0 (#3831) @scala-steward
• Update elasticsearch, ... to 6.8.16 (#3830) @scala-steward
• Update protobuf-java to 3.17.1 (#3829) @scala-steward
• Update sbt-scoverage to 1.8.1 (#3825) @scala-steward
• Update scalactic to 3.2.9 (#3818) @scala-steward
• Update scalatest to 3.2.9 (#3819) @scala-steward
• Update pprint to 0.6.6 (#3821) @scala-steward
• Update sbt-mdoc to 2.2.21 (#3817) @scala-steward
• Update scala-collection-compat to 2.4.4 (#3816) @scala-steward
• Update sbt-mima-plugin to 0.9.1 (#3815) @scala-steward
• Update sbt-jmh to 0.4.2 (#3814) @scala-steward
• Update protobuf-java to 3.17.0 (#3813) @scala-steward
• Update mysql-connector-java to 8.0.25 (#3806) @scala-steward
• Update sbt-scoverage to 1.8.0 (#3807) @scala-steward
• Update sbt to 1.5.2 (#3804) @scala-steward
• Update protobuf-java to 3.16.0 (#3802) @scala-steward
• Update caseapp to 2.0.6 (#3801) @nevillelyh
• Update sbt-scoverage to 1.7.3 (#3794) @scala-steward
• Update mysql-socket-factory to 1.2.3 (#3795) @scala-steward
• Update scalacheck to 1.15.4 (#3792) @scala-steward
• Update sbt-scoverage to 1.7.2 (#3788) @scala-steward
• Update elasticsearch, ... to 7.12.1 (#3779) @scala-steward
• Update caffeine to 2.9.1 (#3789) @scala-steward
• Update elasticsearch-rest-client, ... to 7.12.1 (#3780) @scala-steward
• Update pprint to 0.6.5 (#3783) @scala-steward
• Update sbt-scoverage to 1.7.0 (#3784) @scala-steward
• Update sbt to 1.5.1 (#3778) @scala-steward
• Update auto-value, auto-value-annotations to 1.8.1 (#3776) @scala-steward
• Update scalactic to 3.2.8 (#3774) @scala-steward
• Update scalatest to 3.2.8 (#3775) @scala-steward
• Update sbt-mdoc to 2.2.20 (#3773) @scala-steward
• Update mysql-connector-java to 8.0.24 (#3768) @scala-steward
• Update case-app, case-app-annotations, ... to 2.0.5 (#3764) @scala-steward
• Update breeze to 1.2 (#3763) @scala-steward
• Update auto-service to 1.0 (#3740) @scala-steward
• Update auto-value, auto-value-annotations to 1.8 (#3741) @scala-steward
• Update shapeless to 2.3.4 (#3751) @scala-steward
• Update protobuf-java to 3.15.8 (#3745) @scala-steward
• Update annoy4s to 0.10.0 (#3746) @scala-steward

Contributors to this release

@anish749, @iezer, @jordiolivares, @jto, @kndarp, @mkrajc, @mlachkar, @nevillelyh, @regadas and @scala-steward

Release v0.10.2

"Cantabrigia"

The release has the fix #3716 for the critical coder performance regression issue leading to an abnormal CPU usage due to a coder logic being evaluated per every element.

🐛 Bug Fixes

• fix coder performance regression in #3716 (#3743) @nevillelyh

🚀 Enhancements

• improve dependency hygiene (#3734) @nevillelyh

📗 Documentation

• Remove internal release steps from the How-to-Release.md (#3738) @stormy-ua

🌱 Dependency Updates

• Update mysql-socket-factory to 1.2.2 (#3742) @scala-steward
• Update protobuf-java to 3.15.7 (#3735) @scala-steward
• Update sbt to 1.5.0 (#3736) @scala-steward
• Update scalatest to 3.2.7 (#3730) @scala-steward
• Update pprint to 0.6.4 (#3731) @scala-steward
• Update sbt-scalafix to 0.9.27 (#3729) @regadas
• Update algebra to 2.2.2 (#3732) @scala-steward
• Bump JamesIves/github-pages-deploy-action from 4.1.0 to 4.1.1 (#3737) @dependabot

Contributors to this release

@nevillelyh, @regadas and @stormy-ua

Release v0.10.1

"Belli Horizontis"

🚀 Enhancements

• Support verifyDeterministic and consistentWithEquals in recursive coders (#3716) @jto
• Add Sparkey-backed variants of hashJoin/hashIntersect/etc. (#3679) @psobot
• Add Sparkey-backed .asLargeSetSideInput. (#3678) @psobot
• Add Sparkey-backed .asLargeMapSideInput with coder support. (#3677) @psobot
• Add updateCacheOnGlobalWindow to DelegatingSideInput. (#3668) @psobot
• Add RollupAndCount aggregation (#3674) @annicai
• Add JavaThenScala compiler order to scio-smb (#3719) @nevillelyh
• Add serializeToByteArray (#3588) @wayoung
• Remove unused context bounds, coders and @unused (#3685) @regadas
• Avoid flatMapValues possible underlying copy (#3683) @regadas
• Deprecate Beam SQL #3695 (#3706) @nevillelyh
• Clean up CI JVM usage & labels (#3696) @nevillelyh
• Clean up CI build (#3724) @nevillelyh
• Speed up build (#3687) @regadas
• Update CI JVM (#3682) @regadas

🐛 Bug Fixes

• Fix infinite recursion in PubsubIO.readAvro (#3690) @moscowart
• Fix header/footer in TextIO.textOut (#3715) @shomolomo

🌱 Dependency Updates

• Update magnolify-avro, magnolify-bigtable, ... to 0.4.3 (#3684) @scala-steward
• Update scalactic to 3.2.7 (#3728) @scala-steward
• Update scala-collection-compat to 2.4.3 (#3727) @scala-steward
• Update sbt-mdoc to 2.2.19 (#3722) @scala-steward
• Update parquet-avro, parquet-column, ... to 1.12.0 (#3713) @scala-steward
• Update pprint to 0.6.3 (#3712) @scala-steward
• Update elasticsearch-rest-client, ... to 7.12.0 (#3703) @scala-steward
• Update transport to 6.8.15 (#3704) @scala-steward
• Update jna to 5.8.0 (#3697) @scala-steward
• Update auto-value, auto-value-annotations to 1.7.5 (#3699) @scala-steward
• Update sbt-ci-release to 1.5.7 (#3700) @scala-steward
• Bump coursier/cache-action from v5 to v6 (#3698) @nevillelyh
• Update cassandra-driver-core to 3.11.0 (#3676) @scala-steward
• Update protobuf-java to 3.15.6 (#3681) @scala-steward
• Update sbt-ci-release to 1.5.6 (#3675) @scala-steward
• Update zoltar-api, zoltar-core, ... to 0.6.0-M2 (#3666) @scala-steward
• Update elasticsearch-rest-client, ... to 7.11.2 (#3672) @scala-steward
• Update elasticsearch, ... to 7.11.2 (#3671) @scala-steward
• Update sbt to 1.4.9 (#3670) @scala-steward
• Update Bigtable proto dependencies to 1.14.0 (#3665) @mrkm4ntr
• Update sbt to 1.4.8 (#3662) @scala-steward
• Update pprint to 0.6.2 (#3661) @scala-steward
• Update scalatest to 3.2.6 (#3664) @scala-steward
• Update scalactic to 3.2.6 (#3663) @scala-steward
• Update protobuf-java to 3.15.5 (#3659) @scala-steward
• Bump JamesIves/github-pages-deploy-action from 4.0.0 to 4.1.0 (#3660) @dependabot
• Update protobuf-java to 3.15.4 (#3656) @scala-steward
• Update socco-ng to 0.1.4 (#3654) @regadas

Contributors to this release

@annicai, @jto, @moscowart, @mrkm4ntr, @nevillelyh, @psobot, @regadas, @shomolomo and @wayoung

Release v0.10.0

"Aquae Sextiae"

🚀 Enhancements

• SortedBucketTransform lazily evaluates the inputs to transformFn (#3647) @clairemcginty
• Rework doc and repl scalacOptions (#3653) @regadas
• add Parquet SMB E2E test (#3638) @nevillelyh
• add ParquetTypeSortedBucketIO (#3627) @nevillelyh
• add ParquetBucketMetadata and ParquetTypeFileOperations (#3622) @nevillelyh
• Add Parquet Avro support for SMB (#3604) @nevillelyh
• support reading Parquet as Avro GenericRecord (#3650) @nevillelyh
• add Hadoop core-site.xml to scio-smb (#3649) @nevillelyh
• expose Configuration in SMB Parquet reads (#3637) @nevillelyh
• Expose Hadoop Configuration in non-SMB Parquet IOs #3630 (#3635) @nevillelyh
• syntaxify scio-parquet (#3598) @nevillelyh
• make GZIP default for Parquet (#3597) @nevillelyh
• Add typed Parquet support (#3591) @nevillelyh
• simplify tempDirectory setting in SMB write (#3587) @clairemcginty
• Support username password auth for Elasticsearch 7.x (#3572) @mrkm4ntr

🐛 Bug Fixes

• Fix SMB Avro codec/metadata handling (#3599) @nevillelyh
• Only allow accesor methods for BigQuery fields in case classes (#3651) @jordiolivares
• Respect filesToStage set through CLI (#3642) @regadas
• Fix BigQuery implicit coder (#3640) @regadas

🌱 Dependency Updates

• exclude transitive avro from parquet-avro (#3646) @nevillelyh
• Update magnolify-avro, magnolify-bigtable, ... to 0.4.2 (#3648) @scala-steward
• Update beam-runners-core-construction-java, ... to 2.28.0 (#3632) @scala-steward
• Update transport to 6.8.14 (#3603) @scala-steward
• Update joda-time to 2.10.10 (#3592) @scala-steward
• Update magnolify-avro, magnolify-bigtable, ... to 0.4.1 (#3590) @scala-steward
• Update scala to 2.13.5 (#3645) @regadas
• Update sbt-protobuf to 0.7.0 (#3644) @scala-steward
• Update commons-lang3 to 3.12.0 (#3643) @scala-steward
• Update sbt-scalafix to 0.9.26 (#3641) @scala-steward
• Update protobuf-java to 3.15.3 (#3636) @scala-steward
• Update protobuf-java to 3.15.2 (#3634) @scala-steward
• Update scalatest to 3.2.5 (#3625) @scala-steward
• Update scalactic to 3.2.5 (#3629) @scala-steward
• Update protobuf-java to 3.15.1 (#3628) @scala-steward
• Update sbt-paradox to 0.9.2 (#3626) @scala-steward
• Update algebra to 2.2.1 (#3623) @scala-steward
• Update sbt-bloop to 1.4.8 (#3621) @scala-steward
• Update scalacheck to 1.15.3 (#3611) @scala-steward
• Update scalactic to 3.2.4 (#3619) @scala-steward
• Update scalatest to 3.2.4 (#3620) @scala-steward
• Update elasticsearch, ... to 7.11.1 (#3614) @scala-steward
• Update elasticsearch-rest-client, ... to 7.11.1 (#3615) @scala-steward
• Update sbt-mdoc to 2.2.18 (#3618) @scala-steward
• Update mysql-socket-factory to 1.2.1 (#3612) @scala-steward
• Update scala-collection-compat to 2.4.2 (#3613) @scala-steward
• Update caffeine to 2.9.0 (#3610) @scala-steward
• Update algebra to 2.2.0 (#3609) @scala-steward
• Update junit to 4.13.2 (#3608) @scala-steward
• Update sbt-bloop to 1.4.7 (#3607) @scala-steward
• Update elasticsearch, ... to 6.8.14 (#3600) @scala-steward
• Bump JamesIves/github-pages-deploy-action from 3.7.1 to 4.0.0 (#3596) @regadas
• Update sbt-mdoc to 2.2.17 (#3593) @scala-steward
• Update socco (#3589) @regadas
• Update cassandra-all to 3.11.10 (#3586) @scala-steward
• Update scala-collection-compat to 2.4.1 (#3584) @scala-steward
• Update sbt to 1.4.7 (#3585) @scala-steward
• Update jna to 5.7.0 (#3594) @scala-steward

Contributors to this release

@clairemcginty, @jordiolivares, @mrkm4ntr, @nevillelyh, @regadas and @scala-steward

Release v0.10.0-beta3

🚀 Enhancements

• expose more context in DoFns, fix #3579 (#3583) @nevillelyh
• Update TensorFlow to 2.3.1 (#3578) @regadas
• Avoid reshuffling when numOfShard is 0 (#3566) @mrkm4ntr
• set Parquet writer row group size, fix #3569 (#3570) @nevillelyh
• Rework RedisMutator (#3543) @regadas
• Use Redis atomic PSETEX (#3509) @regadas
• Add RedisType implicit error message (#3456) (#3510) @regadas
• Remove deprecated BigQueryTable (#3493) @regadas
• Use consistent Hll naming (#3508) @regadas
• log when BufferedExternalSorter switches from to external sort (#3511) @clairemcginty
• Add parameters for passing retry settings to Jdbc write (#3497) @DeaconDesperado

🐛 Bug Fixes

• Upgrade Sparkey to work around hash collision bug. (#3532) @psobot
• TestInput is not thread safe and can result in flaky tests. (#3512) @rteabeault

📗 Documentation

• remove dangling sentence in Coders.md (#3557) @mattnworb
• Add Ztore to Powered By (#3554) @dennisylyung
• add more public posts, talks, projects to site (#3545) @nevillelyh
• Update release steps (#3506) @regadas
• Follow up to Hll doc update (#3516) @regadas

🌱 Dependency Updates

• Update caffeine to 2.8.7 (#3519) @scala-steward
• Update pprint to 0.6.1 (#3581) @scala-steward
• Update scala-collection-compat to 2.4.0 (#3577) @scala-steward
• Update scala 2.12.x to 2.12.13 and 2.13.x to 2.13.4 (#3574) @regadas
• Update TensorFlow to 2.3.1 (#3578) @regadas
• Update Flink to 1.12.1 (#3568) @regadas
• Update mysql-connector-java to 8.0.23 (#3564) @scala-steward
• Update elasticsearch-rest-client, ... to 7.10.2 (#3559) @scala-steward
• Bump Beam to 2.27.0 (#3552) @nevillelyh
• Update algebra to 2.1.1 (#3544) @scala-steward
• Update beam to 2.26.0 (#3538) @regadas
• Update joda-time to 2.10.9 (#3540) @scala-steward
• Update algebra to 2.1.0 (#3527) @scala-steward
• Update elasticsearch-rest-client, ... to 7.10.1 (#3523) @scala-steward
• Update caffeine to 2.8.8 (#3520) @scala-steward
• HyperLogLog Documentation (#3492) @syodage
• Update scala-collection-compat to 2.3.1 (#3498) @scala-steward
• Update scalacheck to 1.15.2 (#3533) @scala-steward
• Update sbt-mdoc to 2.2.16 (#3567) @scala-steward
• Update sbt-mdoc to 2.2.15 (#3565) @scala-steward
• Update sbt-scalafix to 0.9.25 (#3563) @scala-steward
• Update sbt to 1.4.6 (#3539) @scala-steward
• Update sbt-mdoc to 2.2.14 (#3534) @scala-steward
• Update sbt-paradox to 0.9.1 (#3531) @scala-steward
• Update sbt to 1.4.5 (#3529) @scala-steward
• Update sbt-ci-release to 1.5.5 (#3517) @scala-steward
• Update sbt-bloop to 1.4.6 (#3513) @scala-steward
• Update sbt-paradox to 0.9.0 (#3515) @scala-steward
• Update sbt-explicit-dependencies to 0.2.16 (#3504) @scala-steward
• Update sbt-scalafix to 0.9.24 (#3500) @scala-steward
• Update sbt-mdoc to 2.2.13 (#3499) @scala-steward
• Update sbt to 1.4.4 (#3496) @scala-steward

Contributors to this release

@clairemcginty, @DeaconDesperado, @dennisylyung, @mattnworb, @mrkm4ntr, @nevillelyh, @psobot, @regadas, @rteabeault, @scala-steward and @syodage