Skip to content

Latest commit

 

History

History
638 lines (438 loc) · 21.6 KB

RELEASE.md

File metadata and controls

638 lines (438 loc) · 21.6 KB
Raw

Release 0.26.0

Major Features and Bug Fixes

  • Updated arrow version to 7.0.0

Thanks to our Contributors

This release contains contributions from many people:

372046933, Colin, Yong Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.25.0

Major Features and Bug Fixes

  • Decrease max bytes read from hdfs
  • Hide mongodb connection uri from being logged
  • Update log level from fetal to error when loading the libhdfs.so failed

Thanks to our Contributors

This release contains contributions from many people:

Junfan Zhang, Stan Chen, Vignesh Kothapalli, Yong Tang, trabenx, yleeeee

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.24.0

Major Features and Bug Fixes

  • Added Bigtable dataset support.
  • Added tfio.audio.inverse_spectrogram.
  • Fixed decode_json empty lists segmentation issue.
  • Fix parquet unknown shape issue in graph execution.
  • Removed IgniteDataset.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Andrew Goodbody, Douglas Coimbra de Andrade, Marek Dopiera, Pierre Dulac, Vignesh Kothapalli, Yong Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.23.1

Major Features and Bug Fixes

  • A bug preventing correct installation with python 3.10 has been fixed.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Vignesh Kothapalli, Yong Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.23.0

Bug Fixes

  • TensorFlow is not a hard requirement to tensorflow-io, to allow alternative dependency packages like tensorflow-rocm.
  • Migrate azure blob storage binding to azure storage sdk.
  • Fix chunk size initialization in s3 storage.
  • Enable python 3.10 support.
  • IgniteDataset is deprecated and will be removed in future releases.
  • Adding an option to specify default values for nullable fields in BigQuery

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Jan Bernlöhr, Johnu George, Luca Toscano, Lukas Geiger, Mark McDonald, Vansh Sharma, Vignesh Kothapalli, Yong Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.22.0

Bug Fixes

  • Fix hdfs file system append error.
  • Add support for Azure Shared Access Signatures.
  • Fix several Azure file system related issues.
  • Update Dicom tutorial to include tag examples.

Thanks to our Contributors

This release contains contributions from many people:

Cheng Ren, Jan Bernlöhr, Vignesh Kothapalli, Yong Tang, Z_Wael

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.21.0

Bug Fixes

  • Fix temporary file issue in s3
  • Remove extra build directory in python pip packages.

Thanks to our Contributors

This release contains contributions from many people:

Marcin Juszkiewicz, Mark Daoust, Vignesh Kothapalli, Yong Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.20.0

Major Features

  • S3 and HDFS file system supports fully migrated from tensorflow to tensorflow-io package.
  • Add tutorial of MongoDB support with tensorflow-io.
  • Add tutorial of ORC support with tensorflow-io
  • Add batched string support for Apache Arrow.

Bug Fixes

  • Fix decode_video returning only the first frame.
  • Reset mongo cursor after reaching end of collection.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Gerard Casas Saez, Keqiu Hu, Kota Yamaguchi, Mark Daoust, Vignesh Kothapalli, Yong Tang, austinzh

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.19.1

Bug Fixes

  • Fixed wheel issue with tensorflow-io-gcs-filesystem by removing temporary build folder.

Thanks to our Contributors

This release contains contributions from many people:

Gerard Casas Saez, Kota Yamaguchi, Vignesh Kothapalli, Vo Van Nghia, Yong Tang, emkornfield

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.19.0

Major Features

  • Add ffmpeg default thread options.
  • Set deadline for ReadRows request in BigQuery.
  • Allow setting the number of records fetched from kafka in KafkaDataset.

Thanks to our Contributors

This release contains contributions from many people:

Kota Yamaguchi, Vignesh Kothapalli, Vo Van Nghia, Yong Tang, emkornfield

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.18.0

Major Features

  • GCS modular file system is now part of the tensorflow-io-gcs-filesystem package.
  • S3 and HDFS modular file systems can be enabled with TF_USE_MODULAR_FILESYSTEM=1.
  • Add python 3.9 support on macOS, Linux, and Windows.
  • Add initial wavefront/obj parser for 3D vertices.
  • Move tfio.experimental.audio to tfio.audio.
  • Add https file system registration.
  • Add FFmpeg support on macOS.
  • Add 16 bit TIFF support.

Thanks to our Contributors

This release contains contributions from many people:

Cheng Ren, Dale Lane, Irene Onyeneho, Keqiu Hu, Kota Yamaguchi, Mark Daoust, Vignesh Kothapalli, Vo Van Nghia, Yong Tang, Yuan Tang, markemus

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.17.1

Bug Fixes

  • Fixed incomplete row reading issue in parquet files.

Thanks to our Contributors

This release contains contributions from many people:

Samuel Marks, Tom McTiernan, Vignesh Kothapalli, Yong Tang, Yunze Xu, 博琰

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.17.0

Major Features

  • Added MongoDB dataset support.
  • Added Apache Pulsar dataset support.
  • Added FFMpeg support for Ubuntu 20.04.
  • Added the message offset to record for Kafka dataset.
  • Azure file system migrated to modular file system C APIs.
  • HTTP file system migrated to modular file system C APIs.
  • Initial s3 modular file system support through scheme s3e://.
  • Initial gcs modular file system support through scheme gse://.
  • Initial hdfs modular file system support through scheme hdfse://.

Thanks to our Contributors

This release contains contributions from many people:

Samuel Marks, Tom McTiernan, Vignesh Kothapalli, Yong Tang, Yunze Xu, 博琰

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.16.0

Major Features

  • Added support for stream timeout in KafkaGroupIODataset
  • Renamed gstpufs to gsmemcachedfs
  • Added experimental KakfaBatchIODataset for online learning
  • Added gabor/laplacian/gaussian filter support
  • Added basic Arrow string type support for BigQuery reader
  • Added ElasticSearch dataset support
  • Added Prewitt and Sobel filter support
  • Added arbitary dimensional support for decode_json
  • Added bool data type support for decode_json
  • Added tutorials for Kafka and ElasticSearch usage with tf.keras.
  • Containers of tensorflow-io releases are available at docker pull tfsigio/tfio.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Daniel, Kota Yamaguchi, Mark Daoust, Michael Kuchnik, Vignesh Kothapalli, Yong Tang, Yuan Tang, emkornfield, marioecd

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.15.0

Major Features

  • Add basic gstpu file system for GCS/TPU support.
  • Add null handling support for AvroRecordDataset.
  • Add tfio.experimental.color for colorspace conversions:
    • tfio.experimental.color.[rgb_to_bgr|bgr_to_rgb]: BGR
    • tfio.experimental.color.[rgb_to_rgba|rgba_to_rgb]: RGBA
    • tfio.experimental.color.[rgb_to_ycbcr|ycbcr_to_rgb]: YCbCr
    • tfio.experimental.color.[rgb_to_ypbpr|ypbpr_to_rgb]: YPbPr
    • tfio.experimental.color.[rgb_to_ydbdr|ydbdr_to_rgb]: YDbDr
    • tfio.experimental.color.[rgb_to_xyz|xyz_to_rgb]: CIE XYZ
    • tfio.experimental.color.[rgb_to_lab|lab_to_rgb]: CIE LAB
    • tfio.experimental.color.[rgb_to_yiq|yiq_to_rgb]: YIQ
    • tfio.experimental.color.[rgb_to_yuv|yuv_to_rgb]: YUV
    • tfio.experimental.color.rgb_to_grayscale: Grayscale(BT 709)
  • Add tfio.image.encode_gif for GIF (animated) encoding support.

Thanks to our Contributors

This release contains contributions from many people:

Cheng Ren, Paul Shved, Vignesh Kothapalli, Yong Tang, marioecd

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.14.0

Major Features

  • Add decode_avif for AVIF image format support.
  • Add decode_jp3 for JPEG2000 image format support.
  • Add `JPEG compression support for decoding TIFF images.
  • Add audio spectrogram transform support.
  • Add operations to trim/split/remix audio signals.
  • Add Fade in/out audio augmentation support.
  • Add frequency/time masking audio augmentation support.
  • Add repeated field support in BigQuery API.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Cheng Ren, Dio Gado, Ruhua Jiang, Yong Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.13.0

Major Features

  • Add Python 3.8 support for Linux/macOS/Windows.
  • Add Graph mode support for ArrowIOTensor.
  • Add make_avro_dataset, parse_avro, and AvroRecordDataset in tfio.experimental.columnar for Avro file format support.
  • Add GeoTIFF support in decode_tiff as an extension.
  • Add Video Capture support for macOS and Linux.
  • Add decode_nv12 and decode_yuy2 in tfio.experimental.image for colorspace conversion to RGB.
  • Add decode_wav/encode_wav, decode_flac/encode_flac, decode_vorbis/encode_vorbis(ogg) decode_mp3/encode_mp3, decode_aac/encode_aac(mp4a) in tfio.audio for audio encoding and decoding support.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Ann Yan, Anthony Hsu, Bryan Cutler, Cheng Ren, Florian Raudies, Keqiu Hu, Mark Daoust, Pei-Lun Liao, Pratik Dixit, Yong Tang, Yuan Tang, Zou Xu, ashahab, marioecd

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.12.0

Major Features

  • Add Windows support for tensorflow-io.
  • Add PostgreSQL server dataset support.
  • Add MP3 format for audio dataset support.
  • Add ArrowIOTensor with input from a pyarrow.Table.
  • Add Numpy dataset support for numpy file and memory input.
  • Add decode_avro/encode_avro for Avro serialization support.
  • Prometheus dataset now outputs structured shapes.

Thanks to our Contributors

This release contains contributions from many people:

Bryan Cutler, DylanTallchiefGit, Kota Yamaguchi, Mark Daoust, Suyash Kumar, Yong Tang, Yuan Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.11.0

Major Features

  • Add Ogg audio format support.
  • Add FLAC audio format support.
  • Add HDR image format support.
  • Extend HDF5 format support to all common types.

Thanks to our Contributors

This release contains contributions from many people:

Mark Daoust, Yong Tang, Yuan Tang, pshiko

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.10.0

Major Features

  • Add Kafka message key support.
  • Add support to calculate Phred Quality Scores (Genome).
  • Add PBM(PPM/PGM) image support.
  • Add OpenEXR format support.
  • Use balanced sharding strategy in bigquery read session.
  • Add decode_jpeg_exif to support extract orientation information.
  • Enable SSE4.2 and AVX for macOS and Linux build.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Amarpreet Singh, Mark Daoust, Olivier Martin, Peter Götz, Soroush Radpour, Suyash Kumar, Yong Tang, Yuan Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.9.1

Major Features

  • tensorflow_io.bigquery: Fixes for Google Cloud BigQuery for Tensorflow 2.0

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Amarpreet Singh, Bryan Cutler, Damien Pontifex, Duke Wang, Jiacheng Xu, Marcelo Lerendegui, Mark Daoust, Ouwen Huang, Suyash Kumar, Yong Tang, Yuan Tang, henrytansetiawan

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.9.0

Release 0.9.0 is the first release that is fully compatible with TensorFlow 2.0. The package of 0.9.0 is different from 0.8.0, though it shares the same code base as 0.8.0 with the same sets of features and contributors.

Major Features

  • TensorFlow 2.0 compatible.
  • tensorflow_io.json: JSON Dataset support.
  • tensorflow_io.dicom: Medical image DICOM format support.
  • tensorflow_io.genome: DNA Sequence FastQ format support added.
  • tensorflow_io.ffmpeg: FFmpeg now support selection of substreams.
  • tensorflow_io.ffmpeg: FFmpeg now support subtitle (captioning).
  • tensorflow_io.ffmpeg: FFmpeg now support decode video from memory.
  • tensorflow_io.image: BMP encoding (encode_bmp) support.
  • tensorflow_io.kafka: Kafka Dataset now support Kafka Schema Registry.
  • tensorflow_io.audio: WAV format now support 24 bit audio streams.
  • tensorflow_io.text: Regex capture group (re2_full_match) support.
  • manylinux2010 compliant on Linux.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Amarpreet Singh, Bryan Cutler, Damien Pontifex, Duke Wang, Jiacheng Xu, Marcelo Lerendegui, Mark Daoust, Ouwen Huang, Suyash Kumar, Yong Tang, Yuan Tang, henrytansetiawan

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.8.1

Major Features

  • tensorflow_io.bigquery: Fixes for Google Cloud BigQuery for Tensorflow 1.15.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Amarpreet Singh, Bryan Cutler, Damien Pontifex, Duke Wang, Jiacheng Xu, Marcelo Lerendegui, Mark Daoust, Ouwen Huang, Suyash Kumar, Yong Tang, Yuan Tang, henrytansetiawan

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.8.0

Major Features

  • tensorflow_io.json: JSON Dataset support.
  • tensorflow_io.dicom: Medical image DICOM format support.
  • tensorflow_io.genome: DNA Sequence FastQ format support added.
  • tensorflow_io.ffmpeg: FFmpeg now support selection of substreams.
  • tensorflow_io.ffmpeg: FFmpeg now support subtitle (captioning).
  • tensorflow_io.ffmpeg: FFmpeg now support decode video from memory.
  • tensorflow_io.image: BMP encoding (encode_bmp) support.
  • tensorflow_io.kafka: Kafka Dataset now support Kafka Schema Registry.
  • tensorflow_io.audio: WAV format now support 24 bit audio streams.
  • tensorflow_io.text: Regex capture group (re2_full_match) support.
  • manylinux2010 compliant on Linux.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Amarpreet Singh, Bryan Cutler, Damien Pontifex, Duke Wang, Jiacheng Xu, Marcelo Lerendegui, Mark Daoust, Ouwen Huang, Suyash Kumar, Yong Tang, Yuan Tang, henrytansetiawan

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.7.2

Major Features

  • tensorflow_io.bigquery: Fixes for Google Cloud BigQuery for Tensorflow 1.14

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Anton Dmitriev, Bryan Cutler, Damien Pontifex, Ivelin Ivanov, Jiacheng Xu, Misha Brukman, Russell Power, Yong Tang, Yuan Tang, zhjunqin

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.7.1

Major Features

  • tensorflow_io.bigquery: Fixes for Google Cloud BigQuery for Tensorflow 1.14

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Anton Dmitriev, Bryan Cutler, Damien Pontifex, Ivelin Ivanov, Jiacheng Xu, Misha Brukman, Russell Power, Yong Tang, Yuan Tang, zhjunqin

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.7.0

Major Features

  • tensorflow_io.bigquery: Google Cloud BigQuery support.
  • tensorflow_io.text: Pcap network packet capture file support.
  • tensorflow_io.azure: Microsoft Azure Storage support.
  • tensorflow_io.gcs: GCS Configuration support.
  • tensorflow_io.prometheus: Prometheus observation data support.

Thanks to our Contributors

This release contains contributions from many people:

Aleksey Vlasenko, Anton Dmitriev, Bryan Cutler, Damien Pontifex, Ivelin Ivanov, Jiacheng Xu, Misha Brukman, Russell Power, Yong Tang, Yuan Tang, zhjunqin

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.6.0

Major Features

  • tensorflow_io.avro: Apache Avro Dataset.
  • tensorflow_io.audio: WAV file Dataset.
  • tensorflow_io.grpc: gRPC server Dataset, support for streaming Numpy input.
  • tensorflow_io.hdf5: HDF5 file Dataset.
  • tensorflow_io.text: Text file Dataset and TextSequence output.
  • Improved batching support for many Datasets, see #191.

Thanks to our Contributors

This release contains contributions from many people:

Yong Tang, Yuan Tang, Bryan Cutler, Jiacheng Xu, Junqin Zhang, August Xiong, caszkgui, zou000

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.5.0

Major Features

  • tensorflow_io.kafka: Kafka Output support.
  • tensorflow_io.cifar: CIFAR file format support.
  • tensorflow_io.bigtable: Google Cloud Bigtable support.

Thanks to our Contributors

This release contains contributions from many people:

Bryan Cutler, Damien Pontifex, Florian Raudies, Henry Tan, Junqin Zhang, Stephan Uphoff, Yong Tang, Yuan Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.4.0

Major Features

  • tensorflow_io.pubsub: Google Cloud Pub/Sub Dataset support.
  • tensorflow_io.mnist: MNIST file format support.
  • tensorflow_io.image: decode_webp support.
  • tensorflow_io.kafka: write_kafka support.

Thanks to our Contributors

This release contains contributions from many people:

Bryan Cutler, Jongwook Choi, Sergii Khomenko, Stephan Uphoff, Yong Tang, Yuan Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.3.0

Major Features

  • tensorflow_io.image: TIFF image Dataset.
  • tensorflow_io.lmdb: LMDB Dataset.

Thanks to our Contributors

This release contains contributions from many people:

Bryan Cutler, Yong Tang, Yuan Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.2.0

Major Features

  • tensorflow_io.arrow: Apache Arrow Datasets.
  • tensorflow_io.image: WebP image Dataset.
  • tensorflow_io.libsvm: LIBSVM Dataset.
  • tensorflow_io.parquet: Apache Parquet Dataset.
  • tensorflow_io.video: Video Dataset (from FFmpeg).

Thanks to our Contributors

This release contains contributions from many people:

Anton Dmitriev, Bryan Cutler, Peng Yu, Yong Tang, Yuan Tang

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.

Release 0.1.0

Initial release of TensorFlow I/O.

Major Features

  • tensorflow_io.ignite: Data source for Apache Ignite and File System (IGFS).
  • tensorflow_io.kafka: Apache Kafka stream-processing support.
  • tensorflow_io.kinesis: Amazon Kinesis data streams support.
  • tensorflow_io.hadoop: Hadoop SequenceFile format support.

Thanks to our Contributors

This release contains contributions from many people:

Anjali Sridhar, Anton Dmitriev, Artem Malykh, Brennan Saeta, Derek Murray, Gunhan Gulsoy, Jacques Pienaar, Jianwei Xie, Jiri Simsa, knight, Loo Rong Jie, Martin Wicke, Michael Case, Sergei Lebedev, Sourabh Bajaj, Yifei Feng, Yong Tang, Yuan Tang, Yun Peng

We are also grateful to all who filed issues or helped resolve them, asked and answered questions, and were part of inspiring discussions.