Skip to content

Releases: pinax-network/substreams-sink-clickhouse

v0.3.0

19 Feb 03:09
de00d7b
Compare
Choose a tag to compare

What's new

  • /init on launch
  • add exit handling
    • flush buffer on exit
  • Convert buffer to in-memory instead of SQLite
  • add module_hash to blocks TABLE
    • add module_hash query to /blocks
  • Ed25519 public key validation (check length)
  • add optimize to /blocks enpdoint (how many duplicate blocks that need to be optimized)
    • OPTIMIZE TABLE blocks FINAL
  • implement file based buffer (buffer.txt)

Deprecated

  • remove PUT auth
    • sink should be deployed on private network
    • can enforce authentication with reverse proxy nginx
  • remove SQLite buffer
    • add multiple replicates of Clickhouse sinks for higher throughput
    • leverage Clickhouse DB for internal buffer
    • Allows for atomic POST requests
    • simplify DB inserts
  • remove unparsed
    • should throw error if EntityChanges schemas are not defined
  • remove HTTP GET query
    • sink should be private and not exposed to HTTP public
    • other more efficient tools can expose SQL queries via HTTP
  • remove deleted entity changes table
    • replaced by adding operation as extra field
  • remove final_blocks TABLE
    • Clickhouse Sink should use final_blocks=true when loading data

What's Changed

Full Changelog: v0.2.2...v0.3.0

v0.2.2

15 Feb 02:41
711b647
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.2.1...v0.2.2

v0.2.1

14 Feb 16:05
Compare
Choose a tag to compare
  • Update latest substreams-sink-webhook signature

v0.1.0

13 Dec 19:35
Compare
Choose a tag to compare

Initial minor release

substreams-sink-clickhouse's minor release

Extra features

  • Added support for db_out as a data format.

v0.0.15

09 Dec 16:08
Compare
Choose a tag to compare
  • update substreams-sink-webhook import path to use "substreams-sink-webhook/auth"

v0.0.14

01 Dec 04:41
Compare
Choose a tag to compare
  • rename /cursors/latest => /cursor/latest
    • return /cursor/latest as toText instead of toJSON

v0.0.13

01 Dec 03:17
20dcf4f
Compare
Choose a tag to compare
  • add back block_id & id to extra metadata

v0.0.12

29 Nov 04:01
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.0.11...v0.0.12

v0.0.11

08 Nov 16:41
Compare
Choose a tag to compare
  • Denormalize database by #71
  • Added 1s cache to /health by #72
  • Fixed array insertion issue

v0.0.10

03 Nov 18:49
Compare
Choose a tag to compare
  • Added buffered insertions
  • Changed unparsed_json to a Null table engine. See readme to setup MaterializedViews.
  • Added --allow-unparsed flag
  • Fixed AUTH_KEY parsing