v0.0.5-beta2

Changelog

Client

• Improved defaults for --proto-path and --proto, using globs.
• WASM file paths in substreams.yaml manifests now resolve relative to the location of the yaml file.
• Added substreams manifest package to create .pb packages to simplify querying using other languages. See the python example.
• Added substreams manifest graph to show the Mermaid graph alone.
• Improved mermaid graph layout.
• Removed native Go code support for now.

Server

• Always writes store snapshots, each 10,000 blocks.
• A few tools to manage partial snapshots under substreams tools

Commits

• 05012e1 Added substreams manifest package command.
• 0770804 Added good defaults for proto rendering experience.
• 5adb936 Always add .pb and that's it.
• e9677eb Improve mermaid graph. Added substreams manifest graph
• cadb0e4 Merge branch 'develop' of github.com:streamingfast/substreams into develop
• 26175e8 Merge branch 'develop' of github.com:streamingfast/substreams into develop
• 5712290 Merge branch 'develop' of github.com:streamingfast/substreams into pipeline-rework
• de77bd4 No need to install wasmer
• d829192 Remove eth check, open up possibility for Solana.
• b09403f Rework of pipeline, module executor, in prep for caching
• 3222703 Update README.md
• aa8436d Updated .gitignore
• 35e1f4a Updated README.md
• fb25f4d Updated README.md
• 36eed17 added module name to state store folders fix some tests
• dd1ff1e adding wip module ouput cache
• 911b189 better error message when substreams terminate with error remove println
• 215f243 cmd: added first version of squasher
• 09b5bd4 database changes have been moved, adding validation for input sources
• a606476 find proto files recursively and change manifest module code path to absolute
• df77c1f fix panic handling
• b5d922e lower level of some logs
• 1652f15 make pipeline compile and test to runn
• 03d1b6c more log to debug
• 0463c3a only accepted value for input.source is sf.ethereum.type.v1.Block, in other cases, we return an error
• 77d5015 pipeline: allow invalid state in partial mode
• 99f3cda pipeline: fix snapshot interval
• ca3f41d remove database changes stuff from substreams
• 8ff8f25 remove database from proto build
• 6f767ff remove database proto from substreams
• 4041ba7 remove println again
• 5b63a0a remove un-used code
• 484cd9c removing a comment
• 91e2048 removing test
• c95415a renaming of parameter
• a31eab5 setting remote cmd to root as we only have remote command available
• 8923491 spec out module output cache
• 49ee4fc squasher cmd, state.ParseFile refactor
• c2625d0 squasher: fix args
• 0a083d6 state: fix bug where BuilderFromFile would create an additional substore
• 2bc44ae store sync todos
• d715952 substreams run commend
• a0ec093 todo management
• 74bae47 tools: cleanup in parallel
• 4c7931a uncommented panic recovery code in pineline
• 6d4fe90 update readme
• 067cb55 update readme

v0.0.5-beta

[v0.0.5-beta]

First chain-agnostic release. THIS IS BETA SOFTWARE. USE AT YOUR OWN RISK.
WE PROVIDE NO BACKWARDS COMPATIBILITY GUARANTEES FOR THIS RELEASE.

See https://github.com/streamingfast/substreams for usage docs.

• Removed local command. See README.md for instructions on how to run locally now. Build sfeth from source for now.
• Changed the remote command to run.
• Changed run command's --substreams-api-key-envvar flag to ``--substreams-api-token-envvar, and its default value is changed from SUBSTREAMS_API_KEY` to `SUBSTREAMS_API_TOKEN`. See README.md to learn how to obtain such tokens.

Previous Changelog

• 1a22a92 Added CHANGELOG.md
• 378d759 Added LICENSE
• 6f6e46a Added README.md
• c6e537a Added notes.
• b2e180d Added some docs. Renamed remote to run.
• 84b6852 Adding Cargo lock to gitignore
• 961d855 Adding decimals
• 86b760d Adding proto wip
• 408277e Adding sum float 64
• 60b5f59 Adding tests and adding sum_float64
• 6b9e5ab Apply table changes to an entity
• 54b7a68 Attempt at integrating protobuf to json rendering upon output.
• bb77f30 Better flags setting.
• 2b128c7 Better manifest
• b47ad60 Better print
• 91e1cd4 Bump prost to 0.10.1
• b246896 Bumped tidwall/gjson to fix sec issue.
• 39ac0f2 Change hard code value of block
• 856060c Changelog update. First draft of goreleaser.
• c396a0f Changing variable names and adding logging
• 2b2abce Closer closer to something functional. Missing the decoding and displaying the rest is pretty much there.
• ae1b219 Compiles. No more deps on sparkle now.
• 05e7960 Decode faster, support unsupported messages.
• 79583a7 Do the decoding at the right place, and load the proto-path.
• 1fbdfac Don't allow running local when not built through sf-ethereum. Only remote.
• 3f31be3 Don't conditionally add the getters
• f29022a Don't fail when proto not available. Show connecting/connected.
• f19fde7 Draft of substreams-native gRPC endpoint.
• bfc1c94 First draft at importing from PCS and splitting in a proper lib
• e753428 First draft at moving proto defs around, to have a first-class Substreams endpoint.
• a792613 First draft of proto for manifests
• cb97e74 First workable draft of multi-module remote sync'ing.
• 655782f Fix imports
• ac1c28d Fix leak between blocks for input sources.
• d47606c Fix tests. SetBuidlder -> SetOutputStore. We need the data to align for bigint
• 853deea Fixed graph building, and renamed a few stream things into modules.
• 1610439 Fixup RPC calls
• 310e60a Fixup printing of those blocks.
• 38b71c8 Fixup rust tests.
• 4526a22 Fixup the registry, and finding the right func.
• c3b725e Fixups
• 2b242c9 Flush stores at stop block too. Fix compilation issues. Fix logs. Options here and there. Cosmetics in builder.go
• 2f33f70 Go generated code
• 4fd59bb Go mod tidy
• 7c144c3 Gracefully terminate. Better print output. Optimize anypb.Any creation.
• 8f73094 Implementing and adding tests for set max int64, bigint, flaot64 and bigfloat
• 0a5fb9d Implementing sum_big_float and adding tests
• c18fa29 Improved docs. Renamed remote to run.
• fc6b067 Initialize the wasm modules within the Firehose thread.
• 03cef88 LocalConfig and RemoteConfig now extends Config
• 785889e Mega hack!
• 19ac176 Merge
• 64a2135 Merge branch 'develop' into feature/proto_manifest
• 025a55f Merge branch 'develop' of github.com:streamingfast/substreams into develop
• aa8db1e Merge branch 'develop' of github.com:streamingfast/substreams into develop
• fd2ebbb Merge branch 'develop' of github.com:streamingfast/substreams into develop
• 947015b Merge branch 'develop' of github.com:streamingfast/substreams into develop
• 835a1cc Merge branch 'develop' of github.com:streamingfast/substreams into develop
• 5cc72f2 Merge branch 'develop' of github.com:streamingfast/substreams into develop
• fb55150 Merge branch 'develop' of github.com:streamingfast/substreams into develop
• 0165628 Merge branch 'develop' of github.com:streamingfast/substreams into develop
• 09b405c Merge branch 'develop' of github.com:streamingfast/substreams into feature/refactor-state-imports
• 11efad5 Merge pull request #1 from streamingfast/master
• 4925463 Merge pull request #6 from streamingfast/feature/waiter_refactoring
• 67b9fab Merge pull request #7 from streamingfast/refactor-instance
• 44eac00 Merge pull request #8 from streamingfast/graphnode_returnhandler
• 31a8cb4 ModuleSignature WIP
• 8fa5ae4 Move return handler out of there. Will be able to be re-used by the front-end to do the same sort of decoding there.
• 5c747ea Much better on-the-fly decoding
• a377ef7 Par dessus
• 19d3238 Pass in deltas (serialized as JSON for now)
• 48aecaa Proper fallback on ENV variables.
• 81bd08b REVERT! now use block payload instead of unmarshal and re marshall it
• 2951140 Recovered cache baby, somehow, baby tukka.
• 3f00f60 Removing time handling log
• 2a47bb9 Rename a few proto stuff
• f8586cc Rename all those freaking fields. Fix mermaid output. Make that state deltas proto buf serialized instead of json.
• a037fe2 Renames
• 6a9136f Restore println's output. Cleaner output.
• 43b99b4 Revert "Initialize the wasm modules within the Firehose thread."
• db70091 Revert "remove all panic"
• c6d7524 Revert "test commit"
• ba27538 Safeguard against WASM data leaking between blocks
• b36d168 Shared engine
• 521a8e8 Sign native code too.
• d85c2f5 Small refactor. Implement SetIfNotExists. Write as strings in storage for ints and floats. Runtime error when stores do not match imported function calls.
• a96619f Start block int64. Better print.
• 10cbc89 Try to pinpoint the odd behavior
• 5287ec4 UPdate
• 4340f80 Update README.md
• 7674fe3 Update the rust package.
• 5964ae4 Updated README.md
• 0528605 Updated loggers for graph-node and rpc packages
• ce9bbdc Updated proto
• 3c37fbb Use protoreflect for dynamic proto message handling.
• 0a7a75c Use startBlock from the manifest now.
• 013ab56 Using require isEqual with testing suite
• fe9c283 WIP
• 312c326 WIP exchange dataloader
• e40a039 WIP for bigfloat
• 63a8106 WIP transform, print
• 104e7ea WIP: have decode/print.go print with the new output format.
• 4f77f84 Wire in the cursor, step still missing for the remote transforms-based version.
• 54bff23 add a more verbose format and resetting time to now in if statement
• c7fb4cd add context to progress tracker
• db8b90b add default case to input mode and set keys to lowercase
• 11e0c44 add eth_call to rpc to wasm machine, using proto
• 54be505 add gen for substreams
• 41d63da add log for rpc call time taken
• fa6ba49 add logger module
• 570c145 add memory leak test
• 48076b9 add missing file
• 0554f76 add prost-build in build dependencies
• 2a21aff add proto generate files and build scripts
• a4eb426 add protobuf
• 2b4fb7e add remote runtime, update cli, cleanup runtime vars
• a4a0405 add set_if_not_exist as extern function
• e42dc23 add tests for graph methods from manifest file and fix some tests
• 348cc22 add time blocks pps
• b5f493e add time to process x number of blocks per second
• df7c321 add timer for rpc
• 9f00432 added a small tool to print some manifest info
• 7077a9b added graph-node definition parsing
• af02435 added initial block to module and start block is now a program argument
• bd02d03 added no-return-handler param
• ecf7264 added param rpc-cache-store-url
• 50ac81c added secondary-rpc-endpoints params
• d2a95ef added set_min support!
• 9fe1dd1 added stack traces log when recovery from panic
• d08b4a8 added stupid fmt.println
• 7f411f8 added substreams Output "wrapper" around return value
• d25dd6b added support to multi rpc endpoints
• 6e5887b added test for graph
• b53083a added unset to table_change operation
• e5608b7 adding logging for types v1 package
• 5ca3e6a adding more logs and adding statesSaveInterval
• f1cb290 adding proto url for local command
• f6f5e93 adding protobufBlockType missing in the LocalConfig constructor
• 97fbd4b adding test orphan node in the test file
• f295730 all broken wip
• 7791c31 better logging
• c6f764c better start block handling
• af01a46 builder io: walk partials func
• 6bf377d builder: compile-time check for interfaces
• 05bbd05 builder: fix call to WriteState
• 40555a6 builder: fix tests
• 1154df0 builder: fix tests
• 92d9dba builder: if partial file starts at module start block, save as full snapshot
• 25521a5 builder: implement merge logic for all types (int64, bigInt, float64, big.Float)
• 982de94 builder: max tests
• ef1eb93 builder: min tests
• 352a891 builder: partial prep work wip
• b60b87b builder: remove bundler stuff
• 96e64bd builder: remove patate log
• df30de1 builder: sum tests
• 2a44a23 builder: unify receiver names
• 84f4eac bump bstream, add ground work for substreams as transform
• a448af6 bump bstream, firehose with new transform patterns
• c77f822 bump dstore
• 515e830 bump dstore
• ae83b68 bump eth-go
• 2889dd3 bump eth-go, now uses context
• c972832 bump substreams to pick up bugfix for gas uint64 deterministic error
• 8db7cc9 change module initialStartBlock to startBlock
• 9a3f3fe check requested start block before wait loop
• dcfa9c9 cherry pick changes from substreams_transform branch and implement onReturn method
• cbc2063 clear todo
• 94c1c35 cli: add command to get ordered list of stores to run in parallel
• a5f31be cli: add stop-block flag
• af5e1f8 create a new store for each instance
• 315403d database changes test update
• 0d3fd72 database squash test cleanup
• e1e8f43 debug/info -> println
• de8c53c deps: use streamingfast fork of graph library
• 5cde373 ensure substreams transform runner catches EOF as non-error
• ce5cb6e ensure transform creates an (empty) cache to prevent nil pointer
• 9013de9 entity package copied over from sparkle
• 3132c4a extern state methods are no longer taking owner ship o...