Release v0.41.0

[xgreenx]

Version v0.41.0

Added

• 2547: Replace the old Graphql gas price provider adapter with the ArcGasPriceEstimate.
• 2445: Added GQL endpoint for querying asset details.
• 2442: Add uninitialized task for V1 gas price service
• 2154: Added Unknown variant to ConsensusParameters graphql queries
• 2154: Added Unknown variant to Block graphql queries
• 2154: Added TransactionType type in fuel-client
• 2321: New metrics for the TxPool:
  • The size of transactions in the txpool (txpool_tx_size)
  • The time spent by a transaction in the txpool in seconds (txpool_tx_time_in_txpool_seconds)
  • The number of transactions in the txpool (txpool_number_of_transactions)
  • The number of transactions pending verification before entering the txpool (txpool_number_of_transactions_pending_verification)
  • The number of executable transactions in the txpool (txpool_number_of_executable_transactions)
  • The time it took to select transactions for inclusion in a block in microseconds (txpool_select_transactions_time_microseconds)
  • The time it took to insert a transaction in the txpool in microseconds (transaction_insertion_time_in_thread_pool_microseconds)
• 2385: Added new histogram buckets for some of the TxPool metrics, optimize the way they are collected.
• 2347: Add activity concept in order to protect against infinitely increasing DA gas price scenarios
• 2362: Added a new request_response protocol version /fuel/req_res/0.0.2. In comparison with /fuel/req/0.0.1, which returns an empty response when a request cannot be fulfilled, this version returns more meaningful error codes. Nodes still support the version 0.0.1 of the protocol to guarantee backward compatibility with fuel-core nodes. Empty responses received from nodes using the old protocol /fuel/req/0.0.1 are automatically converted into an error ProtocolV1EmptyResponse with error code 0, which is also the only error code implemented. More specific error codes will be added in the future.
• 2386: Add a flag to define the maximum number of file descriptors that RocksDB can use. By default it's half of the OS limit.
• 2376: Add a way to fetch transactions in P2P without specifying a peer.
• 2361: Add caches to the sync service to not reask for data it already fetched from the network.
• 2327: Add more services tests and more checks of the pool. Also add an high level documentation for users of the pool and contributors.
• 2416: Define the GasPriceServiceV1 task.
• 2447: Use new expiration policy in the transaction pool. Add a mechanism to prune the transactions when they expired.
• 1922: Added support for posting blocks to the shared sequencer.
• 2033: Remove Option<BlockHeight> in favor of BlockHeightQuery where applicable.
• 2490: Added pagination support for the balances GraphQL query, available only when 'balances indexation' is enabled.
• 2439: Add gas costs for the two new zk opcodes ecop and eadd and the benches that allow to calibrate them.
• 2472: Added the amountU128 field to the Balance GraphQL schema, providing the total balance as a U128. The existing amount field clamps any balance exceeding U64 to u64::MAX.
• 2526: Add possibility to not have any cache set for RocksDB. Add an option to either load the RocksDB columns families on creation of the database or when the column is used.
• 2532: Getters for inner rocksdb database handles.
• 2524: Adds a new lock type which is optimized for certain workloads to the txpool and p2p services.
• 2535: Expose backup and restore APIs on the CombinedDatabase struct to create portable backups and restore from them.
• 2550: Add statistics and more limits infos about txpool on the node_info endpoint

Fixed

• 2560: Fix flaky test by increasing timeout
• 2558: Rename cost and reward to remove excess wording
• 2469: Improved the logic for syncing the gas price database with on_chain database
• 2365: Fixed the error during dry run in the case of race condition.
• 2366: The importer_gas_price_for_block metric is properly collected.
• 2369: The transaction_insertion_time_in_thread_pool_milliseconds metric is properly collected.
• 2413: block production immediately errors if unable to lock the mutex.
• 2389: Fix construction of reverse iterator in RocksDB.
• 2479: Fix an error on the last iteration of the read and write sequential opcodes on contract storage.
• 2478: Fix proof created by message_receipts_proof function by ignoring the receipts from failed transactions to match message_outbox_root.
• 2485: Hardcode the timestamp of the genesis block and version of tai64 to avoid breaking changes for us.
• 2511: Fix backward compatibility of V0Metadata in gas price db.

Changed

• 2469: Updated adapter for querying costs from DA Block committer API
• 2469: Use the gas price from the latest block to estimate future gas prices
• 2501: Use gas price from block for estimating future gas prices
• 2468: Abstract unrecorded blocks concept for V1 algorithm, create new storage impl. Introduce TransactionableStorage trait to allow atomic changes to the storage.
• 2295: CombinedDb::from_config now respects state_rewind_policy with tmp RocksDB.
• 2378: Use cached hash of the topic instead of calculating it on each publishing gossip message.
• 2438: Refactored service to use new implementation of StorageRead::read that takes an offset in input.
• 2429: Introduce custom enum for representing result of running service tasks
• 2377: Add more errors that can be returned as responses when using protocol /fuel/req_res/0.0.2. The errors supported are ProtocolV1EmptyResponse (status code 0) for converting empty responses sent via protocol /fuel/req_res/0.0.1, RequestedRangeTooLarge(status code 1) if the client requests a range of objects such as sealed block headers or transactions too large, Timeout (status code 2) if the remote peer takes too long to fulfill a request, or SyncProcessorOutOfCapacity if the remote peer is fulfilling too many requests concurrently.
• 2233: Introduce a new column modification_history_v2 for storing the modification history in the historical rocksDB. Keys in this column are stored in big endian order. Changed the behaviour of the historical rocksDB to write changes for new block heights to the new column, and to perform lookup of values from the modification_history_v2 table first, and then from the modification_history table, performing a migration upon access if necessary.
• 2383: The balance and balances GraphQL query handlers now use index to provide the response in a more performant way. As the index is not created retroactively, the client must be initialized with an empty database and synced from the genesis block to utilize it. Otherwise, the legacy way of retrieving data will be used.
• 2463: The coinsToSpend GraphQL query handler now uses index to provide the response in a more performant way. As the index is not created retroactively, the client must be initialized with an empty database and synced from the genesis block to utilize it. Otherwise, the legacy way of retrieving data will be used.
• 2556: Ensure that the last_recorded_height is set for the DA gas price source.

Breaking

• 2469: Move from GasPriceServicev0 to GasPriceServiceV1. Include new config values.
• 2438: The fuel-core-client can only work with new version of the fuel-core. The 0.40 and all older versions are not supported.
• 2438: Updated fuel-vm to 0.59.1 release. Check release notes for more details.
• 2389: Updated the messageProof GraphQL schema to return a non-nullable MessageProof.
• 2154: Transaction graphql endpoints use TransactionType instead of fuel_tx::Transaction.
• 2446: Use graphiql instead of graphql-playground due to known vulnerability and stale development.
• 2379: Change kv_store::Value to be Arc<[u8]> instead of Arc<Vec<u8>>.
• 2490: Updated GraphQL complexity calculation for balances query to account for pagination (first/last) and nested field complexity (child_complexity). Queries with large pagination values or deeply nested fields may have higher complexity costs.
• 2463: 'CoinsQueryError::MaxCoinsReachedvariant has been removed. TheInsufficientCoinsvariant has been renamed toInsufficientCoinsForTheMaxand it now contains the additionalmax` field
• 2463: The number of excluded ids in the coinsToSpend GraphQL query is now limited to the maximum number of inputs allowed in transaction.
• 2463: The coinsToSpend GraphQL query may now return different coins, depending whether the indexation is enabled or not. However, regardless of the differences, the returned coins will accurately reflect the current state of the database within the context of the query.
• 2526: By default the cache of RocksDB is now disabled instead of being 1024 * 1024 * 1024.

What's Changed

• Add metrics to TxPool by @acerone85 in Add metrics to TxPool #2321
• Fix collection of gas price metric by @rafal-ch in Fix collection of gas price metric #2366
• Add documentation to run a ignition node in readme by @AurelienFT in Add documentation to run a ignition node in readme #2363
• Fix collection of tx pool insertion time metric by @rafal-ch in Fix collection of tx pool insertion time metric #2369
• Add versioning to request response protocols by @acerone85 in Add versioning to request response protocols #2362
• Return reason of why proof cant be generated by @rafal-ch in Return reason of why proof cant be generated #2258
• p2p: use precalculated topic hash by @yaziciahmet in p2p: use precalculated topic hash #2378
• Remove ignore RUSTSEC-2024-0336 by @AurelienFT in Remove ignore RUSTSEC-2024-0336 #2384
• Deal with negative feed back loop in DA gas price by @MitchTurner in Deal with negative feed back loop in DA gas price #2364
• Add new flag for maximum file descriptors in rocksdb. by @AurelienFT in Add new flag for maximum file descriptors in rocksdb. #2386
• Add codeowners for gas price algorithm crate by @rafal-ch in Add codeowners for gas price algorithm crate #2404
• Weekly cargo update by @github-actions in Weekly cargo update #2373
• chore(gas_price_service): initialize v1 metadata by @rymnc in chore(gas_price_service): initialize v1 metadata #2288
• chore(gas_price_service_v0): remove unused trait impl by @rymnc in chore(gas_price_service_v0): remove unused trait impl #2410
• Update tai64 to fix the wrong time offset by @AurelienFT in Update tai64 to fix the wrong time offset #2409
• fix(block_producer): immediately return error if lock cannot be acquired during production by @rymnc in fix(block_producer): immediately return error if lock cannot be acquired during production #2413
• Add a way to fetch transactions in P2P without specifying a peer by @AurelienFT in Add a way to fetch transactions in P2P without specifying a peer  #2376
• Add a new code owner for tx pool by @AurelienFT in Add a new code owner for tx pool #2417
• Satisfy clippy in gas-price-analysis by @rafal-ch in Satisfy clippy in gas-price-analysis #2418
• Txpool metrics update by @rafal-ch in Txpool metrics update #2385
• Improve TxPool tests and documentation by @AurelienFT in Improve TxPool tests and documentation #2327
• feat(gas_price_service_v1): define RunnableTask for GasPriceServiceV1 by @rymnc in feat(gas_price_service_v1): define RunnableTask for GasPriceServiceV1 #2416
• Return reason of why proof cant be generated (api change) by @rafal-ch in Return reason of why proof cant be generated (api change) #2389
• Fuel/Request_Response v0.0.2: More meaningful error messages by @acerone85 in Fuel/Request_Response v0.0.2: More meaningful error messages #2377
• Fix reverse iterator in RocksDB by @AurelienFT in Fix reverse iterator in RocksDB #2398
• Add test node herself in reserved nodes. by @AurelienFT in Add test node herself in reserved nodes. #2390
• Weekly cargo update by @github-actions in Weekly cargo update #2424
• Weekly cargo update by @github-actions in Weekly cargo update #2440
• Resolve some falky tests and improve CI times by @AurelienFT in Resolve some falky tests and improve CI times #2401
• feat: handle Unknown transactions, blocks and consensus parameters by @hal3e in feat: handle Unknown transactions, blocks and consensus parameters #2154
• fix(p2p): cache responses to serve without roundtrip to db by @rymnc in fix(p2p): cache responses to serve without roundtrip to db #2352
• Replace task run() return result with custom enum by @MitchTurner in Replace task run() return result with custom enum #2429
• Fix codeowners by @AurelienFT in Fix codeowners #2444
• fix(graphql_playground): use graphiql instead by @rymnc in fix(graphql_playground): use graphiql instead #2446
• Weekly cargo update by @github-actions in Weekly cargo update #2453
• refactor: remove Option<BlockHeight> and use new enum where applicable by @matt-user in refactor: remove Option<BlockHeight> and use new enum where applicable #2033
• Fixed the error during dry run by @xgreenx in Fixed the error during dry run #2365
• Add decompression traits and a test case by @Dentosal in Add decompression traits and a test case #2295
• Versioned Storage for Modifications History by @acerone85 in Versioned Storage for Modifications History #2233
• Allow DA recorded blocks to come out-of-order by @MitchTurner in Allow DA recorded blocks to come out-of-order #2415
• feat: Change kv_store::Value to be Arc<[u8]> instead of Arc<Vec> by @netrome in feat: Change kv_store::Value to be Arc<[u8]> instead of Arc<Vec<u8>> #2411
• Optimize balance-related queries with a cache by @rafal-ch in Optimize balance-related queries with a cache #2383
• fix: Add missing features to fuel-core-tests by @netrome in fix: Add missing features to fuel-core-tests #2467
• Keep data in fails cases in sync service by @AurelienFT in Keep data in fails cases in sync service #2361
• Weekly cargo update by @github-actions in Weekly cargo update #2470
• Revert balances amount to U64 and introduce new amountU128 getter by @rafal-ch in Revert balances amount to U64 and introduce new amountU128 getter #2472
• Create uninitialized task for v1 gas price service by @MitchTurner in Create uninitialized task for v1 gas price service #2442
• Port the 0.40.2 fix of TAI on master by @AurelienFT in Port the 0.40.2 fix of TAI on master #2485
• Ignore RUSTSEC-2024-0421 by @AurelienFT in Ignore RUSTSEC-2024-0421 #2489
• Ignore receipts from failed transactions in message_receipts_proof by @AurelienFT in Ignore receipts from failed transactions in message_receipts_proof #2478
• Add unrecorded blocks abstraction to gas price algo by @MitchTurner in Add unrecorded blocks abstraction to gas price algo #2468
• Fix last iteration in sequential opcode by @AurelienFT in Fix last iteration in sequential opcode #2479
• fix(gas_price_service_v0): bring back removed fields, causing UB when trying to access by @rymnc in fix(gas_price_service_v0): bring back removed fields, causing UB when trying to access #2511
• Refactor fuel-core to use version of StorageRead::read with offset (Full update to 0.59.1) by @acerone85 in Refactor fuel-core to use version of StorageRead::read with offset (Full update to 0.59.1) #2438
• Sync the version of the fuel-core with minor hot fixes by @xgreenx in Sync the version of the fuel-core with minor hot fixes #2516
• fix(docs): typo preventing ci checks from passing by @rymnc in fix(docs): typo preventing ci checks from passing #2525
• Integration test for balances and (non)retryable messages by @rafal-ch in Integration test for balances and (non)retryable messages #2505
• Add document for launching Ignition node from source and Local network from source by @AurelienFT in Add document for launching Ignition node from source and Local network from source #2502
• Make the rocksdb cache optional in config and add policy for column opening by @AurelienFT in Make the rocksdb cache optional in config and add policy for column opening  #2526
• Weekly cargo update by @github-actions in Weekly cargo update #2530
• chore(rocksdb): getter for inner database handle by @rymnc in chore(rocksdb): getter for inner database handle #2532
• Use gas prices from actual blocks to calculate estimate gas prices by @MitchTurner in Use gas prices from actual blocks to calculate estimate gas prices #2501
• chore(codeowners): gas price service codeowners by @rymnc in chore(codeowners): gas price service codeowners #2534
• Add zk opcodes by @AurelienFT in Add zk opcodes #2439
• Gas price simulation data retriever by @acerone85 in Gas price simulation data retriever #2533
• Shared sequencer integration by @Dentosal in Shared sequencer integration #1922
• Use expiration policy by @AurelienFT in Use expiration policy #2447
• Fixed TPS benchmark to work with latest changes by @xgreenx in Fixed TPS benchmark to work with latest changes #2515
• Use indexation cache to satisfy "coins to spend" queries by @rafal-ch in Use indexation cache to satisfy "coins to spend" queries #2463
• feat(txpool|p2p): use seqlock instead of small copy-able RwLocks by @rymnc in feat(txpool|p2p): use seqlock instead of small copy-able RwLocks #2524
• Create new index for tracking Asset metadata by @maschad in Create new index for tracking Asset metadata #2445
• feat(rocksdb): remove getters for internal rocksdb handles, expose backup instead by @rymnc in feat(rocksdb): remove getters for internal rocksdb handles, expose backup instead #2535
• Integrate with V1 algo for tests by @MitchTurner in Integrate with V1 algo for tests #2469
• Lock-free latest_l2_height in gas price service by @rafal-ch in Lock-free latest_l2_height in gas price service #2546
• chore(gas_price_service_v1): strictly ensure last_recorded_height is set, to avoid initial poll of da source by @rymnc in chore(gas_price_service_v1): strictly ensure last_recorded_height is set, to avoid initial poll of da source #2556
• Replace old Graphql Gas Price adapter with new latest gas price struct by @MitchTurner in Replace old Graphql Gas Price adapter with new latest gas price struct #2547
• Rename cost and rewards without 'excess' by @MitchTurner in Rename cost and rewards without 'excess' #2558
• Add current pool gas to the node info endpoint by @AurelienFT in Add current pool gas to the node info endpoint #2550
• Pagination queries for balances endpoint by @rafal-ch in Pagination queries for balances endpoint #2490
• 2559 Increase timeout for test by @MitchTurner in 2559 Increase timeout for test #2560
• Add test expiration policy in executor by @AurelienFT in Add test expiration policy in executor #2563

New Contributors

• @yaziciahmet made their first contribution in p2p: use precalculated topic hash #2378

Full Changelog: v0.40.0...v0.41.0

[MitchTurner]

Lfg